[2025-10-25T18:23:02.330136] [INFO ] [MAIN ] Using last completed trading day: 2025-10-24 [2025-10-25T18:23:02.330410] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-25T18:23:02.330489] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-25T18:23:02.330575] [DEBUG] [LOCAL ] IBM: No primary data file found to delete. [2025-10-25T18:23:02.330667] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-25T18:23:02.716152] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:23:02.716522] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-25T18:23:09.932547] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (7.22 seconds). [2025-10-25T18:23:09.942837] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-25T18:23:12.340579] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-25T18:23:12.350666] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-25T18:23:14.703171] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-25T18:23:14.714100] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-25T18:23:15.707594] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T18:23:15.718795] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-25T18:23:16.873858] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T18:23:16.885813] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-25T18:23:17.962082] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T18:23:17.973541] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-25T18:23:19.042332] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T18:23:19.054599] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-25T18:23:20.087030] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T18:23:20.099576] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-25T18:23:20.943954] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T18:23:20.956828] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-25T18:23:21.939000] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T18:23:21.949777] [INFO ] [REMOTE ] IBM: Full fetch complete (77743 records). [2025-10-25T18:23:21.949995] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-25T18:23:22.354464] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-25T18:23:22.354622] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-25T18:23:22.355412] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-25T18:23:22.355504] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-25T18:23:22.357745] [DEBUG] [LOCAL ] IBM: Trimmed 77743 records to 54408 (keeping 200 days of data) [2025-10-25T18:23:22.695913] [DEBUG] [LOCAL ] IBM: Primary data saved (54408 records). [2025-10-25T18:23:22.696149] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-25T18:24:29.070450] [INFO ] [MAIN ] Using last completed trading day: 2025-10-24 [2025-10-25T18:24:29.244513] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:24:29.304159] [DEBUG] [LOCAL ] IBM: Loaded 54408 existing records from primary storage. [2025-10-25T18:24:29.304562] [INFO ] [MAIN ] IBM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:24:46.636728] [INFO ] [MAIN ] Using last completed trading day: 2025-10-24 [2025-10-25T18:24:46.832952] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-25T18:24:46.833136] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-25T18:24:46.902979] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-25T18:24:46.903303] [WARN ] [STATE ] State set to: RUNNING [2025-10-25T18:24:46.903395] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-25T18:24:46.903480] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-25T18:24:46.903693] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-25T18:24:46.903772] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-25T18:24:48.115957] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-25T18:24:48.116165] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-25T18:24:48.116406] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-25T18:24:48.116979] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-25T18:24:48.117055] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-25T18:24:48.117127] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-25T18:24:48.117262] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-25T18:24:48.117336] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-25T18:24:48.117453] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-25T18:24:48.117901] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-25T18:24:48.117989] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-25T18:24:48.118204] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-25T18:24:48.118295] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-25T18:24:48.118384] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-25T18:24:48.118476] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-25T18:24:48.118661] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-25T18:24:48.118828] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-25T18:24:48.118917] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-25T18:24:48.119003] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-25T18:24:48.119088] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-25T18:24:48.119203] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-25T18:24:48.119664] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-25T18:24:48.119751] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-25T18:24:48.119838] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-25T18:24:48.119921] [INFO ] [MAIN ] Running in single-threaded mode [2025-10-25T18:24:48.298533] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:24:48.298749] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-25T18:24:48.298823] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-25T18:24:48.298950] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-25T18:24:48.299023] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-25T18:24:48.299107] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-25T18:24:48.299179] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-25T18:24:48.662609] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:24:48.662994] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-25T18:24:49.618287] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-25T18:24:49.628761] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-25T18:24:50.584401] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T18:24:50.594024] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-25T18:24:51.673386] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-25T18:24:51.684987] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-25T18:24:52.558772] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T18:24:52.571002] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-25T18:24:53.421858] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T18:24:53.432564] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-25T18:24:54.314054] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T18:24:54.323997] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-25T18:24:54.802386] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-25T18:24:54.814509] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-25T18:24:56.007713] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-25T18:24:56.019496] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-25T18:24:56.907775] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-25T18:24:56.919579] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-25T18:24:57.729930] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T18:24:57.740594] [INFO ] [REMOTE ] A: Full fetch complete (73539 records). [2025-10-25T18:24:57.740812] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-25T18:24:58.145006] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-25T18:24:58.145138] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-25T18:24:58.146034] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-25T18:24:58.146126] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-25T18:24:58.149424] [DEBUG] [LOCAL ] A: Trimmed 73539 records to 51315 (keeping 200 days of data) [2025-10-25T18:24:58.468268] [DEBUG] [LOCAL ] A: Primary data saved (51315 records). [2025-10-25T18:24:58.468455] [INFO ] [MAIN ] A: Full history saved. [2025-10-25T18:24:58.468945] [INFO ] [MAIN ] Update Progress: 1/2366 symbols. A took 10.3s. Estimated remaining time: 6h 47m 55s [2025-10-25T18:24:58.644238] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:24:58.644453] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-25T18:24:58.644526] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-25T18:24:58.644665] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-25T18:24:58.644742] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-25T18:24:58.644826] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-25T18:24:58.644898] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-25T18:24:59.015872] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:24:59.016227] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-25T18:24:59.963500] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T18:24:59.974127] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-25T18:25:01.319622] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T18:25:01.329415] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-25T18:25:02.939966] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T18:25:02.953717] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-25T18:25:04.054237] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T18:25:04.069081] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-25T18:25:05.192572] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T18:25:05.203845] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-25T18:25:06.043561] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T18:25:06.054534] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-25T18:25:07.201405] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T18:25:07.216231] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-25T18:25:08.169416] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T18:25:08.180920] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-25T18:25:09.195045] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T18:25:09.206588] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-25T18:25:10.232869] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T18:25:10.242806] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-25T18:25:10.243001] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-25T18:25:10.642265] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-25T18:25:10.642386] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-25T18:25:10.643142] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-25T18:25:10.643225] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-25T18:25:10.644732] [DEBUG] [LOCAL ] AA: Trimmed 77733 records to 54402 (keeping 200 days of data) [2025-10-25T18:25:10.958862] [DEBUG] [LOCAL ] AA: Primary data saved (54402 records). [2025-10-25T18:25:10.959026] [INFO ] [MAIN ] AA: Full history saved. [2025-10-25T18:25:10.959133] [INFO ] [MAIN ] Update Progress: 2/2366 symbols. AA took 12.5s. Estimated remaining time: 7h 29m 56s [2025-10-25T18:25:11.130776] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:25:11.130985] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-25T18:25:11.131056] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-25T18:25:11.131169] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-25T18:25:11.131239] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-25T18:25:11.131318] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-25T18:25:11.131387] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-25T18:25:11.508498] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:25:11.508893] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-25T18:25:11.927399] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-25T18:25:11.928343] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-25T18:25:12.441850] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-25T18:25:12.442818] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-25T18:25:12.917691] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-25T18:25:12.918685] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-25T18:25:13.346600] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-25T18:25:13.347705] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-25T18:25:13.711724] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-25T18:25:13.712581] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-25T18:25:14.111630] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-25T18:25:14.112504] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-25T18:25:14.619546] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-25T18:25:14.620550] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-25T18:25:15.155893] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-25T18:25:15.157007] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-25T18:25:15.595479] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-25T18:25:15.596384] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-25T18:25:15.978200] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-25T18:25:15.979202] [INFO ] [REMOTE ] AAM: Full fetch complete (914 records). [2025-10-25T18:25:15.979314] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-25T18:25:16.164801] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-25T18:25:16.164980] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-25T18:25:16.165052] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-25T18:25:16.165125] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-25T18:25:16.165215] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-25T18:25:16.165268] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-25T18:25:16.165318] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-25T18:25:16.165402] [INFO ] [MAIN ] Update Progress: 3/2366 symbols. AAM took 5.2s. Estimated remaining time: 6h 8m 10s [2025-10-25T18:25:16.339291] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:25:16.339509] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-25T18:25:16.339583] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-25T18:25:16.339728] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-25T18:25:16.339803] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-25T18:25:16.339886] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-25T18:25:16.339957] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-25T18:25:16.701442] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:25:16.701828] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-25T18:25:17.931490] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-25T18:25:17.935393] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-25T18:25:18.984511] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T18:25:18.988468] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-25T18:25:20.206982] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-25T18:25:20.212034] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-25T18:25:21.724383] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T18:25:21.733812] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-25T18:25:22.703408] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T18:25:22.708814] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-25T18:25:23.988391] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T18:25:23.994037] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-25T18:25:25.320010] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T18:25:25.325872] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-25T18:25:26.622217] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T18:25:26.627405] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-25T18:25:27.931758] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T18:25:27.937901] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-25T18:25:28.773432] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T18:25:28.777763] [INFO ] [REMOTE ] AAMI: Full fetch complete (33081 records). [2025-10-25T18:25:28.777895] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-25T18:25:29.150638] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-25T18:25:29.150767] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-25T18:25:29.151155] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-25T18:25:29.151234] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-25T18:25:29.152056] [DEBUG] [LOCAL ] AAMI: Trimmed 33081 records to 24637 (keeping 200 days of data) [2025-10-25T18:25:29.291462] [DEBUG] [LOCAL ] AAMI: Primary data saved (24637 records). [2025-10-25T18:25:29.291608] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-25T18:25:29.291729] [INFO ] [MAIN ] Update Progress: 4/2366 symbols. AAMI took 13.1s. Estimated remaining time: 6h 45m 12s [2025-10-25T18:25:29.465597] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:25:29.465965] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-10-25T18:25:29.466047] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-10-25T18:25:29.466139] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-25T18:25:29.466214] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-25T18:25:29.466280] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-25T18:25:29.466341] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-25T18:25:29.824190] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:25:29.824560] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-25T18:25:30.847379] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T18:25:30.857613] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-25T18:25:31.916873] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T18:25:31.926471] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-25T18:25:32.991469] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T18:25:33.002237] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-25T18:25:33.977810] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T18:25:33.988887] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-25T18:25:34.887922] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T18:25:34.899089] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-25T18:25:35.766099] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T18:25:35.776917] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-25T18:25:36.799212] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T18:25:36.810467] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-25T18:25:37.898496] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T18:25:37.909537] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-25T18:25:39.097114] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T18:25:39.108010] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-25T18:25:39.988436] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T18:25:39.998168] [INFO ] [REMOTE ] AAP: Full fetch complete (75046 records). [2025-10-25T18:25:39.998394] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-25T18:25:40.418994] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-25T18:25:40.419105] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-25T18:25:40.419871] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-25T18:25:40.419960] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-25T18:25:40.421457] [DEBUG] [LOCAL ] AAP: Trimmed 75046 records to 52419 (keeping 200 days of data) [2025-10-25T18:25:40.726171] [DEBUG] [LOCAL ] AAP: Primary data saved (52419 records). [2025-10-25T18:25:40.726353] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-25T18:25:40.726465] [INFO ] [MAIN ] Update Progress: 5/2366 symbols. AAP took 11.4s. Estimated remaining time: 6h 54m 1s [2025-10-25T18:25:40.907267] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:25:40.907455] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-25T18:25:40.907525] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-25T18:25:40.907662] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-25T18:25:40.907742] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-25T18:25:40.907842] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-25T18:25:40.907912] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-25T18:25:41.295139] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:25:41.296577] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-25T18:25:42.562891] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T18:25:42.568448] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-25T18:25:43.909448] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T18:25:43.915449] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-25T18:25:45.388299] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T18:25:45.395113] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-25T18:25:46.950332] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T18:25:46.958008] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-25T18:25:48.350809] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T18:25:48.357337] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-25T18:25:49.514866] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T18:25:49.521441] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-25T18:25:51.001092] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T18:25:51.008416] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-25T18:25:52.564370] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T18:25:52.571108] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-25T18:25:53.944454] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T18:25:53.950857] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-25T18:25:55.086781] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T18:25:55.092949] [INFO ] [REMOTE ] AAT: Full fetch complete (43050 records). [2025-10-25T18:25:55.093160] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-25T18:25:55.479685] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-25T18:25:55.479808] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-25T18:25:55.480276] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-25T18:25:55.480356] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-25T18:25:55.481442] [DEBUG] [LOCAL ] AAT: Trimmed 43050 records to 30590 (keeping 200 days of data) [2025-10-25T18:25:55.652975] [DEBUG] [LOCAL ] AAT: Primary data saved (30590 records). [2025-10-25T18:25:55.653137] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-25T18:25:55.653242] [INFO ] [MAIN ] Update Progress: 6/2366 symbols. AAT took 14.9s. Estimated remaining time: 7h 22m 43s [2025-10-25T18:25:55.820825] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:25:55.821035] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-25T18:25:55.821106] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-25T18:25:55.821218] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-25T18:25:55.821289] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-25T18:25:55.821369] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-25T18:25:55.821438] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-25T18:25:56.178529] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:25:56.178925] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-25T18:25:56.452610] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:25:56.453074] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-25T18:25:56.453185] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:25:56.453288] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-25T18:25:56.453376] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:25:56.453472] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-25T18:25:56.453593] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-25T18:25:56.453723] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-25T18:25:56.453825] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-25T18:25:56.454128] [INFO ] [MAIN ] Update Progress: 7/2366 symbols. AAUC took 0.8s. Estimated remaining time: 6h 23m 48s [2025-10-25T18:25:56.651668] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:25:56.651903] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-25T18:25:56.651977] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-25T18:25:56.652104] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-25T18:25:56.652177] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-25T18:25:56.652259] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-25T18:25:56.652327] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-25T18:25:57.008002] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:25:57.008372] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-25T18:25:58.730561] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T18:25:58.741208] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-25T18:26:00.505831] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T18:26:00.514460] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-25T18:26:02.263797] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T18:26:02.273158] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-25T18:26:03.857888] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T18:26:03.866117] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-25T18:26:05.255194] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T18:26:05.263246] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-25T18:26:06.435428] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T18:26:06.440189] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-25T18:26:07.821699] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T18:26:07.827406] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-25T18:26:08.951072] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T18:26:08.958572] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-25T18:26:10.208436] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T18:26:10.214103] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-25T18:26:11.375043] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T18:26:11.379402] [INFO ] [REMOTE ] AB: Full fetch complete (43828 records). [2025-10-25T18:26:11.379521] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-25T18:26:11.753674] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-25T18:26:11.753783] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-25T18:26:11.754250] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-25T18:26:11.754331] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-25T18:26:11.755330] [DEBUG] [LOCAL ] AB: Trimmed 43828 records to 24911 (keeping 200 days of data) [2025-10-25T18:26:11.897390] [DEBUG] [LOCAL ] AB: Primary data saved (24911 records). [2025-10-25T18:26:11.897566] [INFO ] [MAIN ] AB: Full history saved. [2025-10-25T18:26:11.897727] [INFO ] [MAIN ] Update Progress: 8/2366 symbols. AB took 15.4s. Estimated remaining time: 6h 51m 33s [2025-10-25T18:26:12.070323] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:26:12.070530] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-25T18:26:12.070601] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-25T18:26:12.070746] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-25T18:26:12.070820] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-25T18:26:12.070902] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-25T18:26:12.070968] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-25T18:26:12.428036] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:26:12.428364] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-25T18:26:14.474433] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-25T18:26:14.484949] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-25T18:26:16.703077] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-25T18:26:16.713247] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-25T18:26:18.811952] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T18:26:18.823177] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-25T18:26:20.984710] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-25T18:26:20.996000] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-25T18:26:23.346346] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-25T18:26:23.357590] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-25T18:26:25.299103] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-25T18:26:25.309876] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-25T18:26:27.587441] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-25T18:26:27.599047] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-25T18:26:29.972222] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-25T18:26:29.983290] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-25T18:26:32.094233] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-25T18:26:32.105523] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-25T18:26:34.056324] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-25T18:26:34.066196] [INFO ] [REMOTE ] ABBV: Full fetch complete (77843 records). [2025-10-25T18:26:34.066371] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-25T18:26:34.469577] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-25T18:26:34.469718] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-25T18:26:34.470420] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-25T18:26:34.470501] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-25T18:26:34.471985] [DEBUG] [LOCAL ] ABBV: Trimmed 77843 records to 54458 (keeping 200 days of data) [2025-10-25T18:26:34.805800] [DEBUG] [LOCAL ] ABBV: Primary data saved (54458 records). [2025-10-25T18:26:34.805996] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-25T18:26:34.806116] [INFO ] [MAIN ] Update Progress: 9/2366 symbols. ABBV took 22.9s. Estimated remaining time: 7h 45m 40s [2025-10-25T18:26:34.980274] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:26:34.980457] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-25T18:26:34.980532] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-25T18:26:34.980677] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-25T18:26:34.980752] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-25T18:26:34.980834] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-25T18:26:34.980911] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-25T18:26:35.342575] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:26:35.343366] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-25T18:26:36.250945] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T18:26:36.257459] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-25T18:26:37.160419] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T18:26:37.167305] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-25T18:26:38.107961] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T18:26:38.115265] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-25T18:26:39.000854] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T18:26:39.008941] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-25T18:26:39.864394] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T18:26:39.874387] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-25T18:26:40.496479] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T18:26:40.505222] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-25T18:26:41.408412] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T18:26:41.416011] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-25T18:26:42.275506] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T18:26:42.282874] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-25T18:26:42.724254] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-25T18:26:42.731561] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-25T18:26:43.298354] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T18:26:43.304672] [INFO ] [REMOTE ] ABCB: Full fetch complete (44872 records). [2025-10-25T18:26:43.304888] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-25T18:26:43.690911] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-25T18:26:43.691034] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-25T18:26:43.691503] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-25T18:26:43.691580] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-25T18:26:43.692574] [DEBUG] [LOCAL ] ABCB: Trimmed 44872 records to 30712 (keeping 200 days of data) [2025-10-25T18:26:43.869689] [DEBUG] [LOCAL ] ABCB: Primary data saved (30712 records). [2025-10-25T18:26:43.869851] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-25T18:26:43.869960] [INFO ] [MAIN ] Update Progress: 10/2366 symbols. ABCB took 9.1s. Estimated remaining time: 7h 34m 30s [2025-10-25T18:26:44.043415] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:26:44.043611] [DEBUG] [LOCAL ] ABEV: No existing data file found in primary storage. [2025-10-25T18:26:44.043703] [WARN ] [MAIN ] ABEV: No existing data found, performing full refresh instead. [2025-10-25T18:26:44.043818] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-25T18:26:44.043901] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-25T18:26:44.043986] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-25T18:26:44.044036] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-25T18:26:44.397239] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:26:44.397605] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-25T18:26:46.474161] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-25T18:26:46.485010] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-25T18:26:48.173234] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T18:26:48.184115] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-25T18:26:50.020567] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-25T18:26:50.031473] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-25T18:26:51.116245] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T18:26:51.127288] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-25T18:26:52.088340] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T18:26:52.099683] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-25T18:26:53.034787] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T18:26:53.046050] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-25T18:26:53.997279] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T18:26:54.011167] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-25T18:26:54.977381] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T18:26:54.989335] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-25T18:26:56.078364] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T18:26:56.089477] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-25T18:26:56.927107] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T18:26:56.936930] [INFO ] [REMOTE ] ABEV: Full fetch complete (77334 records). [2025-10-25T18:26:56.937098] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-25T18:26:57.336052] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-25T18:26:57.336170] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-25T18:26:57.336900] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-25T18:26:57.336981] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-25T18:26:57.338571] [DEBUG] [LOCAL ] ABEV: Trimmed 77334 records to 54059 (keeping 200 days of data) [2025-10-25T18:26:57.632955] [DEBUG] [LOCAL ] ABEV: Primary data saved (54059 records). [2025-10-25T18:26:57.633110] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-25T18:26:57.633212] [INFO ] [MAIN ] Update Progress: 11/2366 symbols. ABEV took 13.8s. Estimated remaining time: 7h 42m 7s [2025-10-25T18:26:57.803398] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:26:57.803589] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-25T18:26:57.803677] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-25T18:26:57.803787] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-25T18:26:57.803858] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-25T18:26:57.803936] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-25T18:26:57.803982] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-25T18:26:58.169005] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:26:58.169396] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-25T18:26:58.949224] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T18:26:58.953351] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-25T18:26:59.871959] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-25T18:26:59.876045] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-25T18:27:00.710982] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-25T18:27:00.716061] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-25T18:27:02.306207] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T18:27:02.313221] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-25T18:27:03.154436] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T18:27:03.158353] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-25T18:27:03.980740] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T18:27:03.985984] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-25T18:27:04.844538] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T18:27:04.849757] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-25T18:27:05.653042] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T18:27:05.657961] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-25T18:27:06.433192] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T18:27:06.437400] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-25T18:27:07.037046] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T18:27:07.040521] [INFO ] [REMOTE ] ABG: Full fetch complete (26708 records). [2025-10-25T18:27:07.040708] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-25T18:27:07.412024] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-25T18:27:07.412155] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-25T18:27:07.412482] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-25T18:27:07.412559] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-25T18:27:07.413331] [DEBUG] [LOCAL ] ABG: Trimmed 26708 records to 18043 (keeping 200 days of data) [2025-10-25T18:27:07.516000] [DEBUG] [LOCAL ] ABG: Primary data saved (18043 records). [2025-10-25T18:27:07.516177] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-25T18:27:07.516287] [INFO ] [MAIN ] Update Progress: 12/2366 symbols. ABG took 9.9s. Estimated remaining time: 7h 35m 45s [2025-10-25T18:27:07.688666] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:27:07.688890] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-25T18:27:07.688963] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-25T18:27:07.689099] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-25T18:27:07.689178] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-25T18:27:07.689279] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-25T18:27:07.689365] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-25T18:27:08.053336] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:27:08.053702] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-25T18:27:09.005423] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T18:27:09.011335] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-25T18:27:09.959976] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T18:27:09.965066] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-25T18:27:10.806865] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-25T18:27:10.813945] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-25T18:27:11.743543] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T18:27:11.751101] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-25T18:27:12.676368] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T18:27:12.682056] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-25T18:27:13.594441] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T18:27:13.601978] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-25T18:27:14.468714] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T18:27:14.476053] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-25T18:27:15.430242] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T18:27:15.437280] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-25T18:27:16.412425] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T18:27:16.420382] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-25T18:27:17.304884] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T18:27:17.310862] [INFO ] [REMOTE ] ABM: Full fetch complete (45097 records). [2025-10-25T18:27:17.310971] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-25T18:27:17.691430] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-25T18:27:17.691539] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-25T18:27:17.692053] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-25T18:27:17.692133] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-25T18:27:17.693178] [DEBUG] [LOCAL ] ABM: Trimmed 45097 records to 32551 (keeping 200 days of data) [2025-10-25T18:27:17.882514] [DEBUG] [LOCAL ] ABM: Primary data saved (32551 records). [2025-10-25T18:27:17.882703] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-25T18:27:17.882819] [INFO ] [MAIN ] Update Progress: 13/2366 symbols. ABM took 10.4s. Estimated remaining time: 7h 31m 47s [2025-10-25T18:27:18.052223] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:27:18.052389] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-10-25T18:27:18.052438] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-10-25T18:27:18.052522] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-25T18:27:18.052606] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-25T18:27:18.052697] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-25T18:27:18.052775] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-25T18:27:18.416882] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:27:18.417273] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-25T18:27:19.333892] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-25T18:27:19.344026] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-25T18:27:20.357524] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T18:27:20.367074] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-25T18:27:21.311476] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T18:27:21.322397] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-25T18:27:22.360017] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T18:27:22.371850] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-25T18:27:23.458836] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T18:27:23.470148] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-25T18:27:24.455548] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T18:27:24.466433] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-25T18:27:25.565380] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T18:27:25.577627] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-25T18:27:26.531091] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T18:27:26.548348] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-25T18:27:27.599969] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T18:27:27.611179] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-25T18:27:28.156094] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T18:27:28.165272] [INFO ] [REMOTE ] ABR: Full fetch complete (75363 records). [2025-10-25T18:27:28.165418] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-25T18:27:28.555527] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-25T18:27:28.555667] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-25T18:27:28.556391] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-25T18:27:28.556473] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-25T18:27:28.557978] [DEBUG] [LOCAL ] ABR: Trimmed 75363 records to 52600 (keeping 200 days of data) [2025-10-25T18:27:28.858530] [DEBUG] [LOCAL ] ABR: Primary data saved (52600 records). [2025-10-25T18:27:28.858751] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-25T18:27:28.858872] [INFO ] [MAIN ] Update Progress: 14/2366 symbols. ABR took 11.0s. Estimated remaining time: 7h 30m 4s [2025-10-25T18:27:29.027948] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:27:29.028147] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-25T18:27:29.028252] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-25T18:27:29.028397] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-25T18:27:29.028484] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-25T18:27:29.028572] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-25T18:27:29.028690] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-25T18:27:29.390805] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:27:29.391189] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-25T18:27:30.299160] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T18:27:30.309543] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-25T18:27:31.280414] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-25T18:27:31.290563] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-25T18:27:32.320678] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T18:27:32.339985] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-25T18:27:33.474967] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T18:27:33.486271] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-25T18:27:34.510067] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:27:34.521307] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-25T18:27:35.465256] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T18:27:35.476019] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-25T18:27:36.544976] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T18:27:36.557509] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-25T18:27:37.530918] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T18:27:37.543988] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-25T18:27:38.534458] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T18:27:38.546626] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-25T18:27:39.503579] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:27:39.513464] [INFO ] [REMOTE ] ABT: Full fetch complete (77772 records). [2025-10-25T18:27:39.513676] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-25T18:27:39.918511] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-25T18:27:39.918722] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-25T18:27:39.919715] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-25T18:27:39.919807] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-25T18:27:39.922034] [DEBUG] [LOCAL ] ABT: Trimmed 77772 records to 54404 (keeping 200 days of data) [2025-10-25T18:27:40.279217] [DEBUG] [LOCAL ] ABT: Primary data saved (54404 records). [2025-10-25T18:27:40.279406] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-25T18:27:40.279516] [INFO ] [MAIN ] Update Progress: 15/2366 symbols. ABT took 11.4s. Estimated remaining time: 7h 29m 43s [2025-10-25T18:27:40.447767] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:27:40.448371] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-25T18:27:40.448512] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-25T18:27:40.448762] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-25T18:27:40.448844] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-25T18:27:40.448930] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-25T18:27:40.449016] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-25T18:27:40.821227] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:27:40.821736] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-25T18:27:42.112889] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-25T18:27:42.118279] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-25T18:27:43.372218] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T18:27:43.377380] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-25T18:27:44.746145] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T18:27:44.752940] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-25T18:27:46.033108] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T18:27:46.039694] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-25T18:27:47.215916] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T18:27:47.225050] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-25T18:27:48.122453] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T18:27:48.127744] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-25T18:27:49.330268] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T18:27:49.335928] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-25T18:27:50.566397] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T18:27:50.572159] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-25T18:27:51.777981] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T18:27:51.782803] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-25T18:27:52.880199] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T18:27:52.884239] [INFO ] [REMOTE ] ACA: Full fetch complete (34219 records). [2025-10-25T18:27:52.884353] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-25T18:27:53.298065] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-25T18:27:53.298218] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-25T18:27:53.298813] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-25T18:27:53.298902] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-25T18:27:53.299989] [DEBUG] [LOCAL ] ACA: Trimmed 34219 records to 22746 (keeping 200 days of data) [2025-10-25T18:27:53.441447] [DEBUG] [LOCAL ] ACA: Primary data saved (22746 records). [2025-10-25T18:27:53.441677] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-25T18:27:53.441816] [INFO ] [MAIN ] Update Progress: 16/2366 symbols. ACA took 13.2s. Estimated remaining time: 7h 33m 39s [2025-10-25T18:27:53.618409] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:27:53.618703] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-25T18:27:53.618778] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-25T18:27:53.618876] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-25T18:27:53.618947] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-25T18:27:53.619029] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-25T18:27:53.619100] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-25T18:27:53.978115] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:27:53.978531] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-25T18:27:54.774295] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T18:27:54.782516] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-25T18:27:55.648873] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-25T18:27:55.656357] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-25T18:27:56.571299] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-25T18:27:56.580408] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-25T18:27:57.454583] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T18:27:57.463782] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-25T18:27:58.113264] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-25T18:27:58.122677] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-25T18:27:58.919552] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T18:27:58.928326] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-25T18:27:59.831167] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T18:27:59.840507] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-25T18:28:01.048588] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T18:28:01.057280] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-25T18:28:02.031247] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T18:28:02.042022] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-25T18:28:02.999424] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:28:03.006243] [INFO ] [REMOTE ] ACCO: Full fetch complete (53906 records). [2025-10-25T18:28:03.006464] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-25T18:28:03.411185] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-25T18:28:03.411299] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-25T18:28:03.411880] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-25T18:28:03.411983] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-25T18:28:03.413141] [DEBUG] [LOCAL ] ACCO: Trimmed 53906 records to 37089 (keeping 200 days of data) [2025-10-25T18:28:03.620856] [DEBUG] [LOCAL ] ACCO: Primary data saved (37089 records). [2025-10-25T18:28:03.621018] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-25T18:28:03.621125] [INFO ] [MAIN ] Update Progress: 17/2366 symbols. ACCO took 10.2s. Estimated remaining time: 7h 30m 13s [2025-10-25T18:28:03.794323] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:28:03.794512] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-25T18:28:03.794572] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-25T18:28:03.794708] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-25T18:28:03.794783] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-25T18:28:03.794843] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-25T18:28:03.794907] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-25T18:28:04.152380] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:28:04.152774] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-25T18:28:05.388709] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T18:28:05.393580] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-25T18:28:06.640193] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T18:28:06.646075] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-25T18:28:07.920173] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T18:28:07.926843] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-25T18:28:09.470911] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T18:28:09.478583] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-25T18:28:10.692928] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T18:28:10.699407] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-25T18:28:11.881700] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T18:28:11.886833] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-25T18:28:13.245463] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T18:28:13.251606] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-25T18:28:14.536028] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T18:28:14.542188] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-25T18:28:15.724119] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T18:28:15.730206] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-25T18:28:16.878400] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T18:28:16.885464] [INFO ] [REMOTE ] ACEL: Full fetch complete (38667 records). [2025-10-25T18:28:16.885695] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-25T18:28:17.305934] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-25T18:28:17.306108] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-25T18:28:17.306612] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-25T18:28:17.306713] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-25T18:28:17.307768] [DEBUG] [LOCAL ] ACEL: Trimmed 38667 records to 26599 (keeping 200 days of data) [2025-10-25T18:28:17.463041] [DEBUG] [LOCAL ] ACEL: Primary data saved (26599 records). [2025-10-25T18:28:17.463204] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-25T18:28:17.463306] [INFO ] [MAIN ] Update Progress: 18/2366 symbols. ACEL took 13.8s. Estimated remaining time: 7h 35m 7s [2025-10-25T18:28:17.649785] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:28:17.649989] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-25T18:28:17.650061] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-25T18:28:17.650177] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-25T18:28:17.650268] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-25T18:28:17.650365] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-25T18:28:17.650436] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-25T18:28:18.024207] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:28:18.024531] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-25T18:28:20.477310] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-25T18:28:20.488321] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-25T18:28:23.065961] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-25T18:28:23.075835] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-25T18:28:25.517589] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-25T18:28:25.528991] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-25T18:28:27.898702] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-25T18:28:27.909626] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-25T18:28:30.414420] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-25T18:28:30.425869] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-25T18:28:32.806888] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-25T18:28:32.818471] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-25T18:28:35.391802] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-25T18:28:35.403934] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-25T18:28:38.120347] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-25T18:28:38.131700] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-25T18:28:40.532691] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-25T18:28:40.543884] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-25T18:28:41.455979] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T18:28:41.465774] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-25T18:28:41.465963] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-25T18:28:41.875473] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-25T18:28:41.875595] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-25T18:28:41.876348] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-25T18:28:41.876428] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-25T18:28:41.877933] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-10-25T18:28:42.190015] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-10-25T18:28:42.190199] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-25T18:28:42.190304] [INFO ] [MAIN ] Update Progress: 19/2366 symbols. ACHR took 24.7s. Estimated remaining time: 8h 1m 54s [2025-10-25T18:28:42.358456] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:28:42.358669] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-25T18:28:42.358741] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-25T18:28:42.358854] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-25T18:28:42.358925] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-25T18:28:42.359005] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-25T18:28:42.359073] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-25T18:28:42.723305] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:28:42.723693] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-25T18:28:43.797483] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T18:28:43.808420] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-25T18:28:44.770999] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T18:28:44.782515] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-25T18:28:45.379836] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T18:28:45.391418] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-25T18:28:46.124796] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T18:28:46.136940] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-25T18:28:47.289674] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-25T18:28:47.301713] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-25T18:28:48.331283] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T18:28:48.342617] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-25T18:28:49.403911] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T18:28:49.416567] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-25T18:28:50.367698] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T18:28:50.379191] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-25T18:28:51.362351] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T18:28:51.373503] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-25T18:28:52.313787] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T18:28:52.323587] [INFO ] [REMOTE ] ACI: Full fetch complete (77232 records). [2025-10-25T18:28:52.323780] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-25T18:28:52.758197] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-25T18:28:52.758765] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-25T18:28:52.759736] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-25T18:28:52.759828] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-25T18:28:52.762084] [DEBUG] [LOCAL ] ACI: Trimmed 77232 records to 54065 (keeping 200 days of data) [2025-10-25T18:28:53.112369] [DEBUG] [LOCAL ] ACI: Primary data saved (54065 records). [2025-10-25T18:28:53.112602] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-25T18:28:53.112760] [INFO ] [MAIN ] Update Progress: 20/2366 symbols. ACI took 10.9s. Estimated remaining time: 7h 58m 57s [2025-10-25T18:28:53.294393] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:28:53.294692] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-25T18:28:53.294800] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-25T18:28:53.294927] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-25T18:28:53.295003] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-25T18:28:53.295086] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-25T18:28:53.295156] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-25T18:28:53.675822] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:28:53.676300] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-25T18:28:55.221762] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T18:28:55.230798] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-25T18:28:56.838901] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T18:28:56.847881] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-25T18:28:58.548894] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T18:28:58.558505] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-25T18:29:00.230003] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T18:29:00.239550] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-25T18:29:02.497011] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-25T18:29:02.506400] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-25T18:29:04.054248] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T18:29:04.063127] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-25T18:29:05.699260] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T18:29:05.708477] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-25T18:29:07.421691] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T18:29:07.430714] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-25T18:29:09.288443] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T18:29:09.298182] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-25T18:29:10.893154] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-25T18:29:10.900996] [INFO ] [REMOTE ] ACM: Full fetch complete (63277 records). [2025-10-25T18:29:10.901138] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-25T18:29:11.295632] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-25T18:29:11.295770] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-25T18:29:11.296441] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-25T18:29:11.296539] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-25T18:29:11.298003] [DEBUG] [LOCAL ] ACM: Trimmed 63277 records to 43273 (keeping 200 days of data) [2025-10-25T18:29:11.560692] [DEBUG] [LOCAL ] ACM: Primary data saved (43273 records). [2025-10-25T18:29:11.560853] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-25T18:29:11.560972] [INFO ] [MAIN ] Update Progress: 21/2366 symbols. ACM took 18.4s. Estimated remaining time: 8h 10m 17s [2025-10-25T18:29:11.746406] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:29:11.746628] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-25T18:29:11.746739] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-25T18:29:11.746899] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-25T18:29:11.747000] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-25T18:29:11.747257] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-25T18:29:11.747354] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-25T18:29:12.103817] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:29:12.104140] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-25T18:29:13.093385] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T18:29:13.103500] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-25T18:29:14.014585] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T18:29:14.024588] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-25T18:29:15.147811] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T18:29:15.158946] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-25T18:29:16.145664] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T18:29:16.156952] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-25T18:29:17.142324] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T18:29:17.153446] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-25T18:29:18.127526] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T18:29:18.138255] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-25T18:29:19.137621] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T18:29:19.149711] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-25T18:29:20.137349] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T18:29:20.149371] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-25T18:29:21.153238] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T18:29:21.165521] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-25T18:29:21.988307] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T18:29:21.997879] [INFO ] [REMOTE ] ACN: Full fetch complete (77417 records). [2025-10-25T18:29:21.998028] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-25T18:29:22.387181] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-25T18:29:22.387295] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-25T18:29:22.388058] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-25T18:29:22.388137] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-25T18:29:22.389593] [DEBUG] [LOCAL ] ACN: Trimmed 77417 records to 54215 (keeping 200 days of data) [2025-10-25T18:29:22.720382] [DEBUG] [LOCAL ] ACN: Primary data saved (54215 records). [2025-10-25T18:29:22.720567] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-25T18:29:22.720714] [INFO ] [MAIN ] Update Progress: 22/2366 symbols. ACN took 11.2s. Estimated remaining time: 8h 7m 37s [2025-10-25T18:29:22.887352] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:29:22.887540] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-25T18:29:22.887609] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-25T18:29:22.887741] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-25T18:29:22.887810] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-25T18:29:22.887888] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-25T18:29:22.887957] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-25T18:29:23.236611] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:29:23.236969] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-25T18:29:24.664904] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T18:29:24.672769] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-25T18:29:26.021066] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T18:29:26.027621] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-25T18:29:27.363098] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T18:29:27.369807] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-25T18:29:28.900977] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T18:29:28.912391] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-25T18:29:30.318745] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T18:29:30.328857] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-25T18:29:31.643713] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T18:29:31.650265] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-25T18:29:33.082539] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T18:29:33.089680] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-25T18:29:34.439875] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T18:29:34.446432] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-25T18:29:35.719231] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T18:29:35.725426] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-25T18:29:37.088390] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T18:29:37.094464] [INFO ] [REMOTE ] ACP: Full fetch complete (46426 records). [2025-10-25T18:29:37.094575] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-25T18:29:37.473851] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-25T18:29:37.473961] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-25T18:29:37.474699] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-25T18:29:37.474777] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-25T18:29:37.476008] [DEBUG] [LOCAL ] ACP: Trimmed 46426 records to 31563 (keeping 200 days of data) [2025-10-25T18:29:37.654389] [DEBUG] [LOCAL ] ACP: Primary data saved (31563 records). [2025-10-25T18:29:37.654560] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-25T18:29:37.654704] [INFO ] [MAIN ] Update Progress: 23/2366 symbols. ACP took 14.9s. Estimated remaining time: 8h 11m 35s [2025-10-25T18:29:37.827748] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:29:37.827928] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-25T18:29:37.827999] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-25T18:29:37.828108] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-25T18:29:37.828180] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-25T18:29:37.828241] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-25T18:29:37.828305] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-25T18:29:38.189350] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:29:38.189711] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-25T18:29:38.942058] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T18:29:38.943506] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-25T18:29:39.602705] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-25T18:29:39.604627] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-25T18:29:40.546836] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T18:29:40.549626] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-25T18:29:41.423439] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T18:29:41.425557] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-25T18:29:42.262714] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T18:29:42.264822] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-25T18:29:43.125914] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T18:29:43.128147] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-25T18:29:43.793254] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-25T18:29:43.795412] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-25T18:29:44.465348] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-25T18:29:44.466918] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-25T18:29:45.087746] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T18:29:45.089317] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-25T18:29:45.716243] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-25T18:29:45.717522] [INFO ] [REMOTE ] ACR: Full fetch complete (8532 records). [2025-10-25T18:29:45.717613] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-25T18:29:46.096797] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-25T18:29:46.096939] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-25T18:29:46.097183] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-25T18:29:46.097262] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-25T18:29:46.097739] [DEBUG] [LOCAL ] ACR: Trimmed 8532 records to 5349 (keeping 200 days of data) [2025-10-25T18:29:46.129503] [DEBUG] [LOCAL ] ACR: Primary data saved (5349 records). [2025-10-25T18:29:46.129699] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-25T18:29:46.129807] [INFO ] [MAIN ] Update Progress: 24/2366 symbols. ACR took 8.5s. Estimated remaining time: 8h 4m 41s [2025-10-25T18:29:46.301350] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:29:46.301554] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-25T18:29:46.301624] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-25T18:29:46.301764] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-25T18:29:46.301833] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-25T18:29:46.301913] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-25T18:29:46.301982] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-25T18:29:46.670477] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:29:46.670859] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-25T18:29:48.166430] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T18:29:48.174146] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-25T18:29:49.707700] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T18:29:49.715073] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-25T18:29:51.135737] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T18:29:51.142993] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-25T18:29:52.655423] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T18:29:52.663991] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-25T18:29:54.130122] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T18:29:54.137505] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-25T18:29:55.680982] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T18:29:55.688346] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-25T18:29:57.240811] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T18:29:57.248026] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-25T18:29:58.361541] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T18:29:58.369924] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-25T18:29:59.766841] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T18:29:59.778133] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-25T18:30:01.012350] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T18:30:01.018687] [INFO ] [REMOTE ] ACRE: Full fetch complete (49286 records). [2025-10-25T18:30:01.018848] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-25T18:30:01.411550] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-25T18:30:01.411686] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-25T18:30:01.412203] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-25T18:30:01.412284] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-25T18:30:01.413323] [DEBUG] [LOCAL ] ACRE: Trimmed 49286 records to 33607 (keeping 200 days of data) [2025-10-25T18:30:01.610214] [DEBUG] [LOCAL ] ACRE: Primary data saved (33607 records). [2025-10-25T18:30:01.610410] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-25T18:30:01.610521] [INFO ] [MAIN ] Update Progress: 25/2366 symbols. ACRE took 15.5s. Estimated remaining time: 8h 9m 15s [2025-10-25T18:30:01.796430] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:30:01.796684] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-25T18:30:01.796760] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-25T18:30:01.796880] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-25T18:30:01.796983] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-25T18:30:01.797120] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-25T18:30:01.797233] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-25T18:30:02.159203] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:30:02.159568] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-25T18:30:03.119086] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-25T18:30:03.120817] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-25T18:30:04.148878] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T18:30:04.150753] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-25T18:30:05.209256] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T18:30:05.211519] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-25T18:30:06.217445] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T18:30:06.220379] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-25T18:30:07.389460] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T18:30:07.391521] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-25T18:30:08.114583] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T18:30:08.116393] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-25T18:30:08.895182] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T18:30:08.897229] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-25T18:30:09.675610] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T18:30:09.677612] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-25T18:30:10.496279] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-25T18:30:10.499010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-25T18:30:11.490061] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T18:30:11.492777] [INFO ] [REMOTE ] ACV: Full fetch complete (10560 records). [2025-10-25T18:30:11.492887] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-25T18:30:11.878560] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-25T18:30:11.878701] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-25T18:30:11.878954] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-25T18:30:11.879031] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-25T18:30:11.879502] [DEBUG] [LOCAL ] ACV: Trimmed 10560 records to 7578 (keeping 200 days of data) [2025-10-25T18:30:11.923676] [DEBUG] [LOCAL ] ACV: Primary data saved (7578 records). [2025-10-25T18:30:11.923822] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-25T18:30:11.923933] [INFO ] [MAIN ] Update Progress: 26/2366 symbols. ACV took 10.3s. Estimated remaining time: 8h 5m 42s [2025-10-25T18:30:12.092437] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:30:12.092663] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-25T18:30:12.092741] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-25T18:30:12.092855] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-25T18:30:12.092946] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-25T18:30:12.093047] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-25T18:30:12.093114] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-25T18:30:12.460165] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:30:12.460565] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-25T18:30:14.023349] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T18:30:14.032740] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-25T18:30:15.581796] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T18:30:15.590910] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-25T18:30:17.275015] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T18:30:17.289001] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-25T18:30:18.294116] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T18:30:18.305639] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-25T18:30:19.331102] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T18:30:19.341396] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-25T18:30:20.238669] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T18:30:20.248105] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-25T18:30:20.683255] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-25T18:30:20.693297] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-25T18:30:21.714782] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T18:30:21.726063] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-25T18:30:22.561374] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T18:30:22.572260] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-25T18:30:23.465846] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T18:30:23.475051] [INFO ] [REMOTE ] ACVA: Full fetch complete (71093 records). [2025-10-25T18:30:23.475225] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-25T18:30:23.876919] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-25T18:30:23.877032] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-25T18:30:23.877723] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-25T18:30:23.877803] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-25T18:30:23.879199] [DEBUG] [LOCAL ] ACVA: Trimmed 71093 records to 49969 (keeping 200 days of data) [2025-10-25T18:30:24.164292] [DEBUG] [LOCAL ] ACVA: Primary data saved (49969 records). [2025-10-25T18:30:24.164451] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-25T18:30:24.164574] [INFO ] [MAIN ] Update Progress: 27/2366 symbols. ACVA took 12.2s. Estimated remaining time: 8h 5m 11s [2025-10-25T18:30:24.336620] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:30:24.336854] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-25T18:30:24.336941] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-25T18:30:24.337074] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-25T18:30:24.337191] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-25T18:30:24.337284] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-25T18:30:24.337355] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-25T18:30:24.699004] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:30:24.699379] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-25T18:30:25.045444] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:30:25.045792] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-25T18:30:25.045874] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:30:25.045950] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-25T18:30:25.046018] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:30:25.046090] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-25T18:30:25.046192] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-25T18:30:25.046264] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-25T18:30:25.046344] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-25T18:30:25.046425] [INFO ] [MAIN ] Update Progress: 28/2366 symbols. AD took 0.9s. Estimated remaining time: 7h 48m 53s [2025-10-25T18:30:25.217268] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:30:25.217477] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-25T18:30:25.217547] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-25T18:30:25.217697] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-25T18:30:25.217770] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-25T18:30:25.217829] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-25T18:30:25.217891] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-25T18:30:25.577521] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:30:25.577926] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-25T18:30:26.463266] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-25T18:30:26.472046] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-25T18:30:27.457617] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T18:30:27.466333] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-25T18:30:28.426272] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T18:30:28.436182] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-25T18:30:29.384126] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T18:30:29.394599] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-25T18:30:30.433256] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T18:30:30.443435] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-25T18:30:32.237034] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-25T18:30:32.246347] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-25T18:30:33.181224] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T18:30:33.191453] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-25T18:30:34.148901] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T18:30:34.158396] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-25T18:30:34.923721] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T18:30:34.933337] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-25T18:30:35.837276] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T18:30:35.845901] [INFO ] [REMOTE ] ADC: Full fetch complete (66721 records). [2025-10-25T18:30:35.846048] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-25T18:30:36.266264] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-25T18:30:36.266392] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-25T18:30:36.267114] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-25T18:30:36.267218] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-25T18:30:36.268539] [DEBUG] [LOCAL ] ADC: Trimmed 66721 records to 47102 (keeping 200 days of data) [2025-10-25T18:30:36.550441] [DEBUG] [LOCAL ] ADC: Primary data saved (47102 records). [2025-10-25T18:30:36.550639] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-25T18:30:36.550784] [INFO ] [MAIN ] Update Progress: 29/2366 symbols. ADC took 11.5s. Estimated remaining time: 7h 47m 58s [2025-10-25T18:30:36.719948] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:30:36.720189] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-25T18:30:36.720289] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-25T18:30:36.720412] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-25T18:30:36.720491] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-25T18:30:36.720578] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-25T18:30:36.720674] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-25T18:30:37.091182] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:30:37.091592] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-25T18:30:38.534882] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T18:30:38.542868] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-25T18:30:39.926854] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T18:30:39.934891] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-25T18:30:41.315076] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T18:30:41.322166] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-25T18:30:42.499817] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T18:30:42.506293] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-25T18:30:43.776818] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T18:30:43.783631] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-25T18:30:45.369927] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T18:30:45.378847] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-25T18:30:46.858764] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T18:30:46.868457] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-25T18:30:48.282750] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T18:30:48.290303] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-25T18:30:49.811828] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T18:30:49.820213] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-25T18:30:51.460549] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-25T18:30:51.470872] [INFO ] [REMOTE ] ADCT: Full fetch complete (51420 records). [2025-10-25T18:30:51.471058] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-25T18:30:51.850737] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-25T18:30:51.850868] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-25T18:30:51.851440] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-25T18:30:51.851521] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-25T18:30:51.852601] [DEBUG] [LOCAL ] ADCT: Trimmed 51420 records to 36037 (keeping 200 days of data) [2025-10-25T18:30:52.041476] [DEBUG] [LOCAL ] ADCT: Primary data saved (36037 records). [2025-10-25T18:30:52.041639] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-25T18:30:52.041803] [INFO ] [MAIN ] Update Progress: 30/2366 symbols. ADCT took 15.5s. Estimated remaining time: 7h 52m 17s [2025-10-25T18:30:52.234897] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:30:52.235090] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-25T18:30:52.235176] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-25T18:30:52.235339] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-25T18:30:52.235438] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-25T18:30:52.235549] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-25T18:30:52.235692] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-25T18:30:52.611429] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:30:52.611826] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-25T18:30:53.608114] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T18:30:53.618254] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-25T18:30:54.545422] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T18:30:54.556179] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-25T18:30:55.736032] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T18:30:55.747228] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-25T18:30:56.995465] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T18:30:57.006302] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-25T18:30:58.370255] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T18:30:58.381569] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-25T18:30:59.416627] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T18:30:59.427552] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-25T18:31:00.542431] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T18:31:00.557868] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-25T18:31:01.629361] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T18:31:01.643483] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-25T18:31:02.671867] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T18:31:02.683351] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-25T18:31:03.617760] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T18:31:03.627749] [INFO ] [REMOTE ] ADM: Full fetch complete (77477 records). [2025-10-25T18:31:03.627952] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-25T18:31:04.041440] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-25T18:31:04.041558] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-25T18:31:04.042361] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-25T18:31:04.042451] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-25T18:31:04.044064] [DEBUG] [LOCAL ] ADM: Trimmed 77477 records to 54167 (keeping 200 days of data) [2025-10-25T18:31:04.358881] [DEBUG] [LOCAL ] ADM: Primary data saved (54167 records). [2025-10-25T18:31:04.359062] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-25T18:31:04.359172] [INFO ] [MAIN ] Update Progress: 31/2366 symbols. ADM took 12.3s. Estimated remaining time: 7h 52m 19s [2025-10-25T18:31:04.546181] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:31:04.546429] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-25T18:31:04.546521] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-25T18:31:04.546692] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-25T18:31:04.546787] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-25T18:31:04.546895] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-25T18:31:04.546982] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-25T18:31:04.918037] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:31:04.918396] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-25T18:31:06.546879] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T18:31:06.556612] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-25T18:31:08.176708] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T18:31:08.185306] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-25T18:31:09.959500] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T18:31:09.975808] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-25T18:31:10.895394] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T18:31:10.905676] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-25T18:31:11.859889] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T18:31:11.869795] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-25T18:31:12.828436] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T18:31:12.838537] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-25T18:31:13.974901] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T18:31:13.985093] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-25T18:31:14.923007] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T18:31:14.933328] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-25T18:31:15.990267] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T18:31:15.999987] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-25T18:31:16.856271] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T18:31:16.864331] [INFO ] [REMOTE ] ADNT: Full fetch complete (67741 records). [2025-10-25T18:31:16.864533] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-25T18:31:17.272763] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-25T18:31:17.272878] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-25T18:31:17.273549] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-25T18:31:17.273638] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-25T18:31:17.275110] [DEBUG] [LOCAL ] ADNT: Trimmed 67741 records to 46882 (keeping 200 days of data) [2025-10-25T18:31:17.540364] [DEBUG] [LOCAL ] ADNT: Primary data saved (46882 records). [2025-10-25T18:31:17.540539] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-25T18:31:17.540672] [INFO ] [MAIN ] Update Progress: 32/2366 symbols. ADNT took 13.2s. Estimated remaining time: 7h 53m 23s [2025-10-25T18:31:17.739916] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:31:17.740105] [DEBUG] [LOCAL ] ADT: No existing data file found in primary storage. [2025-10-25T18:31:17.740175] [WARN ] [MAIN ] ADT: No existing data found, performing full refresh instead. [2025-10-25T18:31:17.740285] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-25T18:31:17.740356] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-25T18:31:17.740436] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-25T18:31:17.740505] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-25T18:31:18.093244] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:31:18.093591] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-25T18:31:19.888340] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T18:31:19.898468] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-25T18:31:21.613178] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T18:31:21.623267] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-25T18:31:23.399827] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T18:31:23.410852] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-25T18:31:24.409385] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T18:31:24.420826] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-25T18:31:25.220682] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T18:31:25.231879] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-25T18:31:26.174435] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T18:31:26.184941] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-25T18:31:27.220886] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T18:31:27.232981] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-25T18:31:28.482755] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-25T18:31:28.493973] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-25T18:31:29.415726] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T18:31:29.427282] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-25T18:31:30.436928] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T18:31:30.446401] [INFO ] [REMOTE ] ADT: Full fetch complete (77372 records). [2025-10-25T18:31:30.446557] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-25T18:31:30.855321] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-25T18:31:30.855434] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-25T18:31:30.856242] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-25T18:31:30.856341] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-25T18:31:30.857858] [DEBUG] [LOCAL ] ADT: Trimmed 77372 records to 54214 (keeping 200 days of data) [2025-10-25T18:31:31.165571] [DEBUG] [LOCAL ] ADT: Primary data saved (54214 records). [2025-10-25T18:31:31.165768] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-25T18:31:31.165890] [INFO ] [MAIN ] Update Progress: 33/2366 symbols. ADT took 13.6s. Estimated remaining time: 7h 54m 54s [2025-10-25T18:31:31.334619] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:31:31.334850] [DEBUG] [LOCAL ] ADX: No existing data file found in primary storage. [2025-10-25T18:31:31.334935] [WARN ] [MAIN ] ADX: No existing data found, performing full refresh instead. [2025-10-25T18:31:31.335073] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-25T18:31:31.335160] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-25T18:31:31.335270] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-10-25T18:31:31.335362] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-25T18:31:31.690036] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:31:31.690380] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-25T18:31:32.973503] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T18:31:32.980525] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-25T18:31:34.417505] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T18:31:34.423485] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-25T18:31:35.605277] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T18:31:35.611722] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-25T18:31:36.720555] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T18:31:36.727388] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-25T18:31:37.630279] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T18:31:37.635901] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-25T18:31:39.004411] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T18:31:39.011144] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-25T18:31:40.474126] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T18:31:40.481724] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-25T18:31:41.722470] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T18:31:41.730759] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-25T18:31:43.022271] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-25T18:31:43.028477] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-25T18:31:44.268955] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T18:31:44.274311] [INFO ] [REMOTE ] ADX: Full fetch complete (41822 records). [2025-10-25T18:31:44.274429] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-25T18:31:44.644908] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-25T18:31:44.645017] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-25T18:31:44.645467] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-25T18:31:44.645542] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-25T18:31:44.646457] [DEBUG] [LOCAL ] ADX: Trimmed 41822 records to 28052 (keeping 200 days of data) [2025-10-25T18:31:44.805618] [DEBUG] [LOCAL ] ADX: Primary data saved (28052 records). [2025-10-25T18:31:44.805794] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-25T18:31:44.805898] [INFO ] [MAIN ] Update Progress: 34/2366 symbols. ADX took 13.6s. Estimated remaining time: 7h 56m 20s [2025-10-25T18:31:44.978185] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:31:44.979219] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-10-25T18:31:44.979291] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-10-25T18:31:44.979425] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-25T18:31:44.979499] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-25T18:31:44.979581] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-25T18:31:44.979679] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-25T18:31:45.329055] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:31:45.329365] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-25T18:31:47.118949] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T18:31:47.128305] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-25T18:31:48.757028] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T18:31:48.766812] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-25T18:31:50.621616] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T18:31:50.632289] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-25T18:31:51.486858] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T18:31:51.497459] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-25T18:31:52.423346] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T18:31:52.434166] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-25T18:31:53.273369] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T18:31:53.283410] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-25T18:31:54.189543] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T18:31:54.204446] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-25T18:31:55.099874] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T18:31:55.110406] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-25T18:31:56.222182] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T18:31:56.232947] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-25T18:31:57.157715] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T18:31:57.171873] [INFO ] [REMOTE ] AEE: Full fetch complete (72979 records). [2025-10-25T18:31:57.172114] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-25T18:31:57.796355] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-25T18:31:57.796491] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-25T18:31:57.797313] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-25T18:31:57.797403] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-25T18:31:57.799226] [DEBUG] [LOCAL ] AEE: Trimmed 72979 records to 50716 (keeping 200 days of data) [2025-10-25T18:31:58.160176] [DEBUG] [LOCAL ] AEE: Primary data saved (50716 records). [2025-10-25T18:31:58.160356] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-25T18:31:58.160461] [INFO ] [MAIN ] Update Progress: 35/2366 symbols. AEE took 13.4s. Estimated remaining time: 7h 57m 20s [2025-10-25T18:31:58.331367] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:31:58.331569] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-25T18:31:58.331660] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-25T18:31:58.331777] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-25T18:31:58.331849] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-25T18:31:58.331929] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-25T18:31:58.331998] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-25T18:31:58.696880] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:31:58.697313] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-25T18:31:59.634548] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T18:31:59.636677] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-25T18:32:00.573518] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-25T18:32:00.575592] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-25T18:32:01.558388] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T18:32:01.560911] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-25T18:32:02.444422] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T18:32:02.447468] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-25T18:32:03.353311] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T18:32:03.356368] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-25T18:32:04.154071] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T18:32:04.156308] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-25T18:32:05.012459] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T18:32:05.014709] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-25T18:32:05.913556] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T18:32:05.916303] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-25T18:32:06.887510] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T18:32:06.889707] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-25T18:32:07.597024] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T18:32:07.598616] [INFO ] [REMOTE ] AEFC: Full fetch complete (11606 records). [2025-10-25T18:32:07.598768] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-25T18:32:07.969581] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-25T18:32:07.969717] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-25T18:32:07.969940] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-25T18:32:07.970018] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-25T18:32:07.970534] [DEBUG] [LOCAL ] AEFC: Trimmed 11606 records to 7718 (keeping 200 days of data) [2025-10-25T18:32:08.016561] [DEBUG] [LOCAL ] AEFC: Primary data saved (7718 records). [2025-10-25T18:32:08.016805] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-25T18:32:08.016914] [INFO ] [MAIN ] Update Progress: 36/2366 symbols. AEFC took 9.9s. Estimated remaining time: 7h 54m 31s [2025-10-25T18:32:08.185910] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:32:08.186096] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-25T18:32:08.186166] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-25T18:32:08.186278] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-25T18:32:08.186354] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-25T18:32:08.186436] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-25T18:32:08.186513] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-25T18:32:08.537259] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:32:08.537628] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-25T18:32:10.122185] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T18:32:10.131068] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-25T18:32:11.676259] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T18:32:11.685774] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-25T18:32:13.558740] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T18:32:13.572921] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-25T18:32:14.642805] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T18:32:14.653132] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-25T18:32:15.201945] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-25T18:32:15.212699] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-25T18:32:16.338018] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T18:32:16.348084] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-25T18:32:17.353411] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T18:32:17.364095] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-25T18:32:18.242083] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-25T18:32:18.252389] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-25T18:32:19.171464] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T18:32:19.182396] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-25T18:32:19.739632] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T18:32:19.748443] [INFO ] [REMOTE ] AEG: Full fetch complete (70651 records). [2025-10-25T18:32:19.748636] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-25T18:32:20.136777] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-25T18:32:20.136901] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-25T18:32:20.137689] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-25T18:32:20.137783] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-25T18:32:20.139199] [DEBUG] [LOCAL ] AEG: Trimmed 70651 records to 50239 (keeping 200 days of data) [2025-10-25T18:32:20.422987] [DEBUG] [LOCAL ] AEG: Primary data saved (50239 records). [2025-10-25T18:32:20.423171] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-25T18:32:20.423291] [INFO ] [MAIN ] Update Progress: 37/2366 symbols. AEG took 12.4s. Estimated remaining time: 7h 54m 30s [2025-10-25T18:32:20.594405] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:32:20.594612] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-10-25T18:32:20.594702] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-10-25T18:32:20.594825] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-25T18:32:20.594895] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-25T18:32:20.594975] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-10-25T18:32:20.595044] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-25T18:32:20.984057] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:32:20.984422] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-25T18:32:22.979038] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T18:32:22.989279] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-25T18:32:24.574378] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T18:32:24.584431] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-25T18:32:26.778115] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-25T18:32:26.789439] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-25T18:32:27.941182] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T18:32:27.952814] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-25T18:32:28.937002] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T18:32:28.948237] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-25T18:32:29.737116] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T18:32:29.748152] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-25T18:32:30.773082] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T18:32:30.784861] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-25T18:32:31.662976] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-25T18:32:31.674493] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-25T18:32:32.628058] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T18:32:32.639316] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-25T18:32:33.490361] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T18:32:33.499939] [INFO ] [REMOTE ] AEM: Full fetch complete (77485 records). [2025-10-25T18:32:33.500137] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-25T18:32:33.900751] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-25T18:32:33.900875] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-25T18:32:33.901604] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-25T18:32:33.901703] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-25T18:32:33.903242] [DEBUG] [LOCAL ] AEM: Trimmed 77485 records to 54253 (keeping 200 days of data) [2025-10-25T18:32:34.226787] [DEBUG] [LOCAL ] AEM: Primary data saved (54253 records). [2025-10-25T18:32:34.226936] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-25T18:32:34.227039] [INFO ] [MAIN ] Update Progress: 38/2366 symbols. AEM took 13.8s. Estimated remaining time: 7h 55m 55s [2025-10-25T18:32:34.394718] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:32:34.394893] [DEBUG] [LOCAL ] AEO: No existing data file found in primary storage. [2025-10-25T18:32:34.394962] [WARN ] [MAIN ] AEO: No existing data found, performing full refresh instead. [2025-10-25T18:32:34.395072] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-25T18:32:34.395141] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-25T18:32:34.395220] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-25T18:32:34.395288] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-25T18:32:34.754279] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:32:34.754630] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-25T18:32:36.538705] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T18:32:36.549420] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-25T18:32:38.338062] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T18:32:38.348227] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-25T18:32:40.289436] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T18:32:40.300722] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-25T18:32:42.231942] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-25T18:32:42.242910] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-25T18:32:44.331271] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-25T18:32:44.342445] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-25T18:32:46.222760] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-25T18:32:46.233579] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-25T18:32:48.239434] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-25T18:32:48.251175] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-25T18:32:50.396721] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-25T18:32:50.408178] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-25T18:32:52.483096] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-25T18:32:52.494697] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-25T18:32:54.382788] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-25T18:32:54.392843] [INFO ] [REMOTE ] AEO: Full fetch complete (77651 records). [2025-10-25T18:32:54.393041] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-25T18:32:54.784857] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-25T18:32:54.785005] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-25T18:32:54.785832] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-25T18:32:54.785933] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-25T18:32:54.787493] [DEBUG] [LOCAL ] AEO: Trimmed 77651 records to 54343 (keeping 200 days of data) [2025-10-25T18:32:55.116629] [DEBUG] [LOCAL ] AEO: Primary data saved (54343 records). [2025-10-25T18:32:55.116875] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-25T18:32:55.117006] [INFO ] [MAIN ] Update Progress: 39/2366 symbols. AEO took 20.9s. Estimated remaining time: 8h 4m 17s [2025-10-25T18:32:55.290593] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:32:55.290831] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-10-25T18:32:55.290917] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-10-25T18:32:55.291055] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-25T18:32:55.291168] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-25T18:32:55.291280] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-25T18:32:55.291369] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-25T18:32:55.663887] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:32:55.664329] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-25T18:32:57.427556] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T18:32:57.436621] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-25T18:32:59.075781] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T18:32:59.085394] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-25T18:33:00.974006] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-25T18:33:00.985011] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-25T18:33:01.977450] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T18:33:01.988771] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-25T18:33:03.041292] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T18:33:03.051638] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-25T18:33:03.910062] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T18:33:03.919529] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-25T18:33:04.912362] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T18:33:04.930071] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-25T18:33:05.826632] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T18:33:05.842693] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-25T18:33:06.816094] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T18:33:06.826213] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-25T18:33:07.750101] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T18:33:07.758363] [INFO ] [REMOTE ] AER: Full fetch complete (69904 records). [2025-10-25T18:33:07.758500] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-25T18:33:08.144411] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-25T18:33:08.144551] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-25T18:33:08.145234] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-25T18:33:08.145315] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-25T18:33:08.146726] [DEBUG] [LOCAL ] AER: Trimmed 69904 records to 48541 (keeping 200 days of data) [2025-10-25T18:33:08.445469] [DEBUG] [LOCAL ] AER: Primary data saved (48541 records). [2025-10-25T18:33:08.445671] [INFO ] [MAIN ] AER: Full history saved. [2025-10-25T18:33:08.445782] [INFO ] [MAIN ] Update Progress: 40/2366 symbols. AER took 13.3s. Estimated remaining time: 8h 4m 54s [2025-10-25T18:33:08.635788] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:33:08.636016] [DEBUG] [LOCAL ] AES: No existing data file found in primary storage. [2025-10-25T18:33:08.636091] [WARN ] [MAIN ] AES: No existing data found, performing full refresh instead. [2025-10-25T18:33:08.636205] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-25T18:33:08.636277] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-25T18:33:08.636357] [DEBUG] [LOCAL ] AES: No primary data file found to delete. [2025-10-25T18:33:08.636424] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-25T18:33:09.060761] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:33:09.061226] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-25T18:33:11.053834] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T18:33:11.064175] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-25T18:33:12.992822] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T18:33:13.005091] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-25T18:33:15.046602] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T18:33:15.057820] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-25T18:33:16.062999] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T18:33:16.073920] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-25T18:33:17.124572] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T18:33:17.135880] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-25T18:33:18.186037] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T18:33:18.197221] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-25T18:33:19.289981] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T18:33:19.301787] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-25T18:33:20.158862] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T18:33:20.171406] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-25T18:33:21.262501] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T18:33:21.273981] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-25T18:33:22.249882] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T18:33:22.259438] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-25T18:33:22.259601] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-25T18:33:22.668971] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-25T18:33:22.669096] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-25T18:33:22.669986] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-25T18:33:22.670071] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-25T18:33:22.671695] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 54443 (keeping 200 days of data) [2025-10-25T18:33:23.007137] [DEBUG] [LOCAL ] AES: Primary data saved (54443 records). [2025-10-25T18:33:23.007319] [INFO ] [MAIN ] AES: Full history saved. [2025-10-25T18:33:23.007421] [INFO ] [MAIN ] Update Progress: 41/2366 symbols. AES took 14.6s. Estimated remaining time: 8h 6m 38s [2025-10-25T18:33:23.179306] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:33:23.179605] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-10-25T18:33:23.179744] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-10-25T18:33:23.179833] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-25T18:33:23.179909] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-25T18:33:23.179968] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-10-25T18:33:23.180005] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-25T18:33:23.529703] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:33:23.530062] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-25T18:33:25.038483] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T18:33:25.046960] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-25T18:33:26.791883] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T18:33:26.801412] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-25T18:33:28.580565] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T18:33:28.591295] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-25T18:33:30.379071] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T18:33:30.390131] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-25T18:33:32.186406] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T18:33:32.196748] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-25T18:33:33.906162] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T18:33:33.916207] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-25T18:33:35.640893] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-25T18:33:35.651599] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-25T18:33:37.388255] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T18:33:37.398791] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-25T18:33:39.148006] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-25T18:33:39.158877] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-25T18:33:40.854358] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-25T18:33:40.864131] [INFO ] [REMOTE ] AESI: Full fetch complete (71803 records). [2025-10-25T18:33:40.864328] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-25T18:33:41.267766] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-25T18:33:41.267900] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-25T18:33:41.268588] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-25T18:33:41.268689] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-25T18:33:41.270196] [DEBUG] [LOCAL ] AESI: Trimmed 71803 records to 50567 (keeping 200 days of data) [2025-10-25T18:33:41.564782] [DEBUG] [LOCAL ] AESI: Primary data saved (50567 records). [2025-10-25T18:33:41.564946] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-25T18:33:41.565092] [INFO ] [MAIN ] Update Progress: 42/2366 symbols. AESI took 18.6s. Estimated remaining time: 8h 11m 57s [2025-10-25T18:33:41.735428] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:33:41.735709] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-25T18:33:41.735798] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-25T18:33:41.735924] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-25T18:33:41.735996] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-25T18:33:41.736073] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-25T18:33:41.736142] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-25T18:33:42.092079] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:33:42.092434] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-25T18:33:42.426449] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:33:42.426838] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-25T18:33:42.426930] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:33:42.427029] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-25T18:33:42.427119] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:33:42.427252] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-25T18:33:42.427370] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-25T18:33:42.427463] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-25T18:33:42.427571] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-25T18:33:42.427708] [INFO ] [MAIN ] Update Progress: 43/2366 symbols. AEXA took 0.9s. Estimated remaining time: 8h 1m 5s [2025-10-25T18:33:42.604593] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:33:42.604858] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-10-25T18:33:42.604928] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-10-25T18:33:42.605039] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-25T18:33:42.605108] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-25T18:33:42.605185] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-25T18:33:42.605250] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-25T18:33:42.962889] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:33:42.963213] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-25T18:33:43.844194] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T18:33:43.847082] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-25T18:33:44.709200] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T18:33:44.711950] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-25T18:33:45.879085] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-25T18:33:45.882329] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-25T18:33:46.934552] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T18:33:46.938251] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-25T18:33:47.894724] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T18:33:47.897808] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-25T18:33:48.788365] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T18:33:48.791348] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-25T18:33:49.650440] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T18:33:49.655324] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-25T18:33:50.619039] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T18:33:50.621688] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-25T18:33:51.563544] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T18:33:51.566607] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-25T18:33:52.409954] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T18:33:52.412331] [INFO ] [REMOTE ] AFB: Full fetch complete (16277 records). [2025-10-25T18:33:52.412422] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-25T18:33:52.784898] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-25T18:33:52.785011] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-25T18:33:52.785267] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-25T18:33:52.785342] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-25T18:33:52.785915] [DEBUG] [LOCAL ] AFB: Trimmed 16277 records to 11166 (keeping 200 days of data) [2025-10-25T18:33:52.850758] [DEBUG] [LOCAL ] AFB: Primary data saved (11166 records). [2025-10-25T18:33:52.850914] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-25T18:33:52.851019] [INFO ] [MAIN ] Update Progress: 44/2366 symbols. AFB took 10.4s. Estimated remaining time: 7h 59m 7s [2025-10-25T18:33:53.026079] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:33:53.026262] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-10-25T18:33:53.026333] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-10-25T18:33:53.026444] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-25T18:33:53.026514] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-25T18:33:53.026593] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-25T18:33:53.026688] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-25T18:33:53.410595] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:33:53.410981] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-25T18:33:54.946200] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T18:33:54.951613] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-25T18:33:56.350639] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-25T18:33:56.357755] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-25T18:33:57.935885] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T18:33:57.943744] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-25T18:33:59.496593] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T18:33:59.503543] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-25T18:34:01.184549] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T18:34:01.194542] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-25T18:34:02.900310] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T18:34:02.907620] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-25T18:34:04.388927] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T18:34:04.396679] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-25T18:34:05.872121] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T18:34:05.879020] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-25T18:34:07.401466] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T18:34:07.408558] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-25T18:34:08.753953] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T18:34:08.759752] [INFO ] [REMOTE ] AFG: Full fetch complete (46833 records). [2025-10-25T18:34:08.759865] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-25T18:34:09.157331] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-25T18:34:09.157450] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-25T18:34:09.157954] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-25T18:34:09.158031] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-25T18:34:09.159057] [DEBUG] [LOCAL ] AFG: Trimmed 46833 records to 32241 (keeping 200 days of data) [2025-10-25T18:34:09.366931] [DEBUG] [LOCAL ] AFG: Primary data saved (32241 records). [2025-10-25T18:34:09.367101] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-25T18:34:09.367243] [INFO ] [MAIN ] Update Progress: 45/2366 symbols. AFG took 16.5s. Estimated remaining time: 8h 2m 28s [2025-10-25T18:34:09.543338] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:34:09.543551] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-25T18:34:09.543662] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-25T18:34:09.543823] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-25T18:34:09.543919] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-25T18:34:09.544034] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-25T18:34:09.544133] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-25T18:34:09.907079] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:34:09.907528] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-25T18:34:10.636709] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T18:34:10.637968] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-25T18:34:11.228566] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-25T18:34:11.229836] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-25T18:34:11.900709] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T18:34:11.902178] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-25T18:34:12.615515] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T18:34:12.616877] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-25T18:34:13.182337] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T18:34:13.183578] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-25T18:34:13.772032] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T18:34:13.773263] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-25T18:34:14.308131] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-25T18:34:14.309447] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-25T18:34:14.857815] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T18:34:14.859056] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-25T18:34:15.484965] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T18:34:15.486180] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-25T18:34:15.964170] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T18:34:15.965074] [INFO ] [REMOTE ] AFGB: Full fetch complete (3420 records). [2025-10-25T18:34:15.965164] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-25T18:34:16.340524] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-25T18:34:16.340637] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-25T18:34:16.340808] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-25T18:34:16.340882] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-25T18:34:16.341286] [DEBUG] [LOCAL ] AFGB: Trimmed 3420 records to 2224 (keeping 200 days of data) [2025-10-25T18:34:16.354593] [DEBUG] [LOCAL ] AFGB: Primary data saved (2224 records). [2025-10-25T18:34:16.354702] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-25T18:34:16.354798] [INFO ] [MAIN ] Update Progress: 46/2366 symbols. AFGB took 7.0s. Estimated remaining time: 7h 57m 39s [2025-10-25T18:34:16.528133] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:34:16.528321] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-10-25T18:34:16.528393] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-10-25T18:34:16.528513] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-25T18:34:16.528585] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-25T18:34:16.528693] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-25T18:34:16.528766] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-25T18:34:16.881009] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:34:16.881377] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-25T18:34:17.446074] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-25T18:34:17.447395] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-25T18:34:18.030451] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T18:34:18.031709] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-25T18:34:18.553613] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-25T18:34:18.554822] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-25T18:34:19.098044] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-25T18:34:19.099220] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-25T18:34:19.690250] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T18:34:19.691891] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-25T18:34:20.236580] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-25T18:34:20.237998] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-25T18:34:20.978114] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T18:34:20.980285] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-25T18:34:21.714634] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T18:34:21.716110] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-25T18:34:22.339924] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T18:34:22.341213] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-25T18:34:22.907634] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T18:34:22.908564] [INFO ] [REMOTE ] AFGC: Full fetch complete (3563 records). [2025-10-25T18:34:22.908671] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-25T18:34:23.272613] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-25T18:34:23.272750] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-25T18:34:23.272902] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-25T18:34:23.272976] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-25T18:34:23.273342] [DEBUG] [LOCAL ] AFGC: Trimmed 3563 records to 2572 (keeping 200 days of data) [2025-10-25T18:34:23.288408] [DEBUG] [LOCAL ] AFGC: Primary data saved (2572 records). [2025-10-25T18:34:23.288489] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-25T18:34:23.288584] [INFO ] [MAIN ] Update Progress: 47/2366 symbols. AFGC took 6.9s. Estimated remaining time: 7h 52m 59s [2025-10-25T18:34:23.463191] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:34:23.463415] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-25T18:34:23.463486] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-25T18:34:23.463575] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-25T18:34:23.463663] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-25T18:34:23.463750] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-25T18:34:23.463824] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-25T18:34:23.815619] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:34:23.815991] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-25T18:34:24.486476] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-25T18:34:24.487942] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-25T18:34:25.061999] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T18:34:25.063334] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-25T18:34:25.781064] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-25T18:34:25.782305] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-25T18:34:26.358763] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-25T18:34:26.359949] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-25T18:34:27.216597] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T18:34:27.217961] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-25T18:34:27.742242] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-25T18:34:27.743395] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-25T18:34:28.324826] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T18:34:28.325967] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-25T18:34:28.786500] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T18:34:28.787805] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-25T18:34:29.377543] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-25T18:34:29.379312] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-25T18:34:29.822044] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-25T18:34:29.822872] [INFO ] [REMOTE ] AFGD: Full fetch complete (2698 records). [2025-10-25T18:34:29.822958] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-25T18:34:30.190945] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-25T18:34:30.191041] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-25T18:34:30.191176] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-25T18:34:30.191249] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-25T18:34:30.191604] [DEBUG] [LOCAL ] AFGD: Trimmed 2698 records to 1763 (keeping 200 days of data) [2025-10-25T18:34:30.201933] [DEBUG] [LOCAL ] AFGD: Primary data saved (1763 records). [2025-10-25T18:34:30.202012] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-25T18:34:30.202078] [INFO ] [MAIN ] Update Progress: 48/2366 symbols. AFGD took 6.9s. Estimated remaining time: 7h 48m 29s [2025-10-25T18:34:30.371139] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:34:30.371302] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-10-25T18:34:30.371371] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-10-25T18:34:30.371478] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-25T18:34:30.371559] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-25T18:34:30.371669] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-10-25T18:34:30.371739] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-25T18:34:30.720504] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:34:30.720857] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-25T18:34:31.436678] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T18:34:31.437954] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-25T18:34:31.934223] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-25T18:34:31.935327] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-25T18:34:32.510384] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T18:34:32.511589] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-25T18:34:33.055077] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-25T18:34:33.056891] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-25T18:34:33.525114] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-25T18:34:33.526495] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-25T18:34:33.898341] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-25T18:34:33.899515] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-25T18:34:34.353427] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-25T18:34:34.354676] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-25T18:34:35.109827] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T18:34:35.111454] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-25T18:34:35.646292] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-25T18:34:35.647550] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-25T18:34:36.087514] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-25T18:34:36.088368] [INFO ] [REMOTE ] AFGE: Full fetch complete (3307 records). [2025-10-25T18:34:36.088473] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-25T18:34:36.446554] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-25T18:34:36.446728] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-25T18:34:36.446917] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-25T18:34:36.447012] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-25T18:34:36.447507] [DEBUG] [LOCAL ] AFGE: Trimmed 3307 records to 2255 (keeping 200 days of data) [2025-10-25T18:34:36.461004] [DEBUG] [LOCAL ] AFGE: Primary data saved (2255 records). [2025-10-25T18:34:36.461152] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-25T18:34:36.461283] [INFO ] [MAIN ] Update Progress: 49/2366 symbols. AFGE took 6.3s. Estimated remaining time: 7h 43m 40s [2025-10-25T18:34:36.637729] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:34:36.637960] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-10-25T18:34:36.638048] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-10-25T18:34:36.638183] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-25T18:34:36.638271] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-25T18:34:36.638376] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-25T18:34:36.638461] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-25T18:34:37.011248] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:34:37.011595] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-25T18:34:38.763736] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T18:34:38.774386] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-25T18:34:40.446322] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T18:34:40.456186] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-25T18:34:42.240188] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T18:34:42.251186] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-25T18:34:43.232794] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T18:34:43.243916] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-25T18:34:44.225501] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T18:34:44.236512] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-25T18:34:45.291227] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T18:34:45.302413] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-25T18:34:46.332664] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T18:34:46.346963] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-25T18:34:47.342127] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T18:34:47.353345] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-25T18:34:48.369838] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T18:34:48.381140] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-25T18:34:49.400748] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T18:34:49.410314] [INFO ] [REMOTE ] AFL: Full fetch complete (77072 records). [2025-10-25T18:34:49.410455] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-25T18:34:49.796190] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-25T18:34:49.796310] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-25T18:34:49.797058] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-25T18:34:49.797141] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-25T18:34:49.798584] [DEBUG] [LOCAL ] AFL: Trimmed 77072 records to 53948 (keeping 200 days of data) [2025-10-25T18:34:50.117666] [DEBUG] [LOCAL ] AFL: Primary data saved (53948 records). [2025-10-25T18:34:50.117828] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-25T18:34:50.117929] [INFO ] [MAIN ] Update Progress: 50/2366 symbols. AFL took 13.7s. Estimated remaining time: 7h 44m 44s [2025-10-25T18:34:50.291204] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:34:50.291436] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-25T18:34:50.291506] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-25T18:34:50.291620] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-25T18:34:50.291721] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-25T18:34:50.291825] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-25T18:34:50.291905] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-25T18:34:50.646199] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:34:50.646527] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-25T18:34:52.760179] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-25T18:34:52.770400] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-25T18:34:54.609774] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T18:34:54.619688] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-25T18:34:56.554255] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T18:34:56.565548] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-25T18:34:57.462726] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-25T18:34:57.473938] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-25T18:34:58.476033] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T18:34:58.488241] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-25T18:34:59.479901] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T18:34:59.490971] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-25T18:35:00.433452] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T18:35:00.445109] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-25T18:35:01.855838] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T18:35:01.867806] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-25T18:35:03.164789] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T18:35:03.179760] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-25T18:35:04.160035] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T18:35:04.169762] [INFO ] [REMOTE ] AG: Full fetch complete (77791 records). [2025-10-25T18:35:04.169924] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-25T18:35:04.572769] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-25T18:35:04.572881] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-25T18:35:04.573705] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-25T18:35:04.573784] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-25T18:35:04.575264] [DEBUG] [LOCAL ] AG: Trimmed 77791 records to 54423 (keeping 200 days of data) [2025-10-25T18:35:04.895056] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-10-25T18:35:04.895225] [INFO ] [MAIN ] AG: Full history saved. [2025-10-25T18:35:04.895332] [INFO ] [MAIN ] Update Progress: 51/2366 symbols. AG took 14.8s. Estimated remaining time: 7h 46m 37s [2025-10-25T18:35:05.061677] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:35:05.061860] [DEBUG] [LOCAL ] AGCO: No existing data file found in primary storage. [2025-10-25T18:35:05.061930] [WARN ] [MAIN ] AGCO: No existing data found, performing full refresh instead. [2025-10-25T18:35:05.062039] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-25T18:35:05.062109] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-25T18:35:05.062188] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-25T18:35:05.062253] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-25T18:35:05.423100] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:35:05.424108] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-25T18:35:07.317600] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-25T18:35:07.325980] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-25T18:35:09.094865] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-25T18:35:09.103342] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-25T18:35:10.777940] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T18:35:10.787734] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-25T18:35:11.783927] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T18:35:11.793898] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-25T18:35:12.667026] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T18:35:12.676422] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-25T18:35:13.333687] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T18:35:13.342222] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-25T18:35:14.217521] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T18:35:14.227322] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-25T18:35:14.832799] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T18:35:14.842353] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-25T18:35:16.072398] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T18:35:16.081597] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-25T18:35:16.753225] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T18:35:16.762169] [INFO ] [REMOTE ] AGCO: Full fetch complete (61551 records). [2025-10-25T18:35:16.762364] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-25T18:35:17.226206] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-25T18:35:17.226361] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-25T18:35:17.227065] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-25T18:35:17.227172] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-25T18:35:17.228556] [DEBUG] [LOCAL ] AGCO: Trimmed 61551 records to 42682 (keeping 200 days of data) [2025-10-25T18:35:17.483584] [DEBUG] [LOCAL ] AGCO: Primary data saved (42682 records). [2025-10-25T18:35:17.483769] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-25T18:35:17.483877] [INFO ] [MAIN ] Update Progress: 52/2366 symbols. AGCO took 12.6s. Estimated remaining time: 7h 46m 46s [2025-10-25T18:35:17.657631] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:35:17.657877] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-10-25T18:35:17.657952] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-10-25T18:35:17.658067] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-25T18:35:17.658139] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-25T18:35:17.658220] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-25T18:35:17.658291] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-25T18:35:18.013590] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:35:18.013956] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-25T18:35:19.430517] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T18:35:19.435780] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-25T18:35:20.426739] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T18:35:20.431808] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-25T18:35:21.358368] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T18:35:21.361560] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-25T18:35:22.422942] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T18:35:22.426869] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-25T18:35:23.600908] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T18:35:23.605350] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-25T18:35:24.675893] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T18:35:24.680353] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-25T18:35:25.775235] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T18:35:25.780190] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-25T18:35:26.723369] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T18:35:26.727883] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-25T18:35:27.843202] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T18:35:27.851281] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-25T18:35:29.082209] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T18:35:29.088396] [INFO ] [REMOTE ] AGD: Full fetch complete (26546 records). [2025-10-25T18:35:29.088573] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-25T18:35:29.468807] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-25T18:35:29.468924] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-25T18:35:29.469271] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-25T18:35:29.469347] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-25T18:35:29.470151] [DEBUG] [LOCAL ] AGD: Trimmed 26546 records to 19455 (keeping 200 days of data) [2025-10-25T18:35:29.586311] [DEBUG] [LOCAL ] AGD: Primary data saved (19455 records). [2025-10-25T18:35:29.586504] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-25T18:35:29.586616] [INFO ] [MAIN ] Update Progress: 53/2366 symbols. AGD took 12.1s. Estimated remaining time: 7h 46m 34s [2025-10-25T18:35:29.765513] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:35:29.765748] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-10-25T18:35:29.765819] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-10-25T18:35:29.765937] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-25T18:35:29.766029] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-25T18:35:29.766112] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-25T18:35:29.766180] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-25T18:35:30.126736] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:35:30.127273] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-25T18:35:33.073843] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-10-25T18:35:33.085684] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-25T18:35:34.651204] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T18:35:34.661402] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-25T18:35:36.638359] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-25T18:35:36.649551] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-25T18:35:37.675273] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T18:35:37.686582] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-25T18:35:38.286549] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T18:35:38.298161] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-25T18:35:38.880604] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-25T18:35:38.891916] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-25T18:35:39.944419] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T18:35:39.956151] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-25T18:35:41.120179] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T18:35:41.134785] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-25T18:35:42.189679] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T18:35:42.201114] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-25T18:35:43.081451] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T18:35:43.091202] [INFO ] [REMOTE ] AGI: Full fetch complete (77349 records). [2025-10-25T18:35:43.091368] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-25T18:35:43.496337] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-25T18:35:43.496467] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-25T18:35:43.497241] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-25T18:35:43.497323] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-25T18:35:43.498818] [DEBUG] [LOCAL ] AGI: Trimmed 77349 records to 54201 (keeping 200 days of data) [2025-10-25T18:35:43.817592] [DEBUG] [LOCAL ] AGI: Primary data saved (54201 records). [2025-10-25T18:35:43.817807] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-25T18:35:43.817975] [INFO ] [MAIN ] Update Progress: 54/2366 symbols. AGI took 14.2s. Estimated remaining time: 7h 47m 53s [2025-10-25T18:35:43.987493] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:35:43.987732] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-25T18:35:43.987828] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-25T18:35:43.987983] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-25T18:35:43.988083] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-25T18:35:43.988194] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-25T18:35:43.988283] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-25T18:35:44.367603] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:35:44.367978] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-25T18:35:46.168040] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T18:35:46.178681] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-25T18:35:47.814836] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T18:35:47.824753] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-25T18:35:49.491569] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T18:35:49.502443] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-25T18:35:50.766837] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T18:35:50.778179] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-25T18:35:51.799240] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:35:51.810582] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-25T18:35:52.917903] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T18:35:52.932570] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-25T18:35:53.778357] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T18:35:53.789493] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-25T18:35:54.716931] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T18:35:54.728329] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-25T18:35:55.645398] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T18:35:55.656679] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-25T18:35:56.544464] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T18:35:56.554472] [INFO ] [REMOTE ] AGL: Full fetch complete (75980 records). [2025-10-25T18:35:56.554685] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-25T18:35:56.949725] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-25T18:35:56.949883] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-25T18:35:56.950693] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-25T18:35:56.950792] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-25T18:35:56.952281] [DEBUG] [LOCAL ] AGL: Trimmed 75980 records to 53365 (keeping 200 days of data) [2025-10-25T18:35:57.243051] [DEBUG] [LOCAL ] AGL: Primary data saved (53365 records). [2025-10-25T18:35:57.243247] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-25T18:35:57.243372] [INFO ] [MAIN ] Update Progress: 55/2366 symbols. AGL took 13.4s. Estimated remaining time: 7h 48m 35s [2025-10-25T18:35:57.413504] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:35:57.413717] [DEBUG] [LOCAL ] AGM: No existing data file found in primary storage. [2025-10-25T18:35:57.413788] [WARN ] [MAIN ] AGM: No existing data found, performing full refresh instead. [2025-10-25T18:35:57.413901] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-25T18:35:57.413973] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-25T18:35:57.414055] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-10-25T18:35:57.414123] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-25T18:35:57.765895] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:35:57.766234] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-25T18:35:58.807482] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-25T18:35:58.809306] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-25T18:35:59.661776] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-25T18:35:59.663852] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-25T18:36:00.600291] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T18:36:00.602380] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-25T18:36:02.237368] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T18:36:02.239604] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-25T18:36:03.257987] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:36:03.260236] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-25T18:36:04.691196] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T18:36:04.696135] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-25T18:36:05.627943] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T18:36:05.631175] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-25T18:36:06.593779] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T18:36:06.597902] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-25T18:36:07.511262] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T18:36:07.514338] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-25T18:36:08.581745] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T18:36:08.584451] [INFO ] [REMOTE ] AGM: Full fetch complete (13318 records). [2025-10-25T18:36:08.584549] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-25T18:36:08.963625] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-25T18:36:08.963768] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-25T18:36:08.964031] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-25T18:36:08.964110] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-25T18:36:08.964633] [DEBUG] [LOCAL ] AGM: Trimmed 13318 records to 10702 (keeping 200 days of data) [2025-10-25T18:36:09.029816] [DEBUG] [LOCAL ] AGM: Primary data saved (10702 records). [2025-10-25T18:36:09.029983] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-25T18:36:09.030091] [INFO ] [MAIN ] Update Progress: 56/2366 symbols. AGM took 11.8s. Estimated remaining time: 7h 48m 7s [2025-10-25T18:36:09.230781] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:36:09.231093] [DEBUG] [LOCAL ] AGO: No existing data file found in primary storage. [2025-10-25T18:36:09.231173] [WARN ] [MAIN ] AGO: No existing data found, performing full refresh instead. [2025-10-25T18:36:09.231301] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-25T18:36:09.231390] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-25T18:36:09.231477] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-25T18:36:09.231554] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-25T18:36:09.655311] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:36:09.655663] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-25T18:36:10.938682] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T18:36:10.945204] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-25T18:36:12.275820] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T18:36:12.280724] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-25T18:36:13.635866] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T18:36:13.642007] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-25T18:36:15.211436] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T18:36:15.218971] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-25T18:36:16.526578] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T18:36:16.532750] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-25T18:36:17.866318] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T18:36:17.871935] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-25T18:36:19.345923] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T18:36:19.352920] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-25T18:36:20.437102] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T18:36:20.444504] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-25T18:36:21.638217] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T18:36:21.645349] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-25T18:36:22.852416] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T18:36:22.857960] [INFO ] [REMOTE ] AGO: Full fetch complete (39697 records). [2025-10-25T18:36:22.858080] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-25T18:36:23.344089] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-25T18:36:23.344202] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-25T18:36:23.344721] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-25T18:36:23.344799] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-25T18:36:23.345770] [DEBUG] [LOCAL ] AGO: Trimmed 39697 records to 28041 (keeping 200 days of data) [2025-10-25T18:36:23.508324] [DEBUG] [LOCAL ] AGO: Primary data saved (28041 records). [2025-10-25T18:36:23.508484] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-25T18:36:23.508594] [INFO ] [MAIN ] Update Progress: 57/2366 symbols. AGO took 14.5s. Estimated remaining time: 7h 49m 29s [2025-10-25T18:36:23.677922] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:36:23.678147] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-25T18:36:23.678221] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-25T18:36:23.678336] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-25T18:36:23.678408] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-25T18:36:23.678489] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-25T18:36:23.678561] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-25T18:36:24.101441] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:36:24.101926] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-25T18:36:25.578944] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T18:36:25.587272] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-25T18:36:27.101886] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T18:36:27.109424] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-25T18:36:28.804032] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T18:36:28.813450] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-25T18:36:30.634554] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T18:36:30.646330] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-25T18:36:32.457829] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T18:36:32.466492] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-25T18:36:33.720505] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T18:36:33.726424] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-25T18:36:35.158276] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T18:36:35.165202] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-25T18:36:36.817606] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-25T18:36:36.825097] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-25T18:36:38.159807] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T18:36:38.167087] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-25T18:36:39.550609] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T18:36:39.559317] [INFO ] [REMOTE ] AGRO: Full fetch complete (48705 records). [2025-10-25T18:36:39.559527] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-25T18:36:39.947818] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-25T18:36:39.947932] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-25T18:36:39.948443] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-25T18:36:39.948520] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-25T18:36:39.949513] [DEBUG] [LOCAL ] AGRO: Trimmed 48705 records to 32912 (keeping 200 days of data) [2025-10-25T18:36:40.127856] [DEBUG] [LOCAL ] AGRO: Primary data saved (32912 records). [2025-10-25T18:36:40.128012] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-25T18:36:40.128115] [INFO ] [MAIN ] Update Progress: 58/2366 symbols. AGRO took 16.6s. Estimated remaining time: 7h 52m 13s [2025-10-25T18:36:40.294758] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:36:40.294968] [DEBUG] [LOCAL ] AGX: No existing data file found in primary storage. [2025-10-25T18:36:40.295037] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-10-25T18:36:40.295124] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-25T18:36:40.295190] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-25T18:36:40.295249] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-25T18:36:40.295310] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-25T18:36:40.657722] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:36:40.658098] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-25T18:36:42.554718] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T18:36:42.566811] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-25T18:36:44.346207] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T18:36:44.356816] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-25T18:36:45.998674] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T18:36:46.006123] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-25T18:36:47.426835] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T18:36:47.434473] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-25T18:36:48.869703] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-25T18:36:48.877560] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-25T18:36:50.639934] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T18:36:50.648948] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-25T18:36:52.217757] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T18:36:52.226447] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-25T18:36:53.725591] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T18:36:53.732092] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-25T18:36:55.174458] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T18:36:55.182103] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-25T18:36:56.646096] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T18:36:56.653448] [INFO ] [REMOTE ] AGX: Full fetch complete (48852 records). [2025-10-25T18:36:56.653769] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-25T18:36:57.080748] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-25T18:36:57.080910] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-25T18:36:57.081557] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-25T18:36:57.081664] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-25T18:36:57.083176] [DEBUG] [LOCAL ] AGX: Trimmed 48852 records to 33012 (keeping 200 days of data) [2025-10-25T18:36:57.297105] [DEBUG] [LOCAL ] AGX: Primary data saved (33012 records). [2025-10-25T18:36:57.297444] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-25T18:36:57.297568] [INFO ] [MAIN ] Update Progress: 59/2366 symbols. AGX took 17.2s. Estimated remaining time: 7h 55m 12s [2025-10-25T18:36:57.477869] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:36:57.478185] [DEBUG] [LOCAL ] AHH: No existing data file found in primary storage. [2025-10-25T18:36:57.478263] [WARN ] [MAIN ] AHH: No existing data found, performing full refresh instead. [2025-10-25T18:36:57.478408] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-25T18:36:57.478485] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-25T18:36:57.478569] [DEBUG] [LOCAL ] AHH: No primary data file found to delete. [2025-10-25T18:36:57.478668] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-25T18:36:57.854261] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:36:57.854769] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-25T18:36:59.339263] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T18:36:59.348213] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-25T18:37:01.325470] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-25T18:37:01.335482] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-25T18:37:04.155552] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-25T18:37:04.165751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-25T18:37:06.073113] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-25T18:37:06.082828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-25T18:37:07.783308] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T18:37:07.792456] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-25T18:37:09.234801] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T18:37:09.243939] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-25T18:37:10.858238] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T18:37:10.867445] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-25T18:37:12.472782] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T18:37:12.481862] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-25T18:37:14.007859] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T18:37:14.016314] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-25T18:37:15.613301] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-25T18:37:15.620924] [INFO ] [REMOTE ] AHH: Full fetch complete (59365 records). [2025-10-25T18:37:15.621101] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-25T18:37:16.036424] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-25T18:37:16.036588] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-25T18:37:16.037383] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-25T18:37:16.037543] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-25T18:37:16.039357] [DEBUG] [LOCAL ] AHH: Trimmed 59365 records to 40649 (keeping 200 days of data) [2025-10-25T18:37:16.284312] [DEBUG] [LOCAL ] AHH: Primary data saved (40649 records). [2025-10-25T18:37:16.284526] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-25T18:37:16.284671] [INFO ] [MAIN ] Update Progress: 60/2366 symbols. AHH took 19.0s. Estimated remaining time: 7h 59m 14s [2025-10-25T18:37:16.476509] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:37:16.476820] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-25T18:37:16.476898] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-25T18:37:16.477028] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-25T18:37:16.477104] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-25T18:37:16.477215] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-25T18:37:16.477291] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-25T18:37:16.860215] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:37:16.860700] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-25T18:37:17.148856] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:37:17.149207] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-25T18:37:17.149319] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:37:17.149405] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-25T18:37:17.149474] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:37:17.149550] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-25T18:37:17.149666] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-25T18:37:17.149742] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-25T18:37:17.149823] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-25T18:37:17.149908] [INFO ] [MAIN ] Update Progress: 61/2366 symbols. AHL took 0.9s. Estimated remaining time: 7h 51m 43s [2025-10-25T18:37:17.339705] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:37:17.340067] [DEBUG] [LOCAL ] AHR: No existing data file found in primary storage. [2025-10-25T18:37:17.340145] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-10-25T18:37:17.340305] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-25T18:37:17.340380] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-25T18:37:17.340466] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-25T18:37:17.340539] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-25T18:37:17.717319] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:37:17.717765] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-25T18:37:19.694213] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-25T18:37:19.705084] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-25T18:37:21.320396] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T18:37:21.330050] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-25T18:37:23.135242] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T18:37:23.145555] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-25T18:37:24.018501] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T18:37:24.029024] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-25T18:37:25.207587] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T18:37:25.218597] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-25T18:37:26.098966] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T18:37:26.110533] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-25T18:37:26.992406] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T18:37:27.005370] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-25T18:37:28.009925] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T18:37:28.023462] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-25T18:37:29.145589] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T18:37:29.158178] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-25T18:37:30.078724] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T18:37:30.092509] [INFO ] [REMOTE ] AHR: Full fetch complete (70820 records). [2025-10-25T18:37:30.092873] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-25T18:37:30.618006] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-25T18:37:30.618206] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-25T18:37:30.619608] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-25T18:37:30.619785] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-25T18:37:30.622505] [DEBUG] [LOCAL ] AHR: Trimmed 70820 records to 49637 (keeping 200 days of data) [2025-10-25T18:37:30.942633] [DEBUG] [LOCAL ] AHR: Primary data saved (49637 records). [2025-10-25T18:37:30.942856] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-25T18:37:30.942979] [INFO ] [MAIN ] Update Progress: 62/2366 symbols. AHR took 13.8s. Estimated remaining time: 7h 52m 27s [2025-10-25T18:37:31.116988] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:37:31.117274] [DEBUG] [LOCAL ] AHT: No existing data file found in primary storage. [2025-10-25T18:37:31.117349] [WARN ] [MAIN ] AHT: No existing data found, performing full refresh instead. [2025-10-25T18:37:31.117474] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-25T18:37:31.117547] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-25T18:37:31.117680] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-10-25T18:37:31.117755] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-25T18:37:31.484790] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:37:31.485261] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-25T18:37:32.587206] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T18:37:32.589267] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-25T18:37:33.415830] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-25T18:37:33.419408] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-25T18:37:34.150829] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T18:37:34.152440] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-25T18:37:34.975082] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T18:37:34.977008] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-25T18:37:35.647959] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-25T18:37:35.650228] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-25T18:37:36.456092] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-25T18:37:36.458366] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-25T18:37:37.031926] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T18:37:37.034154] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-25T18:37:37.608929] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T18:37:37.611208] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-25T18:37:38.392442] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T18:37:38.394855] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-25T18:37:39.157354] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T18:37:39.159275] [INFO ] [REMOTE ] AHT: Full fetch complete (9043 records). [2025-10-25T18:37:39.159384] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-25T18:37:39.544443] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-25T18:37:39.544597] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-25T18:37:39.544916] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-25T18:37:39.545022] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-25T18:37:39.545818] [DEBUG] [LOCAL ] AHT: Trimmed 9043 records to 6490 (keeping 200 days of data) [2025-10-25T18:37:39.585945] [DEBUG] [LOCAL ] AHT: Primary data saved (6490 records). [2025-10-25T18:37:39.586184] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-25T18:37:39.586291] [INFO ] [MAIN ] Update Progress: 63/2366 symbols. AHT took 8.6s. Estimated remaining time: 7h 50m 1s [2025-10-25T18:37:39.783382] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:37:39.783833] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-25T18:37:39.783913] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-25T18:37:39.784066] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-25T18:37:39.784168] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-25T18:37:39.784256] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-25T18:37:39.784397] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-25T18:37:40.236120] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:37:40.236553] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-25T18:37:42.467224] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-25T18:37:42.478705] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-25T18:37:45.142465] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-25T18:37:45.153621] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-25T18:37:47.598009] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-25T18:37:47.609313] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-25T18:37:48.593591] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T18:37:48.607197] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-25T18:37:49.786224] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T18:37:49.798579] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-25T18:37:50.962795] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T18:37:50.975403] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-25T18:37:51.557744] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T18:37:51.570345] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-25T18:37:52.943827] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T18:37:52.956223] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-25T18:37:53.995330] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T18:37:54.007762] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-25T18:37:54.979505] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T18:37:54.991814] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-25T18:37:54.992129] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-25T18:37:55.400158] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-25T18:37:55.400289] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-25T18:37:55.401048] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-25T18:37:55.401132] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-25T18:37:55.402626] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 54544 (keeping 200 days of data) [2025-10-25T18:37:55.739570] [DEBUG] [LOCAL ] AI: Primary data saved (54544 records). [2025-10-25T18:37:55.740049] [INFO ] [MAIN ] AI: Full history saved. [2025-10-25T18:37:55.740174] [INFO ] [MAIN ] Update Progress: 64/2366 symbols. AI took 16.2s. Estimated remaining time: 7h 52m 9s [2025-10-25T18:37:55.914565] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:37:55.914835] [DEBUG] [LOCAL ] AIG: No existing data file found in primary storage. [2025-10-25T18:37:55.914909] [WARN ] [MAIN ] AIG: No existing data found, performing full refresh instead. [2025-10-25T18:37:55.915035] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-25T18:37:55.915109] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-25T18:37:55.915170] [DEBUG] [LOCAL ] AIG: No primary data file found to delete. [2025-10-25T18:37:55.915236] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-25T18:37:56.288004] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:37:56.288432] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-25T18:37:58.359851] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-25T18:37:58.370206] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-25T18:38:00.040083] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T18:38:00.051202] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-25T18:38:02.298254] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-25T18:38:02.309452] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-25T18:38:03.966702] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T18:38:03.978075] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-25T18:38:05.046584] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T18:38:05.058047] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-25T18:38:06.074055] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T18:38:06.084908] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-25T18:38:07.235807] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T18:38:07.248073] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-25T18:38:08.120531] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T18:38:08.131884] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-25T18:38:09.105091] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T18:38:09.116506] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-25T18:38:09.714097] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T18:38:09.723959] [INFO ] [REMOTE ] AIG: Full fetch complete (77564 records). [2025-10-25T18:38:09.724156] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-25T18:38:10.117917] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-25T18:38:10.118081] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-25T18:38:10.118914] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-25T18:38:10.119018] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-25T18:38:10.120561] [DEBUG] [LOCAL ] AIG: Trimmed 77564 records to 54234 (keeping 200 days of data) [2025-10-25T18:38:10.440043] [DEBUG] [LOCAL ] AIG: Primary data saved (54234 records). [2025-10-25T18:38:10.440261] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-25T18:38:10.440390] [INFO ] [MAIN ] Update Progress: 65/2366 symbols. AIG took 14.7s. Estimated remaining time: 7h 53m 22s [2025-10-25T18:38:10.611702] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:38:10.611928] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-25T18:38:10.612015] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-25T18:38:10.612154] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-25T18:38:10.612253] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-25T18:38:10.612370] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-25T18:38:10.612458] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-25T18:38:10.971630] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:38:10.972277] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-25T18:38:11.279994] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:38:11.280325] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-25T18:38:11.280431] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:38:11.280530] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-25T18:38:11.280682] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:38:11.280787] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-25T18:38:11.280916] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-25T18:38:11.281009] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-25T18:38:11.281134] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-25T18:38:11.281274] [INFO ] [MAIN ] Update Progress: 66/2366 symbols. AII took 0.8s. Estimated remaining time: 7h 46m 29s [2025-10-25T18:38:11.453742] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:38:11.453986] [DEBUG] [LOCAL ] AIN: No existing data file found in primary storage. [2025-10-25T18:38:11.454072] [WARN ] [MAIN ] AIN: No existing data found, performing full refresh instead. [2025-10-25T18:38:11.454212] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-25T18:38:11.454331] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-25T18:38:11.454443] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-10-25T18:38:11.454531] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-25T18:38:11.805758] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:38:11.806067] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-25T18:38:12.943019] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T18:38:12.947366] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-25T18:38:14.110125] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T18:38:14.114051] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-25T18:38:15.451026] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T18:38:15.460062] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-25T18:38:16.936991] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T18:38:16.943296] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-25T18:38:18.204792] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T18:38:18.213337] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-25T18:38:19.388717] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T18:38:19.394359] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-25T18:38:20.710242] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-25T18:38:20.716046] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-25T18:38:21.980997] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T18:38:21.987028] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-25T18:38:23.139784] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T18:38:23.146849] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-25T18:38:24.515983] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T18:38:24.520823] [INFO ] [REMOTE ] AIN: Full fetch complete (33705 records). [2025-10-25T18:38:24.520939] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-25T18:38:24.925203] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-25T18:38:24.925322] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-25T18:38:24.925807] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-25T18:38:24.925888] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-25T18:38:24.927078] [DEBUG] [LOCAL ] AIN: Trimmed 33705 records to 24638 (keeping 200 days of data) [2025-10-25T18:38:25.079963] [DEBUG] [LOCAL ] AIN: Primary data saved (24638 records). [2025-10-25T18:38:25.080133] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-25T18:38:25.080251] [INFO ] [MAIN ] Update Progress: 67/2366 symbols. AIN took 13.8s. Estimated remaining time: 7h 47m 12s [2025-10-25T18:38:25.274153] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:38:25.274534] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-25T18:38:25.274634] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-25T18:38:25.274829] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-25T18:38:25.274922] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-25T18:38:25.275037] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-25T18:38:25.275169] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-25T18:38:25.638746] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:38:25.639108] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-25T18:38:26.918045] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T18:38:26.922006] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-25T18:38:27.981594] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T18:38:27.985143] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-25T18:38:28.984821] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-25T18:38:28.991794] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-25T18:38:30.072146] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T18:38:30.076674] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-25T18:38:30.902995] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T18:38:30.906526] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-25T18:38:32.015509] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T18:38:32.021313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-25T18:38:32.976583] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T18:38:32.980010] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-25T18:38:33.830916] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T18:38:33.834273] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-25T18:38:34.497088] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T18:38:34.501898] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-25T18:38:35.243440] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T18:38:35.246687] [INFO ] [REMOTE ] AIO: Full fetch complete (20042 records). [2025-10-25T18:38:35.246805] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-25T18:38:35.670371] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-25T18:38:35.670492] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-25T18:38:35.670839] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-25T18:38:35.670913] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-25T18:38:35.671674] [DEBUG] [LOCAL ] AIO: Trimmed 20042 records to 13183 (keeping 200 days of data) [2025-10-25T18:38:35.749376] [DEBUG] [LOCAL ] AIO: Primary data saved (13183 records). [2025-10-25T18:38:35.749546] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-25T18:38:35.749682] [INFO ] [MAIN ] Update Progress: 68/2366 symbols. AIO took 10.7s. Estimated remaining time: 7h 46m 9s [2025-10-25T18:38:35.927075] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:38:35.927309] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-25T18:38:35.927379] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-25T18:38:35.927492] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-25T18:38:35.927561] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-25T18:38:35.927639] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-25T18:38:35.927731] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-25T18:38:36.327926] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:38:36.328287] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-25T18:38:37.394733] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T18:38:37.400496] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-25T18:38:38.541611] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T18:38:38.546093] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-25T18:38:39.772835] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-25T18:38:39.782338] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-25T18:38:41.197179] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T18:38:41.203958] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-25T18:38:42.386232] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T18:38:42.391900] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-25T18:38:43.522382] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T18:38:43.528042] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-25T18:38:45.088926] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-25T18:38:45.097831] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-25T18:38:46.545347] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T18:38:46.552270] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-25T18:38:47.970492] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T18:38:47.977844] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-25T18:38:49.349032] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T18:38:49.355596] [INFO ] [REMOTE ] AIR: Full fetch complete (40316 records). [2025-10-25T18:38:49.355802] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-25T18:38:49.739854] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-25T18:38:49.740005] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-25T18:38:49.740567] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-25T18:38:49.740678] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-25T18:38:49.741783] [DEBUG] [LOCAL ] AIR: Trimmed 40316 records to 29010 (keeping 200 days of data) [2025-10-25T18:38:49.903763] [DEBUG] [LOCAL ] AIR: Primary data saved (29010 records). [2025-10-25T18:38:49.903908] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-25T18:38:49.904009] [INFO ] [MAIN ] Update Progress: 69/2366 symbols. AIR took 14.2s. Estimated remaining time: 7h 47m 3s [2025-10-25T18:38:50.071018] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:38:50.071166] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-10-25T18:38:50.071232] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-10-25T18:38:50.071332] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-25T18:38:50.071399] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-25T18:38:50.071476] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-10-25T18:38:50.071527] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-25T18:38:50.431428] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:38:50.431781] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-25T18:38:51.770090] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T18:38:51.776053] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-25T18:38:53.145004] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T18:38:53.153538] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-25T18:38:54.721319] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T18:38:54.732278] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-25T18:38:55.966881] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T18:38:55.975215] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-25T18:38:57.365686] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T18:38:57.372696] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-25T18:38:58.768354] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-25T18:38:58.775439] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-25T18:39:00.159168] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T18:39:00.166163] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-25T18:39:01.865022] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T18:39:01.870969] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-25T18:39:03.694397] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T18:39:03.698868] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-25T18:39:04.900740] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T18:39:04.905193] [INFO ] [REMOTE ] AIT: Full fetch complete (39017 records). [2025-10-25T18:39:04.905358] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-25T18:39:05.285437] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-25T18:39:05.285558] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-25T18:39:05.286065] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-25T18:39:05.286146] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-25T18:39:05.287268] [DEBUG] [LOCAL ] AIT: Trimmed 39017 records to 26948 (keeping 200 days of data) [2025-10-25T18:39:05.448352] [DEBUG] [LOCAL ] AIT: Primary data saved (26948 records). [2025-10-25T18:39:05.448538] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-25T18:39:05.448671] [INFO ] [MAIN ] Update Progress: 70/2366 symbols. AIT took 15.5s. Estimated remaining time: 7h 48m 40s [2025-10-25T18:39:05.621123] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:39:05.621348] [DEBUG] [LOCAL ] AIV: No existing data file found in primary storage. [2025-10-25T18:39:05.621418] [WARN ] [MAIN ] AIV: No existing data found, performing full refresh instead. [2025-10-25T18:39:05.621530] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-25T18:39:05.621600] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-25T18:39:05.621721] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-10-25T18:39:05.621790] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-25T18:39:05.984185] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:39:05.984579] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-25T18:39:07.540093] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T18:39:07.549200] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-25T18:39:09.129505] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T18:39:09.137710] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-25T18:39:10.712492] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T18:39:10.724165] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-25T18:39:12.077891] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T18:39:12.086853] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-25T18:39:13.645681] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T18:39:13.653743] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-25T18:39:15.435806] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-25T18:39:15.445318] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-25T18:39:17.122738] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T18:39:17.131963] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-25T18:39:18.760858] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T18:39:18.770809] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-25T18:39:20.463331] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T18:39:20.473543] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-25T18:39:22.140104] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-25T18:39:22.149161] [INFO ] [REMOTE ] AIV: Full fetch complete (60371 records). [2025-10-25T18:39:22.149356] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-25T18:39:22.549127] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-25T18:39:22.549244] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-25T18:39:22.549890] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-25T18:39:22.549968] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-25T18:39:22.551266] [DEBUG] [LOCAL ] AIV: Trimmed 60371 records to 42538 (keeping 200 days of data) [2025-10-25T18:39:22.789753] [DEBUG] [LOCAL ] AIV: Primary data saved (42538 records). [2025-10-25T18:39:22.789908] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-25T18:39:22.789993] [INFO ] [MAIN ] Update Progress: 71/2366 symbols. AIV took 17.3s. Estimated remaining time: 7h 51m 13s [2025-10-25T18:39:22.963728] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:39:22.963919] [DEBUG] [LOCAL ] AIZ: No existing data file found in primary storage. [2025-10-25T18:39:22.963993] [WARN ] [MAIN ] AIZ: No existing data found, performing full refresh instead. [2025-10-25T18:39:22.964105] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-25T18:39:22.964178] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-25T18:39:22.964249] [DEBUG] [LOCAL ] AIZ: No primary data file found to delete. [2025-10-25T18:39:22.964320] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-25T18:39:23.350044] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:39:23.350449] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-25T18:39:24.679277] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-25T18:39:24.685305] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-25T18:39:26.057226] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T18:39:26.063777] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-25T18:39:27.637589] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T18:39:27.644924] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-25T18:39:29.184588] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T18:39:29.191705] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-25T18:39:31.185455] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T18:39:31.193593] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-25T18:39:32.626134] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T18:39:32.633066] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-25T18:39:34.079791] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T18:39:34.086002] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-25T18:39:35.614794] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T18:39:35.621861] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-25T18:39:36.792406] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T18:39:36.798716] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-25T18:39:38.095787] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-25T18:39:38.100512] [INFO ] [REMOTE ] AIZ: Full fetch complete (42723 records). [2025-10-25T18:39:38.100624] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-25T18:39:38.476443] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-25T18:39:38.476572] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-25T18:39:38.477059] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-25T18:39:38.477146] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-25T18:39:38.478111] [DEBUG] [LOCAL ] AIZ: Trimmed 42723 records to 29600 (keeping 200 days of data) [2025-10-25T18:39:38.655751] [DEBUG] [LOCAL ] AIZ: Primary data saved (29600 records). [2025-10-25T18:39:38.655903] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-25T18:39:38.656007] [INFO ] [MAIN ] Update Progress: 72/2366 symbols. AIZ took 15.9s. Estimated remaining time: 7h 52m 53s [2025-10-25T18:39:38.823196] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:39:38.823380] [DEBUG] [LOCAL ] AIZN: No existing data file found in primary storage. [2025-10-25T18:39:38.823449] [WARN ] [MAIN ] AIZN: No existing data found, performing full refresh instead. [2025-10-25T18:39:38.823560] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-25T18:39:38.823662] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-25T18:39:38.823747] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-10-25T18:39:38.823813] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-25T18:39:39.179691] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:39:39.180043] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-25T18:39:39.875624] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T18:39:39.877385] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-25T18:39:40.481753] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T18:39:40.482983] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-25T18:39:41.109706] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T18:39:41.111559] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-25T18:39:41.791758] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-25T18:39:41.793473] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-25T18:39:42.377759] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-25T18:39:42.379159] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-25T18:39:43.094226] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T18:39:43.096547] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-25T18:39:43.798902] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T18:39:43.800579] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-25T18:39:44.268729] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-25T18:39:44.270311] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-25T18:39:44.965337] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T18:39:44.968134] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-25T18:39:45.631925] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-25T18:39:45.634160] [INFO ] [REMOTE ] AIZN: Full fetch complete (5762 records). [2025-10-25T18:39:45.634280] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-25T18:39:46.023726] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-25T18:39:46.023882] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-25T18:39:46.024146] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-25T18:39:46.024230] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-25T18:39:46.024704] [DEBUG] [LOCAL ] AIZN: Trimmed 5762 records to 3851 (keeping 200 days of data) [2025-10-25T18:39:46.051914] [DEBUG] [LOCAL ] AIZN: Primary data saved (3851 records). [2025-10-25T18:39:46.052116] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-25T18:39:46.052258] [INFO ] [MAIN ] Update Progress: 73/2366 symbols. AIZN took 7.4s. Estimated remaining time: 7h 50m 5s [2025-10-25T18:39:46.226072] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:39:46.226360] [DEBUG] [LOCAL ] AJG: No existing data file found in primary storage. [2025-10-25T18:39:46.226442] [WARN ] [MAIN ] AJG: No existing data found, performing full refresh instead. [2025-10-25T18:39:46.226576] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-25T18:39:46.226686] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-25T18:39:46.226777] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-10-25T18:39:46.226850] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-25T18:39:46.680145] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:39:46.680590] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-25T18:39:48.449396] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T18:39:48.460679] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-25T18:39:49.969727] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T18:39:49.981070] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-25T18:39:51.792430] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T18:39:51.804333] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-25T18:39:53.700955] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-25T18:39:53.713514] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-25T18:39:55.407954] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T18:39:55.417511] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-25T18:39:57.291717] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-25T18:39:57.301865] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-25T18:39:58.978352] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T18:39:58.988235] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-25T18:40:00.755341] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T18:40:00.765575] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-25T18:40:03.625279] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-25T18:40:03.635360] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-25T18:40:05.315729] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T18:40:05.324222] [INFO ] [REMOTE ] AJG: Full fetch complete (68756 records). [2025-10-25T18:40:05.324399] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-25T18:40:05.726727] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-25T18:40:05.726847] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-25T18:40:05.727530] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-25T18:40:05.727611] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-25T18:40:05.729020] [DEBUG] [LOCAL ] AJG: Trimmed 68756 records to 47015 (keeping 200 days of data) [2025-10-25T18:40:06.024424] [DEBUG] [LOCAL ] AJG: Primary data saved (47015 records). [2025-10-25T18:40:06.024595] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-25T18:40:06.024730] [INFO ] [MAIN ] Update Progress: 74/2366 symbols. AJG took 20.0s. Estimated remaining time: 7h 53m 50s [2025-10-25T18:40:06.199248] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:40:06.199463] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-25T18:40:06.199538] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-25T18:40:06.199678] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-25T18:40:06.199754] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-25T18:40:06.199836] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-25T18:40:06.199908] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-25T18:40:06.572565] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:40:06.572907] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-25T18:40:07.062941] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-25T18:40:07.064150] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-25T18:40:07.681758] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T18:40:07.683009] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-25T18:40:08.393718] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T18:40:08.395066] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-25T18:40:08.987905] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-25T18:40:08.989063] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-25T18:40:09.723377] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-25T18:40:09.724935] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-25T18:40:10.251217] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-25T18:40:10.252425] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-25T18:40:10.754473] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-25T18:40:10.755383] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-25T18:40:11.408935] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-25T18:40:11.410164] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-25T18:40:11.915761] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-25T18:40:11.917015] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-25T18:40:12.707213] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T18:40:12.708711] [INFO ] [REMOTE ] AKA: Full fetch complete (2830 records). [2025-10-25T18:40:12.708820] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-25T18:40:12.909211] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T18:40:12.909426] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-25T18:40:12.909498] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-25T18:40:12.909573] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-25T18:40:12.909693] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-25T18:40:12.909765] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-25T18:40:12.909850] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-25T18:40:12.909946] [INFO ] [MAIN ] Update Progress: 75/2366 symbols. AKA took 6.9s. Estimated remaining time: 7h 50m 49s [2025-10-25T18:40:13.100543] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:40:13.100777] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-10-25T18:40:13.100852] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-10-25T18:40:13.100978] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-25T18:40:13.101052] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-25T18:40:13.101132] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-10-25T18:40:13.101201] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-25T18:40:13.459357] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:40:13.459710] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-25T18:40:15.260331] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T18:40:15.268831] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-25T18:40:16.867621] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T18:40:16.875684] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-25T18:40:18.407427] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T18:40:18.416891] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-25T18:40:19.279300] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T18:40:19.292174] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-25T18:40:20.422419] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T18:40:20.431498] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-25T18:40:21.412230] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T18:40:21.421923] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-25T18:40:22.457357] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T18:40:22.467920] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-25T18:40:23.382140] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T18:40:23.392904] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-25T18:40:24.481877] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T18:40:24.491784] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-25T18:40:25.345206] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T18:40:25.353710] [INFO ] [REMOTE ] AKR: Full fetch complete (65443 records). [2025-10-25T18:40:25.353851] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-25T18:40:25.742116] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-25T18:40:25.742255] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-25T18:40:25.742969] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-25T18:40:25.743067] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-25T18:40:25.744400] [DEBUG] [LOCAL ] AKR: Trimmed 65443 records to 46704 (keeping 200 days of data) [2025-10-25T18:40:26.017865] [DEBUG] [LOCAL ] AKR: Primary data saved (46704 records). [2025-10-25T18:40:26.018082] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-25T18:40:26.018207] [INFO ] [MAIN ] Update Progress: 76/2366 symbols. AKR took 13.1s. Estimated remaining time: 7h 51m 0s [2025-10-25T18:40:26.203597] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:40:26.203883] [DEBUG] [LOCAL ] AL: No existing data file found in primary storage. [2025-10-25T18:40:26.203954] [WARN ] [MAIN ] AL: No existing data found, performing full refresh instead. [2025-10-25T18:40:26.204072] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-25T18:40:26.204159] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-25T18:40:26.204259] [DEBUG] [LOCAL ] AL: No primary data file found to delete. [2025-10-25T18:40:26.204327] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-25T18:40:26.568147] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:40:26.568466] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-25T18:40:28.207458] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T18:40:28.215635] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-25T18:40:29.722627] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T18:40:29.731946] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-25T18:40:31.701722] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T18:40:31.711123] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-25T18:40:33.394583] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-25T18:40:33.404893] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-25T18:40:35.207352] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T18:40:35.217213] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-25T18:40:36.734320] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T18:40:36.742930] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-25T18:40:38.269604] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T18:40:38.278749] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-25T18:40:39.934897] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T18:40:39.943955] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-25T18:40:41.650096] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T18:40:41.660637] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-25T18:40:43.237522] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T18:40:43.246298] [INFO ] [REMOTE ] AL: Full fetch complete (63798 records). [2025-10-25T18:40:43.246447] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-25T18:40:43.689191] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-25T18:40:43.689334] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-25T18:40:43.690045] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-25T18:40:43.690135] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-25T18:40:43.691535] [DEBUG] [LOCAL ] AL: Trimmed 63798 records to 45506 (keeping 200 days of data) [2025-10-25T18:40:43.967987] [DEBUG] [LOCAL ] AL: Primary data saved (45506 records). [2025-10-25T18:40:43.968147] [INFO ] [MAIN ] AL: Full history saved. [2025-10-25T18:40:43.968255] [INFO ] [MAIN ] Update Progress: 77/2366 symbols. AL took 17.9s. Estimated remaining time: 7h 53m 35s [2025-10-25T18:40:44.146801] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:40:44.147003] [DEBUG] [LOCAL ] ALB: No existing data file found in primary storage. [2025-10-25T18:40:44.147074] [WARN ] [MAIN ] ALB: No existing data found, performing full refresh instead. [2025-10-25T18:40:44.147214] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-25T18:40:44.147390] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-25T18:40:44.147476] [DEBUG] [LOCAL ] ALB: No primary data file found to delete. [2025-10-25T18:40:44.147560] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-25T18:40:44.519740] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:40:44.520111] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-25T18:40:46.363011] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T18:40:46.373032] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-25T18:40:48.280686] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-25T18:40:48.290751] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-25T18:40:50.217839] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T18:40:50.233265] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-25T18:40:51.648354] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T18:40:51.659400] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-25T18:40:52.664073] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T18:40:52.675002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-25T18:40:53.615904] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T18:40:53.627079] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-25T18:40:54.880065] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T18:40:54.891829] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-25T18:40:55.986965] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T18:40:55.998475] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-25T18:40:56.656971] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T18:40:56.668367] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-25T18:40:57.585119] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T18:40:57.595149] [INFO ] [REMOTE ] ALB: Full fetch complete (77104 records). [2025-10-25T18:40:57.595337] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-25T18:40:57.992943] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-25T18:40:57.993057] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-25T18:40:57.993817] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-25T18:40:57.993899] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-25T18:40:57.995420] [DEBUG] [LOCAL ] ALB: Trimmed 77104 records to 54142 (keeping 200 days of data) [2025-10-25T18:40:58.309601] [DEBUG] [LOCAL ] ALB: Primary data saved (54142 records). [2025-10-25T18:40:58.309776] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-25T18:40:58.309895] [INFO ] [MAIN ] Update Progress: 78/2366 symbols. ALB took 14.3s. Estimated remaining time: 7h 54m 19s [2025-10-25T18:40:58.478692] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:40:58.478879] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-25T18:40:58.478950] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-25T18:40:58.479080] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-25T18:40:58.479161] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-25T18:40:58.479295] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-25T18:40:58.479428] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-25T18:40:58.835567] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:40:58.836015] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-25T18:41:00.739483] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T18:41:00.748966] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-25T18:41:03.320263] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-25T18:41:03.329865] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-25T18:41:05.267545] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T18:41:05.277801] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-25T18:41:06.351822] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T18:41:06.362971] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-25T18:41:07.209318] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T18:41:07.225898] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-25T18:41:08.275901] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T18:41:08.285910] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-25T18:41:09.212474] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T18:41:09.223411] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-25T18:41:10.165912] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T18:41:10.177282] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-25T18:41:10.970223] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T18:41:10.981217] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-25T18:41:11.847672] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T18:41:11.857284] [INFO ] [REMOTE ] ALC: Full fetch complete (73941 records). [2025-10-25T18:41:11.857472] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-25T18:41:12.242142] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-25T18:41:12.242267] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-25T18:41:12.243044] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-25T18:41:12.243135] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-25T18:41:12.244603] [DEBUG] [LOCAL ] ALC: Trimmed 73941 records to 51966 (keeping 200 days of data) [2025-10-25T18:41:12.554103] [DEBUG] [LOCAL ] ALC: Primary data saved (51966 records). [2025-10-25T18:41:12.554273] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-25T18:41:12.554386] [INFO ] [MAIN ] Update Progress: 79/2366 symbols. ALC took 14.2s. Estimated remaining time: 7h 54m 59s [2025-10-25T18:41:12.751440] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:41:12.751889] [DEBUG] [LOCAL ] ALE: No existing data file found in primary storage. [2025-10-25T18:41:12.751963] [WARN ] [MAIN ] ALE: No existing data found, performing full refresh instead. [2025-10-25T18:41:12.752078] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-25T18:41:12.752150] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-25T18:41:12.752239] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-10-25T18:41:12.752312] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-25T18:41:13.187123] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:41:13.187701] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-25T18:41:14.513621] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-25T18:41:14.519869] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-25T18:41:15.764938] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T18:41:15.770386] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-25T18:41:16.975403] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T18:41:16.981052] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-25T18:41:18.394421] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T18:41:18.401176] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-25T18:41:19.669988] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T18:41:19.675879] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-25T18:41:21.135810] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T18:41:21.141395] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-25T18:41:22.730240] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T18:41:22.738123] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-25T18:41:24.318743] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T18:41:24.326743] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-25T18:41:25.860162] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T18:41:25.868957] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-25T18:41:27.546565] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T18:41:27.553818] [INFO ] [REMOTE ] ALE: Full fetch complete (44374 records). [2025-10-25T18:41:27.553991] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-25T18:41:27.944984] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-25T18:41:27.945093] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-25T18:41:27.945587] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-25T18:41:27.945688] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-25T18:41:27.946607] [DEBUG] [LOCAL ] ALE: Trimmed 44374 records to 32460 (keeping 200 days of data) [2025-10-25T18:41:28.130469] [DEBUG] [LOCAL ] ALE: Primary data saved (32460 records). [2025-10-25T18:41:28.130622] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-25T18:41:28.130749] [INFO ] [MAIN ] Update Progress: 80/2366 symbols. ALE took 15.6s. Estimated remaining time: 7h 56m 15s [2025-10-25T18:41:28.302063] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:41:28.302276] [DEBUG] [LOCAL ] ALEX: No existing data file found in primary storage. [2025-10-25T18:41:28.302354] [WARN ] [MAIN ] ALEX: No existing data found, performing full refresh instead. [2025-10-25T18:41:28.302559] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-25T18:41:28.302674] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-25T18:41:28.302798] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-10-25T18:41:28.302872] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-25T18:41:28.662342] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:41:28.662779] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-25T18:41:29.935824] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T18:41:29.942082] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-25T18:41:31.371250] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T18:41:31.376520] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-25T18:41:33.417353] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T18:41:33.424950] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-25T18:41:35.151335] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T18:41:35.159505] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-25T18:41:36.614409] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T18:41:36.620846] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-25T18:41:38.025305] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-25T18:41:38.031584] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-25T18:41:39.459766] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T18:41:39.466956] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-25T18:41:40.739906] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T18:41:40.746031] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-25T18:41:42.257208] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T18:41:42.264308] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-25T18:41:43.780092] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-25T18:41:43.786060] [INFO ] [REMOTE ] ALEX: Full fetch complete (44539 records). [2025-10-25T18:41:43.786175] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-25T18:41:44.161976] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-25T18:41:44.162206] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-25T18:41:44.162733] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-25T18:41:44.162810] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-25T18:41:44.163801] [DEBUG] [LOCAL ] ALEX: Trimmed 44539 records to 31192 (keeping 200 days of data) [2025-10-25T18:41:44.367743] [DEBUG] [LOCAL ] ALEX: Primary data saved (31192 records). [2025-10-25T18:41:44.367901] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-25T18:41:44.368007] [INFO ] [MAIN ] Update Progress: 81/2366 symbols. ALEX took 16.2s. Estimated remaining time: 7h 57m 48s [2025-10-25T18:41:44.533427] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:41:44.533603] [DEBUG] [LOCAL ] ALG: No existing data file found in primary storage. [2025-10-25T18:41:44.533696] [WARN ] [MAIN ] ALG: No existing data found, performing full refresh instead. [2025-10-25T18:41:44.533809] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-25T18:41:44.533880] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-25T18:41:44.533965] [DEBUG] [LOCAL ] ALG: No primary data file found to delete. [2025-10-25T18:41:44.534033] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-25T18:41:44.936566] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:41:44.937081] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-25T18:41:45.890414] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T18:41:45.893349] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-25T18:41:46.939612] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T18:41:46.942431] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-25T18:41:47.749593] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T18:41:47.753135] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-25T18:41:48.881700] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T18:41:48.884790] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-25T18:41:49.971794] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T18:41:49.974463] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-25T18:41:50.874800] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T18:41:50.878405] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-25T18:41:51.847270] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T18:41:51.850195] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-25T18:41:52.737927] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T18:41:52.740317] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-25T18:41:53.640693] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T18:41:53.643088] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-25T18:41:54.496969] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T18:41:54.498922] [INFO ] [REMOTE ] ALG: Full fetch complete (15198 records). [2025-10-25T18:41:54.499014] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-25T18:41:54.866191] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-25T18:41:54.866303] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-25T18:41:54.866558] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-25T18:41:54.866633] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-25T18:41:54.867157] [DEBUG] [LOCAL ] ALG: Trimmed 15198 records to 9813 (keeping 200 days of data) [2025-10-25T18:41:54.928729] [DEBUG] [LOCAL ] ALG: Primary data saved (9813 records). [2025-10-25T18:41:54.928883] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-25T18:41:54.929005] [INFO ] [MAIN ] Update Progress: 82/2366 symbols. ALG took 10.6s. Estimated remaining time: 7h 56m 40s [2025-10-25T18:41:55.101505] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:41:55.101739] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-25T18:41:55.101812] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-25T18:41:55.101926] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-25T18:41:55.101998] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-25T18:41:55.102080] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-25T18:41:55.102150] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-25T18:41:55.469937] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:41:55.470260] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-25T18:41:55.759940] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:41:55.760297] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-25T18:41:55.760404] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:41:55.760486] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-25T18:41:55.760553] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:41:55.760627] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-25T18:41:55.760736] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-25T18:41:55.760804] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-25T18:41:55.760882] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-25T18:41:55.760964] [INFO ] [MAIN ] Update Progress: 83/2366 symbols. ALH took 0.8s. Estimated remaining time: 7h 51m 6s [2025-10-25T18:41:55.929026] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:41:55.929226] [DEBUG] [LOCAL ] ALIT: No existing data file found in primary storage. [2025-10-25T18:41:55.929296] [WARN ] [MAIN ] ALIT: No existing data found, performing full refresh instead. [2025-10-25T18:41:55.929406] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-25T18:41:55.929478] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-25T18:41:55.929556] [DEBUG] [LOCAL ] ALIT: No primary data file found to delete. [2025-10-25T18:41:55.929624] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-25T18:41:56.283290] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:41:56.283669] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-25T18:41:57.958979] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T18:41:57.969491] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-25T18:41:59.597089] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T18:41:59.609671] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-25T18:42:01.463575] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T18:42:01.475665] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-25T18:42:03.102019] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T18:42:03.115810] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-25T18:42:04.372459] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T18:42:04.388527] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-25T18:42:05.449103] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T18:42:05.459546] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-25T18:42:06.673577] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T18:42:06.685758] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-25T18:42:07.757699] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T18:42:07.772163] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-25T18:42:08.820454] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T18:42:08.831497] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-25T18:42:09.799887] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T18:42:09.809550] [INFO ] [REMOTE ] ALIT: Full fetch complete (76626 records). [2025-10-25T18:42:09.809741] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-25T18:42:10.195038] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-25T18:42:10.195172] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-25T18:42:10.195940] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-25T18:42:10.196036] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-25T18:42:10.197504] [DEBUG] [LOCAL ] ALIT: Trimmed 76626 records to 53550 (keeping 200 days of data) [2025-10-25T18:42:10.487148] [DEBUG] [LOCAL ] ALIT: Primary data saved (53550 records). [2025-10-25T18:42:10.487342] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-25T18:42:10.487469] [INFO ] [MAIN ] Update Progress: 84/2366 symbols. ALIT took 14.7s. Estimated remaining time: 7h 51m 57s [2025-10-25T18:42:10.658466] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:42:10.658683] [DEBUG] [LOCAL ] ALK: No existing data file found in primary storage. [2025-10-25T18:42:10.658769] [WARN ] [MAIN ] ALK: No existing data found, performing full refresh instead. [2025-10-25T18:42:10.658976] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-25T18:42:10.659078] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-25T18:42:10.659194] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-10-25T18:42:10.659359] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-25T18:42:11.006867] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:42:11.007294] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-25T18:42:12.803633] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T18:42:12.814286] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-25T18:42:14.758226] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T18:42:14.767958] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-25T18:42:16.795064] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-25T18:42:16.806120] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-25T18:42:17.802677] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T18:42:17.814837] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-25T18:42:18.475731] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T18:42:18.486985] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-25T18:42:19.447633] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T18:42:19.458512] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-25T18:42:20.164353] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T18:42:20.175663] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-25T18:42:21.455598] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T18:42:21.466550] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-25T18:42:22.504721] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T18:42:22.516113] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-25T18:42:23.491353] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T18:42:23.504395] [INFO ] [REMOTE ] ALK: Full fetch complete (77039 records). [2025-10-25T18:42:23.504588] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-25T18:42:23.931632] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-25T18:42:23.931785] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-25T18:42:23.932514] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-25T18:42:23.932593] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-25T18:42:23.934126] [DEBUG] [LOCAL ] ALK: Trimmed 77039 records to 53867 (keeping 200 days of data) [2025-10-25T18:42:24.233698] [DEBUG] [LOCAL ] ALK: Primary data saved (53867 records). [2025-10-25T18:42:24.233851] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-25T18:42:24.233968] [INFO ] [MAIN ] Update Progress: 85/2366 symbols. ALK took 13.7s. Estimated remaining time: 7h 52m 21s [2025-10-25T18:42:24.402081] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:42:24.402253] [DEBUG] [LOCAL ] ALL: No existing data file found in primary storage. [2025-10-25T18:42:24.402323] [WARN ] [MAIN ] ALL: No existing data found, performing full refresh instead. [2025-10-25T18:42:24.402433] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-25T18:42:24.402503] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-25T18:42:24.402583] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-25T18:42:24.402674] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-25T18:42:24.747778] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:42:24.748092] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-25T18:42:26.461922] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T18:42:26.472801] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-25T18:42:28.165429] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T18:42:28.175319] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-25T18:42:30.119583] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T18:42:30.130484] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-25T18:42:32.092178] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-25T18:42:32.102698] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-25T18:42:34.134960] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-25T18:42:34.145494] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-25T18:42:35.756343] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T18:42:35.766820] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-25T18:42:37.720595] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-25T18:42:37.732727] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-25T18:42:39.517077] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T18:42:39.527332] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-25T18:42:40.476816] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T18:42:40.487307] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-25T18:42:42.167592] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T18:42:42.176295] [INFO ] [REMOTE ] ALL: Full fetch complete (72369 records). [2025-10-25T18:42:42.176454] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-25T18:42:42.564938] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-25T18:42:42.565075] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-25T18:42:42.565881] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-25T18:42:42.565962] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-25T18:42:42.567720] [DEBUG] [LOCAL ] ALL: Trimmed 72369 records to 50286 (keeping 200 days of data) [2025-10-25T18:42:42.866659] [DEBUG] [LOCAL ] ALL: Primary data saved (50286 records). [2025-10-25T18:42:42.866820] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-25T18:42:42.866925] [INFO ] [MAIN ] Update Progress: 86/2366 symbols. ALL took 18.6s. Estimated remaining time: 7h 54m 53s [2025-10-25T18:42:43.034003] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:42:43.034184] [DEBUG] [LOCAL ] ALLE: No existing data file found in primary storage. [2025-10-25T18:42:43.034253] [WARN ] [MAIN ] ALLE: No existing data found, performing full refresh instead. [2025-10-25T18:42:43.034364] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-25T18:42:43.034452] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-25T18:42:43.034533] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-25T18:42:43.034599] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-25T18:42:43.384714] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:42:43.385074] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-25T18:42:44.955594] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T18:42:44.964028] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-25T18:42:46.677015] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T18:42:46.687092] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-25T18:42:48.332360] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T18:42:48.342001] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-25T18:42:50.083151] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T18:42:50.092975] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-25T18:42:51.854519] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T18:42:51.864596] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-25T18:42:53.467580] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T18:42:53.476671] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-25T18:42:55.233723] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-25T18:42:55.243934] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-25T18:42:56.985343] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T18:42:56.994893] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-25T18:42:58.603271] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T18:42:58.612243] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-25T18:43:00.331142] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-25T18:43:00.338845] [INFO ] [REMOTE ] ALLE: Full fetch complete (64928 records). [2025-10-25T18:43:00.338990] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-25T18:43:00.729350] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-25T18:43:00.729463] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-25T18:43:00.730119] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-25T18:43:00.730198] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-25T18:43:00.731429] [DEBUG] [LOCAL ] ALLE: Trimmed 64928 records to 44606 (keeping 200 days of data) [2025-10-25T18:43:01.002328] [DEBUG] [LOCAL ] ALLE: Primary data saved (44606 records). [2025-10-25T18:43:01.002505] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-25T18:43:01.002618] [INFO ] [MAIN ] Update Progress: 87/2366 symbols. ALLE took 18.1s. Estimated remaining time: 7h 57m 8s [2025-10-25T18:43:01.173096] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:43:01.173313] [DEBUG] [LOCAL ] ALLY: No existing data file found in primary storage. [2025-10-25T18:43:01.173385] [WARN ] [MAIN ] ALLY: No existing data found, performing full refresh instead. [2025-10-25T18:43:01.173505] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-25T18:43:01.173577] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-25T18:43:01.173679] [DEBUG] [LOCAL ] ALLY: No primary data file found to delete. [2025-10-25T18:43:01.173749] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-25T18:43:01.534057] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:43:01.534387] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-25T18:43:03.680448] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-25T18:43:03.692090] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-25T18:43:05.408639] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T18:43:05.419047] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-25T18:43:07.515950] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T18:43:07.527149] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-25T18:43:08.729402] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T18:43:08.740548] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-25T18:43:09.901725] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T18:43:09.912601] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-25T18:43:10.847970] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T18:43:10.858622] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-25T18:43:11.821441] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T18:43:11.834390] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-25T18:43:12.896952] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T18:43:12.908487] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-25T18:43:13.955634] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T18:43:13.966906] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-25T18:43:14.909342] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T18:43:14.918917] [INFO ] [REMOTE ] ALLY: Full fetch complete (77255 records). [2025-10-25T18:43:14.919068] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-25T18:43:15.311115] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-25T18:43:15.311243] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-25T18:43:15.312010] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-25T18:43:15.312091] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-25T18:43:15.313545] [DEBUG] [LOCAL ] ALLY: Trimmed 77255 records to 53998 (keeping 200 days of data) [2025-10-25T18:43:15.622864] [DEBUG] [LOCAL ] ALLY: Primary data saved (53998 records). [2025-10-25T18:43:15.623012] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-25T18:43:15.623117] [INFO ] [MAIN ] Update Progress: 88/2366 symbols. ALLY took 14.6s. Estimated remaining time: 7h 57m 49s [2025-10-25T18:43:15.790597] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:43:15.790782] [DEBUG] [LOCAL ] ALSN: No existing data file found in primary storage. [2025-10-25T18:43:15.790852] [WARN ] [MAIN ] ALSN: No existing data found, performing full refresh instead. [2025-10-25T18:43:15.790963] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-25T18:43:15.791040] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-25T18:43:15.791121] [DEBUG] [LOCAL ] ALSN: No primary data file found to delete. [2025-10-25T18:43:15.791190] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-25T18:43:16.142966] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:43:16.143284] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-25T18:43:17.657364] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T18:43:17.665156] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-25T18:43:19.355031] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T18:43:19.363426] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-25T18:43:21.146127] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T18:43:21.155724] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-25T18:43:22.767617] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T18:43:22.777291] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-25T18:43:24.336041] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T18:43:24.344576] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-25T18:43:25.928895] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T18:43:25.937794] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-25T18:43:27.606578] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-25T18:43:27.615982] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-25T18:43:29.324959] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T18:43:29.334461] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-25T18:43:30.910471] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T18:43:30.920035] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-25T18:43:32.768845] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-25T18:43:32.777015] [INFO ] [REMOTE ] ALSN: Full fetch complete (62778 records). [2025-10-25T18:43:32.777241] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-25T18:43:33.162282] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-25T18:43:33.162407] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-25T18:43:33.163052] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-25T18:43:33.163131] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-25T18:43:33.164376] [DEBUG] [LOCAL ] ALSN: Trimmed 62778 records to 43809 (keeping 200 days of data) [2025-10-25T18:43:33.420802] [DEBUG] [LOCAL ] ALSN: Primary data saved (43809 records). [2025-10-25T18:43:33.420964] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-25T18:43:33.421070] [INFO ] [MAIN ] Update Progress: 89/2366 symbols. ALSN took 17.8s. Estimated remaining time: 7h 59m 50s [2025-10-25T18:43:33.590252] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:43:33.590477] [DEBUG] [LOCAL ] ALTG: No existing data file found in primary storage. [2025-10-25T18:43:33.590548] [WARN ] [MAIN ] ALTG: No existing data found, performing full refresh instead. [2025-10-25T18:43:33.590688] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-25T18:43:33.590762] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-25T18:43:33.590843] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-10-25T18:43:33.590912] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-25T18:43:33.946699] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:43:33.947126] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-25T18:43:35.038931] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T18:43:35.042880] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-25T18:43:36.388433] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T18:43:36.393124] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-25T18:43:37.681585] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T18:43:37.687995] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-25T18:43:38.968199] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T18:43:38.973427] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-25T18:43:40.047600] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T18:43:40.052108] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-25T18:43:40.929602] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T18:43:40.934779] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-25T18:43:42.305891] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T18:43:42.312460] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-25T18:43:43.577147] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T18:43:43.583323] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-25T18:43:44.679133] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T18:43:44.684951] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-25T18:43:45.810764] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T18:43:45.814883] [INFO ] [REMOTE ] ALTG: Full fetch complete (33363 records). [2025-10-25T18:43:45.814975] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-25T18:43:46.178074] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-25T18:43:46.178201] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-25T18:43:46.178584] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-25T18:43:46.178683] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-25T18:43:46.179444] [DEBUG] [LOCAL ] ALTG: Trimmed 33363 records to 23319 (keeping 200 days of data) [2025-10-25T18:43:46.300954] [DEBUG] [LOCAL ] ALTG: Primary data saved (23319 records). [2025-10-25T18:43:46.301102] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-25T18:43:46.301207] [INFO ] [MAIN ] Update Progress: 90/2366 symbols. ALTG took 12.9s. Estimated remaining time: 7h 59m 43s [2025-10-25T18:43:46.468535] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:43:46.468807] [DEBUG] [LOCAL ] ALUR: No existing data file found in primary storage. [2025-10-25T18:43:46.468879] [WARN ] [MAIN ] ALUR: No existing data found, performing full refresh instead. [2025-10-25T18:43:46.468991] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-25T18:43:46.469061] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-25T18:43:46.469142] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-10-25T18:43:46.469211] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-25T18:43:46.814982] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:43:46.815348] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-25T18:43:48.089385] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T18:43:48.094437] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-25T18:43:49.269777] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-25T18:43:49.274198] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-25T18:43:50.509878] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T18:43:50.514357] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-25T18:43:51.394290] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T18:43:51.397401] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-25T18:43:52.477439] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T18:43:52.481569] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-25T18:43:53.388463] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T18:43:53.391428] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-25T18:43:54.316129] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T18:43:54.319591] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-25T18:43:55.189372] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T18:43:55.191783] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-25T18:43:55.882488] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T18:43:55.885061] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-25T18:43:56.714864] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T18:43:56.717966] [INFO ] [REMOTE ] ALUR: Full fetch complete (18282 records). [2025-10-25T18:43:56.718137] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-25T18:43:57.097490] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-25T18:43:57.097607] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-25T18:43:57.097922] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-25T18:43:57.097997] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-25T18:43:57.098611] [DEBUG] [LOCAL ] ALUR: Trimmed 18282 records to 9342 (keeping 200 days of data) [2025-10-25T18:43:57.149514] [DEBUG] [LOCAL ] ALUR: Primary data saved (9342 records). [2025-10-25T18:43:57.149712] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-25T18:43:57.149821] [INFO ] [MAIN ] Update Progress: 91/2366 symbols. ALUR took 10.8s. Estimated remaining time: 7h 58m 46s [2025-10-25T18:43:57.324449] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:43:57.324685] [DEBUG] [LOCAL ] ALV: No existing data file found in primary storage. [2025-10-25T18:43:57.324755] [WARN ] [MAIN ] ALV: No existing data found, performing full refresh instead. [2025-10-25T18:43:57.324871] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-25T18:43:57.324942] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-25T18:43:57.325024] [DEBUG] [LOCAL ] ALV: No primary data file found to delete. [2025-10-25T18:43:57.325073] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-25T18:43:57.697944] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:43:57.698308] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-25T18:43:59.302994] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T18:43:59.312274] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-25T18:44:01.277562] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-25T18:44:01.286881] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-25T18:44:03.777909] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-25T18:44:03.787335] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-25T18:44:05.568070] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T18:44:05.578550] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-25T18:44:07.093954] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T18:44:07.102876] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-25T18:44:08.709520] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T18:44:08.718567] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-25T18:44:10.589223] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-25T18:44:10.599142] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-25T18:44:12.240339] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T18:44:12.248949] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-25T18:44:13.956390] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T18:44:13.966443] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-25T18:44:15.774835] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-25T18:44:15.783122] [INFO ] [REMOTE ] ALV: Full fetch complete (62449 records). [2025-10-25T18:44:15.783323] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-25T18:44:16.190626] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-25T18:44:16.190759] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-25T18:44:16.191367] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-25T18:44:16.191443] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-25T18:44:16.192696] [DEBUG] [LOCAL ] ALV: Trimmed 62449 records to 42871 (keeping 200 days of data) [2025-10-25T18:44:16.446954] [DEBUG] [LOCAL ] ALV: Primary data saved (42871 records). [2025-10-25T18:44:16.447104] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-25T18:44:16.447244] [INFO ] [MAIN ] Update Progress: 92/2366 symbols. ALV took 19.3s. Estimated remaining time: 8h 1m 18s [2025-10-25T18:44:16.619899] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:44:16.620115] [DEBUG] [LOCAL ] ALX: No existing data file found in primary storage. [2025-10-25T18:44:16.620205] [WARN ] [MAIN ] ALX: No existing data found, performing full refresh instead. [2025-10-25T18:44:16.620341] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-25T18:44:16.620438] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-25T18:44:16.620549] [DEBUG] [LOCAL ] ALX: No primary data file found to delete. [2025-10-25T18:44:16.620636] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-25T18:44:16.976135] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:44:16.976476] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-25T18:44:17.564957] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-25T18:44:17.565966] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-25T18:44:18.176921] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T18:44:18.178233] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-25T18:44:18.762677] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T18:44:18.763795] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-25T18:44:19.451220] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-25T18:44:19.452378] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-25T18:44:20.154504] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-25T18:44:20.156434] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-25T18:44:21.041298] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T18:44:21.044375] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-25T18:44:21.849014] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-25T18:44:21.851372] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-25T18:44:22.782053] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T18:44:22.784465] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-25T18:44:23.665502] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-25T18:44:23.667892] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-25T18:44:24.588253] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T18:44:24.590742] [INFO ] [REMOTE ] ALX: Full fetch complete (8266 records). [2025-10-25T18:44:24.590839] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-25T18:44:24.958995] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-25T18:44:24.959110] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-25T18:44:24.959334] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-25T18:44:24.959410] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-25T18:44:24.959896] [DEBUG] [LOCAL ] ALX: Trimmed 8266 records to 7452 (keeping 200 days of data) [2025-10-25T18:44:25.004201] [DEBUG] [LOCAL ] ALX: Primary data saved (7452 records). [2025-10-25T18:44:25.004340] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-25T18:44:25.004451] [INFO ] [MAIN ] Update Progress: 93/2366 symbols. ALX took 8.6s. Estimated remaining time: 7h 59m 24s [2025-10-25T18:44:25.169351] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:44:25.169556] [DEBUG] [LOCAL ] AM: No existing data file found in primary storage. [2025-10-25T18:44:25.169670] [WARN ] [MAIN ] AM: No existing data found, performing full refresh instead. [2025-10-25T18:44:25.169778] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-25T18:44:25.169845] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-25T18:44:25.169930] [DEBUG] [LOCAL ] AM: No primary data file found to delete. [2025-10-25T18:44:25.170013] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-25T18:44:25.562687] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:44:25.563032] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-25T18:44:27.357091] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T18:44:27.367873] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-25T18:44:29.219450] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-25T18:44:29.229570] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-25T18:44:31.038460] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T18:44:31.049240] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-25T18:44:32.046484] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T18:44:32.057530] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-25T18:44:33.075510] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:44:33.086359] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-25T18:44:33.998908] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T18:44:34.009822] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-25T18:44:34.929244] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T18:44:34.940367] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-25T18:44:35.909541] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T18:44:35.921533] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-25T18:44:36.920281] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T18:44:36.931265] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-25T18:44:37.839617] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T18:44:37.849280] [INFO ] [REMOTE ] AM: Full fetch complete (75659 records). [2025-10-25T18:44:37.849475] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-25T18:44:38.251043] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-25T18:44:38.251194] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-25T18:44:38.252054] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-25T18:44:38.252155] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-25T18:44:38.253709] [DEBUG] [LOCAL ] AM: Trimmed 75659 records to 52592 (keeping 200 days of data) [2025-10-25T18:44:38.577096] [DEBUG] [LOCAL ] AM: Primary data saved (52592 records). [2025-10-25T18:44:38.577294] [INFO ] [MAIN ] AM: Full history saved. [2025-10-25T18:44:38.577404] [INFO ] [MAIN ] Update Progress: 94/2366 symbols. AM took 13.6s. Estimated remaining time: 7h 59m 33s [2025-10-25T18:44:38.749637] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:44:38.749883] [DEBUG] [LOCAL ] AMBC: No existing data file found in primary storage. [2025-10-25T18:44:38.749957] [WARN ] [MAIN ] AMBC: No existing data found, performing full refresh instead. [2025-10-25T18:44:38.750071] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-25T18:44:38.750143] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-25T18:44:38.750219] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-10-25T18:44:38.750287] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-25T18:44:39.100668] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:44:39.100994] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-25T18:44:40.303563] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-25T18:44:40.309326] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-25T18:44:41.591219] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-25T18:44:41.597786] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-25T18:44:43.183480] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T18:44:43.197724] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-25T18:44:44.771428] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T18:44:44.779959] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-25T18:44:46.195268] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T18:44:46.203262] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-25T18:44:47.753742] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T18:44:47.761162] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-25T18:44:49.236753] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T18:44:49.246396] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-25T18:44:50.598066] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T18:44:50.605662] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-25T18:44:52.020728] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T18:44:52.027634] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-25T18:44:53.564488] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T18:44:53.571367] [INFO ] [REMOTE ] AMBC: Full fetch complete (51887 records). [2025-10-25T18:44:53.571551] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-25T18:44:53.965897] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-25T18:44:53.966020] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-25T18:44:53.966582] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-25T18:44:53.966683] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-25T18:44:53.968281] [DEBUG] [LOCAL ] AMBC: Trimmed 51887 records to 36371 (keeping 200 days of data) [2025-10-25T18:44:54.181995] [DEBUG] [LOCAL ] AMBC: Primary data saved (36371 records). [2025-10-25T18:44:54.182234] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-25T18:44:54.182349] [INFO ] [MAIN ] Update Progress: 95/2366 symbols. AMBC took 15.6s. Estimated remaining time: 8h 0m 31s [2025-10-25T18:44:54.369034] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:44:54.369235] [DEBUG] [LOCAL ] AMBP: No existing data file found in primary storage. [2025-10-25T18:44:54.369309] [WARN ] [MAIN ] AMBP: No existing data found, performing full refresh instead. [2025-10-25T18:44:54.369426] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-25T18:44:54.369499] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-25T18:44:54.369561] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-25T18:44:54.369627] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-25T18:44:54.729343] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:44:54.729780] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-25T18:44:56.331525] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T18:44:56.340898] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-25T18:44:57.886462] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T18:44:57.895275] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-25T18:44:59.337805] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-25T18:44:59.347249] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-25T18:45:00.372684] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T18:45:00.382838] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-25T18:45:01.920814] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T18:45:01.933808] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-25T18:45:02.825408] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T18:45:02.838903] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-25T18:45:04.003341] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T18:45:04.013877] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-25T18:45:04.981366] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T18:45:04.991211] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-25T18:45:05.768108] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T18:45:05.777132] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-25T18:45:06.712304] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T18:45:06.719765] [INFO ] [REMOTE ] AMBP: Full fetch complete (64989 records). [2025-10-25T18:45:06.719969] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-25T18:45:07.133673] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-25T18:45:07.133790] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-25T18:45:07.134411] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-25T18:45:07.134489] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-25T18:45:07.135761] [DEBUG] [LOCAL ] AMBP: Trimmed 64989 records to 45024 (keeping 200 days of data) [2025-10-25T18:45:07.378932] [DEBUG] [LOCAL ] AMBP: Primary data saved (45024 records). [2025-10-25T18:45:07.379084] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-25T18:45:07.379189] [INFO ] [MAIN ] Update Progress: 96/2366 symbols. AMBP took 13.2s. Estimated remaining time: 8h 0m 30s [2025-10-25T18:45:07.549740] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:45:07.550012] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-25T18:45:07.550086] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-25T18:45:07.550214] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-25T18:45:07.550306] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-25T18:45:07.550403] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-25T18:45:07.550478] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-25T18:45:07.906338] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:45:07.906715] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-25T18:45:08.202271] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:45:08.202639] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-25T18:45:08.202784] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:45:08.202859] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-25T18:45:08.202927] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:45:08.203000] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-25T18:45:08.203092] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-25T18:45:08.203162] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-25T18:45:08.203242] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-25T18:45:08.203327] [INFO ] [MAIN ] Update Progress: 97/2366 symbols. AMBQ took 0.8s. Estimated remaining time: 7h 55m 40s [2025-10-25T18:45:08.379294] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:45:08.379520] [DEBUG] [LOCAL ] AMC: No existing data file found in primary storage. [2025-10-25T18:45:08.379621] [WARN ] [MAIN ] AMC: No existing data found, performing full refresh instead. [2025-10-25T18:45:08.379765] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-25T18:45:08.379837] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-25T18:45:08.379921] [DEBUG] [LOCAL ] AMC: No primary data file found to delete. [2025-10-25T18:45:08.379992] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-25T18:45:08.744044] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:45:08.744368] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-25T18:45:11.403542] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-25T18:45:11.413972] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-25T18:45:13.873264] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-25T18:45:13.883314] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-25T18:45:16.343252] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-25T18:45:16.354380] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-25T18:45:17.268727] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T18:45:17.279895] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-25T18:45:18.392912] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T18:45:18.404541] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-25T18:45:19.404052] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T18:45:19.414842] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-25T18:45:20.351454] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T18:45:20.363078] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-25T18:45:21.453352] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T18:45:21.470928] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-25T18:45:22.507279] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T18:45:22.518567] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-25T18:45:23.465705] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T18:45:23.475556] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-25T18:45:23.475788] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-25T18:45:23.888251] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-25T18:45:23.888379] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-25T18:45:23.889337] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-25T18:45:23.889422] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-25T18:45:23.890978] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54546 (keeping 200 days of data) [2025-10-25T18:45:24.193335] [DEBUG] [LOCAL ] AMC: Primary data saved (54546 records). [2025-10-25T18:45:24.193522] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-25T18:45:24.193615] [INFO ] [MAIN ] Update Progress: 98/2366 symbols. AMC took 16.0s. Estimated remaining time: 7h 56m 46s [2025-10-25T18:45:24.370586] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:45:24.370808] [DEBUG] [LOCAL ] AMCR: No existing data file found in primary storage. [2025-10-25T18:45:24.370882] [WARN ] [MAIN ] AMCR: No existing data found, performing full refresh instead. [2025-10-25T18:45:24.371002] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-25T18:45:24.371075] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-25T18:45:24.371163] [DEBUG] [LOCAL ] AMCR: No primary data file found to delete. [2025-10-25T18:45:24.371235] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-25T18:45:24.763240] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:45:24.763576] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-25T18:45:26.561153] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T18:45:26.571791] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-25T18:45:28.394104] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T18:45:28.404943] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-25T18:45:30.356059] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T18:45:30.367326] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-25T18:45:31.397471] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T18:45:31.408691] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-25T18:45:32.433026] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:45:32.444239] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-25T18:45:33.363695] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T18:45:33.374445] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-25T18:45:34.445812] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T18:45:34.457864] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-25T18:45:35.404613] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T18:45:35.416638] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-25T18:45:36.496065] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T18:45:36.513319] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-25T18:45:37.592957] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T18:45:37.603007] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-25T18:45:37.603163] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-25T18:45:38.034222] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-25T18:45:38.034410] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-25T18:45:38.035410] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-25T18:45:38.035503] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-25T18:45:38.037156] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 54450 (keeping 200 days of data) [2025-10-25T18:45:38.373088] [DEBUG] [LOCAL ] AMCR: Primary data saved (54450 records). [2025-10-25T18:45:38.373252] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-25T18:45:38.373398] [INFO ] [MAIN ] Update Progress: 99/2366 symbols. AMCR took 14.2s. Estimated remaining time: 7h 57m 9s [2025-10-25T18:45:38.550711] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:45:38.550971] [DEBUG] [LOCAL ] AME: No existing data file found in primary storage. [2025-10-25T18:45:38.551047] [WARN ] [MAIN ] AME: No existing data found, performing full refresh instead. [2025-10-25T18:45:38.551182] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-25T18:45:38.551264] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-25T18:45:38.551380] [DEBUG] [LOCAL ] AME: No primary data file found to delete. [2025-10-25T18:45:38.551456] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-25T18:45:38.923458] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:45:38.923874] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-25T18:45:40.562532] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T18:45:40.571983] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-25T18:45:42.222839] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T18:45:42.231916] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-25T18:45:44.240639] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-25T18:45:44.250798] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-25T18:45:45.130807] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T18:45:45.142634] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-25T18:45:45.848428] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T18:45:45.858480] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-25T18:45:46.885953] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T18:45:46.896532] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-25T18:45:47.894365] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T18:45:47.905408] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-25T18:45:48.895609] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T18:45:48.906003] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-25T18:45:49.833836] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T18:45:49.844769] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-25T18:45:50.742174] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T18:45:50.751054] [INFO ] [REMOTE ] AME: Full fetch complete (70194 records). [2025-10-25T18:45:50.751228] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-25T18:45:51.147925] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-25T18:45:51.148053] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-25T18:45:51.148783] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-25T18:45:51.148862] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-25T18:45:51.150338] [DEBUG] [LOCAL ] AME: Trimmed 70194 records to 49145 (keeping 200 days of data) [2025-10-25T18:45:51.452516] [DEBUG] [LOCAL ] AME: Primary data saved (49145 records). [2025-10-25T18:45:51.452708] [INFO ] [MAIN ] AME: Full history saved. [2025-10-25T18:45:51.452838] [INFO ] [MAIN ] Update Progress: 100/2366 symbols. AME took 13.1s. Estimated remaining time: 7h 57m 7s [2025-10-25T18:45:51.631690] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:45:51.631877] [DEBUG] [LOCAL ] AMG: No existing data file found in primary storage. [2025-10-25T18:45:51.631974] [WARN ] [MAIN ] AMG: No existing data found, performing full refresh instead. [2025-10-25T18:45:51.632104] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-25T18:45:51.632203] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-25T18:45:51.632290] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-10-25T18:45:51.632416] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-25T18:45:52.018969] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:45:52.019520] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-25T18:45:53.180258] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T18:45:53.184613] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-25T18:45:54.362577] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-25T18:45:54.366964] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-25T18:45:55.568274] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T18:45:55.573560] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-25T18:45:56.882051] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T18:45:56.887579] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-25T18:45:58.142564] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T18:45:58.148238] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-25T18:45:59.331351] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T18:45:59.335552] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-25T18:46:00.808986] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T18:46:00.814192] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-25T18:46:02.516011] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T18:46:02.522378] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-25T18:46:03.803837] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T18:46:03.808575] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-25T18:46:05.028289] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T18:46:05.032048] [INFO ] [REMOTE ] AMG: Full fetch complete (29498 records). [2025-10-25T18:46:05.032145] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-25T18:46:05.412245] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-25T18:46:05.412366] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-25T18:46:05.412839] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-25T18:46:05.412920] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-25T18:46:05.413666] [DEBUG] [LOCAL ] AMG: Trimmed 29498 records to 20306 (keeping 200 days of data) [2025-10-25T18:46:05.538773] [DEBUG] [LOCAL ] AMG: Primary data saved (20306 records). [2025-10-25T18:46:05.538945] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-25T18:46:05.539072] [INFO ] [MAIN ] Update Progress: 101/2366 symbols. AMG took 14.1s. Estimated remaining time: 7h 57m 27s [2025-10-25T18:46:05.741839] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:46:05.742061] [DEBUG] [LOCAL ] AMH: No existing data file found in primary storage. [2025-10-25T18:46:05.742149] [WARN ] [MAIN ] AMH: No existing data found, performing full refresh instead. [2025-10-25T18:46:05.742272] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-25T18:46:05.742345] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-25T18:46:05.742408] [DEBUG] [LOCAL ] AMH: No primary data file found to delete. [2025-10-25T18:46:05.742472] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-25T18:46:06.134584] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:46:06.134970] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-25T18:46:07.837595] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T18:46:07.847853] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-25T18:46:09.623529] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T18:46:09.638005] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-25T18:46:11.536774] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T18:46:11.547498] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-25T18:46:12.513631] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T18:46:12.525717] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-25T18:46:13.407169] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T18:46:13.418166] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-25T18:46:14.457804] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T18:46:14.468952] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-25T18:46:15.450538] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T18:46:15.461911] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-25T18:46:16.616527] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T18:46:16.627605] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-25T18:46:17.539229] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T18:46:17.550566] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-25T18:46:18.432766] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T18:46:18.442216] [INFO ] [REMOTE ] AMH: Full fetch complete (75117 records). [2025-10-25T18:46:18.442358] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-25T18:46:18.832693] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-25T18:46:18.832802] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-25T18:46:18.833596] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-25T18:46:18.833701] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-25T18:46:18.835133] [DEBUG] [LOCAL ] AMH: Trimmed 75117 records to 52581 (keeping 200 days of data) [2025-10-25T18:46:19.138227] [DEBUG] [LOCAL ] AMH: Primary data saved (52581 records). [2025-10-25T18:46:19.138385] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-25T18:46:19.138495] [INFO ] [MAIN ] Update Progress: 102/2366 symbols. AMH took 13.6s. Estimated remaining time: 7h 57m 35s [2025-10-25T18:46:19.309611] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:46:19.309828] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-10-25T18:46:19.309917] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-10-25T18:46:19.310033] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-25T18:46:19.310104] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-25T18:46:19.310183] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-25T18:46:19.310250] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-25T18:46:19.661539] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:46:19.661879] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-25T18:46:21.255956] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T18:46:21.264108] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-25T18:46:22.895237] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T18:46:22.904715] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-25T18:46:24.527418] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T18:46:24.536344] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-25T18:46:25.534730] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T18:46:25.544866] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-25T18:46:26.517681] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T18:46:26.526503] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-25T18:46:27.396284] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T18:46:27.404298] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-25T18:46:28.399583] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T18:46:28.409227] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-25T18:46:29.333200] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T18:46:29.343523] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-25T18:46:30.327011] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T18:46:30.338550] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-25T18:46:31.173834] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T18:46:31.181382] [INFO ] [REMOTE ] AMN: Full fetch complete (60178 records). [2025-10-25T18:46:31.181576] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-25T18:46:31.569536] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-25T18:46:31.569692] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-25T18:46:31.570322] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-25T18:46:31.570402] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-25T18:46:31.571890] [DEBUG] [LOCAL ] AMN: Trimmed 60178 records to 42147 (keeping 200 days of data) [2025-10-25T18:46:31.803510] [DEBUG] [LOCAL ] AMN: Primary data saved (42147 records). [2025-10-25T18:46:31.803675] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-25T18:46:31.803783] [INFO ] [MAIN ] Update Progress: 103/2366 symbols. AMN took 12.7s. Estimated remaining time: 7h 57m 23s [2025-10-25T18:46:31.976185] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:46:31.976408] [DEBUG] [LOCAL ] AMP: No existing data file found in primary storage. [2025-10-25T18:46:31.976479] [WARN ] [MAIN ] AMP: No existing data found, performing full refresh instead. [2025-10-25T18:46:31.976592] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-25T18:46:31.976685] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-25T18:46:31.976797] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-10-25T18:46:31.976866] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-25T18:46:32.335970] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:46:32.336348] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-25T18:46:33.919844] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T18:46:33.926946] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-25T18:46:35.615192] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T18:46:35.621703] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-25T18:46:37.320264] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T18:46:37.328305] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-25T18:46:38.838959] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T18:46:38.847784] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-25T18:46:40.258980] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T18:46:40.266605] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-25T18:46:41.453464] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T18:46:41.460419] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-25T18:46:42.972060] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T18:46:42.979325] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-25T18:46:44.271760] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T18:46:44.278137] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-25T18:46:45.722942] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T18:46:45.733335] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-25T18:46:47.124173] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-25T18:46:47.131422] [INFO ] [REMOTE ] AMP: Full fetch complete (47527 records). [2025-10-25T18:46:47.131762] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-25T18:46:47.560894] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-25T18:46:47.561017] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-25T18:46:47.561576] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-25T18:46:47.561678] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-25T18:46:47.562850] [DEBUG] [LOCAL ] AMP: Trimmed 47527 records to 32168 (keeping 200 days of data) [2025-10-25T18:46:47.757304] [DEBUG] [LOCAL ] AMP: Primary data saved (32168 records). [2025-10-25T18:46:47.757467] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-25T18:46:47.757575] [INFO ] [MAIN ] Update Progress: 104/2366 symbols. AMP took 16.0s. Estimated remaining time: 7h 58m 22s [2025-10-25T18:46:47.930487] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:46:47.930705] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-10-25T18:46:47.930766] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-10-25T18:46:47.930876] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-25T18:46:47.930955] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-25T18:46:47.931045] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-25T18:46:47.931114] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-25T18:46:48.297325] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:46:48.297784] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-25T18:46:50.189425] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-25T18:46:50.199814] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-25T18:46:51.936788] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T18:46:51.945963] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-25T18:46:53.693482] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T18:46:53.704119] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-25T18:46:55.640295] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T18:46:55.650840] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-25T18:46:57.375691] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T18:46:57.390894] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-25T18:46:59.466513] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-25T18:46:59.477797] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-25T18:47:02.012281] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-25T18:47:02.023950] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-25T18:47:04.786210] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-25T18:47:04.797539] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-25T18:47:06.937157] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-25T18:47:06.948258] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-25T18:47:09.242835] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-25T18:47:09.252461] [INFO ] [REMOTE ] AMPX: Full fetch complete (75257 records). [2025-10-25T18:47:09.252622] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-25T18:47:09.634094] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-25T18:47:09.634202] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-25T18:47:09.634987] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-25T18:47:09.635068] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-25T18:47:09.636489] [DEBUG] [LOCAL ] AMPX: Trimmed 75257 records to 53219 (keeping 200 days of data) [2025-10-25T18:47:09.926451] [DEBUG] [LOCAL ] AMPX: Primary data saved (53219 records). [2025-10-25T18:47:09.926607] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-25T18:47:09.926735] [INFO ] [MAIN ] Update Progress: 105/2366 symbols. AMPX took 22.2s. Estimated remaining time: 8h 1m 33s [2025-10-25T18:47:10.091291] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:47:10.091478] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-10-25T18:47:10.091548] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-10-25T18:47:10.091685] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-25T18:47:10.091797] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-25T18:47:10.091883] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-25T18:47:10.091950] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-25T18:47:10.493482] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:47:10.493932] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-25T18:47:11.876209] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T18:47:11.882568] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-25T18:47:13.036076] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T18:47:13.041954] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-25T18:47:14.579491] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T18:47:14.586887] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-25T18:47:16.287777] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T18:47:16.296692] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-25T18:47:17.901230] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T18:47:17.909533] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-25T18:47:19.582544] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T18:47:19.591609] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-25T18:47:21.197806] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T18:47:21.206441] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-25T18:47:22.663497] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T18:47:22.670925] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-25T18:47:24.137925] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T18:47:24.145796] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-25T18:47:25.883046] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T18:47:25.892272] [INFO ] [REMOTE ] AMPY: Full fetch complete (53562 records). [2025-10-25T18:47:25.892476] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-25T18:47:26.305598] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-25T18:47:26.305739] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-25T18:47:26.306292] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-25T18:47:26.306369] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-25T18:47:26.307582] [DEBUG] [LOCAL ] AMPY: Trimmed 53562 records to 40008 (keeping 200 days of data) [2025-10-25T18:47:26.527610] [DEBUG] [LOCAL ] AMPY: Primary data saved (40008 records). [2025-10-25T18:47:26.527786] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-25T18:47:26.527892] [INFO ] [MAIN ] Update Progress: 106/2366 symbols. AMPY took 16.6s. Estimated remaining time: 8h 2m 42s [2025-10-25T18:47:26.713130] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:47:26.713319] [DEBUG] [LOCAL ] AMR: No existing data file found in primary storage. [2025-10-25T18:47:26.713391] [WARN ] [MAIN ] AMR: No existing data found, performing full refresh instead. [2025-10-25T18:47:26.713506] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-25T18:47:26.713578] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-25T18:47:26.713685] [DEBUG] [LOCAL ] AMR: No primary data file found to delete. [2025-10-25T18:47:26.713759] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-25T18:47:27.067488] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:47:27.067858] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-25T18:47:28.456937] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T18:47:28.461705] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-25T18:47:29.808559] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T18:47:29.814544] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-25T18:47:31.228325] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T18:47:31.236032] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-25T18:47:32.734256] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T18:47:32.741031] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-25T18:47:34.057400] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-25T18:47:34.064855] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-25T18:47:35.507930] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T18:47:35.514051] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-25T18:47:36.967966] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T18:47:36.975488] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-25T18:47:38.515800] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T18:47:38.522329] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-25T18:47:39.779227] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-25T18:47:39.787739] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-25T18:47:41.072117] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T18:47:41.077364] [INFO ] [REMOTE ] AMR: Full fetch complete (40710 records). [2025-10-25T18:47:41.077476] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-25T18:47:41.453134] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-25T18:47:41.453235] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-25T18:47:41.453711] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-25T18:47:41.453789] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-25T18:47:41.454631] [DEBUG] [LOCAL ] AMR: Trimmed 40710 records to 29133 (keeping 200 days of data) [2025-10-25T18:47:41.618729] [DEBUG] [LOCAL ] AMR: Primary data saved (29133 records). [2025-10-25T18:47:41.618894] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-25T18:47:41.619017] [INFO ] [MAIN ] Update Progress: 107/2366 symbols. AMR took 15.1s. Estimated remaining time: 8h 3m 17s [2025-10-25T18:47:41.793027] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:47:41.793228] [DEBUG] [LOCAL ] AMRC: No existing data file found in primary storage. [2025-10-25T18:47:41.793298] [WARN ] [MAIN ] AMRC: No existing data found, performing full refresh instead. [2025-10-25T18:47:41.793414] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-25T18:47:41.793482] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-25T18:47:41.793543] [DEBUG] [LOCAL ] AMRC: No primary data file found to delete. [2025-10-25T18:47:41.793605] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-25T18:47:42.147133] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:47:42.147474] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-25T18:47:43.523143] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T18:47:43.529765] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-25T18:47:44.826003] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-25T18:47:44.832443] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-25T18:47:46.607171] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T18:47:46.616481] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-25T18:47:48.150003] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T18:47:48.159050] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-25T18:47:49.703961] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T18:47:49.711883] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-25T18:47:50.989761] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T18:47:50.996895] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-25T18:47:52.640098] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T18:47:52.648981] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-25T18:47:54.187346] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T18:47:54.195519] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-25T18:47:55.681111] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T18:47:55.690153] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-25T18:47:56.998566] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-25T18:47:57.006240] [INFO ] [REMOTE ] AMRC: Full fetch complete (54669 records). [2025-10-25T18:47:57.006362] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-25T18:47:57.391306] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-25T18:47:57.391463] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-25T18:47:57.392083] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-25T18:47:57.392162] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-25T18:47:57.393268] [DEBUG] [LOCAL ] AMRC: Trimmed 54669 records to 39067 (keeping 200 days of data) [2025-10-25T18:47:57.609466] [DEBUG] [LOCAL ] AMRC: Primary data saved (39067 records). [2025-10-25T18:47:57.609625] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-25T18:47:57.609747] [INFO ] [MAIN ] Update Progress: 108/2366 symbols. AMRC took 16.0s. Estimated remaining time: 8h 4m 10s [2025-10-25T18:47:57.779709] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:47:57.779881] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-25T18:47:57.779958] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-25T18:47:57.780065] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-25T18:47:57.780132] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-25T18:47:57.780211] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-25T18:47:57.780277] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-25T18:47:58.135955] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:47:58.136276] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-25T18:47:58.483410] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:47:58.483809] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-25T18:47:58.483897] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:47:58.483973] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-25T18:47:58.484058] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:47:58.484138] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-25T18:47:58.484235] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-25T18:47:58.484308] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-25T18:47:58.484424] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-25T18:47:58.484518] [INFO ] [MAIN ] Update Progress: 109/2366 symbols. AMRZ took 0.9s. Estimated remaining time: 7h 59m 49s [2025-10-25T18:47:58.663037] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:47:58.663215] [DEBUG] [LOCAL ] AMT: No existing data file found in primary storage. [2025-10-25T18:47:58.663289] [WARN ] [MAIN ] AMT: No existing data found, performing full refresh instead. [2025-10-25T18:47:58.663406] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-25T18:47:58.663482] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-25T18:47:58.663565] [DEBUG] [LOCAL ] AMT: No primary data file found to delete. [2025-10-25T18:47:58.663639] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-25T18:47:59.044232] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:47:59.044571] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-25T18:48:01.564409] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-25T18:48:01.574786] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-25T18:48:03.994960] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-25T18:48:04.005210] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-25T18:48:05.801306] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T18:48:05.812161] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-25T18:48:06.983095] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T18:48:06.994078] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-25T18:48:08.108620] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T18:48:08.120553] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-25T18:48:09.201961] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T18:48:09.212241] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-25T18:48:10.035184] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T18:48:10.047394] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-25T18:48:11.061575] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T18:48:11.072891] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-25T18:48:11.830199] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T18:48:11.842356] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-25T18:48:12.896587] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T18:48:12.906961] [INFO ] [REMOTE ] AMT: Full fetch complete (76156 records). [2025-10-25T18:48:12.907214] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-25T18:48:13.331587] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-25T18:48:13.331765] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-25T18:48:13.332687] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-25T18:48:13.332777] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-25T18:48:13.334902] [DEBUG] [LOCAL ] AMT: Trimmed 76156 records to 53186 (keeping 200 days of data) [2025-10-25T18:48:13.689845] [DEBUG] [LOCAL ] AMT: Primary data saved (53186 records). [2025-10-25T18:48:13.690339] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-25T18:48:13.690472] [INFO ] [MAIN ] Update Progress: 110/2366 symbols. AMT took 15.2s. Estimated remaining time: 8h 0m 27s [2025-10-25T18:48:13.867959] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:48:13.868294] [DEBUG] [LOCAL ] AMTB: No existing data file found in primary storage. [2025-10-25T18:48:13.868378] [WARN ] [MAIN ] AMTB: No existing data found, performing full refresh instead. [2025-10-25T18:48:13.868503] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-25T18:48:13.868581] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-25T18:48:13.868696] [DEBUG] [LOCAL ] AMTB: No primary data file found to delete. [2025-10-25T18:48:13.868770] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-25T18:48:14.246144] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:48:14.246566] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-25T18:48:15.429185] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T18:48:15.433857] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-25T18:48:16.552362] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T18:48:16.556710] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-25T18:48:17.650807] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-25T18:48:17.655109] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-25T18:48:18.906912] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T18:48:18.912413] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-25T18:48:20.099134] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T18:48:20.103877] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-25T18:48:21.163785] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T18:48:21.169119] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-25T18:48:22.485158] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-25T18:48:22.491115] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-25T18:48:23.639281] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T18:48:23.644256] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-25T18:48:24.780519] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T18:48:24.785451] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-25T18:48:25.906553] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-25T18:48:25.910817] [INFO ] [REMOTE ] AMTB: Full fetch complete (29743 records). [2025-10-25T18:48:25.910922] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-25T18:48:26.295586] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-25T18:48:26.295734] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-25T18:48:26.296129] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-25T18:48:26.296204] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-25T18:48:26.296969] [DEBUG] [LOCAL ] AMTB: Trimmed 29743 records to 20875 (keeping 200 days of data) [2025-10-25T18:48:26.416885] [DEBUG] [LOCAL ] AMTB: Primary data saved (20875 records). [2025-10-25T18:48:26.417037] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-25T18:48:26.417133] [INFO ] [MAIN ] Update Progress: 111/2366 symbols. AMTB took 12.7s. Estimated remaining time: 8h 0m 13s [2025-10-25T18:48:26.586500] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:48:26.586731] [DEBUG] [LOCAL ] AMTD: No existing data file found in primary storage. [2025-10-25T18:48:26.586823] [WARN ] [MAIN ] AMTD: No existing data found, performing full refresh instead. [2025-10-25T18:48:26.586938] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-25T18:48:26.587010] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-25T18:48:26.587091] [DEBUG] [LOCAL ] AMTD: No primary data file found to delete. [2025-10-25T18:48:26.587159] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-25T18:48:26.947712] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:48:26.948056] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-25T18:48:27.701495] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T18:48:27.703151] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-25T18:48:28.383130] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-25T18:48:28.384676] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-25T18:48:28.906342] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-25T18:48:28.907696] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-25T18:48:29.485125] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-25T18:48:29.486327] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-25T18:48:30.158016] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-25T18:48:30.159351] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-25T18:48:30.926941] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T18:48:30.928859] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-25T18:48:31.533741] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-25T18:48:31.535184] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-25T18:48:32.218575] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-25T18:48:32.220229] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-25T18:48:32.931634] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T18:48:32.933445] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-25T18:48:33.616912] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-25T18:48:33.618258] [INFO ] [REMOTE ] AMTD: Full fetch complete (5357 records). [2025-10-25T18:48:33.618350] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-25T18:48:33.985170] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-25T18:48:33.985279] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-25T18:48:33.985453] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-25T18:48:33.985541] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-25T18:48:33.985970] [DEBUG] [LOCAL ] AMTD: Trimmed 5357 records to 3828 (keeping 200 days of data) [2025-10-25T18:48:34.006448] [DEBUG] [LOCAL ] AMTD: Primary data saved (3828 records). [2025-10-25T18:48:34.006535] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-25T18:48:34.006619] [INFO ] [MAIN ] Update Progress: 112/2366 symbols. AMTD took 7.6s. Estimated remaining time: 7h 58m 16s [2025-10-25T18:48:34.184446] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:48:34.184702] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-10-25T18:48:34.184777] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-10-25T18:48:34.184906] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-25T18:48:34.184982] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-25T18:48:34.185063] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-25T18:48:34.185126] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-25T18:48:34.536675] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:48:34.536998] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-25T18:48:36.326541] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T18:48:36.336553] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-25T18:48:38.112110] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T18:48:38.121858] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-25T18:48:39.975751] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T18:48:39.987345] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-25T18:48:40.930461] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T18:48:40.945406] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-25T18:48:41.921595] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T18:48:41.939003] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-25T18:48:42.898677] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T18:48:42.909617] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-25T18:48:43.821179] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T18:48:43.832076] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-25T18:48:44.724502] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T18:48:44.735132] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-25T18:48:45.659338] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T18:48:45.672905] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-25T18:48:46.558030] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T18:48:46.566902] [INFO ] [REMOTE ] AMTM: Full fetch complete (73560 records). [2025-10-25T18:48:46.567076] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-25T18:48:46.976897] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-25T18:48:46.977015] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-25T18:48:46.977918] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-25T18:48:46.978010] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-25T18:48:46.979461] [DEBUG] [LOCAL ] AMTM: Trimmed 73560 records to 50952 (keeping 200 days of data) [2025-10-25T18:48:47.270334] [DEBUG] [LOCAL ] AMTM: Primary data saved (50952 records). [2025-10-25T18:48:47.270492] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-25T18:48:47.270601] [INFO ] [MAIN ] Update Progress: 113/2366 symbols. AMTM took 13.3s. Estimated remaining time: 7h 58m 14s [2025-10-25T18:48:47.435569] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:48:47.435769] [DEBUG] [LOCAL ] AMWL: No existing data file found in primary storage. [2025-10-25T18:48:47.435839] [WARN ] [MAIN ] AMWL: No existing data found, performing full refresh instead. [2025-10-25T18:48:47.435952] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-25T18:48:47.436027] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-25T18:48:47.436107] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-10-25T18:48:47.436177] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-25T18:48:47.787582] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:48:47.787963] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-25T18:48:48.638746] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-25T18:48:48.641401] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-25T18:48:49.625222] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T18:48:49.628967] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-25T18:48:50.559826] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T18:48:50.562605] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-25T18:48:51.384718] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T18:48:51.387299] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-25T18:48:52.244061] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T18:48:52.246890] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-25T18:48:53.103049] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T18:48:53.106175] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-25T18:48:53.993462] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T18:48:53.996129] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-25T18:48:54.834407] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T18:48:54.836904] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-25T18:48:55.740257] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T18:48:55.743205] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-25T18:48:56.802843] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T18:48:56.806268] [INFO ] [REMOTE ] AMWL: Full fetch complete (14902 records). [2025-10-25T18:48:56.806372] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-25T18:48:57.185517] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-25T18:48:57.185629] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-25T18:48:57.185907] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-25T18:48:57.185981] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-25T18:48:57.186497] [DEBUG] [LOCAL ] AMWL: Trimmed 14902 records to 9978 (keeping 200 days of data) [2025-10-25T18:48:57.239581] [DEBUG] [LOCAL ] AMWL: Primary data saved (9978 records). [2025-10-25T18:48:57.239752] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-25T18:48:57.239859] [INFO ] [MAIN ] Update Progress: 114/2366 symbols. AMWL took 10.0s. Estimated remaining time: 7h 57m 6s [2025-10-25T18:48:57.415695] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:48:57.415878] [DEBUG] [LOCAL ] AMX: No existing data file found in primary storage. [2025-10-25T18:48:57.415946] [WARN ] [MAIN ] AMX: No existing data found, performing full refresh instead. [2025-10-25T18:48:57.416058] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-25T18:48:57.416127] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-25T18:48:57.416211] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-25T18:48:57.416285] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-25T18:48:57.763296] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:48:57.763632] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-25T18:48:59.572142] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T18:48:59.581813] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-25T18:49:01.464282] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T18:49:01.473934] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-25T18:49:03.904914] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-25T18:49:03.915208] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-25T18:49:04.895242] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T18:49:04.906237] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-25T18:49:05.854467] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T18:49:05.865153] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-25T18:49:06.878120] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T18:49:06.887966] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-25T18:49:07.862036] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T18:49:07.872340] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-25T18:49:08.869769] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T18:49:08.880075] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-25T18:49:09.934218] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T18:49:09.944881] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-25T18:49:10.872571] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T18:49:10.881756] [INFO ] [REMOTE ] AMX: Full fetch complete (71021 records). [2025-10-25T18:49:10.881927] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-25T18:49:11.275405] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-25T18:49:11.275512] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-25T18:49:11.276245] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-25T18:49:11.276325] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-25T18:49:11.277786] [DEBUG] [LOCAL ] AMX: Trimmed 71021 records to 49882 (keeping 200 days of data) [2025-10-25T18:49:11.569787] [DEBUG] [LOCAL ] AMX: Primary data saved (49882 records). [2025-10-25T18:49:11.569945] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-25T18:49:11.570030] [INFO ] [MAIN ] Update Progress: 115/2366 symbols. AMX took 14.3s. Estimated remaining time: 7h 57m 25s [2025-10-25T18:49:11.748279] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:49:11.748508] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-25T18:49:11.748594] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-25T18:49:11.748932] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-25T18:49:11.749003] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-25T18:49:11.749085] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-25T18:49:11.749155] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-25T18:49:12.119469] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:49:12.119987] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-25T18:49:13.553163] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T18:49:13.561671] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-25T18:49:15.368812] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T18:49:15.375560] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-25T18:49:16.918982] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T18:49:16.926833] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-25T18:49:18.526595] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T18:49:18.535034] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-25T18:49:19.895353] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T18:49:19.902348] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-25T18:49:21.256563] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T18:49:21.263107] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-25T18:49:22.739378] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T18:49:22.746982] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-25T18:49:24.102785] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T18:49:24.108597] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-25T18:49:25.492565] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T18:49:25.498978] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-25T18:49:26.828372] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T18:49:26.833988] [INFO ] [REMOTE ] AN: Full fetch complete (47148 records). [2025-10-25T18:49:26.834116] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-25T18:49:27.210493] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-25T18:49:27.210598] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-25T18:49:27.211135] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-25T18:49:27.211217] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-25T18:49:27.212233] [DEBUG] [LOCAL ] AN: Trimmed 47148 records to 31602 (keeping 200 days of data) [2025-10-25T18:49:27.391657] [DEBUG] [LOCAL ] AN: Primary data saved (31602 records). [2025-10-25T18:49:27.391807] [INFO ] [MAIN ] AN: Full history saved. [2025-10-25T18:49:27.391917] [INFO ] [MAIN ] Update Progress: 116/2366 symbols. AN took 15.8s. Estimated remaining time: 7h 58m 13s [2025-10-25T18:49:27.558612] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:49:27.558780] [DEBUG] [LOCAL ] ANET: No existing data file found in primary storage. [2025-10-25T18:49:27.558852] [WARN ] [MAIN ] ANET: No existing data found, performing full refresh instead. [2025-10-25T18:49:27.558961] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-25T18:49:27.559049] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-25T18:49:27.559133] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-10-25T18:49:27.559198] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-25T18:49:27.910498] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:49:27.910827] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-25T18:49:30.052029] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-25T18:49:30.062971] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-25T18:49:32.358481] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-25T18:49:32.369432] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-25T18:49:34.774088] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-25T18:49:34.786041] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-25T18:49:35.372382] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-25T18:49:35.383888] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-25T18:49:35.929482] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-25T18:49:35.940689] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-25T18:49:36.886729] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T18:49:36.897482] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-25T18:49:37.660529] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-25T18:49:37.672623] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-25T18:49:38.690772] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T18:49:38.702238] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-25T18:49:39.818895] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T18:49:39.830954] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-25T18:49:40.789113] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:49:40.799393] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-25T18:49:40.799626] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-25T18:49:41.212362] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-25T18:49:41.212478] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-25T18:49:41.213298] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-25T18:49:41.213381] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-25T18:49:41.214878] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 54546 (keeping 200 days of data) [2025-10-25T18:49:41.534275] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-10-25T18:49:41.534453] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-25T18:49:41.534561] [INFO ] [MAIN ] Update Progress: 117/2366 symbols. ANET took 14.1s. Estimated remaining time: 7h 58m 27s [2025-10-25T18:49:41.702305] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:49:41.702493] [DEBUG] [LOCAL ] ANF: No existing data file found in primary storage. [2025-10-25T18:49:41.702564] [WARN ] [MAIN ] ANF: No existing data found, performing full refresh instead. [2025-10-25T18:49:41.702673] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-25T18:49:41.702781] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-25T18:49:41.702892] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-25T18:49:41.702983] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-25T18:49:42.058469] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:49:42.058855] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-25T18:49:44.045323] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T18:49:44.055489] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-25T18:49:45.933792] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T18:49:45.943439] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-25T18:49:48.073768] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-25T18:49:48.084638] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-25T18:49:49.046090] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T18:49:49.057144] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-25T18:49:50.137555] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T18:49:50.148434] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-25T18:49:51.134052] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T18:49:51.144590] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-25T18:49:52.074886] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T18:49:52.086252] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-25T18:49:53.082040] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T18:49:53.093130] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-25T18:49:53.700568] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T18:49:53.712104] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-25T18:49:54.736591] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T18:49:54.746779] [INFO ] [REMOTE ] ANF: Full fetch complete (75784 records). [2025-10-25T18:49:54.747008] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-25T18:49:55.179748] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-25T18:49:55.179887] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-25T18:49:55.180787] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-25T18:49:55.180875] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-25T18:49:55.182520] [DEBUG] [LOCAL ] ANF: Trimmed 75784 records to 52772 (keeping 200 days of data) [2025-10-25T18:49:55.506341] [DEBUG] [LOCAL ] ANF: Primary data saved (52772 records). [2025-10-25T18:49:55.506506] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-25T18:49:55.506614] [INFO ] [MAIN ] Update Progress: 118/2366 symbols. ANF took 14.0s. Estimated remaining time: 7h 58m 37s [2025-10-25T18:49:55.698209] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:49:55.698488] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-25T18:49:55.698558] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-25T18:49:55.698695] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-25T18:49:55.698770] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-25T18:49:55.698850] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-25T18:49:55.698920] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-25T18:49:56.074238] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:49:56.074586] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-25T18:49:56.370705] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:49:56.371079] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-25T18:49:56.371164] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:49:56.371237] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-25T18:49:56.371305] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:49:56.371378] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-25T18:49:56.371471] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-25T18:49:56.371546] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-25T18:49:56.371626] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-25T18:49:56.371734] [INFO ] [MAIN ] Update Progress: 119/2366 symbols. ANGX took 0.9s. Estimated remaining time: 7h 54m 39s [2025-10-25T18:49:56.542172] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:49:56.542429] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-25T18:49:56.542501] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-25T18:49:56.542618] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-25T18:49:56.542711] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-25T18:49:56.542792] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-25T18:49:56.542841] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-25T18:49:56.897712] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:49:56.898049] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-25T18:49:58.010909] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T18:49:58.015147] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-25T18:49:59.161761] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T18:49:59.166636] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-25T18:50:00.420834] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T18:50:00.427045] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-25T18:50:02.660934] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-25T18:50:02.666954] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-25T18:50:03.867334] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T18:50:03.872070] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-25T18:50:05.236561] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T18:50:05.242543] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-25T18:50:06.333309] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T18:50:06.337830] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-25T18:50:07.393231] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T18:50:07.397479] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-25T18:50:08.385372] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T18:50:08.388435] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-25T18:50:09.872282] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-25T18:50:09.878685] [INFO ] [REMOTE ] ANRO: Full fetch complete (30523 records). [2025-10-25T18:50:09.878854] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-25T18:50:10.260498] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-25T18:50:10.260617] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-25T18:50:10.261044] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-25T18:50:10.261119] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-25T18:50:10.261891] [DEBUG] [LOCAL ] ANRO: Trimmed 30523 records to 20129 (keeping 200 days of data) [2025-10-25T18:50:10.370427] [DEBUG] [LOCAL ] ANRO: Primary data saved (20129 records). [2025-10-25T18:50:10.370583] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-25T18:50:10.370714] [INFO ] [MAIN ] Update Progress: 120/2366 symbols. ANRO took 14.0s. Estimated remaining time: 7h 54m 51s [2025-10-25T18:50:10.553921] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:50:10.554132] [DEBUG] [LOCAL ] ANVS: No existing data file found in primary storage. [2025-10-25T18:50:10.554223] [WARN ] [MAIN ] ANVS: No existing data found, performing full refresh instead. [2025-10-25T18:50:10.554337] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-25T18:50:10.554407] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-25T18:50:10.554490] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-25T18:50:10.554561] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-25T18:50:10.948144] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:50:10.948590] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-25T18:50:12.168615] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T18:50:12.174289] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-25T18:50:13.684260] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T18:50:13.691243] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-25T18:50:14.942055] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T18:50:14.948045] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-25T18:50:16.221181] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T18:50:16.226461] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-25T18:50:17.456961] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T18:50:17.462853] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-25T18:50:18.911703] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T18:50:18.918259] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-25T18:50:20.082979] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T18:50:20.088534] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-25T18:50:21.196032] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T18:50:21.200597] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-25T18:50:22.287638] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T18:50:22.291772] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-25T18:50:23.764750] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T18:50:23.770582] [INFO ] [REMOTE ] ANVS: Full fetch complete (36707 records). [2025-10-25T18:50:23.770747] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-25T18:50:24.143943] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-25T18:50:24.144053] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-25T18:50:24.144494] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-25T18:50:24.144569] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-25T18:50:24.145438] [DEBUG] [LOCAL ] ANVS: Trimmed 36707 records to 24280 (keeping 200 days of data) [2025-10-25T18:50:24.274468] [DEBUG] [LOCAL ] ANVS: Primary data saved (24280 records). [2025-10-25T18:50:24.274630] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-25T18:50:24.274757] [INFO ] [MAIN ] Update Progress: 121/2366 symbols. ANVS took 13.9s. Estimated remaining time: 7h 55m 1s [2025-10-25T18:50:24.444550] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:50:24.444755] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-10-25T18:50:24.444825] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-10-25T18:50:24.444914] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-25T18:50:24.444980] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-25T18:50:24.445056] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-25T18:50:24.445127] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-25T18:50:24.800419] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:50:24.800765] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-25T18:50:26.458354] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T18:50:26.465362] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-25T18:50:27.601958] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T18:50:27.607857] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-25T18:50:29.163392] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T18:50:29.169797] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-25T18:50:30.714839] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T18:50:30.722004] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-25T18:50:32.176210] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T18:50:32.182915] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-25T18:50:33.472214] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T18:50:33.478526] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-25T18:50:34.991960] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T18:50:34.999516] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-25T18:50:36.085222] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T18:50:36.092275] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-25T18:50:37.489768] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T18:50:37.496405] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-25T18:50:38.811737] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-25T18:50:38.817992] [INFO ] [REMOTE ] AOD: Full fetch complete (44885 records). [2025-10-25T18:50:38.818106] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-25T18:50:39.215504] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-25T18:50:39.215615] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-25T18:50:39.216133] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-25T18:50:39.216208] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-25T18:50:39.217180] [DEBUG] [LOCAL ] AOD: Trimmed 44885 records to 31268 (keeping 200 days of data) [2025-10-25T18:50:39.392618] [DEBUG] [LOCAL ] AOD: Primary data saved (31268 records). [2025-10-25T18:50:39.392785] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-25T18:50:39.392890] [INFO ] [MAIN ] Update Progress: 122/2366 symbols. AOD took 15.1s. Estimated remaining time: 7h 55m 33s [2025-10-25T18:50:39.561532] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:50:39.561744] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-25T18:50:39.561815] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-25T18:50:39.561935] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-25T18:50:39.562005] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-25T18:50:39.562104] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-25T18:50:39.562185] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-25T18:50:39.918215] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:50:39.918728] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-25T18:50:40.225995] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:50:40.226314] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-25T18:50:40.226398] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:50:40.226469] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-25T18:50:40.226533] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:50:40.226604] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-25T18:50:40.226718] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-25T18:50:40.226789] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-25T18:50:40.226868] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-25T18:50:40.226951] [INFO ] [MAIN ] Update Progress: 123/2366 symbols. AOMD took 0.8s. Estimated remaining time: 7h 51m 44s [2025-10-25T18:50:40.398866] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:50:40.399046] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-25T18:50:40.399115] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-25T18:50:40.399224] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-25T18:50:40.399293] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-25T18:50:40.399374] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-25T18:50:40.399439] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-25T18:50:40.800229] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:50:40.800695] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-25T18:50:41.661505] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T18:50:41.664334] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-25T18:50:42.746897] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T18:50:42.751184] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-25T18:50:43.806216] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T18:50:43.810243] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-25T18:50:44.928595] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T18:50:44.932802] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-25T18:50:46.157710] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T18:50:46.163027] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-25T18:50:47.152333] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T18:50:47.155700] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-25T18:50:48.023965] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T18:50:48.027007] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-25T18:50:49.193196] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T18:50:49.199297] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-25T18:50:50.304987] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T18:50:50.309203] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-25T18:50:51.233278] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T18:50:51.235878] [INFO ] [REMOTE ] AOMR: Full fetch complete (23058 records). [2025-10-25T18:50:51.235971] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-25T18:50:51.609071] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-25T18:50:51.609192] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-25T18:50:51.609704] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-25T18:50:51.609784] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-25T18:50:51.610456] [DEBUG] [LOCAL ] AOMR: Trimmed 23058 records to 16465 (keeping 200 days of data) [2025-10-25T18:50:51.702448] [DEBUG] [LOCAL ] AOMR: Primary data saved (16465 records). [2025-10-25T18:50:51.702620] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-25T18:50:51.702752] [INFO ] [MAIN ] Update Progress: 124/2366 symbols. AOMR took 11.5s. Estimated remaining time: 7h 51m 10s [2025-10-25T18:50:51.886011] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:50:51.886280] [DEBUG] [LOCAL ] AON: No existing data file found in primary storage. [2025-10-25T18:50:51.886354] [WARN ] [MAIN ] AON: No existing data found, performing full refresh instead. [2025-10-25T18:50:51.886469] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-25T18:50:51.886542] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-25T18:50:51.886625] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-25T18:50:51.886743] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-25T18:50:52.247705] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:50:52.248041] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-25T18:50:53.885738] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T18:50:53.894319] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-25T18:50:55.547371] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T18:50:55.555775] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-25T18:50:57.455357] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T18:50:57.465336] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-25T18:50:58.493272] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T18:50:58.503546] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-25T18:50:59.435379] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T18:50:59.445754] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-25T18:51:00.404458] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T18:51:00.414007] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-25T18:51:02.061303] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T18:51:02.071318] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-25T18:51:02.860529] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T18:51:02.872219] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-25T18:51:03.909334] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T18:51:03.919164] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-25T18:51:04.391015] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-25T18:51:04.398860] [INFO ] [REMOTE ] AON: Full fetch complete (65206 records). [2025-10-25T18:51:04.399019] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-25T18:51:04.795946] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-25T18:51:04.796056] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-25T18:51:04.796732] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-25T18:51:04.796813] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-25T18:51:04.798091] [DEBUG] [LOCAL ] AON: Trimmed 65206 records to 45634 (keeping 200 days of data) [2025-10-25T18:51:05.080244] [DEBUG] [LOCAL ] AON: Primary data saved (45634 records). [2025-10-25T18:51:05.080840] [INFO ] [MAIN ] AON: Full history saved. [2025-10-25T18:51:05.080955] [INFO ] [MAIN ] Update Progress: 125/2366 symbols. AON took 13.4s. Estimated remaining time: 7h 51m 12s [2025-10-25T18:51:05.256792] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:51:05.257049] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-25T18:51:05.257120] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-25T18:51:05.257240] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-25T18:51:05.257316] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-25T18:51:05.257396] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-25T18:51:05.257463] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-25T18:51:05.613891] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:51:05.614237] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-25T18:51:06.861084] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T18:51:06.867020] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-25T18:51:08.294720] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T18:51:08.300583] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-25T18:51:09.728041] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-25T18:51:09.738135] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-25T18:51:11.182089] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T18:51:11.188799] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-25T18:51:12.626843] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-25T18:51:12.633635] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-25T18:51:13.858674] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T18:51:13.864437] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-25T18:51:15.129724] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T18:51:15.135668] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-25T18:51:16.568365] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T18:51:16.575787] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-25T18:51:18.017611] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T18:51:18.024387] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-25T18:51:19.684504] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-25T18:51:19.689631] [INFO ] [REMOTE ] AORT: Full fetch complete (42387 records). [2025-10-25T18:51:19.689818] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-25T18:51:20.083094] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-25T18:51:20.083222] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-25T18:51:20.083798] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-25T18:51:20.083878] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-25T18:51:20.084969] [DEBUG] [LOCAL ] AORT: Trimmed 42387 records to 29251 (keeping 200 days of data) [2025-10-25T18:51:20.249249] [DEBUG] [LOCAL ] AORT: Primary data saved (29251 records). [2025-10-25T18:51:20.249410] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-25T18:51:20.249495] [INFO ] [MAIN ] Update Progress: 126/2366 symbols. AORT took 15.2s. Estimated remaining time: 7h 51m 44s [2025-10-25T18:51:20.421126] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:51:20.421301] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-25T18:51:20.421379] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-25T18:51:20.421468] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-25T18:51:20.421535] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-25T18:51:20.421616] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-25T18:51:20.421703] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-25T18:51:20.788373] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:51:20.788775] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-25T18:51:22.427443] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T18:51:22.437562] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-25T18:51:24.156933] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T18:51:24.166321] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-25T18:51:25.917620] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T18:51:25.928101] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-25T18:51:27.946481] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-25T18:51:27.957933] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-25T18:51:29.574334] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T18:51:29.584862] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-25T18:51:31.295492] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T18:51:31.305888] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-25T18:51:33.025831] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-25T18:51:33.036936] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-25T18:51:34.588794] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T18:51:34.598839] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-25T18:51:36.301630] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-25T18:51:36.311434] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-25T18:51:38.028417] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-25T18:51:38.037434] [INFO ] [REMOTE ] AOS: Full fetch complete (71081 records). [2025-10-25T18:51:38.037608] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-25T18:51:38.426070] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-25T18:51:38.426172] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-25T18:51:38.426916] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-25T18:51:38.427010] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-25T18:51:38.428367] [DEBUG] [LOCAL ] AOS: Trimmed 71081 records to 49354 (keeping 200 days of data) [2025-10-25T18:51:38.709869] [DEBUG] [LOCAL ] AOS: Primary data saved (49354 records). [2025-10-25T18:51:38.710022] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-25T18:51:38.710125] [INFO ] [MAIN ] Update Progress: 127/2366 symbols. AOS took 18.5s. Estimated remaining time: 7h 53m 14s [2025-10-25T18:51:38.878197] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:51:38.878346] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-25T18:51:38.878416] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-25T18:51:38.878527] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-25T18:51:38.878596] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-25T18:51:38.878697] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-25T18:51:38.878769] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-25T18:51:39.232020] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:51:39.232332] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-25T18:51:39.948614] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T18:51:39.950094] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-25T18:51:40.616371] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T18:51:40.617886] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-25T18:51:41.272044] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-25T18:51:41.273484] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-25T18:51:41.983574] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T18:51:41.985258] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-25T18:51:42.821806] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T18:51:42.824174] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-25T18:51:43.736406] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T18:51:43.739431] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-25T18:51:44.621760] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T18:51:44.624400] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-25T18:51:45.467267] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T18:51:45.469389] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-25T18:51:46.511296] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T18:51:46.513528] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-25T18:51:47.286243] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T18:51:47.287938] [INFO ] [REMOTE ] AP: Full fetch complete (9131 records). [2025-10-25T18:51:47.288028] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-25T18:51:47.647433] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-25T18:51:47.647550] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-25T18:51:47.647801] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-25T18:51:47.647879] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-25T18:51:47.648357] [DEBUG] [LOCAL ] AP: Trimmed 9131 records to 7509 (keeping 200 days of data) [2025-10-25T18:51:47.689304] [DEBUG] [LOCAL ] AP: Primary data saved (7509 records). [2025-10-25T18:51:47.689464] [INFO ] [MAIN ] AP: Full history saved. [2025-10-25T18:51:47.689572] [INFO ] [MAIN ] Update Progress: 128/2366 symbols. AP took 9.0s. Estimated remaining time: 7h 51m 57s [2025-10-25T18:51:47.861919] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:51:47.862110] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-25T18:51:47.862184] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-25T18:51:47.862298] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-25T18:51:47.862367] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-25T18:51:47.862447] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-25T18:51:47.862516] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-25T18:51:48.220548] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:51:48.220953] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-25T18:51:49.656029] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T18:51:49.662956] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-25T18:51:51.056218] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T18:51:51.063228] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-25T18:51:52.284908] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-25T18:51:52.292789] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-25T18:51:53.876809] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T18:51:53.886018] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-25T18:51:55.275760] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T18:51:55.284027] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-25T18:51:56.689714] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T18:51:56.697346] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-25T18:51:58.194537] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T18:51:58.208071] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-25T18:51:59.628057] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T18:51:59.635768] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-25T18:52:01.454555] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T18:52:01.461568] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-25T18:52:03.556421] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-25T18:52:03.562437] [INFO ] [REMOTE ] APAM: Full fetch complete (51922 records). [2025-10-25T18:52:03.562557] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-25T18:52:03.934452] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-25T18:52:03.934564] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-25T18:52:03.935138] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-25T18:52:03.935216] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-25T18:52:03.936232] [DEBUG] [LOCAL ] APAM: Trimmed 51922 records to 36093 (keeping 200 days of data) [2025-10-25T18:52:04.144910] [DEBUG] [LOCAL ] APAM: Primary data saved (36093 records). [2025-10-25T18:52:04.145073] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-25T18:52:04.145159] [INFO ] [MAIN ] Update Progress: 129/2366 symbols. APAM took 16.5s. Estimated remaining time: 7h 52m 50s [2025-10-25T18:52:04.312350] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:52:04.312561] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-10-25T18:52:04.312633] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-10-25T18:52:04.312776] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-25T18:52:04.312850] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-25T18:52:04.312935] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-25T18:52:04.312996] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-25T18:52:04.660803] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:52:04.661133] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-25T18:52:06.393168] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T18:52:06.402924] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-25T18:52:08.092997] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T18:52:08.102366] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-25T18:52:09.788295] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T18:52:09.798121] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-25T18:52:10.952601] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T18:52:10.962806] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-25T18:52:11.822162] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T18:52:11.831836] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-25T18:52:12.737898] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T18:52:12.747638] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-25T18:52:13.802977] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T18:52:13.812936] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-25T18:52:14.708530] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T18:52:14.721085] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-25T18:52:15.240038] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-25T18:52:15.250990] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-25T18:52:16.226485] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T18:52:16.235098] [INFO ] [REMOTE ] APD: Full fetch complete (67280 records). [2025-10-25T18:52:16.235255] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-25T18:52:16.628023] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-25T18:52:16.628156] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-25T18:52:16.628873] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-25T18:52:16.628952] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-25T18:52:16.630297] [DEBUG] [LOCAL ] APD: Trimmed 67280 records to 46082 (keeping 200 days of data) [2025-10-25T18:52:16.910311] [DEBUG] [LOCAL ] APD: Primary data saved (46082 records). [2025-10-25T18:52:16.910463] [INFO ] [MAIN ] APD: Full history saved. [2025-10-25T18:52:16.910569] [INFO ] [MAIN ] Update Progress: 130/2366 symbols. APD took 12.8s. Estimated remaining time: 7h 52m 39s [2025-10-25T18:52:17.077940] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:52:17.078124] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-10-25T18:52:17.078195] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-10-25T18:52:17.078310] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-25T18:52:17.078399] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-25T18:52:17.078506] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-25T18:52:17.078574] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-25T18:52:17.436485] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:52:17.436872] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-25T18:52:19.063028] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T18:52:19.072605] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-25T18:52:20.725033] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T18:52:20.734246] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-25T18:52:22.564806] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T18:52:22.575002] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-25T18:52:24.372971] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-25T18:52:24.383151] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-25T18:52:26.220393] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-25T18:52:26.231201] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-25T18:52:27.873530] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T18:52:27.884029] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-25T18:52:29.769777] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-25T18:52:29.781004] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-25T18:52:31.539763] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T18:52:31.550750] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-25T18:52:33.344142] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T18:52:33.355914] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-25T18:52:34.929523] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T18:52:34.938736] [INFO ] [REMOTE ] APG: Full fetch complete (72264 records). [2025-10-25T18:52:34.938888] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-25T18:52:35.337080] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-25T18:52:35.337228] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-25T18:52:35.338255] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-25T18:52:35.338337] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-25T18:52:35.339742] [DEBUG] [LOCAL ] APG: Trimmed 72264 records to 51359 (keeping 200 days of data) [2025-10-25T18:52:35.624534] [DEBUG] [LOCAL ] APG: Primary data saved (51359 records). [2025-10-25T18:52:35.624713] [INFO ] [MAIN ] APG: Full history saved. [2025-10-25T18:52:35.624821] [INFO ] [MAIN ] Update Progress: 131/2366 symbols. APG took 18.7s. Estimated remaining time: 7h 54m 9s [2025-10-25T18:52:35.799190] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:52:35.799419] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-25T18:52:35.799499] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-25T18:52:35.799613] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-25T18:52:35.799719] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-25T18:52:35.799819] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-25T18:52:35.799890] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-25T18:52:36.156117] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:52:36.156507] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-25T18:52:38.282048] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-25T18:52:38.292721] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-25T18:52:39.971738] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T18:52:39.981967] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-25T18:52:41.956373] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T18:52:41.967670] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-25T18:52:42.999895] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T18:52:43.011017] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-25T18:52:43.969547] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T18:52:43.980553] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-25T18:52:45.005512] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T18:52:45.016662] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-25T18:52:46.037421] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T18:52:46.049103] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-25T18:52:47.015209] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T18:52:47.027513] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-25T18:52:47.932529] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T18:52:47.944439] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-25T18:52:48.480233] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T18:52:48.490307] [INFO ] [REMOTE ] APH: Full fetch complete (77870 records). [2025-10-25T18:52:48.490475] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-25T18:52:48.880938] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-25T18:52:48.881052] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-25T18:52:48.881836] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-25T18:52:48.881915] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-25T18:52:48.883329] [DEBUG] [LOCAL ] APH: Trimmed 77870 records to 54471 (keeping 200 days of data) [2025-10-25T18:52:49.208603] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-10-25T18:52:49.208797] [INFO ] [MAIN ] APH: Full history saved. [2025-10-25T18:52:49.208909] [INFO ] [MAIN ] Update Progress: 132/2366 symbols. APH took 13.6s. Estimated remaining time: 7h 54m 11s [2025-10-25T18:52:49.376131] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:52:49.376306] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-25T18:52:49.376375] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-25T18:52:49.376484] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-25T18:52:49.376554] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-25T18:52:49.376634] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-25T18:52:49.376728] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-25T18:52:49.735745] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:52:49.736112] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-25T18:52:51.491137] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T18:52:51.504817] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-25T18:52:53.213547] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T18:52:53.223356] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-25T18:52:54.948693] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T18:52:54.959400] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-25T18:52:55.954391] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T18:52:55.965298] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-25T18:52:56.989174] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:52:56.999944] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-25T18:52:57.978202] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T18:52:57.989255] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-25T18:52:58.892586] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T18:52:58.904121] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-25T18:52:59.969769] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T18:52:59.981309] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-25T18:53:01.519588] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T18:53:01.530441] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-25T18:53:04.399151] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-25T18:53:04.408770] [INFO ] [REMOTE ] APLE: Full fetch complete (74779 records). [2025-10-25T18:53:04.408962] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-25T18:53:04.808072] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-25T18:53:04.808223] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-25T18:53:04.809068] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-25T18:53:04.809152] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-25T18:53:04.810662] [DEBUG] [LOCAL ] APLE: Trimmed 74779 records to 52707 (keeping 200 days of data) [2025-10-25T18:53:05.120285] [DEBUG] [LOCAL ] APLE: Primary data saved (52707 records). [2025-10-25T18:53:05.120438] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-25T18:53:05.120544] [INFO ] [MAIN ] Update Progress: 133/2366 symbols. APLE took 15.9s. Estimated remaining time: 7h 54m 52s [2025-10-25T18:53:05.287051] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:53:05.287240] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-10-25T18:53:05.287313] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-10-25T18:53:05.287423] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-25T18:53:05.287493] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-25T18:53:05.287574] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-25T18:53:05.287661] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-25T18:53:05.653847] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:53:05.654243] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-25T18:53:07.691031] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-25T18:53:07.701718] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-25T18:53:09.577080] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T18:53:09.587075] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-25T18:53:11.634187] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-25T18:53:11.645669] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-25T18:53:12.754630] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T18:53:12.766188] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-25T18:53:13.788784] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:53:13.800518] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-25T18:53:14.883701] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T18:53:14.894613] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-25T18:53:16.025984] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T18:53:16.037482] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-25T18:53:17.575391] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T18:53:17.586597] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-25T18:53:18.573763] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T18:53:18.585212] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-25T18:53:19.525572] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T18:53:19.535550] [INFO ] [REMOTE ] APO: Full fetch complete (77464 records). [2025-10-25T18:53:19.535769] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-25T18:53:19.959002] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-25T18:53:19.959117] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-25T18:53:19.959917] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-25T18:53:19.959998] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-25T18:53:19.961498] [DEBUG] [LOCAL ] APO: Trimmed 77464 records to 54163 (keeping 200 days of data) [2025-10-25T18:53:20.285620] [DEBUG] [LOCAL ] APO: Primary data saved (54163 records). [2025-10-25T18:53:20.285790] [INFO ] [MAIN ] APO: Full history saved. [2025-10-25T18:53:20.285915] [INFO ] [MAIN ] Update Progress: 134/2366 symbols. APO took 15.2s. Estimated remaining time: 7h 55m 19s [2025-10-25T18:53:20.454621] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:53:20.454818] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-25T18:53:20.454908] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-25T18:53:20.455045] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-25T18:53:20.455135] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-25T18:53:20.455241] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-25T18:53:20.455328] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-25T18:53:20.815140] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:53:20.815557] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-25T18:53:21.612606] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T18:53:21.614401] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-25T18:53:22.438317] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-25T18:53:22.440762] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-25T18:53:23.299884] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T18:53:23.303626] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-25T18:53:24.233293] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T18:53:24.237506] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-25T18:53:25.027963] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T18:53:25.030183] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-25T18:53:25.848705] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T18:53:25.851162] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-25T18:53:26.596813] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T18:53:26.598849] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-25T18:53:27.309330] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T18:53:27.311324] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-25T18:53:28.113847] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T18:53:28.117107] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-25T18:53:28.848997] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T18:53:28.850582] [INFO ] [REMOTE ] APOS: Full fetch complete (10231 records). [2025-10-25T18:53:28.850718] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-25T18:53:29.232898] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-25T18:53:29.233063] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-25T18:53:29.233512] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-25T18:53:29.233596] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-25T18:53:29.234139] [DEBUG] [LOCAL ] APOS: Trimmed 10231 records to 7137 (keeping 200 days of data) [2025-10-25T18:53:29.278967] [DEBUG] [LOCAL ] APOS: Primary data saved (7137 records). [2025-10-25T18:53:29.279181] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-25T18:53:29.279312] [INFO ] [MAIN ] Update Progress: 135/2366 symbols. APOS took 9.0s. Estimated remaining time: 7h 54m 4s [2025-10-25T18:53:29.476986] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:53:29.477272] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-25T18:53:29.477349] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-25T18:53:29.477480] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-25T18:53:29.477557] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-25T18:53:29.477665] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-25T18:53:29.477737] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-25T18:53:29.872928] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:53:29.873423] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-25T18:53:31.559368] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T18:53:31.569830] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-25T18:53:33.396956] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T18:53:33.407291] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-25T18:53:35.233546] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T18:53:35.244949] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-25T18:53:36.189503] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T18:53:36.203318] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-25T18:53:37.301293] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T18:53:37.312921] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-25T18:53:38.252740] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T18:53:38.270057] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-25T18:53:39.219071] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T18:53:39.230578] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-25T18:53:40.331531] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T18:53:40.342748] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-25T18:53:41.263581] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T18:53:41.274567] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-25T18:53:42.236839] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:53:42.245975] [INFO ] [REMOTE ] APTV: Full fetch complete (75786 records). [2025-10-25T18:53:42.246120] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-25T18:53:42.640459] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-25T18:53:42.640580] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-25T18:53:42.641346] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-25T18:53:42.641425] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-25T18:53:42.642873] [DEBUG] [LOCAL ] APTV: Trimmed 75786 records to 52575 (keeping 200 days of data) [2025-10-25T18:53:42.938592] [DEBUG] [LOCAL ] APTV: Primary data saved (52575 records). [2025-10-25T18:53:42.938774] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-25T18:53:42.938890] [INFO ] [MAIN ] Update Progress: 136/2366 symbols. APTV took 13.7s. Estimated remaining time: 7h 54m 6s [2025-10-25T18:53:43.110773] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:53:43.111217] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-25T18:53:43.111291] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-25T18:53:43.111416] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-25T18:53:43.111490] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-25T18:53:43.111570] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-25T18:53:43.111638] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-25T18:53:43.464120] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:53:43.464454] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-25T18:53:45.213511] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T18:53:45.223633] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-25T18:53:47.162799] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T18:53:47.172507] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-25T18:53:49.046591] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T18:53:49.057555] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-25T18:53:50.000218] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T18:53:50.014074] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-25T18:53:51.006613] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T18:53:51.017780] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-25T18:53:51.915956] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T18:53:51.926498] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-25T18:53:52.933244] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T18:53:52.944520] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-25T18:53:53.936268] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T18:53:53.947241] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-25T18:53:54.843769] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T18:53:54.854986] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-25T18:53:55.752039] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T18:53:55.761169] [INFO ] [REMOTE ] AQN: Full fetch complete (75300 records). [2025-10-25T18:53:55.761328] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-25T18:53:56.148119] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-25T18:53:56.148231] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-25T18:53:56.149003] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-25T18:53:56.149082] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-25T18:53:56.150419] [DEBUG] [LOCAL ] AQN: Trimmed 75300 records to 52380 (keeping 200 days of data) [2025-10-25T18:53:56.437751] [DEBUG] [LOCAL ] AQN: Primary data saved (52380 records). [2025-10-25T18:53:56.437907] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-25T18:53:56.438009] [INFO ] [MAIN ] Update Progress: 137/2366 symbols. AQN took 13.5s. Estimated remaining time: 7h 54m 5s [2025-10-25T18:53:56.616400] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:53:56.617585] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-10-25T18:53:56.617678] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-10-25T18:53:56.617838] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-25T18:53:56.617912] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-25T18:53:56.617990] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-25T18:53:56.618058] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-25T18:53:56.974254] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:53:56.974580] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-25T18:53:57.545463] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-25T18:53:57.548211] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-25T18:53:58.063141] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-25T18:53:58.064312] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-25T18:53:58.754296] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-25T18:53:58.755911] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-25T18:53:59.516021] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T18:53:59.517835] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-25T18:54:00.156501] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-25T18:54:00.158122] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-25T18:54:01.697770] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T18:54:01.700810] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-25T18:54:02.913344] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T18:54:02.914893] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-25T18:54:03.544514] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-25T18:54:03.546748] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-25T18:54:04.185297] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T18:54:04.186826] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-25T18:54:04.933976] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T18:54:04.934988] [INFO ] [REMOTE ] AQNB: Full fetch complete (5364 records). [2025-10-25T18:54:04.935075] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-25T18:54:05.304857] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-25T18:54:05.304973] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-25T18:54:05.305168] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-25T18:54:05.305248] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-25T18:54:05.305615] [DEBUG] [LOCAL ] AQNB: Trimmed 5364 records to 3910 (keeping 200 days of data) [2025-10-25T18:54:05.328954] [DEBUG] [LOCAL ] AQNB: Primary data saved (3910 records). [2025-10-25T18:54:05.329119] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-25T18:54:05.329239] [INFO ] [MAIN ] Update Progress: 138/2366 symbols. AQNB took 8.9s. Estimated remaining time: 7h 52m 50s [2025-10-25T18:54:05.495417] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:54:05.495670] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-25T18:54:05.495743] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-25T18:54:05.495830] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-25T18:54:05.495898] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-25T18:54:05.495979] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-25T18:54:05.496048] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-25T18:54:05.849917] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:54:05.850304] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-25T18:54:07.640842] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T18:54:07.651690] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-25T18:54:09.356357] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T18:54:09.367088] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-25T18:54:11.156074] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T18:54:11.167000] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-25T18:54:12.157396] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T18:54:12.169903] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-25T18:54:13.213377] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T18:54:13.224441] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-25T18:54:14.158373] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T18:54:14.169407] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-25T18:54:15.115967] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T18:54:15.127597] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-25T18:54:16.020495] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T18:54:16.031831] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-25T18:54:16.977731] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T18:54:16.989255] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-25T18:54:17.926433] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T18:54:17.936210] [INFO ] [REMOTE ] AR: Full fetch complete (77736 records). [2025-10-25T18:54:17.936360] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-25T18:54:18.335096] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-25T18:54:18.335213] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-25T18:54:18.336194] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-25T18:54:18.336278] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-25T18:54:18.337845] [DEBUG] [LOCAL ] AR: Trimmed 77736 records to 54367 (keeping 200 days of data) [2025-10-25T18:54:18.641410] [DEBUG] [LOCAL ] AR: Primary data saved (54367 records). [2025-10-25T18:54:18.641569] [INFO ] [MAIN ] AR: Full history saved. [2025-10-25T18:54:18.641701] [INFO ] [MAIN ] Update Progress: 139/2366 symbols. AR took 13.3s. Estimated remaining time: 7h 52m 46s [2025-10-25T18:54:18.814495] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:54:18.814719] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-25T18:54:18.814799] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-25T18:54:18.814919] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-25T18:54:18.814991] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-25T18:54:18.815069] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-25T18:54:18.815137] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-25T18:54:19.165263] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:54:19.165597] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-25T18:54:20.968076] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T18:54:20.977795] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-25T18:54:22.475579] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T18:54:22.484354] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-25T18:54:24.156757] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T18:54:24.165930] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-25T18:54:25.377171] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T18:54:25.386772] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-25T18:54:26.288611] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T18:54:26.298440] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-25T18:54:27.182689] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T18:54:27.191569] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-25T18:54:28.194996] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T18:54:28.204927] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-25T18:54:29.142764] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T18:54:29.152683] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-25T18:54:29.924385] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T18:54:29.933800] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-25T18:54:30.839477] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T18:54:30.847311] [INFO ] [REMOTE ] ARCO: Full fetch complete (64776 records). [2025-10-25T18:54:30.847503] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-25T18:54:31.253834] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-25T18:54:31.253965] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-25T18:54:31.254630] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-25T18:54:31.254729] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-25T18:54:31.255971] [DEBUG] [LOCAL ] ARCO: Trimmed 64776 records to 44792 (keeping 200 days of data) [2025-10-25T18:54:31.504803] [DEBUG] [LOCAL ] ARCO: Primary data saved (44792 records). [2025-10-25T18:54:31.504985] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-25T18:54:31.505098] [INFO ] [MAIN ] Update Progress: 140/2366 symbols. ARCO took 12.9s. Estimated remaining time: 7h 52m 36s [2025-10-25T18:54:31.677024] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:54:31.677254] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-10-25T18:54:31.677327] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-10-25T18:54:31.677437] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-25T18:54:31.677507] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-25T18:54:31.677586] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-25T18:54:31.677678] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-25T18:54:32.030739] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:54:32.031084] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-25T18:54:33.118779] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T18:54:33.121726] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-25T18:54:34.155360] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T18:54:34.158564] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-25T18:54:35.201894] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T18:54:35.205510] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-25T18:54:36.268614] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T18:54:36.272762] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-25T18:54:37.249505] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T18:54:37.252463] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-25T18:54:38.319561] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T18:54:38.323032] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-25T18:54:39.357110] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T18:54:39.361885] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-25T18:54:40.284214] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T18:54:40.287472] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-25T18:54:41.427016] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T18:54:41.431028] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-25T18:54:42.555820] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-25T18:54:42.559740] [INFO ] [REMOTE ] ARDC: Full fetch complete (21624 records). [2025-10-25T18:54:42.559849] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-25T18:54:42.944235] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-25T18:54:42.944385] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-25T18:54:42.944886] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-25T18:54:42.944989] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-25T18:54:42.945704] [DEBUG] [LOCAL ] ARDC: Trimmed 21624 records to 15417 (keeping 200 days of data) [2025-10-25T18:54:43.036272] [DEBUG] [LOCAL ] ARDC: Primary data saved (15417 records). [2025-10-25T18:54:43.036447] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-25T18:54:43.036594] [INFO ] [MAIN ] Update Progress: 141/2366 symbols. ARDC took 11.5s. Estimated remaining time: 7h 52m 4s [2025-10-25T18:54:43.215000] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:54:43.215207] [DEBUG] [LOCAL ] ARDT: No existing data file found in primary storage. [2025-10-25T18:54:43.215293] [WARN ] [MAIN ] ARDT: No existing data found, performing full refresh instead. [2025-10-25T18:54:43.215435] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-25T18:54:43.215541] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-25T18:54:43.215669] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-10-25T18:54:43.215764] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-25T18:54:43.581748] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:54:43.582114] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-25T18:54:44.884273] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T18:54:44.890417] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-25T18:54:46.246386] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-25T18:54:46.252741] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-25T18:54:47.670491] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T18:54:47.680739] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-25T18:54:49.031992] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T18:54:49.038823] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-25T18:54:50.143051] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T18:54:50.148389] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-25T18:54:51.243203] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T18:54:51.248613] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-25T18:54:52.717435] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T18:54:52.724823] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-25T18:54:54.108519] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T18:54:54.115107] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-25T18:54:55.285854] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T18:54:55.291880] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-25T18:54:56.559102] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T18:54:56.564905] [INFO ] [REMOTE ] ARDT: Full fetch complete (41645 records). [2025-10-25T18:54:56.565024] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-25T18:54:56.946266] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-25T18:54:56.946383] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-25T18:54:56.946896] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-25T18:54:56.946974] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-25T18:54:56.947974] [DEBUG] [LOCAL ] ARDT: Trimmed 41645 records to 27853 (keeping 200 days of data) [2025-10-25T18:54:57.107929] [DEBUG] [LOCAL ] ARDT: Primary data saved (27853 records). [2025-10-25T18:54:57.108079] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-25T18:54:57.108188] [INFO ] [MAIN ] Update Progress: 142/2366 symbols. ARDT took 14.1s. Estimated remaining time: 7h 52m 12s [2025-10-25T18:54:57.278771] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:54:57.278951] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-25T18:54:57.279021] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-25T18:54:57.279131] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-25T18:54:57.279202] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-25T18:54:57.279282] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-25T18:54:57.279349] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-25T18:54:57.640933] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:54:57.641309] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-25T18:54:59.400807] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T18:54:59.410698] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-25T18:55:01.275578] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T18:55:01.289107] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-25T18:55:03.451225] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-25T18:55:03.462618] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-25T18:55:04.479227] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T18:55:04.490985] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-25T18:55:05.875702] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T18:55:05.886772] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-25T18:55:07.144479] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-25T18:55:07.159681] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-25T18:55:08.142968] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T18:55:08.155195] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-25T18:55:09.173247] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T18:55:09.184391] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-25T18:55:10.159021] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T18:55:10.170410] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-25T18:55:11.501906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T18:55:11.511191] [INFO ] [REMOTE ] ARE: Full fetch complete (73039 records). [2025-10-25T18:55:11.511334] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-25T18:55:11.952795] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-25T18:55:11.952957] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-25T18:55:11.954235] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-25T18:55:11.954332] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-25T18:55:11.956448] [DEBUG] [LOCAL ] ARE: Trimmed 73039 records to 51653 (keeping 200 days of data) [2025-10-25T18:55:12.295962] [DEBUG] [LOCAL ] ARE: Primary data saved (51653 records). [2025-10-25T18:55:12.296194] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-25T18:55:12.296327] [INFO ] [MAIN ] Update Progress: 143/2366 symbols. ARE took 15.2s. Estimated remaining time: 7h 52m 37s [2025-10-25T18:55:12.480052] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:55:12.480421] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-25T18:55:12.480500] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-25T18:55:12.480674] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-25T18:55:12.480755] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-25T18:55:12.480844] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-25T18:55:12.480963] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-25T18:55:12.872718] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:55:12.873137] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-25T18:55:14.686112] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T18:55:14.695475] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-25T18:55:16.768839] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-25T18:55:16.777982] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-25T18:55:18.798014] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-25T18:55:18.808924] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-25T18:55:19.890272] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T18:55:19.901238] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-25T18:55:20.798292] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T18:55:20.809030] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-25T18:55:21.687472] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T18:55:21.697305] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-25T18:55:22.611768] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T18:55:22.622496] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-25T18:55:23.638882] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T18:55:23.649320] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-25T18:55:24.996914] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T18:55:25.007270] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-25T18:55:25.969791] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:55:25.979195] [INFO ] [REMOTE ] ARES: Full fetch complete (71727 records). [2025-10-25T18:55:25.979363] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-25T18:55:26.371021] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-25T18:55:26.371140] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-25T18:55:26.372035] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-25T18:55:26.372117] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-25T18:55:26.373526] [DEBUG] [LOCAL ] ARES: Trimmed 71727 records to 50410 (keeping 200 days of data) [2025-10-25T18:55:26.677791] [DEBUG] [LOCAL ] ARES: Primary data saved (50410 records). [2025-10-25T18:55:26.677958] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-25T18:55:26.678072] [INFO ] [MAIN ] Update Progress: 144/2366 symbols. ARES took 14.4s. Estimated remaining time: 7h 52m 50s [2025-10-25T18:55:26.848460] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:55:26.848729] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-25T18:55:26.848827] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-25T18:55:26.848939] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-25T18:55:26.849008] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-25T18:55:26.849089] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-25T18:55:26.849158] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-25T18:55:27.195937] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:55:27.196257] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-25T18:55:28.740251] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T18:55:28.748466] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-25T18:55:30.254884] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T18:55:30.263073] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-25T18:55:31.866398] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T18:55:31.874997] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-25T18:55:33.242374] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T18:55:33.252525] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-25T18:55:34.276229] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T18:55:34.291240] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-25T18:55:35.690232] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-25T18:55:35.700634] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-25T18:55:36.738972] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T18:55:36.750260] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-25T18:55:37.624350] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T18:55:37.633022] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-25T18:55:38.613191] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T18:55:38.623106] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-25T18:55:39.471184] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T18:55:39.479610] [INFO ] [REMOTE ] ARI: Full fetch complete (62221 records). [2025-10-25T18:55:39.479811] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-25T18:55:39.859914] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-25T18:55:39.860042] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-25T18:55:39.860746] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-25T18:55:39.860826] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-25T18:55:39.862073] [DEBUG] [LOCAL ] ARI: Trimmed 62221 records to 44089 (keeping 200 days of data) [2025-10-25T18:55:40.117985] [DEBUG] [LOCAL ] ARI: Primary data saved (44089 records). [2025-10-25T18:55:40.118139] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-25T18:55:40.118247] [INFO ] [MAIN ] Update Progress: 145/2366 symbols. ARI took 13.4s. Estimated remaining time: 7h 52m 47s [2025-10-25T18:55:40.291313] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:55:40.291495] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-25T18:55:40.291565] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-25T18:55:40.291700] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-25T18:55:40.291771] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-25T18:55:40.291867] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-25T18:55:40.291935] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-25T18:55:40.657547] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:55:40.657938] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-25T18:55:42.204756] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T18:55:42.213348] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-25T18:55:43.620037] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-25T18:55:43.627799] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-25T18:55:45.302199] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T18:55:45.312059] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-25T18:55:46.308524] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T18:55:46.317905] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-25T18:55:47.539325] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T18:55:47.548077] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-25T18:55:48.612495] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T18:55:48.622380] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-25T18:55:49.447755] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T18:55:49.457666] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-25T18:55:50.405139] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T18:55:50.415519] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-25T18:55:51.317431] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T18:55:51.327363] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-25T18:55:52.090002] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T18:55:52.097939] [INFO ] [REMOTE ] ARLO: Full fetch complete (63179 records). [2025-10-25T18:55:52.098085] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-25T18:55:52.503569] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-25T18:55:52.503705] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-25T18:55:52.504342] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-25T18:55:52.504417] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-25T18:55:52.505635] [DEBUG] [LOCAL ] ARLO: Trimmed 63179 records to 44193 (keeping 200 days of data) [2025-10-25T18:55:52.756126] [DEBUG] [LOCAL ] ARLO: Primary data saved (44193 records). [2025-10-25T18:55:52.756277] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-25T18:55:52.756379] [INFO ] [MAIN ] Update Progress: 146/2366 symbols. ARLO took 12.6s. Estimated remaining time: 7h 52m 32s [2025-10-25T18:55:52.937008] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:55:52.937185] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-25T18:55:52.937269] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-25T18:55:52.937381] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-25T18:55:52.937449] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-25T18:55:52.937511] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-25T18:55:52.937574] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-25T18:55:53.318055] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:55:53.318393] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-25T18:55:54.956413] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T18:55:54.966202] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-25T18:55:56.417517] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T18:55:56.427142] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-25T18:55:58.337333] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T18:55:58.347664] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-25T18:55:59.384493] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T18:55:59.394913] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-25T18:56:00.324220] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T18:56:00.334735] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-25T18:56:01.588233] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T18:56:01.598814] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-25T18:56:03.511011] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-25T18:56:03.522399] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-25T18:56:04.958769] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T18:56:04.969228] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-25T18:56:05.937894] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T18:56:05.948477] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-25T18:56:06.826947] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T18:56:06.836251] [INFO ] [REMOTE ] ARMK: Full fetch complete (73003 records). [2025-10-25T18:56:06.836417] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-25T18:56:07.225171] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-25T18:56:07.225283] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-25T18:56:07.226019] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-25T18:56:07.226097] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-25T18:56:07.227451] [DEBUG] [LOCAL ] ARMK: Trimmed 73003 records to 51086 (keeping 200 days of data) [2025-10-25T18:56:07.516702] [DEBUG] [LOCAL ] ARMK: Primary data saved (51086 records). [2025-10-25T18:56:07.516831] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-25T18:56:07.516945] [INFO ] [MAIN ] Update Progress: 147/2366 symbols. ARMK took 14.8s. Estimated remaining time: 7h 52m 50s [2025-10-25T18:56:07.687635] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:56:07.687835] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-25T18:56:07.687905] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-25T18:56:07.688016] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-25T18:56:07.688087] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-25T18:56:07.688167] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-25T18:56:07.688252] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-25T18:56:08.040171] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:56:08.040576] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-25T18:56:09.750145] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T18:56:09.759925] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-25T18:56:11.400374] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T18:56:11.409940] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-25T18:56:13.171059] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-25T18:56:13.185536] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-25T18:56:14.129297] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T18:56:14.139791] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-25T18:56:15.102163] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T18:56:15.112131] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-25T18:56:16.061249] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T18:56:16.071011] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-25T18:56:16.926063] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T18:56:16.936865] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-25T18:56:18.009473] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T18:56:18.019944] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-25T18:56:19.303821] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T18:56:19.314786] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-25T18:56:20.278791] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:56:20.287823] [INFO ] [REMOTE ] AROC: Full fetch complete (71408 records). [2025-10-25T18:56:20.287957] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-25T18:56:20.679440] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-25T18:56:20.679565] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-25T18:56:20.680293] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-25T18:56:20.680373] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-25T18:56:20.681722] [DEBUG] [LOCAL ] AROC: Trimmed 71408 records to 49804 (keeping 200 days of data) [2025-10-25T18:56:20.964292] [DEBUG] [LOCAL ] AROC: Primary data saved (49804 records). [2025-10-25T18:56:20.964441] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-25T18:56:20.964546] [INFO ] [MAIN ] Update Progress: 148/2366 symbols. AROC took 13.4s. Estimated remaining time: 7h 52m 47s [2025-10-25T18:56:21.137294] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:56:21.137523] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-25T18:56:21.137600] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-25T18:56:21.137744] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-25T18:56:21.137818] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-25T18:56:21.137902] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-25T18:56:21.137974] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-25T18:56:21.491148] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:56:21.491475] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-25T18:56:23.310607] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T18:56:23.320812] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-25T18:56:25.236265] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T18:56:25.247832] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-25T18:56:27.137742] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-25T18:56:27.149439] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-25T18:56:28.110414] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T18:56:28.121891] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-25T18:56:29.040880] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T18:56:29.052306] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-25T18:56:29.977313] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T18:56:29.988541] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-25T18:56:31.189747] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T18:56:31.201218] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-25T18:56:32.274364] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T18:56:32.285469] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-25T18:56:33.188517] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T18:56:33.199525] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-25T18:56:34.158827] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T18:56:34.168296] [INFO ] [REMOTE ] ARR: Full fetch complete (75520 records). [2025-10-25T18:56:34.168442] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-25T18:56:34.558416] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-25T18:56:34.558529] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-25T18:56:34.559285] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-25T18:56:34.559364] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-25T18:56:34.560760] [DEBUG] [LOCAL ] ARR: Trimmed 75520 records to 52859 (keeping 200 days of data) [2025-10-25T18:56:34.876377] [DEBUG] [LOCAL ] ARR: Primary data saved (52859 records). [2025-10-25T18:56:34.876565] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-25T18:56:34.876759] [INFO ] [MAIN ] Update Progress: 149/2366 symbols. ARR took 13.9s. Estimated remaining time: 7h 52m 51s [2025-10-25T18:56:35.060570] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:56:35.060824] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-25T18:56:35.060899] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-25T18:56:35.060988] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-25T18:56:35.061059] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-25T18:56:35.061120] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-25T18:56:35.061185] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-25T18:56:35.419266] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:56:35.419603] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-25T18:56:36.981267] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T18:56:36.987965] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-25T18:56:38.594144] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T18:56:38.601309] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-25T18:56:40.056377] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T18:56:40.063888] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-25T18:56:41.606348] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T18:56:41.614922] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-25T18:56:43.080250] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T18:56:43.087774] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-25T18:56:44.409393] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T18:56:44.416254] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-25T18:56:45.747145] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T18:56:45.754062] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-25T18:56:47.108726] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T18:56:47.116050] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-25T18:56:48.484032] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T18:56:48.491422] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-25T18:56:50.003118] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-25T18:56:50.009467] [INFO ] [REMOTE ] ARW: Full fetch complete (48628 records). [2025-10-25T18:56:50.009578] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-25T18:56:50.384663] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-25T18:56:50.384777] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-25T18:56:50.385333] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-25T18:56:50.385408] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-25T18:56:50.386436] [DEBUG] [LOCAL ] ARW: Trimmed 48628 records to 33601 (keeping 200 days of data) [2025-10-25T18:56:50.577901] [DEBUG] [LOCAL ] ARW: Primary data saved (33601 records). [2025-10-25T18:56:50.578057] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-25T18:56:50.578176] [INFO ] [MAIN ] Update Progress: 150/2366 symbols. ARW took 15.7s. Estimated remaining time: 7h 53m 21s [2025-10-25T18:56:50.745151] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:56:50.745355] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-25T18:56:50.745425] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-25T18:56:50.745537] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-25T18:56:50.745607] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-25T18:56:50.745710] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-25T18:56:50.745777] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-25T18:56:51.097321] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:56:51.097680] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-25T18:56:51.402927] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:56:51.403248] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-25T18:56:51.403350] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:56:51.403425] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-25T18:56:51.403489] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:56:51.403559] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-25T18:56:51.403676] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-25T18:56:51.403765] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-25T18:56:51.403844] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-25T18:56:51.403928] [INFO ] [MAIN ] Update Progress: 151/2366 symbols. ARX took 0.8s. Estimated remaining time: 7h 50m 12s [2025-10-25T18:56:51.578972] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:56:51.579179] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-10-25T18:56:51.579249] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-10-25T18:56:51.579365] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-25T18:56:51.579442] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-25T18:56:51.579527] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-25T18:56:51.579594] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-25T18:56:51.933232] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:56:51.933581] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-25T18:56:53.776987] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T18:56:53.788312] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-25T18:56:55.830486] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-25T18:56:55.840270] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-25T18:56:57.689448] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T18:56:57.700336] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-25T18:56:58.720671] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T18:56:58.732251] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-25T18:56:59.559042] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T18:56:59.570128] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-25T18:57:00.498397] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T18:57:00.509074] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-25T18:57:01.927998] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T18:57:01.940133] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-25T18:57:02.981016] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T18:57:02.992238] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-25T18:57:04.050059] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T18:57:04.061376] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-25T18:57:05.037465] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T18:57:05.047399] [INFO ] [REMOTE ] AS: Full fetch complete (76925 records). [2025-10-25T18:57:05.047550] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-25T18:57:05.438299] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-25T18:57:05.438415] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-25T18:57:05.439203] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-25T18:57:05.439296] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-25T18:57:05.440782] [DEBUG] [LOCAL ] AS: Trimmed 76925 records to 53975 (keeping 200 days of data) [2025-10-25T18:57:05.742606] [DEBUG] [LOCAL ] AS: Primary data saved (53975 records). [2025-10-25T18:57:05.742850] [INFO ] [MAIN ] AS: Full history saved. [2025-10-25T18:57:05.742990] [INFO ] [MAIN ] Update Progress: 152/2366 symbols. AS took 14.3s. Estimated remaining time: 7h 50m 23s [2025-10-25T18:57:05.911731] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:05.911917] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-25T18:57:05.911986] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-25T18:57:05.912097] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-25T18:57:05.912166] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-25T18:57:05.912244] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-25T18:57:05.912312] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-25T18:57:06.263947] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:57:06.264275] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-25T18:57:07.585588] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T18:57:07.588576] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-25T18:57:08.559004] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-25T18:57:08.562065] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-25T18:57:09.567741] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T18:57:09.570544] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-25T18:57:10.643920] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T18:57:10.650964] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-25T18:57:12.083823] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T18:57:12.087273] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-25T18:57:12.941351] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T18:57:12.944445] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-25T18:57:14.077693] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T18:57:14.081238] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-25T18:57:15.137200] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T18:57:15.141226] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-25T18:57:16.455087] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T18:57:16.460495] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-25T18:57:17.866204] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T18:57:17.873155] [INFO ] [REMOTE ] ASA: Full fetch complete (20849 records). [2025-10-25T18:57:17.873379] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-25T18:57:18.276447] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-25T18:57:18.276586] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-25T18:57:18.277013] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-25T18:57:18.277105] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-25T18:57:18.277792] [DEBUG] [LOCAL ] ASA: Trimmed 20849 records to 15913 (keeping 200 days of data) [2025-10-25T18:57:18.371616] [DEBUG] [LOCAL ] ASA: Primary data saved (15913 records). [2025-10-25T18:57:18.371824] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-25T18:57:18.371965] [INFO ] [MAIN ] Update Progress: 153/2366 symbols. ASA took 12.6s. Estimated remaining time: 7h 50m 8s [2025-10-25T18:57:18.564242] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:18.564437] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-25T18:57:18.564508] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-25T18:57:18.564669] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-25T18:57:18.564793] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-25T18:57:18.564897] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-25T18:57:18.564969] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-25T18:57:18.928426] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:57:18.928776] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-25T18:57:21.113704] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-25T18:57:21.125547] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-25T18:57:22.973621] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-25T18:57:22.985034] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-25T18:57:25.070016] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-25T18:57:25.081231] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-25T18:57:26.331592] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T18:57:26.342678] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-25T18:57:27.312510] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T18:57:27.325401] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-25T18:57:28.330953] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T18:57:28.343396] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-25T18:57:29.297371] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T18:57:29.309158] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-25T18:57:30.462688] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T18:57:30.474048] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-25T18:57:31.720493] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T18:57:31.731776] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-25T18:57:32.665104] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T18:57:32.675106] [INFO ] [REMOTE ] ASAN: Full fetch complete (76628 records). [2025-10-25T18:57:32.675255] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-25T18:57:33.061991] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-25T18:57:33.062105] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-25T18:57:33.062888] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-25T18:57:33.062966] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-25T18:57:33.064407] [DEBUG] [LOCAL ] ASAN: Trimmed 76628 records to 53499 (keeping 200 days of data) [2025-10-25T18:57:33.363682] [DEBUG] [LOCAL ] ASAN: Primary data saved (53499 records). [2025-10-25T18:57:33.363866] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-25T18:57:33.363991] [INFO ] [MAIN ] Update Progress: 154/2366 symbols. ASAN took 15.0s. Estimated remaining time: 7h 50m 28s [2025-10-25T18:57:33.531691] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:33.531898] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-25T18:57:33.531970] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-25T18:57:33.532104] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-25T18:57:33.532182] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-25T18:57:33.532279] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-25T18:57:33.532347] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-25T18:57:33.911789] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:57:33.912197] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-25T18:57:35.598553] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T18:57:35.608965] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-25T18:57:37.161691] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T18:57:37.171007] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-25T18:57:39.029524] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T18:57:39.040463] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-25T18:57:39.196151] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-10-25T18:57:39.196423] [WARN ] [STATE ] Operation was interrupted, setting state to COMPLETED_ERROR [2025-10-25T18:57:39.196681] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-10-25T18:57:39.196915] [INFO ] [STATE ] Last completion updated: 2025-10-25T18:57:39.196763 [2025-10-25T18:57:40.075873] [WARN ] [REMOTE ] ASB: Shutdown requested, stopping month iteration [2025-10-25T18:57:40.076059] [WARN ] [MAIN ] ASB: Shutdown requested, aborting refresh [2025-10-25T18:57:40.076149] [INFO ] [MAIN ] Update Progress: 155/2366 symbols. ASB took 6.7s. Estimated remaining time: 7h 48m 49s [2025-10-25T18:57:40.076224] [WARN ] [MAIN ] Shutdown requested. Stopping update at symbol 156/2366. [2025-10-25T18:57:40.076309] [WARN ] [MAIN ] Failed symbols (14): AAM, AAUC, AD, AEXA, AHL, AII, AKA, ALH, AMBQ, AMRZ, ANGX, AOMD, ARX, ASB [2025-10-25T18:57:40.076389] [INFO ] [MAIN ] Update success rate: 99.4% (2352/2366 symbols) [2025-10-25T18:57:41.699261] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Data Update Completed (2352/2366 @ 99.41%)' [2025-10-25T18:57:41.823855] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.488255] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.529149] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.570820] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.592301] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.633750] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.673970] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.716488] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.757993] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.797765] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.842366] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.882410] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.927162] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:42.964037] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.007178] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.049969] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.093318] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.134327] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.154128] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.216420] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.237323] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.279323] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.319996] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.361675] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.403110] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.444086] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.486025] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.529261] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.570052] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.614739] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.654880] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.698600] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.715679] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-25T18:57:43.728968] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Update Failed' [2025-10-25T18:57:43.729326] [INFO ] [STATE ] TDM shutdown complete. [2025-10-25T18:57:46.426234] [INFO ] [MAIN ] Using last completed trading day: 2025-10-24 [2025-10-25T18:57:46.611719] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-25T18:57:46.612001] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-25T18:57:46.684100] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-25T18:57:46.684530] [WARN ] [STATE ] State set to: RUNNING [2025-10-25T18:57:46.684615] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-25T18:57:46.684726] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-25T18:57:46.684892] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-25T18:57:46.684967] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-25T18:57:47.951456] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-25T18:57:47.951629] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-25T18:57:47.951924] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-25T18:57:47.952458] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-25T18:57:47.952532] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-25T18:57:47.952577] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-25T18:57:47.952677] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-25T18:57:47.952776] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-25T18:57:47.952848] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-25T18:57:47.953229] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-25T18:57:47.953294] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-25T18:57:47.953485] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-25T18:57:47.953554] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-25T18:57:47.953622] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-25T18:57:47.953718] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-25T18:57:47.954035] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-25T18:57:47.954156] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-25T18:57:47.954230] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-25T18:57:47.954298] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-25T18:57:47.954364] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-25T18:57:47.954452] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-25T18:57:47.954870] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-25T18:57:47.954939] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-25T18:57:47.955009] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-25T18:57:47.955075] [INFO ] [MAIN ] Running in single-threaded mode [2025-10-25T18:57:48.124844] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:48.184464] [DEBUG] [LOCAL ] A: Loaded 51315 existing records from primary storage. [2025-10-25T18:57:48.184862] [INFO ] [MAIN ] A: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:48.185169] [INFO ] [MAIN ] Update Progress: 1/2366 symbols. A took 0.2s. Estimated remaining time: 9m 4s [2025-10-25T18:57:48.355080] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:48.406588] [DEBUG] [LOCAL ] AA: Loaded 54402 existing records from primary storage. [2025-10-25T18:57:48.406995] [INFO ] [MAIN ] AA: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:48.407318] [INFO ] [MAIN ] Update Progress: 2/2366 symbols. AA took 0.2s. Estimated remaining time: 8m 54s [2025-10-25T18:57:48.584209] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:48.584438] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-25T18:57:48.584514] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-25T18:57:48.584664] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-25T18:57:48.584766] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-25T18:57:48.584855] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-25T18:57:48.584926] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-25T18:57:48.939303] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:57:48.939677] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-25T18:57:49.319847] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-25T18:57:49.320898] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-25T18:57:49.737414] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T18:57:49.738428] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-25T18:57:50.103235] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-25T18:57:50.104256] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-25T18:57:50.536745] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-25T18:57:50.537801] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-25T18:57:50.810783] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-25T18:57:50.811702] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-25T18:57:51.127808] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-25T18:57:51.128775] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-25T18:57:51.474323] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-25T18:57:51.475318] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-25T18:57:51.908020] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-25T18:57:51.909116] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-25T18:57:52.252662] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-25T18:57:52.253575] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-25T18:57:52.597835] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-25T18:57:52.598595] [INFO ] [REMOTE ] AAM: Full fetch complete (914 records). [2025-10-25T18:57:52.598709] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-25T18:57:52.784040] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-25T18:57:52.784261] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-25T18:57:52.784333] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-25T18:57:52.784409] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-25T18:57:52.784502] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-25T18:57:52.784575] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-25T18:57:52.784680] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-25T18:57:52.784774] [INFO ] [MAIN ] Update Progress: 3/2366 symbols. AAM took 4.4s. Estimated remaining time: 1h 3m 24s [2025-10-25T18:57:52.951630] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:52.973174] [DEBUG] [LOCAL ] AAMI: Loaded 24637 existing records from primary storage. [2025-10-25T18:57:52.973443] [INFO ] [MAIN ] AAMI: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:52.973536] [INFO ] [MAIN ] Update Progress: 4/2366 symbols. AAMI took 0.2s. Estimated remaining time: 49m 23s [2025-10-25T18:57:53.141160] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:53.190533] [DEBUG] [LOCAL ] AAP: Loaded 52419 existing records from primary storage. [2025-10-25T18:57:53.190946] [INFO ] [MAIN ] AAP: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:53.191609] [INFO ] [MAIN ] Update Progress: 5/2366 symbols. AAP took 0.2s. Estimated remaining time: 41m 12s [2025-10-25T18:57:53.368620] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:53.398867] [DEBUG] [LOCAL ] AAT: Loaded 30590 existing records from primary storage. [2025-10-25T18:57:53.399156] [INFO ] [MAIN ] AAT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:53.399249] [INFO ] [MAIN ] Update Progress: 6/2366 symbols. AAT took 0.2s. Estimated remaining time: 35m 41s [2025-10-25T18:57:53.567764] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:53.567968] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-25T18:57:53.568040] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-25T18:57:53.568156] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-25T18:57:53.568225] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-25T18:57:53.568307] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-25T18:57:53.568376] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-25T18:57:53.920095] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:57:53.920521] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-25T18:57:54.206950] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:57:54.207209] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-25T18:57:54.207334] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:57:54.207411] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-25T18:57:54.207480] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:57:54.207569] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-25T18:57:54.207684] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-25T18:57:54.207757] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-25T18:57:54.207845] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-25T18:57:54.207925] [INFO ] [MAIN ] Update Progress: 7/2366 symbols. AAUC took 0.8s. Estimated remaining time: 35m 7s [2025-10-25T18:57:54.377339] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:54.399721] [DEBUG] [LOCAL ] AB: Loaded 24911 existing records from primary storage. [2025-10-25T18:57:54.400008] [INFO ] [MAIN ] AB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:54.400103] [INFO ] [MAIN ] Update Progress: 8/2366 symbols. AB took 0.2s. Estimated remaining time: 31m 39s [2025-10-25T18:57:54.571616] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:54.625194] [DEBUG] [LOCAL ] ABBV: Loaded 54458 existing records from primary storage. [2025-10-25T18:57:54.625562] [INFO ] [MAIN ] ABBV: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:54.626252] [INFO ] [MAIN ] Update Progress: 9/2366 symbols. ABBV took 0.2s. Estimated remaining time: 29m 7s [2025-10-25T18:57:54.796062] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:54.825320] [DEBUG] [LOCAL ] ABCB: Loaded 30712 existing records from primary storage. [2025-10-25T18:57:54.825614] [INFO ] [MAIN ] ABCB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:54.825765] [INFO ] [MAIN ] Update Progress: 10/2366 symbols. ABCB took 0.2s. Estimated remaining time: 26m 59s [2025-10-25T18:57:54.996344] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:55.044792] [DEBUG] [LOCAL ] ABEV: Loaded 54059 existing records from primary storage. [2025-10-25T18:57:55.045152] [INFO ] [MAIN ] ABEV: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:55.045839] [INFO ] [MAIN ] Update Progress: 11/2366 symbols. ABEV took 0.2s. Estimated remaining time: 25m 18s [2025-10-25T18:57:55.214085] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:55.232323] [DEBUG] [LOCAL ] ABG: Loaded 18043 existing records from primary storage. [2025-10-25T18:57:55.232584] [INFO ] [MAIN ] ABG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:55.232707] [INFO ] [MAIN ] Update Progress: 12/2366 symbols. ABG took 0.2s. Estimated remaining time: 23m 47s [2025-10-25T18:57:55.402482] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:55.433197] [DEBUG] [LOCAL ] ABM: Loaded 32551 existing records from primary storage. [2025-10-25T18:57:55.433486] [INFO ] [MAIN ] ABM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:55.433584] [INFO ] [MAIN ] Update Progress: 13/2366 symbols. ABM took 0.2s. Estimated remaining time: 22m 33s [2025-10-25T18:57:55.604747] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:55.656022] [DEBUG] [LOCAL ] ABR: Loaded 52600 existing records from primary storage. [2025-10-25T18:57:55.656382] [INFO ] [MAIN ] ABR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:55.657056] [INFO ] [MAIN ] Update Progress: 14/2366 symbols. ABR took 0.2s. Estimated remaining time: 21m 34s [2025-10-25T18:57:55.826186] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:55.880947] [DEBUG] [LOCAL ] ABT: Loaded 54404 existing records from primary storage. [2025-10-25T18:57:55.881311] [INFO ] [MAIN ] ABT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:55.882032] [INFO ] [MAIN ] Update Progress: 15/2366 symbols. ABT took 0.2s. Estimated remaining time: 20m 42s [2025-10-25T18:57:56.064756] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:56.086760] [DEBUG] [LOCAL ] ACA: Loaded 22746 existing records from primary storage. [2025-10-25T18:57:56.087034] [INFO ] [MAIN ] ACA: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:56.087137] [INFO ] [MAIN ] Update Progress: 16/2366 symbols. ACA took 0.2s. Estimated remaining time: 19m 54s [2025-10-25T18:57:56.256767] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:56.290065] [DEBUG] [LOCAL ] ACCO: Loaded 37089 existing records from primary storage. [2025-10-25T18:57:56.290364] [INFO ] [MAIN ] ACCO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:56.290461] [INFO ] [MAIN ] Update Progress: 17/2366 symbols. ACCO took 0.2s. Estimated remaining time: 19m 12s [2025-10-25T18:57:56.460274] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:56.485858] [DEBUG] [LOCAL ] ACEL: Loaded 26599 existing records from primary storage. [2025-10-25T18:57:56.486139] [INFO ] [MAIN ] ACEL: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:56.486246] [INFO ] [MAIN ] Update Progress: 18/2366 symbols. ACEL took 0.2s. Estimated remaining time: 18m 33s [2025-10-25T18:57:56.657159] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:56.709937] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-25T18:57:56.710314] [INFO ] [MAIN ] ACHR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:56.710624] [INFO ] [MAIN ] Update Progress: 19/2366 symbols. ACHR took 0.2s. Estimated remaining time: 18m 1s [2025-10-25T18:57:56.878260] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:56.928990] [DEBUG] [LOCAL ] ACI: Loaded 54065 existing records from primary storage. [2025-10-25T18:57:56.929399] [INFO ] [MAIN ] ACI: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:56.930217] [INFO ] [MAIN ] Update Progress: 20/2366 symbols. ACI took 0.2s. Estimated remaining time: 17m 33s [2025-10-25T18:57:57.099496] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:57.141371] [DEBUG] [LOCAL ] ACM: Loaded 43273 existing records from primary storage. [2025-10-25T18:57:57.141750] [INFO ] [MAIN ] ACM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:57.142288] [INFO ] [MAIN ] Update Progress: 21/2366 symbols. ACM took 0.2s. Estimated remaining time: 17m 6s [2025-10-25T18:57:57.312120] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:57.364373] [DEBUG] [LOCAL ] ACN: Loaded 54215 existing records from primary storage. [2025-10-25T18:57:57.364765] [INFO ] [MAIN ] ACN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:57.365440] [INFO ] [MAIN ] Update Progress: 22/2366 symbols. ACN took 0.2s. Estimated remaining time: 16m 42s [2025-10-25T18:57:57.534095] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:57.564058] [DEBUG] [LOCAL ] ACP: Loaded 31563 existing records from primary storage. [2025-10-25T18:57:57.564343] [INFO ] [MAIN ] ACP: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:57.564436] [INFO ] [MAIN ] Update Progress: 23/2366 symbols. ACP took 0.2s. Estimated remaining time: 16m 19s [2025-10-25T18:57:57.734017] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:57.742626] [DEBUG] [LOCAL ] ACR: Loaded 5349 existing records from primary storage. [2025-10-25T18:57:57.742895] [INFO ] [MAIN ] ACR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:57.742989] [INFO ] [MAIN ] Update Progress: 24/2366 symbols. ACR took 0.2s. Estimated remaining time: 15m 55s [2025-10-25T18:57:57.933707] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:57.964110] [DEBUG] [LOCAL ] ACRE: Loaded 33607 existing records from primary storage. [2025-10-25T18:57:57.964402] [INFO ] [MAIN ] ACRE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:57.964498] [INFO ] [MAIN ] Update Progress: 25/2366 symbols. ACRE took 0.2s. Estimated remaining time: 15m 37s [2025-10-25T18:57:58.132563] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:58.143167] [DEBUG] [LOCAL ] ACV: Loaded 7578 existing records from primary storage. [2025-10-25T18:57:58.143397] [INFO ] [MAIN ] ACV: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:58.143491] [INFO ] [MAIN ] Update Progress: 26/2366 symbols. ACV took 0.2s. Estimated remaining time: 15m 17s [2025-10-25T18:57:58.311134] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:58.356945] [DEBUG] [LOCAL ] ACVA: Loaded 49969 existing records from primary storage. [2025-10-25T18:57:58.357307] [INFO ] [MAIN ] ACVA: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:58.358075] [INFO ] [MAIN ] Update Progress: 27/2366 symbols. ACVA took 0.2s. Estimated remaining time: 15m 1s [2025-10-25T18:57:58.525516] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:58.525683] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-25T18:57:58.526685] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-25T18:57:58.526797] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-25T18:57:58.526870] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-25T18:57:58.526954] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-25T18:57:58.527022] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-25T18:57:58.876829] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:57:58.877122] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-25T18:57:59.173271] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:57:59.173499] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-25T18:57:59.173586] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:57:59.173684] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-25T18:57:59.173752] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:57:59.173831] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-25T18:57:59.173930] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-25T18:57:59.174015] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-25T18:57:59.174101] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-25T18:57:59.174183] [INFO ] [MAIN ] Update Progress: 28/2366 symbols. AD took 0.8s. Estimated remaining time: 15m 37s [2025-10-25T18:57:59.342605] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:59.387634] [DEBUG] [LOCAL ] ADC: Loaded 47102 existing records from primary storage. [2025-10-25T18:57:59.388027] [INFO ] [MAIN ] ADC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:59.388590] [INFO ] [MAIN ] Update Progress: 29/2366 symbols. ADC took 0.2s. Estimated remaining time: 15m 21s [2025-10-25T18:57:59.558120] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:59.592526] [DEBUG] [LOCAL ] ADCT: Loaded 36037 existing records from primary storage. [2025-10-25T18:57:59.592832] [INFO ] [MAIN ] ADCT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:59.592932] [INFO ] [MAIN ] Update Progress: 30/2366 symbols. ADCT took 0.2s. Estimated remaining time: 15m 6s [2025-10-25T18:57:59.762345] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:57:59.812635] [DEBUG] [LOCAL ] ADM: Loaded 54167 existing records from primary storage. [2025-10-25T18:57:59.812997] [INFO ] [MAIN ] ADM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:57:59.813673] [INFO ] [MAIN ] Update Progress: 31/2366 symbols. ADM took 0.2s. Estimated remaining time: 14m 53s [2025-10-25T18:57:59.982272] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:00.027302] [DEBUG] [LOCAL ] ADNT: Loaded 46882 existing records from primary storage. [2025-10-25T18:58:00.027623] [INFO ] [MAIN ] ADNT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:00.028243] [INFO ] [MAIN ] Update Progress: 32/2366 symbols. ADNT took 0.2s. Estimated remaining time: 14m 40s [2025-10-25T18:58:00.197572] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:00.249361] [DEBUG] [LOCAL ] ADT: Loaded 54214 existing records from primary storage. [2025-10-25T18:58:00.249740] [INFO ] [MAIN ] ADT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:00.250382] [INFO ] [MAIN ] Update Progress: 33/2366 symbols. ADT took 0.2s. Estimated remaining time: 14m 29s [2025-10-25T18:58:00.418889] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:00.447982] [DEBUG] [LOCAL ] ADX: Loaded 28052 existing records from primary storage. [2025-10-25T18:58:00.448257] [INFO ] [MAIN ] ADX: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:00.448351] [INFO ] [MAIN ] Update Progress: 34/2366 symbols. ADX took 0.2s. Estimated remaining time: 14m 17s [2025-10-25T18:58:00.617305] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:00.665598] [DEBUG] [LOCAL ] AEE: Loaded 50716 existing records from primary storage. [2025-10-25T18:58:00.665962] [INFO ] [MAIN ] AEE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:00.666574] [INFO ] [MAIN ] Update Progress: 35/2366 symbols. AEE took 0.2s. Estimated remaining time: 14m 6s [2025-10-25T18:58:00.834963] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:00.846421] [DEBUG] [LOCAL ] AEFC: Loaded 7718 existing records from primary storage. [2025-10-25T18:58:00.846638] [INFO ] [MAIN ] AEFC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:00.846755] [INFO ] [MAIN ] Update Progress: 36/2366 symbols. AEFC took 0.2s. Estimated remaining time: 13m 54s [2025-10-25T18:58:01.015688] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:01.061578] [DEBUG] [LOCAL ] AEG: Loaded 50239 existing records from primary storage. [2025-10-25T18:58:01.061942] [INFO ] [MAIN ] AEG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:01.062691] [INFO ] [MAIN ] Update Progress: 37/2366 symbols. AEG took 0.2s. Estimated remaining time: 13m 45s [2025-10-25T18:58:01.231605] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:01.286246] [DEBUG] [LOCAL ] AEM: Loaded 54253 existing records from primary storage. [2025-10-25T18:58:01.286585] [INFO ] [MAIN ] AEM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:01.287278] [INFO ] [MAIN ] Update Progress: 38/2366 symbols. AEM took 0.2s. Estimated remaining time: 13m 37s [2025-10-25T18:58:01.454998] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:01.508978] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-10-25T18:58:01.509321] [INFO ] [MAIN ] AEO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:01.509994] [INFO ] [MAIN ] Update Progress: 39/2366 symbols. AEO took 0.2s. Estimated remaining time: 13m 29s [2025-10-25T18:58:01.676816] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:01.724900] [DEBUG] [LOCAL ] AER: Loaded 48541 existing records from primary storage. [2025-10-25T18:58:01.725232] [INFO ] [MAIN ] AER: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:01.725810] [INFO ] [MAIN ] Update Progress: 40/2366 symbols. AER took 0.2s. Estimated remaining time: 13m 21s [2025-10-25T18:58:01.893760] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:01.947726] [DEBUG] [LOCAL ] AES: Loaded 54443 existing records from primary storage. [2025-10-25T18:58:01.948082] [INFO ] [MAIN ] AES: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:01.948749] [INFO ] [MAIN ] Update Progress: 41/2366 symbols. AES took 0.2s. Estimated remaining time: 13m 13s [2025-10-25T18:58:02.115394] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:02.166736] [DEBUG] [LOCAL ] AESI: Loaded 50567 existing records from primary storage. [2025-10-25T18:58:02.167068] [INFO ] [MAIN ] AESI: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:02.167710] [INFO ] [MAIN ] Update Progress: 42/2366 symbols. AESI took 0.2s. Estimated remaining time: 13m 6s [2025-10-25T18:58:02.333991] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:02.334136] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-25T18:58:02.334207] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-25T18:58:02.334315] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-25T18:58:02.334385] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-25T18:58:02.334466] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-25T18:58:02.334535] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-25T18:58:02.682530] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:02.682863] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-25T18:58:03.015234] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:03.015472] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-25T18:58:03.015567] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:03.015638] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-25T18:58:03.015745] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:03.015818] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-25T18:58:03.015886] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-25T18:58:03.015951] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-25T18:58:03.016010] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-25T18:58:03.016063] [INFO ] [MAIN ] Update Progress: 43/2366 symbols. AEXA took 0.8s. Estimated remaining time: 13m 33s [2025-10-25T18:58:03.183986] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:03.198047] [DEBUG] [LOCAL ] AFB: Loaded 11166 existing records from primary storage. [2025-10-25T18:58:03.198296] [INFO ] [MAIN ] AFB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:03.198390] [INFO ] [MAIN ] Update Progress: 44/2366 symbols. AFB took 0.2s. Estimated remaining time: 13m 24s [2025-10-25T18:58:03.365704] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:03.399083] [DEBUG] [LOCAL ] AFG: Loaded 32241 existing records from primary storage. [2025-10-25T18:58:03.399380] [INFO ] [MAIN ] AFG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:03.399488] [INFO ] [MAIN ] Update Progress: 45/2366 symbols. AFG took 0.2s. Estimated remaining time: 13m 16s [2025-10-25T18:58:03.566937] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:03.570586] [DEBUG] [LOCAL ] AFGB: Loaded 2224 existing records from primary storage. [2025-10-25T18:58:03.570785] [INFO ] [MAIN ] AFGB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:03.571408] [INFO ] [MAIN ] Update Progress: 46/2366 symbols. AFGB took 0.2s. Estimated remaining time: 13m 7s [2025-10-25T18:58:03.738087] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:03.742407] [DEBUG] [LOCAL ] AFGC: Loaded 2572 existing records from primary storage. [2025-10-25T18:58:03.742583] [INFO ] [MAIN ] AFGC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:03.742800] [INFO ] [MAIN ] Update Progress: 47/2366 symbols. AFGC took 0.2s. Estimated remaining time: 12m 59s [2025-10-25T18:58:03.910439] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:03.913861] [DEBUG] [LOCAL ] AFGD: Loaded 1763 existing records from primary storage. [2025-10-25T18:58:03.914037] [INFO ] [MAIN ] AFGD: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:03.914138] [INFO ] [MAIN ] Update Progress: 48/2366 symbols. AFGD took 0.2s. Estimated remaining time: 12m 50s [2025-10-25T18:58:04.079011] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:04.082973] [DEBUG] [LOCAL ] AFGE: Loaded 2255 existing records from primary storage. [2025-10-25T18:58:04.083146] [INFO ] [MAIN ] AFGE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:04.083371] [INFO ] [MAIN ] Update Progress: 49/2366 symbols. AFGE took 0.2s. Estimated remaining time: 12m 42s [2025-10-25T18:58:04.248920] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:04.303282] [DEBUG] [LOCAL ] AFL: Loaded 53948 existing records from primary storage. [2025-10-25T18:58:04.303636] [INFO ] [MAIN ] AFL: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:04.304333] [INFO ] [MAIN ] Update Progress: 50/2366 symbols. AFL took 0.2s. Estimated remaining time: 12m 37s [2025-10-25T18:58:04.470393] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:04.522856] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-10-25T18:58:04.523216] [INFO ] [MAIN ] AG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:04.523909] [INFO ] [MAIN ] Update Progress: 51/2366 symbols. AG took 0.2s. Estimated remaining time: 12m 32s [2025-10-25T18:58:04.691339] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:04.733483] [DEBUG] [LOCAL ] AGCO: Loaded 42682 existing records from primary storage. [2025-10-25T18:58:04.733854] [INFO ] [MAIN ] AGCO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:04.734405] [INFO ] [MAIN ] Update Progress: 52/2366 symbols. AGCO took 0.2s. Estimated remaining time: 12m 26s [2025-10-25T18:58:04.900034] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:04.920621] [DEBUG] [LOCAL ] AGD: Loaded 19455 existing records from primary storage. [2025-10-25T18:58:04.920904] [INFO ] [MAIN ] AGD: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:04.921007] [INFO ] [MAIN ] Update Progress: 53/2366 symbols. AGD took 0.2s. Estimated remaining time: 12m 20s [2025-10-25T18:58:05.086809] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:05.137634] [DEBUG] [LOCAL ] AGI: Loaded 54201 existing records from primary storage. [2025-10-25T18:58:05.138024] [INFO ] [MAIN ] AGI: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:05.138713] [INFO ] [MAIN ] Update Progress: 54/2366 symbols. AGI took 0.2s. Estimated remaining time: 12m 16s [2025-10-25T18:58:05.304939] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:05.356871] [DEBUG] [LOCAL ] AGL: Loaded 53365 existing records from primary storage. [2025-10-25T18:58:05.357267] [INFO ] [MAIN ] AGL: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:05.357951] [INFO ] [MAIN ] Update Progress: 55/2366 symbols. AGL took 0.2s. Estimated remaining time: 12m 11s [2025-10-25T18:58:05.524812] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:05.538992] [DEBUG] [LOCAL ] AGM: Loaded 10702 existing records from primary storage. [2025-10-25T18:58:05.539267] [INFO ] [MAIN ] AGM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:05.539365] [INFO ] [MAIN ] Update Progress: 56/2366 symbols. AGM took 0.2s. Estimated remaining time: 12m 5s [2025-10-25T18:58:05.706786] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:05.734074] [DEBUG] [LOCAL ] AGO: Loaded 28041 existing records from primary storage. [2025-10-25T18:58:05.734402] [INFO ] [MAIN ] AGO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:05.734522] [INFO ] [MAIN ] Update Progress: 57/2366 symbols. AGO took 0.2s. Estimated remaining time: 12m 0s [2025-10-25T18:58:05.903261] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:05.932886] [DEBUG] [LOCAL ] AGRO: Loaded 32912 existing records from primary storage. [2025-10-25T18:58:05.933225] [INFO ] [MAIN ] AGRO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:05.933328] [INFO ] [MAIN ] Update Progress: 58/2366 symbols. AGRO took 0.2s. Estimated remaining time: 11m 55s [2025-10-25T18:58:06.099977] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:06.131912] [DEBUG] [LOCAL ] AGX: Loaded 33012 existing records from primary storage. [2025-10-25T18:58:06.132259] [INFO ] [MAIN ] AGX: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:06.132374] [INFO ] [MAIN ] Update Progress: 59/2366 symbols. AGX took 0.2s. Estimated remaining time: 11m 51s [2025-10-25T18:58:06.298863] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:06.335176] [DEBUG] [LOCAL ] AHH: Loaded 40649 existing records from primary storage. [2025-10-25T18:58:06.335535] [INFO ] [MAIN ] AHH: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:06.335672] [INFO ] [MAIN ] Update Progress: 60/2366 symbols. AHH took 0.2s. Estimated remaining time: 11m 46s [2025-10-25T18:58:06.503267] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:06.503447] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-25T18:58:06.503545] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-25T18:58:06.503726] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-25T18:58:06.503810] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-25T18:58:06.503898] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-25T18:58:06.503991] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-25T18:58:06.855491] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:06.855935] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-25T18:58:07.203769] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:07.204232] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-25T18:58:07.204336] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:07.204431] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-25T18:58:07.204522] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:07.204621] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-25T18:58:07.204767] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-25T18:58:07.204858] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-25T18:58:07.204962] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-25T18:58:07.205064] [INFO ] [MAIN ] Update Progress: 61/2366 symbols. AHL took 0.9s. Estimated remaining time: 12m 7s [2025-10-25T18:58:07.374554] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:07.418387] [DEBUG] [LOCAL ] AHR: Loaded 49637 existing records from primary storage. [2025-10-25T18:58:07.418767] [INFO ] [MAIN ] AHR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:07.419464] [INFO ] [MAIN ] Update Progress: 62/2366 symbols. AHR took 0.2s. Estimated remaining time: 12m 3s [2025-10-25T18:58:07.585262] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:07.595515] [DEBUG] [LOCAL ] AHT: Loaded 6490 existing records from primary storage. [2025-10-25T18:58:07.595780] [INFO ] [MAIN ] AHT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:07.595876] [INFO ] [MAIN ] Update Progress: 63/2366 symbols. AHT took 0.2s. Estimated remaining time: 11m 58s [2025-10-25T18:58:07.763523] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:07.818114] [DEBUG] [LOCAL ] AI: Loaded 54544 existing records from primary storage. [2025-10-25T18:58:07.818472] [INFO ] [MAIN ] AI: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:07.819180] [INFO ] [MAIN ] Update Progress: 64/2366 symbols. AI took 0.2s. Estimated remaining time: 11m 54s [2025-10-25T18:58:07.988323] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:08.040594] [DEBUG] [LOCAL ] AIG: Loaded 54234 existing records from primary storage. [2025-10-25T18:58:08.040970] [INFO ] [MAIN ] AIG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:08.041611] [INFO ] [MAIN ] Update Progress: 65/2366 symbols. AIG took 0.2s. Estimated remaining time: 11m 51s [2025-10-25T18:58:08.212883] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:08.213066] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-25T18:58:08.213163] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-25T18:58:08.213302] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-25T18:58:08.213375] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-25T18:58:08.213436] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-25T18:58:08.213511] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-25T18:58:08.565462] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:08.565841] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-25T18:58:08.911344] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:08.911721] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-25T18:58:08.911809] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:08.911882] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-25T18:58:08.911947] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:08.912018] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-25T18:58:08.912120] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-25T18:58:08.912216] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-25T18:58:08.912303] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-25T18:58:08.912386] [INFO ] [MAIN ] Update Progress: 66/2366 symbols. AII took 0.9s. Estimated remaining time: 12m 10s [2025-10-25T18:58:09.106127] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:09.132471] [DEBUG] [LOCAL ] AIN: Loaded 24638 existing records from primary storage. [2025-10-25T18:58:09.132810] [INFO ] [MAIN ] AIN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:09.132911] [INFO ] [MAIN ] Update Progress: 67/2366 symbols. AIN took 0.2s. Estimated remaining time: 12m 6s [2025-10-25T18:58:09.317407] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:09.333033] [DEBUG] [LOCAL ] AIO: Loaded 13183 existing records from primary storage. [2025-10-25T18:58:09.333303] [INFO ] [MAIN ] AIO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:09.333403] [INFO ] [MAIN ] Update Progress: 68/2366 symbols. AIO took 0.2s. Estimated remaining time: 12m 2s [2025-10-25T18:58:09.520167] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:09.549231] [DEBUG] [LOCAL ] AIR: Loaded 29010 existing records from primary storage. [2025-10-25T18:58:09.549540] [INFO ] [MAIN ] AIR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:09.549683] [INFO ] [MAIN ] Update Progress: 69/2366 symbols. AIR took 0.2s. Estimated remaining time: 11m 59s [2025-10-25T18:58:09.742981] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:09.772107] [DEBUG] [LOCAL ] AIT: Loaded 26948 existing records from primary storage. [2025-10-25T18:58:09.772475] [INFO ] [MAIN ] AIT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:09.772579] [INFO ] [MAIN ] Update Progress: 70/2366 symbols. AIT took 0.2s. Estimated remaining time: 11m 55s [2025-10-25T18:58:09.968490] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:10.009460] [DEBUG] [LOCAL ] AIV: Loaded 42538 existing records from primary storage. [2025-10-25T18:58:10.009837] [INFO ] [MAIN ] AIV: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:10.010487] [INFO ] [MAIN ] Update Progress: 71/2366 symbols. AIV took 0.2s. Estimated remaining time: 11m 53s [2025-10-25T18:58:10.204231] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:10.236489] [DEBUG] [LOCAL ] AIZ: Loaded 29600 existing records from primary storage. [2025-10-25T18:58:10.236868] [INFO ] [MAIN ] AIZ: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:10.236976] [INFO ] [MAIN ] Update Progress: 72/2366 symbols. AIZ took 0.2s. Estimated remaining time: 11m 50s [2025-10-25T18:58:10.422059] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:10.428829] [DEBUG] [LOCAL ] AIZN: Loaded 3851 existing records from primary storage. [2025-10-25T18:58:10.429072] [INFO ] [MAIN ] AIZN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:10.429214] [INFO ] [MAIN ] Update Progress: 73/2366 symbols. AIZN took 0.2s. Estimated remaining time: 11m 46s [2025-10-25T18:58:10.613129] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:10.661755] [DEBUG] [LOCAL ] AJG: Loaded 47015 existing records from primary storage. [2025-10-25T18:58:10.662168] [INFO ] [MAIN ] AJG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:10.662796] [INFO ] [MAIN ] Update Progress: 74/2366 symbols. AJG took 0.2s. Estimated remaining time: 11m 43s [2025-10-25T18:58:10.844179] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:10.844394] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-25T18:58:10.844466] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-25T18:58:10.844551] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-25T18:58:10.844619] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-25T18:58:10.844712] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-25T18:58:10.844782] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-25T18:58:11.197489] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:11.197871] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-25T18:58:11.730185] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-25T18:58:11.731424] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-25T18:58:12.201944] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T18:58:12.203169] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-25T18:58:12.803275] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T18:58:12.804542] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-25T18:58:13.300410] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-25T18:58:13.301574] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-25T18:58:13.941171] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-25T18:58:13.942661] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-25T18:58:14.640632] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-25T18:58:14.641758] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-25T18:58:15.052859] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-25T18:58:15.053806] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-25T18:58:15.488420] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-25T18:58:15.489436] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-25T18:58:15.930676] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-25T18:58:15.931796] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-25T18:58:16.552043] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T18:58:16.553537] [INFO ] [REMOTE ] AKA: Full fetch complete (2830 records). [2025-10-25T18:58:16.553630] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-25T18:58:16.732614] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T18:58:16.732832] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-25T18:58:16.732904] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-25T18:58:16.732979] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-25T18:58:16.733072] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-25T18:58:16.733144] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-25T18:58:16.733224] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-25T18:58:16.733319] [INFO ] [MAIN ] Update Progress: 75/2366 symbols. AKA took 6.1s. Estimated remaining time: 14m 39s [2025-10-25T18:58:16.897903] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:16.943846] [DEBUG] [LOCAL ] AKR: Loaded 46704 existing records from primary storage. [2025-10-25T18:58:16.944198] [INFO ] [MAIN ] AKR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:16.944811] [INFO ] [MAIN ] Update Progress: 76/2366 symbols. AKR took 0.2s. Estimated remaining time: 14m 33s [2025-10-25T18:58:17.111441] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:17.159625] [DEBUG] [LOCAL ] AL: Loaded 45506 existing records from primary storage. [2025-10-25T18:58:17.160039] [INFO ] [MAIN ] AL: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:17.160622] [INFO ] [MAIN ] Update Progress: 77/2366 symbols. AL took 0.2s. Estimated remaining time: 14m 28s [2025-10-25T18:58:17.331014] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:17.384103] [DEBUG] [LOCAL ] ALB: Loaded 54142 existing records from primary storage. [2025-10-25T18:58:17.384459] [INFO ] [MAIN ] ALB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:17.385143] [INFO ] [MAIN ] Update Progress: 78/2366 symbols. ALB took 0.2s. Estimated remaining time: 14m 23s [2025-10-25T18:58:17.554520] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:17.605585] [DEBUG] [LOCAL ] ALC: Loaded 51966 existing records from primary storage. [2025-10-25T18:58:17.605951] [INFO ] [MAIN ] ALC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:17.606566] [INFO ] [MAIN ] Update Progress: 79/2366 symbols. ALC took 0.2s. Estimated remaining time: 14m 18s [2025-10-25T18:58:17.776078] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:17.807866] [DEBUG] [LOCAL ] ALE: Loaded 32460 existing records from primary storage. [2025-10-25T18:58:17.808177] [INFO ] [MAIN ] ALE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:17.808275] [INFO ] [MAIN ] Update Progress: 80/2366 symbols. ALE took 0.2s. Estimated remaining time: 14m 13s [2025-10-25T18:58:17.975760] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:18.007953] [DEBUG] [LOCAL ] ALEX: Loaded 31192 existing records from primary storage. [2025-10-25T18:58:18.008247] [INFO ] [MAIN ] ALEX: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:18.008347] [INFO ] [MAIN ] Update Progress: 81/2366 symbols. ALEX took 0.2s. Estimated remaining time: 14m 8s [2025-10-25T18:58:18.176607] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:18.189006] [DEBUG] [LOCAL ] ALG: Loaded 9813 existing records from primary storage. [2025-10-25T18:58:18.189260] [INFO ] [MAIN ] ALG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:18.189354] [INFO ] [MAIN ] Update Progress: 82/2366 symbols. ALG took 0.2s. Estimated remaining time: 14m 2s [2025-10-25T18:58:18.358259] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:18.358470] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-25T18:58:18.358541] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-25T18:58:18.358676] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-25T18:58:18.358749] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-25T18:58:18.358829] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-25T18:58:18.358899] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-25T18:58:18.712271] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:18.712608] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-25T18:58:19.033069] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:19.033413] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-25T18:58:19.033501] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:19.033574] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-25T18:58:19.033661] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:19.033736] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-25T18:58:19.033830] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-25T18:58:19.033898] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-25T18:58:19.033982] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-25T18:58:19.034068] [INFO ] [MAIN ] Update Progress: 83/2366 symbols. ALH took 0.8s. Estimated remaining time: 14m 15s [2025-10-25T18:58:19.211073] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:19.260423] [DEBUG] [LOCAL ] ALIT: Loaded 53550 existing records from primary storage. [2025-10-25T18:58:19.260815] [INFO ] [MAIN ] ALIT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:19.261636] [INFO ] [MAIN ] Update Progress: 84/2366 symbols. ALIT took 0.2s. Estimated remaining time: 14m 10s [2025-10-25T18:58:19.431255] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:19.484172] [DEBUG] [LOCAL ] ALK: Loaded 53867 existing records from primary storage. [2025-10-25T18:58:19.484543] [INFO ] [MAIN ] ALK: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:19.485210] [INFO ] [MAIN ] Update Progress: 85/2366 symbols. ALK took 0.2s. Estimated remaining time: 14m 6s [2025-10-25T18:58:19.661164] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:19.710917] [DEBUG] [LOCAL ] ALL: Loaded 50286 existing records from primary storage. [2025-10-25T18:58:19.711290] [INFO ] [MAIN ] ALL: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:19.711936] [INFO ] [MAIN ] Update Progress: 86/2366 symbols. ALL took 0.2s. Estimated remaining time: 14m 2s [2025-10-25T18:58:19.884397] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:19.929385] [DEBUG] [LOCAL ] ALLE: Loaded 44606 existing records from primary storage. [2025-10-25T18:58:19.929792] [INFO ] [MAIN ] ALLE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:19.930355] [INFO ] [MAIN ] Update Progress: 87/2366 symbols. ALLE took 0.2s. Estimated remaining time: 13m 57s [2025-10-25T18:58:20.101342] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:20.154469] [DEBUG] [LOCAL ] ALLY: Loaded 53998 existing records from primary storage. [2025-10-25T18:58:20.154849] [INFO ] [MAIN ] ALLY: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:20.155501] [INFO ] [MAIN ] Update Progress: 88/2366 symbols. ALLY took 0.2s. Estimated remaining time: 13m 53s [2025-10-25T18:58:20.324545] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:20.367416] [DEBUG] [LOCAL ] ALSN: Loaded 43809 existing records from primary storage. [2025-10-25T18:58:20.367773] [INFO ] [MAIN ] ALSN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:20.368307] [INFO ] [MAIN ] Update Progress: 89/2366 symbols. ALSN took 0.2s. Estimated remaining time: 13m 49s [2025-10-25T18:58:20.542214] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:20.565710] [DEBUG] [LOCAL ] ALTG: Loaded 23319 existing records from primary storage. [2025-10-25T18:58:20.565978] [INFO ] [MAIN ] ALTG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:20.566073] [INFO ] [MAIN ] Update Progress: 90/2366 symbols. ALTG took 0.2s. Estimated remaining time: 13m 44s [2025-10-25T18:58:20.740813] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:20.752444] [DEBUG] [LOCAL ] ALUR: Loaded 9342 existing records from primary storage. [2025-10-25T18:58:20.752722] [INFO ] [MAIN ] ALUR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:20.752819] [INFO ] [MAIN ] Update Progress: 91/2366 symbols. ALUR took 0.2s. Estimated remaining time: 13m 40s [2025-10-25T18:58:20.923759] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:20.965197] [DEBUG] [LOCAL ] ALV: Loaded 42871 existing records from primary storage. [2025-10-25T18:58:20.965523] [INFO ] [MAIN ] ALV: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:20.966175] [INFO ] [MAIN ] Update Progress: 92/2366 symbols. ALV took 0.2s. Estimated remaining time: 13m 36s [2025-10-25T18:58:21.134298] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:21.145633] [DEBUG] [LOCAL ] ALX: Loaded 7452 existing records from primary storage. [2025-10-25T18:58:21.145882] [INFO ] [MAIN ] ALX: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:21.145991] [INFO ] [MAIN ] Update Progress: 93/2366 symbols. ALX took 0.2s. Estimated remaining time: 13m 31s [2025-10-25T18:58:21.314091] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:21.366419] [DEBUG] [LOCAL ] AM: Loaded 52592 existing records from primary storage. [2025-10-25T18:58:21.366809] [INFO ] [MAIN ] AM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:21.367468] [INFO ] [MAIN ] Update Progress: 94/2366 symbols. AM took 0.2s. Estimated remaining time: 13m 27s [2025-10-25T18:58:21.540345] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:21.574557] [DEBUG] [LOCAL ] AMBC: Loaded 36371 existing records from primary storage. [2025-10-25T18:58:21.574883] [INFO ] [MAIN ] AMBC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:21.574981] [INFO ] [MAIN ] Update Progress: 95/2366 symbols. AMBC took 0.2s. Estimated remaining time: 13m 23s [2025-10-25T18:58:21.752513] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:21.793202] [DEBUG] [LOCAL ] AMBP: Loaded 45024 existing records from primary storage. [2025-10-25T18:58:21.793548] [INFO ] [MAIN ] AMBP: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:21.794257] [INFO ] [MAIN ] Update Progress: 96/2366 symbols. AMBP took 0.2s. Estimated remaining time: 13m 20s [2025-10-25T18:58:21.966978] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:21.967169] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-25T18:58:21.967261] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-25T18:58:21.967366] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-25T18:58:21.967449] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-25T18:58:21.967548] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-25T18:58:21.967619] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-25T18:58:22.330488] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:22.330843] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-25T18:58:22.675729] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:22.676094] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-25T18:58:22.676186] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:22.676259] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-25T18:58:22.676326] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:22.676402] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-25T18:58:22.676500] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-25T18:58:22.676568] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-25T18:58:22.676679] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-25T18:58:22.676768] [INFO ] [MAIN ] Update Progress: 97/2366 symbols. AMBQ took 0.9s. Estimated remaining time: 13m 32s [2025-10-25T18:58:22.846408] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:22.900981] [DEBUG] [LOCAL ] AMC: Loaded 54546 existing records from primary storage. [2025-10-25T18:58:22.901376] [INFO ] [MAIN ] AMC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:22.902114] [INFO ] [MAIN ] Update Progress: 98/2366 symbols. AMC took 0.2s. Estimated remaining time: 13m 29s [2025-10-25T18:58:23.077592] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:23.139588] [DEBUG] [LOCAL ] AMCR: Loaded 54450 existing records from primary storage. [2025-10-25T18:58:23.140136] [INFO ] [MAIN ] AMCR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:23.140878] [INFO ] [MAIN ] Update Progress: 99/2366 symbols. AMCR took 0.2s. Estimated remaining time: 13m 26s [2025-10-25T18:58:23.351589] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:23.405286] [DEBUG] [LOCAL ] AME: Loaded 49145 existing records from primary storage. [2025-10-25T18:58:23.405783] [INFO ] [MAIN ] AME: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:23.406498] [INFO ] [MAIN ] Update Progress: 100/2366 symbols. AME took 0.3s. Estimated remaining time: 13m 23s [2025-10-25T18:58:23.634786] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:23.659508] [DEBUG] [LOCAL ] AMG: Loaded 20306 existing records from primary storage. [2025-10-25T18:58:23.659850] [INFO ] [MAIN ] AMG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:23.659975] [INFO ] [MAIN ] Update Progress: 101/2366 symbols. AMG took 0.3s. Estimated remaining time: 13m 20s [2025-10-25T18:58:23.938338] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:23.995127] [DEBUG] [LOCAL ] AMH: Loaded 52581 existing records from primary storage. [2025-10-25T18:58:23.995562] [INFO ] [MAIN ] AMH: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:23.996296] [INFO ] [MAIN ] Update Progress: 102/2366 symbols. AMH took 0.3s. Estimated remaining time: 13m 20s [2025-10-25T18:58:24.195467] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:24.243053] [DEBUG] [LOCAL ] AMN: Loaded 42147 existing records from primary storage. [2025-10-25T18:58:24.243398] [INFO ] [MAIN ] AMN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:24.243981] [INFO ] [MAIN ] Update Progress: 103/2366 symbols. AMN took 0.2s. Estimated remaining time: 13m 17s [2025-10-25T18:58:24.425083] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:24.458066] [DEBUG] [LOCAL ] AMP: Loaded 32168 existing records from primary storage. [2025-10-25T18:58:24.458361] [INFO ] [MAIN ] AMP: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:24.458460] [INFO ] [MAIN ] Update Progress: 104/2366 symbols. AMP took 0.2s. Estimated remaining time: 13m 14s [2025-10-25T18:58:24.629478] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:24.680628] [DEBUG] [LOCAL ] AMPX: Loaded 53219 existing records from primary storage. [2025-10-25T18:58:24.681000] [INFO ] [MAIN ] AMPX: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:24.681637] [INFO ] [MAIN ] Update Progress: 105/2366 symbols. AMPX took 0.2s. Estimated remaining time: 13m 11s [2025-10-25T18:58:24.851779] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:24.890737] [DEBUG] [LOCAL ] AMPY: Loaded 40008 existing records from primary storage. [2025-10-25T18:58:24.891057] [INFO ] [MAIN ] AMPY: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:24.891155] [INFO ] [MAIN ] Update Progress: 106/2366 symbols. AMPY took 0.2s. Estimated remaining time: 13m 7s [2025-10-25T18:58:25.060514] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:25.089378] [DEBUG] [LOCAL ] AMR: Loaded 29133 existing records from primary storage. [2025-10-25T18:58:25.089717] [INFO ] [MAIN ] AMR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:25.089818] [INFO ] [MAIN ] Update Progress: 107/2366 symbols. AMR took 0.2s. Estimated remaining time: 13m 4s [2025-10-25T18:58:25.258040] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:25.294811] [DEBUG] [LOCAL ] AMRC: Loaded 39067 existing records from primary storage. [2025-10-25T18:58:25.295123] [INFO ] [MAIN ] AMRC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:25.295222] [INFO ] [MAIN ] Update Progress: 108/2366 symbols. AMRC took 0.2s. Estimated remaining time: 13m 0s [2025-10-25T18:58:25.462852] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:25.463025] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-25T18:58:25.463093] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-25T18:58:25.463178] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-25T18:58:25.463246] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-25T18:58:25.463305] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-25T18:58:25.463344] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-25T18:58:25.814518] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:25.814902] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-25T18:58:26.127145] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:26.127554] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-25T18:58:26.127672] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:26.127773] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-25T18:58:26.127860] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:26.127953] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-25T18:58:26.128075] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-25T18:58:26.128164] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-25T18:58:26.128273] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-25T18:58:26.128383] [INFO ] [MAIN ] Update Progress: 109/2366 symbols. AMRZ took 0.8s. Estimated remaining time: 13m 10s [2025-10-25T18:58:26.298812] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:26.350964] [DEBUG] [LOCAL ] AMT: Loaded 53186 existing records from primary storage. [2025-10-25T18:58:26.351364] [INFO ] [MAIN ] AMT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:26.352281] [INFO ] [MAIN ] Update Progress: 110/2366 symbols. AMT took 0.2s. Estimated remaining time: 13m 7s [2025-10-25T18:58:26.537286] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:26.560448] [DEBUG] [LOCAL ] AMTB: Loaded 20875 existing records from primary storage. [2025-10-25T18:58:26.560821] [INFO ] [MAIN ] AMTB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:26.560930] [INFO ] [MAIN ] Update Progress: 111/2366 symbols. AMTB took 0.2s. Estimated remaining time: 13m 4s [2025-10-25T18:58:26.756138] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:26.762781] [DEBUG] [LOCAL ] AMTD: Loaded 3828 existing records from primary storage. [2025-10-25T18:58:26.763109] [INFO ] [MAIN ] AMTD: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:26.763521] [INFO ] [MAIN ] Update Progress: 112/2366 symbols. AMTD took 0.2s. Estimated remaining time: 13m 1s [2025-10-25T18:58:26.932509] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:26.983677] [DEBUG] [LOCAL ] AMTM: Loaded 50952 existing records from primary storage. [2025-10-25T18:58:26.984027] [INFO ] [MAIN ] AMTM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:26.984632] [INFO ] [MAIN ] Update Progress: 113/2366 symbols. AMTM took 0.2s. Estimated remaining time: 12m 58s [2025-10-25T18:58:27.158296] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:27.174982] [DEBUG] [LOCAL ] AMWL: Loaded 9978 existing records from primary storage. [2025-10-25T18:58:27.175271] [INFO ] [MAIN ] AMWL: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:27.175368] [INFO ] [MAIN ] Update Progress: 114/2366 symbols. AMWL took 0.2s. Estimated remaining time: 12m 55s [2025-10-25T18:58:27.348538] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:27.396781] [DEBUG] [LOCAL ] AMX: Loaded 49882 existing records from primary storage. [2025-10-25T18:58:27.397146] [INFO ] [MAIN ] AMX: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:27.397826] [INFO ] [MAIN ] Update Progress: 115/2366 symbols. AMX took 0.2s. Estimated remaining time: 12m 52s [2025-10-25T18:58:27.571303] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:27.603161] [DEBUG] [LOCAL ] AN: Loaded 31602 existing records from primary storage. [2025-10-25T18:58:27.603456] [INFO ] [MAIN ] AN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:27.603555] [INFO ] [MAIN ] Update Progress: 116/2366 symbols. AN took 0.2s. Estimated remaining time: 12m 49s [2025-10-25T18:58:27.772116] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:27.825015] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-25T18:58:27.825374] [INFO ] [MAIN ] ANET: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:27.826049] [INFO ] [MAIN ] Update Progress: 117/2366 symbols. ANET took 0.2s. Estimated remaining time: 12m 46s [2025-10-25T18:58:28.001611] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:28.055468] [DEBUG] [LOCAL ] ANF: Loaded 52772 existing records from primary storage. [2025-10-25T18:58:28.055924] [INFO ] [MAIN ] ANF: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:28.056583] [INFO ] [MAIN ] Update Progress: 118/2366 symbols. ANF took 0.2s. Estimated remaining time: 12m 44s [2025-10-25T18:58:28.227167] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:28.227365] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-25T18:58:28.227437] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-25T18:58:28.227532] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-25T18:58:28.227603] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-25T18:58:28.227686] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-25T18:58:28.227757] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-25T18:58:28.579149] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:28.579497] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-25T18:58:28.851690] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:28.852063] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-25T18:58:28.852153] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:28.852227] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-25T18:58:28.852296] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:28.852372] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-25T18:58:28.852464] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-25T18:58:28.852536] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-25T18:58:28.852631] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-25T18:58:28.852761] [INFO ] [MAIN ] Update Progress: 119/2366 symbols. ANGX took 0.8s. Estimated remaining time: 12m 52s [2025-10-25T18:58:29.028387] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:29.049768] [DEBUG] [LOCAL ] ANRO: Loaded 20129 existing records from primary storage. [2025-10-25T18:58:29.050041] [INFO ] [MAIN ] ANRO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:29.050147] [INFO ] [MAIN ] Update Progress: 120/2366 symbols. ANRO took 0.2s. Estimated remaining time: 12m 49s [2025-10-25T18:58:29.224826] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:29.248945] [DEBUG] [LOCAL ] ANVS: Loaded 24280 existing records from primary storage. [2025-10-25T18:58:29.249246] [INFO ] [MAIN ] ANVS: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:29.249345] [INFO ] [MAIN ] Update Progress: 121/2366 symbols. ANVS took 0.2s. Estimated remaining time: 12m 46s [2025-10-25T18:58:29.424386] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:29.454259] [DEBUG] [LOCAL ] AOD: Loaded 31268 existing records from primary storage. [2025-10-25T18:58:29.454584] [INFO ] [MAIN ] AOD: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:29.454707] [INFO ] [MAIN ] Update Progress: 122/2366 symbols. AOD took 0.2s. Estimated remaining time: 12m 43s [2025-10-25T18:58:29.629499] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:29.629715] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-25T18:58:29.629790] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-25T18:58:29.629905] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-25T18:58:29.629978] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-25T18:58:29.630061] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-25T18:58:29.630131] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-25T18:58:29.997894] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:29.998234] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-25T18:58:30.356965] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:30.357352] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-25T18:58:30.357441] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:30.357548] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-25T18:58:30.357620] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:30.357736] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-25T18:58:30.357850] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-25T18:58:30.357942] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-25T18:58:30.358044] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-25T18:58:30.358152] [INFO ] [MAIN ] Update Progress: 123/2366 symbols. AOMD took 0.9s. Estimated remaining time: 12m 53s [2025-10-25T18:58:30.532569] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:30.550111] [DEBUG] [LOCAL ] AOMR: Loaded 16465 existing records from primary storage. [2025-10-25T18:58:30.550381] [INFO ] [MAIN ] AOMR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:30.550481] [INFO ] [MAIN ] Update Progress: 124/2366 symbols. AOMR took 0.2s. Estimated remaining time: 12m 50s [2025-10-25T18:58:30.721811] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:30.763361] [DEBUG] [LOCAL ] AON: Loaded 45634 existing records from primary storage. [2025-10-25T18:58:30.763724] [INFO ] [MAIN ] AON: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:30.764391] [INFO ] [MAIN ] Update Progress: 125/2366 symbols. AON took 0.2s. Estimated remaining time: 12m 47s [2025-10-25T18:58:30.936512] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:30.965765] [DEBUG] [LOCAL ] AORT: Loaded 29251 existing records from primary storage. [2025-10-25T18:58:30.966052] [INFO ] [MAIN ] AORT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:30.966152] [INFO ] [MAIN ] Update Progress: 126/2366 symbols. AORT took 0.2s. Estimated remaining time: 12m 44s [2025-10-25T18:58:31.134839] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:31.179268] [DEBUG] [LOCAL ] AOS: Loaded 49354 existing records from primary storage. [2025-10-25T18:58:31.179611] [INFO ] [MAIN ] AOS: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:31.180270] [INFO ] [MAIN ] Update Progress: 127/2366 symbols. AOS took 0.2s. Estimated remaining time: 12m 42s [2025-10-25T18:58:31.349734] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:31.360989] [DEBUG] [LOCAL ] AP: Loaded 7509 existing records from primary storage. [2025-10-25T18:58:31.361219] [INFO ] [MAIN ] AP: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:31.361317] [INFO ] [MAIN ] Update Progress: 128/2366 symbols. AP took 0.2s. Estimated remaining time: 12m 39s [2025-10-25T18:58:31.532220] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:31.570684] [DEBUG] [LOCAL ] APAM: Loaded 36093 existing records from primary storage. [2025-10-25T18:58:31.571050] [INFO ] [MAIN ] APAM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:31.571152] [INFO ] [MAIN ] Update Progress: 129/2366 symbols. APAM took 0.2s. Estimated remaining time: 12m 36s [2025-10-25T18:58:31.742904] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:31.785418] [DEBUG] [LOCAL ] APD: Loaded 46082 existing records from primary storage. [2025-10-25T18:58:31.785798] [INFO ] [MAIN ] APD: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:31.786488] [INFO ] [MAIN ] Update Progress: 130/2366 symbols. APD took 0.2s. Estimated remaining time: 12m 34s [2025-10-25T18:58:31.957605] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:32.009302] [DEBUG] [LOCAL ] APG: Loaded 51359 existing records from primary storage. [2025-10-25T18:58:32.009699] [INFO ] [MAIN ] APG: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:32.010323] [INFO ] [MAIN ] Update Progress: 131/2366 symbols. APG took 0.2s. Estimated remaining time: 12m 31s [2025-10-25T18:58:32.185518] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:32.242222] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-10-25T18:58:32.242574] [INFO ] [MAIN ] APH: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:32.243273] [INFO ] [MAIN ] Update Progress: 132/2366 symbols. APH took 0.2s. Estimated remaining time: 12m 29s [2025-10-25T18:58:32.429970] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:32.485291] [DEBUG] [LOCAL ] APLE: Loaded 52707 existing records from primary storage. [2025-10-25T18:58:32.485671] [INFO ] [MAIN ] APLE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:32.486323] [INFO ] [MAIN ] Update Progress: 133/2366 symbols. APLE took 0.2s. Estimated remaining time: 12m 27s [2025-10-25T18:58:32.666431] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:32.732182] [DEBUG] [LOCAL ] APO: Loaded 54163 existing records from primary storage. [2025-10-25T18:58:32.732560] [INFO ] [MAIN ] APO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:32.733249] [INFO ] [MAIN ] Update Progress: 134/2366 symbols. APO took 0.2s. Estimated remaining time: 12m 26s [2025-10-25T18:58:32.904594] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:32.915902] [DEBUG] [LOCAL ] APOS: Loaded 7137 existing records from primary storage. [2025-10-25T18:58:32.916186] [INFO ] [MAIN ] APOS: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:32.916285] [INFO ] [MAIN ] Update Progress: 135/2366 symbols. APOS took 0.2s. Estimated remaining time: 12m 23s [2025-10-25T18:58:33.093231] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:33.143949] [DEBUG] [LOCAL ] APTV: Loaded 52575 existing records from primary storage. [2025-10-25T18:58:33.144298] [INFO ] [MAIN ] APTV: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:33.145119] [INFO ] [MAIN ] Update Progress: 136/2366 symbols. APTV took 0.2s. Estimated remaining time: 12m 21s [2025-10-25T18:58:33.318956] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:33.370140] [DEBUG] [LOCAL ] AQN: Loaded 52380 existing records from primary storage. [2025-10-25T18:58:33.370486] [INFO ] [MAIN ] AQN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:33.371142] [INFO ] [MAIN ] Update Progress: 137/2366 symbols. AQN took 0.2s. Estimated remaining time: 12m 19s [2025-10-25T18:58:33.542733] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:33.550490] [DEBUG] [LOCAL ] AQNB: Loaded 3910 existing records from primary storage. [2025-10-25T18:58:33.550720] [INFO ] [MAIN ] AQNB: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:33.550816] [INFO ] [MAIN ] Update Progress: 138/2366 symbols. AQNB took 0.2s. Estimated remaining time: 12m 16s [2025-10-25T18:58:33.723434] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:33.777156] [DEBUG] [LOCAL ] AR: Loaded 54367 existing records from primary storage. [2025-10-25T18:58:33.777528] [INFO ] [MAIN ] AR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:33.778311] [INFO ] [MAIN ] Update Progress: 139/2366 symbols. AR took 0.2s. Estimated remaining time: 12m 14s [2025-10-25T18:58:33.952994] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:33.994733] [DEBUG] [LOCAL ] ARCO: Loaded 44792 existing records from primary storage. [2025-10-25T18:58:33.995060] [INFO ] [MAIN ] ARCO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:33.995603] [INFO ] [MAIN ] Update Progress: 140/2366 symbols. ARCO took 0.2s. Estimated remaining time: 12m 12s [2025-10-25T18:58:34.163291] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:34.181415] [DEBUG] [LOCAL ] ARDC: Loaded 15417 existing records from primary storage. [2025-10-25T18:58:34.181697] [INFO ] [MAIN ] ARDC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:34.181795] [INFO ] [MAIN ] Update Progress: 141/2366 symbols. ARDC took 0.2s. Estimated remaining time: 12m 9s [2025-10-25T18:58:34.353806] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:34.382107] [DEBUG] [LOCAL ] ARDT: Loaded 27853 existing records from primary storage. [2025-10-25T18:58:34.382402] [INFO ] [MAIN ] ARDT: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:34.382500] [INFO ] [MAIN ] Update Progress: 142/2366 symbols. ARDT took 0.2s. Estimated remaining time: 12m 7s [2025-10-25T18:58:34.554288] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:34.607434] [DEBUG] [LOCAL ] ARE: Loaded 51653 existing records from primary storage. [2025-10-25T18:58:34.607924] [INFO ] [MAIN ] ARE: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:34.608709] [INFO ] [MAIN ] Update Progress: 143/2366 symbols. ARE took 0.2s. Estimated remaining time: 12m 5s [2025-10-25T18:58:34.787119] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:34.838404] [DEBUG] [LOCAL ] ARES: Loaded 50410 existing records from primary storage. [2025-10-25T18:58:34.838797] [INFO ] [MAIN ] ARES: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:34.839404] [INFO ] [MAIN ] Update Progress: 144/2366 symbols. ARES took 0.2s. Estimated remaining time: 12m 3s [2025-10-25T18:58:35.013532] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:35.058990] [DEBUG] [LOCAL ] ARI: Loaded 44089 existing records from primary storage. [2025-10-25T18:58:35.059336] [INFO ] [MAIN ] ARI: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:35.059931] [INFO ] [MAIN ] Update Progress: 145/2366 symbols. ARI took 0.2s. Estimated remaining time: 12m 1s [2025-10-25T18:58:35.251625] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:35.296453] [DEBUG] [LOCAL ] ARLO: Loaded 44193 existing records from primary storage. [2025-10-25T18:58:35.296815] [INFO ] [MAIN ] ARLO: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:35.297378] [INFO ] [MAIN ] Update Progress: 146/2366 symbols. ARLO took 0.2s. Estimated remaining time: 11m 60s [2025-10-25T18:58:35.471451] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:35.522267] [DEBUG] [LOCAL ] ARMK: Loaded 51086 existing records from primary storage. [2025-10-25T18:58:35.522690] [INFO ] [MAIN ] ARMK: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:35.523430] [INFO ] [MAIN ] Update Progress: 147/2366 symbols. ARMK took 0.2s. Estimated remaining time: 11m 58s [2025-10-25T18:58:35.694240] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:35.741128] [DEBUG] [LOCAL ] AROC: Loaded 49804 existing records from primary storage. [2025-10-25T18:58:35.741467] [INFO ] [MAIN ] AROC: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:35.742143] [INFO ] [MAIN ] Update Progress: 148/2366 symbols. AROC took 0.2s. Estimated remaining time: 11m 56s [2025-10-25T18:58:35.913667] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:35.970331] [DEBUG] [LOCAL ] ARR: Loaded 52859 existing records from primary storage. [2025-10-25T18:58:35.970792] [INFO ] [MAIN ] ARR: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:35.971464] [INFO ] [MAIN ] Update Progress: 149/2366 symbols. ARR took 0.2s. Estimated remaining time: 11m 54s [2025-10-25T18:58:36.155581] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:36.192909] [DEBUG] [LOCAL ] ARW: Loaded 33601 existing records from primary storage. [2025-10-25T18:58:36.193360] [INFO ] [MAIN ] ARW: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:36.193478] [INFO ] [MAIN ] Update Progress: 150/2366 symbols. ARW took 0.2s. Estimated remaining time: 11m 52s [2025-10-25T18:58:36.382343] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:36.382577] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-25T18:58:36.382677] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-25T18:58:36.382821] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-25T18:58:36.382895] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-25T18:58:36.382979] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-25T18:58:36.383052] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-25T18:58:36.774425] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:36.774819] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-25T18:58:37.108396] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T18:58:37.108845] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-25T18:58:37.108940] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T18:58:37.109022] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-25T18:58:37.109093] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T18:58:37.109170] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-25T18:58:37.109264] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-25T18:58:37.109338] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-25T18:58:37.109421] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-25T18:58:37.109520] [INFO ] [MAIN ] Update Progress: 151/2366 symbols. ARX took 0.9s. Estimated remaining time: 12m 1s [2025-10-25T18:58:37.298504] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:37.351678] [DEBUG] [LOCAL ] AS: Loaded 53975 existing records from primary storage. [2025-10-25T18:58:37.352073] [INFO ] [MAIN ] AS: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:37.352765] [INFO ] [MAIN ] Update Progress: 152/2366 symbols. AS took 0.2s. Estimated remaining time: 11m 59s [2025-10-25T18:58:37.535839] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:37.554867] [DEBUG] [LOCAL ] ASA: Loaded 15913 existing records from primary storage. [2025-10-25T18:58:37.555147] [INFO ] [MAIN ] ASA: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:37.555250] [INFO ] [MAIN ] Update Progress: 153/2366 symbols. ASA took 0.2s. Estimated remaining time: 11m 57s [2025-10-25T18:58:37.737079] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:37.792292] [DEBUG] [LOCAL ] ASAN: Loaded 53499 existing records from primary storage. [2025-10-25T18:58:37.792674] [INFO ] [MAIN ] ASAN: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T18:58:37.793437] [INFO ] [MAIN ] Update Progress: 154/2366 symbols. ASAN took 0.2s. Estimated remaining time: 11m 56s [2025-10-25T18:58:37.972289] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:37.972519] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-25T18:58:37.972593] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-25T18:58:37.972734] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-25T18:58:37.972810] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-25T18:58:37.972871] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-25T18:58:37.972934] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-25T18:58:38.343998] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:38.344369] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-25T18:58:39.325074] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-25T18:58:39.334564] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-25T18:58:40.249288] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T18:58:40.258502] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-25T18:58:41.362904] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T18:58:41.375784] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-25T18:58:42.350158] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T18:58:42.361169] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-25T18:58:43.306728] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T18:58:43.317581] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-25T18:58:44.149414] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T18:58:44.160323] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-25T18:58:45.383081] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T18:58:45.394885] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-25T18:58:46.337400] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T18:58:46.348886] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-25T18:58:47.194030] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T18:58:47.204731] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-25T18:58:47.910035] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T18:58:47.919574] [INFO ] [REMOTE ] ASB: Full fetch complete (72291 records). [2025-10-25T18:58:47.919758] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-25T18:58:48.308981] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-25T18:58:48.309097] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-25T18:58:48.310096] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-25T18:58:48.310181] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-25T18:58:48.311605] [DEBUG] [LOCAL ] ASB: Trimmed 72291 records to 50446 (keeping 200 days of data) [2025-10-25T18:58:48.605886] [DEBUG] [LOCAL ] ASB: Primary data saved (50446 records). [2025-10-25T18:58:48.606124] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-25T18:58:48.606250] [INFO ] [MAIN ] Update Progress: 155/2366 symbols. ASB took 10.8s. Estimated remaining time: 14m 25s [2025-10-25T18:58:48.776941] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:48.777141] [DEBUG] [LOCAL ] ASBA: No existing data file found in primary storage. [2025-10-25T18:58:48.777214] [WARN ] [MAIN ] ASBA: No existing data found, performing full refresh instead. [2025-10-25T18:58:48.777349] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-25T18:58:48.777419] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-25T18:58:48.777476] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-10-25T18:58:48.777539] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-25T18:58:49.133722] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:49.134067] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-25T18:58:49.808116] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-25T18:58:49.809791] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-25T18:58:50.431799] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T18:58:50.433295] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-25T18:58:51.145904] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T18:58:51.147409] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-25T18:58:51.939432] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T18:58:51.940999] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-25T18:58:52.532970] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T18:58:52.534483] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-25T18:58:53.156478] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T18:58:53.158047] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-25T18:58:53.824373] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-25T18:58:53.826189] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-25T18:58:54.539442] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T18:58:54.541086] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-25T18:58:55.176399] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T18:58:55.181703] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-25T18:58:55.732822] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-25T18:58:55.734217] [INFO ] [REMOTE ] ASBA: Full fetch complete (5177 records). [2025-10-25T18:58:55.734315] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-25T18:58:56.109823] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-25T18:58:56.109953] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-25T18:58:56.110167] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-25T18:58:56.110269] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-25T18:58:56.110944] [DEBUG] [LOCAL ] ASBA: Trimmed 5177 records to 3508 (keeping 200 days of data) [2025-10-25T18:58:56.131769] [DEBUG] [LOCAL ] ASBA: Primary data saved (3508 records). [2025-10-25T18:58:56.131946] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-25T18:58:56.132084] [INFO ] [MAIN ] Update Progress: 156/2366 symbols. ASBA took 7.5s. Estimated remaining time: 16m 6s [2025-10-25T18:58:56.310785] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:58:56.311010] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-25T18:58:56.311101] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-25T18:58:56.311256] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-25T18:58:56.311346] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-25T18:58:56.311459] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-25T18:58:56.311554] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-25T18:58:56.690223] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:58:56.690709] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-25T18:58:58.276638] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T18:58:58.285089] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-25T18:58:59.732112] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T18:58:59.741044] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-25T18:59:01.555874] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T18:59:01.565305] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-25T18:59:02.519697] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T18:59:02.528154] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-25T18:59:03.482325] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T18:59:03.490866] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-25T18:59:04.345020] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T18:59:04.352925] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-25T18:59:05.249923] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T18:59:05.258354] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-25T18:59:06.162430] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T18:59:06.170889] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-25T18:59:07.354010] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T18:59:07.361933] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-25T18:59:08.381350] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T18:59:08.388294] [INFO ] [REMOTE ] ASC: Full fetch complete (56012 records). [2025-10-25T18:59:08.388429] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-25T18:59:08.776550] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-25T18:59:08.776702] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-25T18:59:08.777345] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-25T18:59:08.777428] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-25T18:59:08.778736] [DEBUG] [LOCAL ] ASC: Trimmed 56012 records to 37801 (keeping 200 days of data) [2025-10-25T18:59:08.992591] [DEBUG] [LOCAL ] ASC: Primary data saved (37801 records). [2025-10-25T18:59:08.992791] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-25T18:59:08.992879] [INFO ] [MAIN ] Update Progress: 157/2366 symbols. ASC took 12.9s. Estimated remaining time: 18m 60s [2025-10-25T18:59:09.173377] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:59:09.173626] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-10-25T18:59:09.173714] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-10-25T18:59:09.173803] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-25T18:59:09.173873] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-25T18:59:09.173931] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-10-25T18:59:09.173995] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-25T18:59:09.554479] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:59:09.554840] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-25T18:59:10.878215] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T18:59:10.886975] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-25T18:59:12.086130] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-25T18:59:12.090785] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-25T18:59:13.422571] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T18:59:13.428675] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-25T18:59:14.745049] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T18:59:14.750111] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-25T18:59:16.113835] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T18:59:16.121408] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-25T18:59:17.416165] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T18:59:17.420880] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-25T18:59:18.743781] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-25T18:59:18.748508] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-25T18:59:19.901604] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T18:59:19.906053] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-25T18:59:20.972504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T18:59:20.977019] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-25T18:59:22.025154] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T18:59:22.029093] [INFO ] [REMOTE ] ASG: Full fetch complete (30848 records). [2025-10-25T18:59:22.029217] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-25T18:59:22.423287] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-25T18:59:22.423409] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-25T18:59:22.423842] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-25T18:59:22.423948] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-25T18:59:22.424777] [DEBUG] [LOCAL ] ASG: Trimmed 30848 records to 19621 (keeping 200 days of data) [2025-10-25T18:59:22.530717] [DEBUG] [LOCAL ] ASG: Primary data saved (19621 records). [2025-10-25T18:59:22.530894] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-25T18:59:22.531010] [INFO ] [MAIN ] Update Progress: 158/2366 symbols. ASG took 13.5s. Estimated remaining time: 22m 1s [2025-10-25T18:59:22.698694] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:59:22.698906] [DEBUG] [LOCAL ] ASGI: No existing data file found in primary storage. [2025-10-25T18:59:22.698997] [WARN ] [MAIN ] ASGI: No existing data found, performing full refresh instead. [2025-10-25T18:59:22.699093] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-25T18:59:22.699161] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-25T18:59:22.699244] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-25T18:59:22.699314] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-25T18:59:23.055929] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:59:23.056445] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-25T18:59:24.313893] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T18:59:24.319884] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-25T18:59:25.540961] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T18:59:25.545526] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-25T18:59:26.740463] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T18:59:26.745387] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-25T18:59:27.844078] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T18:59:27.849905] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-25T18:59:28.960743] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T18:59:28.965952] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-25T18:59:30.259090] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T18:59:30.264240] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-25T18:59:31.521011] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T18:59:31.526775] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-25T18:59:32.682747] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T18:59:32.688233] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-25T18:59:33.815553] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T18:59:33.821600] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-25T18:59:35.068084] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T18:59:35.072865] [INFO ] [REMOTE ] ASGI: Full fetch complete (32796 records). [2025-10-25T18:59:35.072981] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-25T18:59:35.454256] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-25T18:59:35.454369] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-25T18:59:35.454793] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-25T18:59:35.454875] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-25T18:59:35.455729] [DEBUG] [LOCAL ] ASGI: Trimmed 32796 records to 23238 (keeping 200 days of data) [2025-10-25T18:59:35.593400] [DEBUG] [LOCAL ] ASGI: Primary data saved (23238 records). [2025-10-25T18:59:35.593564] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-25T18:59:35.593698] [INFO ] [MAIN ] Update Progress: 159/2366 symbols. ASGI took 13.1s. Estimated remaining time: 24m 54s [2025-10-25T18:59:35.771228] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:59:35.771401] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-10-25T18:59:35.771474] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-10-25T18:59:35.771589] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-25T18:59:35.771685] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-25T18:59:35.771787] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-25T18:59:35.771859] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-25T18:59:36.128058] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:59:36.128420] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-25T18:59:37.520988] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T18:59:37.527623] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-25T18:59:39.145342] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T18:59:39.153354] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-25T18:59:40.574064] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T18:59:40.582338] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-25T18:59:42.140475] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T18:59:42.148920] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-25T18:59:43.728296] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T18:59:43.735436] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-25T18:59:45.127604] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T18:59:45.134827] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-25T18:59:46.704157] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T18:59:46.712620] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-25T18:59:48.211975] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T18:59:48.220633] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-25T18:59:49.815874] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T18:59:49.824865] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-25T18:59:51.340276] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-25T18:59:51.348104] [INFO ] [REMOTE ] ASGN: Full fetch complete (53864 records). [2025-10-25T18:59:51.348244] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-25T18:59:51.723486] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-25T18:59:51.723621] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-25T18:59:51.724198] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-25T18:59:51.724298] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-25T18:59:51.725410] [DEBUG] [LOCAL ] ASGN: Trimmed 53864 records to 37382 (keeping 200 days of data) [2025-10-25T18:59:51.932677] [DEBUG] [LOCAL ] ASGN: Primary data saved (37382 records). [2025-10-25T18:59:51.932849] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-25T18:59:51.932978] [INFO ] [MAIN ] Update Progress: 160/2366 symbols. ASGN took 16.3s. Estimated remaining time: 28m 29s [2025-10-25T18:59:52.100636] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T18:59:52.100843] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-10-25T18:59:52.100931] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-10-25T18:59:52.101066] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-25T18:59:52.101158] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-25T18:59:52.101265] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-10-25T18:59:52.101353] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-25T18:59:52.450261] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T18:59:52.450692] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-25T18:59:53.954941] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T18:59:53.962582] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-25T18:59:55.538245] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T18:59:55.546377] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-25T18:59:57.144148] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T18:59:57.153346] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-25T18:59:58.770262] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T18:59:58.778925] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-25T19:00:00.382079] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T19:00:00.390251] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-25T19:00:02.458010] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-25T19:00:02.466384] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-25T19:00:04.418746] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-25T19:00:04.428526] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-25T19:00:06.746287] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-25T19:00:06.754238] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-25T19:00:08.363544] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T19:00:08.371716] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-25T19:00:10.236170] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-25T19:00:10.243589] [INFO ] [REMOTE ] ASH: Full fetch complete (55602 records). [2025-10-25T19:00:10.243818] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-25T19:00:10.642049] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-25T19:00:10.642180] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-25T19:00:10.642797] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-25T19:00:10.642880] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-25T19:00:10.644134] [DEBUG] [LOCAL ] ASH: Trimmed 55602 records to 37849 (keeping 200 days of data) [2025-10-25T19:00:10.866431] [DEBUG] [LOCAL ] ASH: Primary data saved (37849 records). [2025-10-25T19:00:10.866614] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-25T19:00:10.866770] [INFO ] [MAIN ] Update Progress: 161/2366 symbols. ASH took 18.9s. Estimated remaining time: 32m 37s [2025-10-25T19:00:11.035311] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:00:11.035496] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-10-25T19:00:11.035568] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-10-25T19:00:11.035705] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-25T19:00:11.035782] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-25T19:00:11.035886] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-25T19:00:11.035960] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-25T19:00:11.398556] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:00:11.399062] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-25T19:00:12.515990] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T19:00:12.520273] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-25T19:00:13.631477] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-25T19:00:13.635769] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-25T19:00:14.841928] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T19:00:14.846335] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-25T19:00:16.352603] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T19:00:16.358427] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-25T19:00:17.829869] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T19:00:17.835504] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-25T19:00:18.842116] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T19:00:18.846324] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-25T19:00:20.315148] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T19:00:20.321495] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-25T19:00:21.702465] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T19:00:21.708463] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-25T19:00:22.827563] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T19:00:22.832737] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-25T19:00:24.030906] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T19:00:24.035473] [INFO ] [REMOTE ] ASIX: Full fetch complete (31060 records). [2025-10-25T19:00:24.035607] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-25T19:00:24.398404] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-25T19:00:24.398525] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-25T19:00:24.398921] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-25T19:00:24.399003] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-25T19:00:24.399911] [DEBUG] [LOCAL ] ASIX: Trimmed 31060 records to 23254 (keeping 200 days of data) [2025-10-25T19:00:24.534868] [DEBUG] [LOCAL ] ASIX: Primary data saved (23254 records). [2025-10-25T19:00:24.535046] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-25T19:00:24.535159] [INFO ] [MAIN ] Update Progress: 162/2366 symbols. ASIX took 13.7s. Estimated remaining time: 35m 30s [2025-10-25T19:00:24.701214] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:00:24.701387] [DEBUG] [LOCAL ] ASPN: No existing data file found in primary storage. [2025-10-25T19:00:24.701459] [WARN ] [MAIN ] ASPN: No existing data found, performing full refresh instead. [2025-10-25T19:00:24.701572] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-25T19:00:24.701663] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-25T19:00:24.701750] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-10-25T19:00:24.701817] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-25T19:00:25.058317] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:00:25.058684] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-25T19:00:27.030463] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T19:00:27.041519] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-25T19:00:28.844522] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T19:00:28.854413] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-25T19:00:30.620790] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T19:00:30.631221] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-25T19:00:31.523816] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T19:00:31.534246] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-25T19:00:32.487764] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T19:00:32.498613] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-25T19:00:33.298682] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T19:00:33.309040] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-25T19:00:34.645780] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T19:00:34.656517] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-25T19:00:35.328093] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-25T19:00:35.339002] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-25T19:00:36.410957] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T19:00:36.421714] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-25T19:00:37.149423] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T19:00:37.159182] [INFO ] [REMOTE ] ASPN: Full fetch complete (72549 records). [2025-10-25T19:00:37.159436] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-25T19:00:37.554097] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-25T19:00:37.554227] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-25T19:00:37.555055] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-25T19:00:37.555156] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-25T19:00:37.556718] [DEBUG] [LOCAL ] ASPN: Trimmed 72549 records to 50576 (keeping 200 days of data) [2025-10-25T19:00:37.827754] [DEBUG] [LOCAL ] ASPN: Primary data saved (50576 records). [2025-10-25T19:00:37.827941] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-25T19:00:37.828089] [INFO ] [MAIN ] Update Progress: 163/2366 symbols. ASPN took 13.3s. Estimated remaining time: 38m 16s [2025-10-25T19:00:37.997115] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:00:37.997391] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-10-25T19:00:37.997481] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-10-25T19:00:37.997623] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-25T19:00:37.997737] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-25T19:00:37.997849] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-25T19:00:37.997935] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-25T19:00:38.358734] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:00:38.359181] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-25T19:00:39.372877] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T19:00:39.374870] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-25T19:00:40.230726] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T19:00:40.232854] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-25T19:00:41.119421] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-25T19:00:41.121506] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-25T19:00:42.097702] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:00:42.100488] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-25T19:00:42.952268] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T19:00:42.954834] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-25T19:00:43.897153] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:00:43.900223] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-25T19:00:44.715037] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-25T19:00:44.717598] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-25T19:00:45.721758] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T19:00:45.724389] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-25T19:00:46.632717] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T19:00:46.635759] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-25T19:00:47.467929] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T19:00:47.469979] [INFO ] [REMOTE ] ASR: Full fetch complete (12560 records). [2025-10-25T19:00:47.470071] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-25T19:00:47.848342] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-25T19:00:47.848461] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-25T19:00:47.848798] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-25T19:00:47.848893] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-25T19:00:47.849465] [DEBUG] [LOCAL ] ASR: Trimmed 12560 records to 9542 (keeping 200 days of data) [2025-10-25T19:00:47.906687] [DEBUG] [LOCAL ] ASR: Primary data saved (9542 records). [2025-10-25T19:00:47.906857] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-25T19:00:47.907008] [INFO ] [MAIN ] Update Progress: 164/2366 symbols. ASR took 10.1s. Estimated remaining time: 40m 16s [2025-10-25T19:00:48.075001] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:00:48.075180] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-10-25T19:00:48.075251] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-10-25T19:00:48.075362] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-25T19:00:48.075433] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-25T19:00:48.075511] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-25T19:00:48.075578] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-25T19:00:48.423220] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:00:48.423543] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-25T19:00:50.414032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T19:00:50.424678] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-25T19:00:51.999880] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T19:00:52.010480] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-25T19:00:53.933576] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T19:00:53.945016] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-25T19:00:54.961506] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T19:00:54.975158] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-25T19:00:56.245103] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T19:00:56.256235] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-25T19:00:57.415337] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T19:00:57.426187] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-25T19:00:58.402233] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T19:00:58.413423] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-25T19:00:59.444803] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:00:59.455737] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-25T19:01:00.384848] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T19:01:00.397697] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-25T19:01:01.580051] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T19:01:01.589927] [INFO ] [REMOTE ] ASX: Full fetch complete (76790 records). [2025-10-25T19:01:01.590126] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-25T19:01:02.057420] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-25T19:01:02.057533] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-25T19:01:02.058271] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-25T19:01:02.058355] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-25T19:01:02.059871] [DEBUG] [LOCAL ] ASX: Trimmed 76790 records to 53647 (keeping 200 days of data) [2025-10-25T19:01:02.366289] [DEBUG] [LOCAL ] ASX: Primary data saved (53647 records). [2025-10-25T19:01:02.366477] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-25T19:01:02.366611] [INFO ] [MAIN ] Update Progress: 165/2366 symbols. ASX took 14.5s. Estimated remaining time: 43m 13s [2025-10-25T19:01:02.537970] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:01:02.538233] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-10-25T19:01:02.538306] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-10-25T19:01:02.538421] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-25T19:01:02.538492] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-25T19:01:02.538572] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-10-25T19:01:02.538660] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-25T19:01:02.895016] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:01:02.895336] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-25T19:01:05.012477] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-25T19:01:05.020314] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-25T19:01:06.681492] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T19:01:06.691449] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-25T19:01:08.327351] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T19:01:08.337305] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-25T19:01:10.117041] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T19:01:10.126548] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-25T19:01:11.732971] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T19:01:11.741383] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-25T19:01:13.233691] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T19:01:13.241554] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-25T19:01:14.995277] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T19:01:15.004115] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-25T19:01:16.603950] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T19:01:16.612293] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-25T19:01:18.197310] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T19:01:18.206511] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-25T19:01:19.561481] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T19:01:19.567494] [INFO ] [REMOTE ] ATEN: Full fetch complete (56608 records). [2025-10-25T19:01:19.567631] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-25T19:01:19.996382] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-25T19:01:19.996529] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-25T19:01:19.997143] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-25T19:01:19.997231] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-25T19:01:19.998766] [DEBUG] [LOCAL ] ATEN: Trimmed 56608 records to 38121 (keeping 200 days of data) [2025-10-25T19:01:20.226129] [DEBUG] [LOCAL ] ATEN: Primary data saved (38121 records). [2025-10-25T19:01:20.226298] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-25T19:01:20.226410] [INFO ] [MAIN ] Update Progress: 166/2366 symbols. ATEN took 17.9s. Estimated remaining time: 46m 53s [2025-10-25T19:01:20.415768] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:01:20.415955] [DEBUG] [LOCAL ] ATGE: No existing data file found in primary storage. [2025-10-25T19:01:20.416027] [WARN ] [MAIN ] ATGE: No existing data found, performing full refresh instead. [2025-10-25T19:01:20.416143] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-25T19:01:20.416215] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-25T19:01:20.416297] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-10-25T19:01:20.416365] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-25T19:01:20.811687] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:01:20.812046] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-25T19:01:22.493869] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T19:01:22.500560] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-25T19:01:23.933948] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T19:01:23.940767] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-25T19:01:25.478044] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T19:01:25.485451] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-25T19:01:26.760328] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T19:01:26.768379] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-25T19:01:28.350975] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T19:01:28.358892] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-25T19:01:29.726515] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T19:01:29.733342] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-25T19:01:31.165299] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T19:01:31.174859] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-25T19:01:32.718512] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T19:01:32.728295] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-25T19:01:34.084842] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-25T19:01:34.091010] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-25T19:01:35.349106] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T19:01:35.354033] [INFO ] [REMOTE ] ATGE: Full fetch complete (45386 records). [2025-10-25T19:01:35.354154] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-25T19:01:35.729580] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-25T19:01:35.729714] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-25T19:01:35.730225] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-25T19:01:35.730312] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-25T19:01:35.731312] [DEBUG] [LOCAL ] ATGE: Trimmed 45386 records to 30729 (keeping 200 days of data) [2025-10-25T19:01:35.904890] [DEBUG] [LOCAL ] ATGE: Primary data saved (30729 records). [2025-10-25T19:01:35.905059] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-25T19:01:35.905185] [INFO ] [MAIN ] Update Progress: 167/2366 symbols. ATGE took 15.7s. Estimated remaining time: 50m 1s [2025-10-25T19:01:36.073331] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:01:36.073498] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-10-25T19:01:36.073572] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-10-25T19:01:36.073703] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-25T19:01:36.073773] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-25T19:01:36.073853] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-25T19:01:36.073919] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-25T19:01:36.426385] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:01:36.426779] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-25T19:01:38.007779] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T19:01:38.016363] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-25T19:01:39.742952] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T19:01:39.751147] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-25T19:01:41.203557] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T19:01:41.211680] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-25T19:01:42.877072] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T19:01:42.886924] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-25T19:01:44.776976] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-25T19:01:44.785190] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-25T19:01:46.228753] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T19:01:46.235599] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-25T19:01:47.341776] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T19:01:47.347677] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-25T19:01:48.824586] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T19:01:48.831524] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-25T19:01:49.994377] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T19:01:50.000690] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-25T19:01:51.212904] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T19:01:51.218332] [INFO ] [REMOTE ] ATHM: Full fetch complete (49253 records). [2025-10-25T19:01:51.218463] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-25T19:01:51.599046] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-25T19:01:51.599180] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-25T19:01:51.599761] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-25T19:01:51.599852] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-25T19:01:51.601039] [DEBUG] [LOCAL ] ATHM: Trimmed 49253 records to 31589 (keeping 200 days of data) [2025-10-25T19:01:51.783219] [DEBUG] [LOCAL ] ATHM: Primary data saved (31589 records). [2025-10-25T19:01:51.783386] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-25T19:01:51.783497] [INFO ] [MAIN ] Update Progress: 168/2366 symbols. ATHM took 15.9s. Estimated remaining time: 53m 10s [2025-10-25T19:01:51.950725] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:01:51.950915] [DEBUG] [LOCAL ] ATHS: No existing data file found in primary storage. [2025-10-25T19:01:51.950985] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-10-25T19:01:51.951095] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-25T19:01:51.951173] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-25T19:01:51.951251] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-10-25T19:01:51.951305] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-25T19:01:52.307577] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:01:52.307933] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-25T19:01:53.009808] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T19:01:53.011672] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-25T19:01:53.725495] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T19:01:53.727189] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-25T19:01:54.593944] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-25T19:01:54.596679] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-25T19:01:55.209519] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T19:01:55.211853] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-25T19:01:55.952551] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T19:01:55.954824] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-25T19:01:56.802568] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T19:01:56.806134] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-25T19:01:57.660975] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T19:01:57.663630] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-25T19:01:58.448247] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T19:01:58.450300] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-25T19:01:59.093580] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T19:01:59.095686] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-25T19:01:59.804754] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T19:01:59.806458] [INFO ] [REMOTE ] ATHS: Full fetch complete (9556 records). [2025-10-25T19:01:59.806580] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-25T19:02:00.376336] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-25T19:02:00.376474] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-25T19:02:00.376843] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-25T19:02:00.376931] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-25T19:02:00.377837] [DEBUG] [LOCAL ] ATHS: Trimmed 9556 records to 6543 (keeping 200 days of data) [2025-10-25T19:02:00.437672] [DEBUG] [LOCAL ] ATHS: Primary data saved (6543 records). [2025-10-25T19:02:00.437885] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-25T19:02:00.438049] [INFO ] [MAIN ] Update Progress: 169/2366 symbols. ATHS took 8.7s. Estimated remaining time: 54m 42s [2025-10-25T19:02:00.682291] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:02:00.682524] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-10-25T19:02:00.682599] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-10-25T19:02:00.682738] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-25T19:02:00.682811] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-25T19:02:00.682893] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-25T19:02:00.682963] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-25T19:02:01.076423] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:02:01.076803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-25T19:02:03.387050] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-25T19:02:03.396399] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-25T19:02:04.919085] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T19:02:04.929764] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-25T19:02:06.737548] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T19:02:06.748411] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-25T19:02:07.811588] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T19:02:07.822498] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-25T19:02:08.998286] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T19:02:09.009336] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-25T19:02:09.871536] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T19:02:09.882080] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-25T19:02:10.983388] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T19:02:10.994139] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-25T19:02:12.076438] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T19:02:12.087975] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-25T19:02:13.110001] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T19:02:13.122635] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-25T19:02:13.939302] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T19:02:13.948131] [INFO ] [REMOTE ] ATI: Full fetch complete (74125 records). [2025-10-25T19:02:13.948283] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-25T19:02:14.350835] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-25T19:02:14.350997] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-25T19:02:14.351822] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-25T19:02:14.351924] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-25T19:02:14.353443] [DEBUG] [LOCAL ] ATI: Trimmed 74125 records to 52040 (keeping 200 days of data) [2025-10-25T19:02:14.657981] [DEBUG] [LOCAL ] ATI: Primary data saved (52040 records). [2025-10-25T19:02:14.658142] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-25T19:02:14.658256] [INFO ] [MAIN ] Update Progress: 170/2366 symbols. ATI took 14.2s. Estimated remaining time: 57m 25s [2025-10-25T19:02:14.826991] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:02:14.827214] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-10-25T19:02:14.827331] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-10-25T19:02:14.827476] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-25T19:02:14.827565] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-25T19:02:14.827698] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-25T19:02:14.827786] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-25T19:02:15.189322] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:02:15.189744] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-25T19:02:16.793777] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T19:02:16.801317] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-25T19:02:18.526910] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T19:02:18.535793] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-25T19:02:20.159542] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T19:02:20.167952] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-25T19:02:21.748156] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T19:02:21.756714] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-25T19:02:23.236465] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T19:02:23.243598] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-25T19:02:24.672586] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T19:02:24.679075] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-25T19:02:26.160933] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T19:02:26.168876] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-25T19:02:27.770798] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T19:02:27.779262] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-25T19:02:29.298934] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T19:02:29.307093] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-25T19:02:30.656734] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T19:02:30.663046] [INFO ] [REMOTE ] ATKR: Full fetch complete (53128 records). [2025-10-25T19:02:30.663213] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-25T19:02:31.044333] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-25T19:02:31.044461] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-25T19:02:31.045109] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-25T19:02:31.045212] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-25T19:02:31.046473] [DEBUG] [LOCAL ] ATKR: Trimmed 53128 records to 35299 (keeping 200 days of data) [2025-10-25T19:02:31.253032] [DEBUG] [LOCAL ] ATKR: Primary data saved (35299 records). [2025-10-25T19:02:31.253223] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-25T19:02:31.253400] [INFO ] [MAIN ] Update Progress: 171/2366 symbols. ATKR took 16.6s. Estimated remaining time: 1h 0m 36s [2025-10-25T19:02:31.423284] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:02:31.423503] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-10-25T19:02:31.423592] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-10-25T19:02:31.423779] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-25T19:02:31.423867] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-25T19:02:31.424029] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-25T19:02:31.424117] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-25T19:02:31.782906] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:02:31.783290] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-25T19:02:33.226764] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T19:02:33.234429] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-25T19:02:34.634358] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-25T19:02:34.642117] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-25T19:02:36.199094] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T19:02:36.208161] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-25T19:02:37.739752] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T19:02:37.748763] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-25T19:02:39.253996] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T19:02:39.261829] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-25T19:02:40.748562] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T19:02:40.755970] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-25T19:02:42.248045] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T19:02:42.256190] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-25T19:02:44.068138] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T19:02:44.077694] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-25T19:02:45.563564] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T19:02:45.572862] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-25T19:02:47.145447] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T19:02:47.156318] [INFO ] [REMOTE ] ATMU: Full fetch complete (56727 records). [2025-10-25T19:02:47.156560] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-25T19:02:47.732933] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-25T19:02:47.733123] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-25T19:02:47.734145] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-25T19:02:47.734262] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-25T19:02:47.736123] [DEBUG] [LOCAL ] ATMU: Trimmed 56727 records to 39070 (keeping 200 days of data) [2025-10-25T19:02:48.025017] [DEBUG] [LOCAL ] ATMU: Primary data saved (39070 records). [2025-10-25T19:02:48.025248] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-25T19:02:48.025372] [INFO ] [MAIN ] Update Progress: 172/2366 symbols. ATMU took 16.8s. Estimated remaining time: 1h 3m 47s [2025-10-25T19:02:48.237746] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:02:48.238009] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-10-25T19:02:48.238084] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-10-25T19:02:48.238202] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-25T19:02:48.238273] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-25T19:02:48.238356] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-25T19:02:48.238427] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-25T19:02:48.632597] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:02:48.632994] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-25T19:02:50.274704] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T19:02:50.283027] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-25T19:02:51.845948] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T19:02:51.857663] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-25T19:02:53.514241] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T19:02:53.523787] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-25T19:02:55.193832] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T19:02:55.203283] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-25T19:02:57.075883] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-25T19:02:57.085791] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-25T19:02:58.655626] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T19:02:58.663780] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-25T19:03:00.217123] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T19:03:00.225773] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-25T19:03:02.307862] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-25T19:03:02.317135] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-25T19:03:04.103808] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T19:03:04.112769] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-25T19:03:05.723352] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T19:03:05.730524] [INFO ] [REMOTE ] ATO: Full fetch complete (60645 records). [2025-10-25T19:03:05.730686] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-25T19:03:06.119160] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-25T19:03:06.119285] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-25T19:03:06.119908] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-25T19:03:06.119990] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-25T19:03:06.121241] [DEBUG] [LOCAL ] ATO: Trimmed 60645 records to 42051 (keeping 200 days of data) [2025-10-25T19:03:06.374605] [DEBUG] [LOCAL ] ATO: Primary data saved (42051 records). [2025-10-25T19:03:06.374791] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-25T19:03:06.374882] [INFO ] [MAIN ] Update Progress: 173/2366 symbols. ATO took 18.3s. Estimated remaining time: 1h 7m 16s [2025-10-25T19:03:06.548151] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:03:06.548383] [DEBUG] [LOCAL ] ATR: No existing data file found in primary storage. [2025-10-25T19:03:06.548458] [WARN ] [MAIN ] ATR: No existing data found, performing full refresh instead. [2025-10-25T19:03:06.548574] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-25T19:03:06.548663] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-25T19:03:06.548751] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-25T19:03:06.548818] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-25T19:03:06.906499] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:03:06.906881] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-25T19:03:08.276122] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T19:03:08.282023] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-25T19:03:09.804968] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T19:03:09.812395] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-25T19:03:11.160120] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T19:03:11.166401] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-25T19:03:12.519714] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T19:03:12.526097] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-25T19:03:14.084920] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T19:03:14.091777] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-25T19:03:15.449003] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T19:03:15.455766] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-25T19:03:16.806785] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T19:03:16.813365] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-25T19:03:18.272395] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T19:03:18.279964] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-25T19:03:19.738933] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T19:03:19.745873] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-25T19:03:21.058374] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-25T19:03:21.064009] [INFO ] [REMOTE ] ATR: Full fetch complete (43932 records). [2025-10-25T19:03:21.064131] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-25T19:03:21.446897] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-25T19:03:21.447005] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-25T19:03:21.447509] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-25T19:03:21.447590] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-25T19:03:21.448686] [DEBUG] [LOCAL ] ATR: Trimmed 43932 records to 30816 (keeping 200 days of data) [2025-10-25T19:03:21.635436] [DEBUG] [LOCAL ] ATR: Primary data saved (30816 records). [2025-10-25T19:03:21.635615] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-25T19:03:21.635765] [INFO ] [MAIN ] Update Progress: 174/2366 symbols. ATR took 15.3s. Estimated remaining time: 1h 10m 3s [2025-10-25T19:03:21.815548] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:03:21.815759] [DEBUG] [LOCAL ] ATS: No existing data file found in primary storage. [2025-10-25T19:03:21.815829] [WARN ] [MAIN ] ATS: No existing data found, performing full refresh instead. [2025-10-25T19:03:21.815958] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-25T19:03:21.816047] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-25T19:03:21.816128] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-25T19:03:21.816194] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-25T19:03:22.181170] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:03:22.181488] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-25T19:03:23.292638] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T19:03:23.296900] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-25T19:03:24.276378] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T19:03:24.280222] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-25T19:03:25.462454] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T19:03:25.466789] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-25T19:03:26.745322] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T19:03:26.750520] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-25T19:03:27.863398] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T19:03:27.867793] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-25T19:03:29.157152] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T19:03:29.161997] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-25T19:03:30.290537] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T19:03:30.295726] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-25T19:03:31.432455] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T19:03:31.436870] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-25T19:03:32.464399] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T19:03:32.468307] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-25T19:03:33.442988] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:03:33.446216] [INFO ] [REMOTE ] ATS: Full fetch complete (25444 records). [2025-10-25T19:03:33.446328] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-25T19:03:33.831720] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-25T19:03:33.831872] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-25T19:03:33.832334] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-25T19:03:33.832420] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-25T19:03:33.833280] [DEBUG] [LOCAL ] ATS: Trimmed 25444 records to 17194 (keeping 200 days of data) [2025-10-25T19:03:33.936238] [DEBUG] [LOCAL ] ATS: Primary data saved (17194 records). [2025-10-25T19:03:33.936490] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-25T19:03:33.936634] [INFO ] [MAIN ] Update Progress: 175/2366 symbols. ATS took 12.3s. Estimated remaining time: 1h 12m 11s [2025-10-25T19:03:34.126105] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:03:34.126387] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-10-25T19:03:34.126464] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-10-25T19:03:34.126603] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-25T19:03:34.126706] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-25T19:03:34.126794] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-10-25T19:03:34.126870] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-25T19:03:34.504888] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:03:34.505412] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-25T19:03:36.233939] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T19:03:36.243493] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-25T19:03:37.860610] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T19:03:37.870231] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-25T19:03:39.543168] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T19:03:39.552573] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-25T19:03:40.489235] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T19:03:40.504004] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-25T19:03:41.415601] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T19:03:41.427619] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-25T19:03:42.628211] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T19:03:42.640589] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-25T19:03:43.540819] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T19:03:43.553176] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-25T19:03:44.472326] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T19:03:44.482617] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-25T19:03:45.344752] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T19:03:45.355814] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-25T19:03:45.875790] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-25T19:03:45.884879] [INFO ] [REMOTE ] ATUS: Full fetch complete (71477 records). [2025-10-25T19:03:45.885022] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-25T19:03:46.266712] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-25T19:03:46.266827] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-25T19:03:46.267551] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-25T19:03:46.267638] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-25T19:03:46.269182] [DEBUG] [LOCAL ] ATUS: Trimmed 71477 records to 50699 (keeping 200 days of data) [2025-10-25T19:03:46.534568] [DEBUG] [LOCAL ] ATUS: Primary data saved (50699 records). [2025-10-25T19:03:46.534779] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-25T19:03:46.534895] [INFO ] [MAIN ] Update Progress: 176/2366 symbols. ATUS took 12.6s. Estimated remaining time: 1h 14m 22s [2025-10-25T19:03:46.705957] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:03:46.706197] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-25T19:03:46.706274] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-25T19:03:46.706394] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-25T19:03:46.706513] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-25T19:03:46.706599] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-25T19:03:46.706698] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-25T19:03:47.057711] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:03:47.058091] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-25T19:03:49.091029] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-25T19:03:49.102100] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-25T19:03:51.213667] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-25T19:03:51.223892] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-25T19:03:53.308518] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-25T19:03:53.320187] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-25T19:03:54.233903] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T19:03:54.244922] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-25T19:03:55.323563] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T19:03:55.334638] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-25T19:03:56.262581] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T19:03:56.273876] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-25T19:03:57.266606] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T19:03:57.278001] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-25T19:03:58.310769] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:03:58.321626] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-25T19:03:59.907456] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T19:03:59.918881] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-25T19:04:01.030054] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T19:04:01.039719] [INFO ] [REMOTE ] AU: Full fetch complete (76654 records). [2025-10-25T19:04:01.039874] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-25T19:04:01.455289] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-25T19:04:01.455742] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-25T19:04:01.456513] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-25T19:04:01.456597] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-25T19:04:01.458223] [DEBUG] [LOCAL ] AU: Trimmed 76654 records to 53860 (keeping 200 days of data) [2025-10-25T19:04:01.772008] [DEBUG] [LOCAL ] AU: Primary data saved (53860 records). [2025-10-25T19:04:01.772176] [INFO ] [MAIN ] AU: Full history saved. [2025-10-25T19:04:01.772287] [INFO ] [MAIN ] Update Progress: 177/2366 symbols. AU took 15.2s. Estimated remaining time: 1h 17m 3s [2025-10-25T19:04:01.939953] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:04:01.940218] [DEBUG] [LOCAL ] AUB: No existing data file found in primary storage. [2025-10-25T19:04:01.940290] [WARN ] [MAIN ] AUB: No existing data found, performing full refresh instead. [2025-10-25T19:04:01.940405] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-25T19:04:01.940452] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-25T19:04:01.940525] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-10-25T19:04:01.940595] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-25T19:04:02.323627] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:04:02.324065] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-25T19:04:03.941608] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T19:04:03.950170] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-25T19:04:05.699059] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-25T19:04:05.707396] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-25T19:04:07.434490] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T19:04:07.447935] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-25T19:04:08.875745] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T19:04:08.886358] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-25T19:04:09.874958] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T19:04:09.884255] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-25T19:04:10.889464] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T19:04:10.900685] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-25T19:04:11.730301] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T19:04:11.740167] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-25T19:04:12.682155] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T19:04:12.691722] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-25T19:04:13.916069] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-25T19:04:13.925477] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-25T19:04:14.807802] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:04:14.816239] [INFO ] [REMOTE ] AUB: Full fetch complete (66497 records). [2025-10-25T19:04:14.816400] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-25T19:04:15.213095] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-25T19:04:15.213216] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-25T19:04:15.213946] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-25T19:04:15.214046] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-25T19:04:15.215347] [DEBUG] [LOCAL ] AUB: Trimmed 66497 records to 46502 (keeping 200 days of data) [2025-10-25T19:04:15.482611] [DEBUG] [LOCAL ] AUB: Primary data saved (46502 records). [2025-10-25T19:04:15.482835] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-25T19:04:15.482990] [INFO ] [MAIN ] Update Progress: 178/2366 symbols. AUB took 13.7s. Estimated remaining time: 1h 19m 23s [2025-10-25T19:04:15.654946] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:04:15.655143] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-10-25T19:04:15.655231] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-10-25T19:04:15.655376] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-25T19:04:15.655467] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-25T19:04:15.655575] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-25T19:04:15.655697] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-25T19:04:16.031852] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:04:16.032157] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-25T19:04:16.978753] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T19:04:16.981005] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-25T19:04:17.759512] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T19:04:17.761432] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-25T19:04:18.447595] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-25T19:04:18.449326] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-25T19:04:19.149146] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-25T19:04:19.150625] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-25T19:04:19.843489] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-25T19:04:19.845181] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-25T19:04:20.684606] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T19:04:20.687049] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-25T19:04:21.302447] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-25T19:04:21.304399] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-25T19:04:21.990379] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-25T19:04:21.991962] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-25T19:04:22.773097] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T19:04:22.775381] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-25T19:04:23.414599] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T19:04:23.416598] [INFO ] [REMOTE ] AUNA: Full fetch complete (7853 records). [2025-10-25T19:04:23.416716] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-25T19:04:23.794457] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-25T19:04:23.794594] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-25T19:04:23.794849] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-25T19:04:23.794950] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-25T19:04:23.795450] [DEBUG] [LOCAL ] AUNA: Trimmed 7853 records to 5332 (keeping 200 days of data) [2025-10-25T19:04:23.824129] [DEBUG] [LOCAL ] AUNA: Primary data saved (5332 records). [2025-10-25T19:04:23.824286] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-25T19:04:23.824425] [INFO ] [MAIN ] Update Progress: 179/2366 symbols. AUNA took 8.3s. Estimated remaining time: 1h 20m 36s [2025-10-25T19:04:24.005637] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:04:24.005890] [DEBUG] [LOCAL ] AVA: No existing data file found in primary storage. [2025-10-25T19:04:24.005986] [WARN ] [MAIN ] AVA: No existing data found, performing full refresh instead. [2025-10-25T19:04:24.006129] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-25T19:04:24.006219] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-25T19:04:24.006326] [DEBUG] [LOCAL ] AVA: No primary data file found to delete. [2025-10-25T19:04:24.006416] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-25T19:04:24.390093] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:04:24.390452] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-25T19:04:25.787360] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T19:04:25.794456] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-25T19:04:27.007811] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T19:04:27.015029] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-25T19:04:28.644636] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T19:04:28.658237] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-25T19:04:30.322352] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T19:04:30.331026] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-25T19:04:31.911679] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T19:04:31.921180] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-25T19:04:33.348849] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T19:04:33.356986] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-25T19:04:34.898151] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T19:04:34.907430] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-25T19:04:36.351110] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T19:04:36.359466] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-25T19:04:37.780235] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T19:04:37.788727] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-25T19:04:39.223193] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T19:04:39.232282] [INFO ] [REMOTE ] AVA: Full fetch complete (55427 records). [2025-10-25T19:04:39.232463] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-25T19:04:39.635416] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-25T19:04:39.635618] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-25T19:04:39.636355] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-25T19:04:39.636445] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-25T19:04:39.638268] [DEBUG] [LOCAL ] AVA: Trimmed 55427 records to 38783 (keeping 200 days of data) [2025-10-25T19:04:39.891530] [DEBUG] [LOCAL ] AVA: Primary data saved (38783 records). [2025-10-25T19:04:39.891810] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-25T19:04:39.891950] [INFO ] [MAIN ] Update Progress: 180/2366 symbols. AVA took 16.1s. Estimated remaining time: 1h 23m 23s [2025-10-25T19:04:40.071318] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:04:40.071600] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-25T19:04:40.071697] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-25T19:04:40.071827] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-25T19:04:40.071901] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-25T19:04:40.071987] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-25T19:04:40.072061] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-25T19:04:40.452156] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:04:40.452611] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-25T19:04:41.407243] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T19:04:41.410481] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-25T19:04:42.497750] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T19:04:42.501366] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-25T19:04:43.533445] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T19:04:43.537197] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-25T19:04:44.465957] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T19:04:44.470930] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-25T19:04:45.323321] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T19:04:45.325584] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-25T19:04:46.113548] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T19:04:46.115926] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-25T19:04:47.035669] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T19:04:47.038376] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-25T19:04:47.951089] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T19:04:47.953275] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-25T19:04:48.738482] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T19:04:48.740701] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-25T19:04:49.658974] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T19:04:49.661265] [INFO ] [REMOTE ] AVAL: Full fetch complete (15029 records). [2025-10-25T19:04:49.661383] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-25T19:04:50.034465] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-25T19:04:50.034574] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-25T19:04:50.034879] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-25T19:04:50.034958] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-25T19:04:50.035509] [DEBUG] [LOCAL ] AVAL: Trimmed 15029 records to 8579 (keeping 200 days of data) [2025-10-25T19:04:50.086079] [DEBUG] [LOCAL ] AVAL: Primary data saved (8579 records). [2025-10-25T19:04:50.086274] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-25T19:04:50.086396] [INFO ] [MAIN ] Update Progress: 181/2366 symbols. AVAL took 10.2s. Estimated remaining time: 1h 24m 56s [2025-10-25T19:04:50.282621] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:04:50.282879] [DEBUG] [LOCAL ] AVB: No existing data file found in primary storage. [2025-10-25T19:04:50.282971] [WARN ] [MAIN ] AVB: No existing data found, performing full refresh instead. [2025-10-25T19:04:50.283112] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-25T19:04:50.283202] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-25T19:04:50.283307] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-25T19:04:50.283393] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-25T19:04:50.659604] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:04:50.660060] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-25T19:04:52.231715] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T19:04:52.238931] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-25T19:04:53.874606] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T19:04:53.882255] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-25T19:04:55.436705] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T19:04:55.445213] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-25T19:04:57.192630] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T19:04:57.202251] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-25T19:04:58.834513] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T19:04:58.845686] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-25T19:05:00.479520] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-25T19:05:00.490573] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-25T19:05:02.872284] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-25T19:05:02.882125] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-25T19:05:04.553208] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T19:05:04.563484] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-25T19:05:06.287668] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T19:05:06.297722] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-25T19:05:08.078842] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-25T19:05:08.086554] [INFO ] [REMOTE ] AVB: Full fetch complete (59510 records). [2025-10-25T19:05:08.086806] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-25T19:05:08.493283] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-25T19:05:08.493449] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-25T19:05:08.494177] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-25T19:05:08.494278] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-25T19:05:08.495584] [DEBUG] [LOCAL ] AVB: Trimmed 59510 records to 42750 (keeping 200 days of data) [2025-10-25T19:05:08.754056] [DEBUG] [LOCAL ] AVB: Primary data saved (42750 records). [2025-10-25T19:05:08.754239] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-25T19:05:08.754366] [INFO ] [MAIN ] Update Progress: 182/2366 symbols. AVB took 18.7s. Estimated remaining time: 1h 28m 9s [2025-10-25T19:05:08.925304] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:05:08.925537] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-25T19:05:08.925623] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-25T19:05:08.925766] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-25T19:05:08.925838] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-25T19:05:08.925919] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-25T19:05:08.925999] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-25T19:05:09.344912] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:05:09.345284] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-25T19:05:09.676022] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:05:09.676342] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-25T19:05:09.676430] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:05:09.676502] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-25T19:05:09.676570] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:05:09.676664] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-25T19:05:09.676760] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-25T19:05:09.676815] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-25T19:05:09.676891] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-25T19:05:09.676981] [INFO ] [MAIN ] Update Progress: 183/2366 symbols. AVBC took 0.9s. Estimated remaining time: 1h 27m 49s [2025-10-25T19:05:09.841072] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:05:09.841246] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-10-25T19:05:09.841317] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-10-25T19:05:09.841427] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-25T19:05:09.841516] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-25T19:05:09.841605] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-25T19:05:09.841695] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-25T19:05:10.199784] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:05:10.200139] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-25T19:05:11.775358] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T19:05:11.781886] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-25T19:05:12.997923] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T19:05:13.002189] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-25T19:05:14.234739] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-25T19:05:14.244430] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-25T19:05:15.252345] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T19:05:15.258046] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-25T19:05:16.396573] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T19:05:16.401282] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-25T19:05:17.615276] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T19:05:17.620698] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-25T19:05:18.826039] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T19:05:18.836873] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-25T19:05:20.183101] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T19:05:20.188788] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-25T19:05:21.399807] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T19:05:21.404675] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-25T19:05:22.390267] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:05:22.393793] [INFO ] [REMOTE ] AVD: Full fetch complete (32425 records). [2025-10-25T19:05:22.393916] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-25T19:05:22.775718] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-25T19:05:22.775843] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-25T19:05:22.776360] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-25T19:05:22.776445] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-25T19:05:22.777435] [DEBUG] [LOCAL ] AVD: Trimmed 32425 records to 21565 (keeping 200 days of data) [2025-10-25T19:05:22.893545] [DEBUG] [LOCAL ] AVD: Primary data saved (21565 records). [2025-10-25T19:05:22.893717] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-25T19:05:22.893826] [INFO ] [MAIN ] Update Progress: 184/2366 symbols. AVD took 13.2s. Estimated remaining time: 1h 29m 55s [2025-10-25T19:05:23.070526] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:05:23.070694] [DEBUG] [LOCAL ] AVK: No existing data file found in primary storage. [2025-10-25T19:05:23.070786] [WARN ] [MAIN ] AVK: No existing data found, performing full refresh instead. [2025-10-25T19:05:23.070899] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-25T19:05:23.070971] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-25T19:05:23.071056] [DEBUG] [LOCAL ] AVK: No primary data file found to delete. [2025-10-25T19:05:23.071124] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-25T19:05:23.445257] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:05:23.445674] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-25T19:05:24.555020] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T19:05:24.559435] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-25T19:05:25.501844] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-25T19:05:25.505546] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-25T19:05:26.654064] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T19:05:26.658438] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-25T19:05:27.785634] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T19:05:27.790224] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-25T19:05:28.966250] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T19:05:28.970365] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-25T19:05:30.035534] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:05:30.041571] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-25T19:05:31.189591] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T19:05:31.194606] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-25T19:05:32.272251] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T19:05:32.277123] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-25T19:05:33.399590] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T19:05:33.404098] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-25T19:05:34.611342] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T19:05:34.615714] [INFO ] [REMOTE ] AVK: Full fetch complete (26739 records). [2025-10-25T19:05:34.615858] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-25T19:05:35.006784] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-25T19:05:35.006915] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-25T19:05:35.007271] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-25T19:05:35.007366] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-25T19:05:35.008331] [DEBUG] [LOCAL ] AVK: Trimmed 26739 records to 18934 (keeping 200 days of data) [2025-10-25T19:05:35.117519] [DEBUG] [LOCAL ] AVK: Primary data saved (18934 records). [2025-10-25T19:05:35.117722] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-25T19:05:35.117817] [INFO ] [MAIN ] Update Progress: 185/2366 symbols. AVK took 12.2s. Estimated remaining time: 1h 31m 47s [2025-10-25T19:05:35.284280] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:05:35.284443] [DEBUG] [LOCAL ] AVNS: No existing data file found in primary storage. [2025-10-25T19:05:35.284510] [WARN ] [MAIN ] AVNS: No existing data found, performing full refresh instead. [2025-10-25T19:05:35.284596] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-25T19:05:35.284698] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-25T19:05:35.284780] [DEBUG] [LOCAL ] AVNS: No primary data file found to delete. [2025-10-25T19:05:35.284846] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-25T19:05:35.633749] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:05:35.634068] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-25T19:05:37.182272] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T19:05:37.189407] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-25T19:05:38.495000] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T19:05:38.505243] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-25T19:05:40.172602] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T19:05:40.180323] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-25T19:05:41.658407] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T19:05:41.666120] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-25T19:05:43.065635] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T19:05:43.072830] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-25T19:05:44.094633] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T19:05:44.100960] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-25T19:05:45.523979] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T19:05:45.531360] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-25T19:05:46.979973] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T19:05:46.988342] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-25T19:05:48.435201] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-25T19:05:48.442560] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-25T19:05:49.714798] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T19:05:49.720755] [INFO ] [REMOTE ] AVNS: Full fetch complete (48308 records). [2025-10-25T19:05:49.720859] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-25T19:05:50.093854] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-25T19:05:50.093970] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-25T19:05:50.094477] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-25T19:05:50.094557] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-25T19:05:50.095540] [DEBUG] [LOCAL ] AVNS: Trimmed 48308 records to 33963 (keeping 200 days of data) [2025-10-25T19:05:50.285746] [DEBUG] [LOCAL ] AVNS: Primary data saved (33963 records). [2025-10-25T19:05:50.285948] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-25T19:05:50.286065] [INFO ] [MAIN ] Update Progress: 186/2366 symbols. AVNS took 15.2s. Estimated remaining time: 1h 34m 13s [2025-10-25T19:05:50.456153] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:05:50.456355] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-10-25T19:05:50.456427] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-10-25T19:05:50.456541] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-25T19:05:50.456613] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-25T19:05:50.456703] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-25T19:05:50.456758] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-25T19:05:50.811090] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:05:50.811417] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-25T19:05:52.182873] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T19:05:52.190328] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-25T19:05:53.613675] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T19:05:53.621262] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-25T19:05:55.150509] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T19:05:55.158937] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-25T19:05:56.729006] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T19:05:56.737849] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-25T19:05:58.340445] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T19:05:58.349335] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-25T19:05:59.877004] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T19:05:59.885135] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-25T19:06:01.702922] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-25T19:06:01.712510] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-25T19:06:03.661695] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-25T19:06:03.670081] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-25T19:06:05.187918] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T19:06:05.195915] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-25T19:06:06.684611] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-25T19:06:06.691114] [INFO ] [REMOTE ] AVNT: Full fetch complete (55937 records). [2025-10-25T19:06:06.691247] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-25T19:06:07.065786] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-25T19:06:07.065892] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-25T19:06:07.066445] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-25T19:06:07.066524] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-25T19:06:07.067731] [DEBUG] [LOCAL ] AVNT: Trimmed 55937 records to 39076 (keeping 200 days of data) [2025-10-25T19:06:07.289125] [DEBUG] [LOCAL ] AVNT: Primary data saved (39076 records). [2025-10-25T19:06:07.289288] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-25T19:06:07.289394] [INFO ] [MAIN ] Update Progress: 187/2366 symbols. AVNT took 17.0s. Estimated remaining time: 1h 36m 58s [2025-10-25T19:06:07.459256] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:06:07.459439] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-10-25T19:06:07.459521] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-10-25T19:06:07.459679] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-25T19:06:07.459749] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-25T19:06:07.459827] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-25T19:06:07.459894] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-25T19:06:07.809350] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:06:07.809752] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-25T19:06:09.556962] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T19:06:09.567102] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-25T19:06:11.339210] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-25T19:06:11.349325] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-25T19:06:13.081275] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T19:06:13.092302] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-25T19:06:14.173088] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T19:06:14.184579] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-25T19:06:15.480293] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T19:06:15.491495] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-25T19:06:16.653438] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T19:06:16.664470] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-25T19:06:17.280461] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-25T19:06:17.291804] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-25T19:06:18.280896] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T19:06:18.292050] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-25T19:06:19.633464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T19:06:19.644843] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-25T19:06:20.610186] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:06:20.620133] [INFO ] [REMOTE ] AVTR: Full fetch complete (77671 records). [2025-10-25T19:06:20.620319] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-25T19:06:21.011670] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-25T19:06:21.011791] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-25T19:06:21.012512] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-25T19:06:21.012590] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-25T19:06:21.014109] [DEBUG] [LOCAL ] AVTR: Trimmed 77671 records to 54350 (keeping 200 days of data) [2025-10-25T19:06:21.321598] [DEBUG] [LOCAL ] AVTR: Primary data saved (54350 records). [2025-10-25T19:06:21.321807] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-25T19:06:21.321952] [INFO ] [MAIN ] Update Progress: 188/2366 symbols. AVTR took 14.0s. Estimated remaining time: 1h 39m 7s [2025-10-25T19:06:21.486456] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:06:21.486723] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-25T19:06:21.486796] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-25T19:06:21.486908] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-25T19:06:21.486979] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-25T19:06:21.487059] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-25T19:06:21.487127] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-25T19:06:21.843744] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:06:21.844118] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-25T19:06:23.473071] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T19:06:23.481979] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-25T19:06:24.984819] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T19:06:24.996858] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-25T19:06:26.677124] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T19:06:26.685398] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-25T19:06:28.459603] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T19:06:28.469895] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-25T19:06:30.158719] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T19:06:30.167756] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-25T19:06:31.669337] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T19:06:31.676746] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-25T19:06:33.358869] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T19:06:33.366996] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-25T19:06:34.813817] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T19:06:34.821444] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-25T19:06:36.401543] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T19:06:36.412077] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-25T19:06:38.037045] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T19:06:38.044935] [INFO ] [REMOTE ] AVY: Full fetch complete (56788 records). [2025-10-25T19:06:38.045098] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-25T19:06:38.418161] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-25T19:06:38.418287] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-25T19:06:38.418939] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-25T19:06:38.419028] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-25T19:06:38.420299] [DEBUG] [LOCAL ] AVY: Trimmed 56788 records to 38829 (keeping 200 days of data) [2025-10-25T19:06:38.649931] [DEBUG] [LOCAL ] AVY: Primary data saved (38829 records). [2025-10-25T19:06:38.650104] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-25T19:06:38.650252] [INFO ] [MAIN ] Update Progress: 189/2366 symbols. AVY took 17.3s. Estimated remaining time: 1h 41m 53s [2025-10-25T19:06:38.816390] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:06:38.816624] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-10-25T19:06:38.816733] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-10-25T19:06:38.816876] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-25T19:06:38.816959] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-25T19:06:38.817074] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-25T19:06:38.817166] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-25T19:06:39.167709] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:06:39.168129] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-25T19:06:40.307099] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T19:06:40.312451] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-25T19:06:41.484606] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-25T19:06:41.489989] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-25T19:06:42.829710] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T19:06:42.835786] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-25T19:06:44.269910] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T19:06:44.275847] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-25T19:06:45.522545] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T19:06:45.528094] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-25T19:06:46.704561] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T19:06:46.709251] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-25T19:06:47.948331] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T19:06:47.953674] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-25T19:06:49.108392] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T19:06:49.113831] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-25T19:06:50.576632] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T19:06:50.582604] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-25T19:06:51.848370] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T19:06:51.853536] [INFO ] [REMOTE ] AWF: Full fetch complete (35981 records). [2025-10-25T19:06:51.853669] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-25T19:06:52.221631] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-25T19:06:52.221785] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-25T19:06:52.222288] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-25T19:06:52.222392] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-25T19:06:52.223265] [DEBUG] [LOCAL ] AWF: Trimmed 35981 records to 24433 (keeping 200 days of data) [2025-10-25T19:06:52.362029] [DEBUG] [LOCAL ] AWF: Primary data saved (24433 records). [2025-10-25T19:06:52.362190] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-25T19:06:52.362320] [INFO ] [MAIN ] Update Progress: 190/2366 symbols. AWF took 13.7s. Estimated remaining time: 1h 43m 55s [2025-10-25T19:06:52.527758] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:06:52.527961] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-10-25T19:06:52.528049] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-10-25T19:06:52.528214] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-25T19:06:52.528306] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-25T19:06:52.528445] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-25T19:06:52.528538] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-25T19:06:52.879898] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:06:52.880220] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-25T19:06:54.063923] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T19:06:54.068055] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-25T19:06:55.409621] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T19:06:55.414789] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-25T19:06:56.824623] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T19:06:56.831071] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-25T19:06:58.250329] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T19:06:58.256737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-25T19:06:59.470857] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T19:06:59.476078] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-25T19:07:00.864690] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T19:07:00.870181] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-25T19:07:03.201691] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-25T19:07:03.207745] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-25T19:07:04.608295] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T19:07:04.614511] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-25T19:07:05.841507] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T19:07:05.846584] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-25T19:07:06.989004] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T19:07:06.993686] [INFO ] [REMOTE ] AWI: Full fetch complete (36079 records). [2025-10-25T19:07:06.993796] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-25T19:07:07.361535] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-25T19:07:07.361663] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-25T19:07:07.362115] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-25T19:07:07.362194] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-25T19:07:07.363066] [DEBUG] [LOCAL ] AWI: Trimmed 36079 records to 25413 (keeping 200 days of data) [2025-10-25T19:07:07.515821] [DEBUG] [LOCAL ] AWI: Primary data saved (25413 records). [2025-10-25T19:07:07.515976] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-25T19:07:07.516081] [INFO ] [MAIN ] Update Progress: 191/2366 symbols. AWI took 15.2s. Estimated remaining time: 1h 46m 12s [2025-10-25T19:07:07.683524] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:07:07.683755] [DEBUG] [LOCAL ] AWK: No existing data file found in primary storage. [2025-10-25T19:07:07.683886] [WARN ] [MAIN ] AWK: No existing data found, performing full refresh instead. [2025-10-25T19:07:07.684033] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-25T19:07:07.684118] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-25T19:07:07.684237] [DEBUG] [LOCAL ] AWK: No primary data file found to delete. [2025-10-25T19:07:07.684322] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-25T19:07:08.037221] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:07:08.037670] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-25T19:07:10.007402] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T19:07:10.016875] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-25T19:07:11.704077] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T19:07:11.713282] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-25T19:07:13.521281] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T19:07:13.531846] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-25T19:07:14.452540] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T19:07:14.463166] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-25T19:07:15.393121] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T19:07:15.403430] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-25T19:07:16.378064] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:07:16.387577] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-25T19:07:17.552636] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T19:07:17.569396] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-25T19:07:18.521479] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T19:07:18.531623] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-25T19:07:19.658143] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T19:07:19.668669] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-25T19:07:20.507825] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T19:07:20.516513] [INFO ] [REMOTE ] AWK: Full fetch complete (70879 records). [2025-10-25T19:07:20.516697] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-25T19:07:20.911467] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-25T19:07:20.911583] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-25T19:07:20.912317] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-25T19:07:20.912401] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-25T19:07:20.913863] [DEBUG] [LOCAL ] AWK: Trimmed 70879 records to 49024 (keeping 200 days of data) [2025-10-25T19:07:21.210087] [DEBUG] [LOCAL ] AWK: Primary data saved (49024 records). [2025-10-25T19:07:21.210265] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-25T19:07:21.210389] [INFO ] [MAIN ] Update Progress: 192/2366 symbols. AWK took 13.7s. Estimated remaining time: 1h 48m 11s [2025-10-25T19:07:21.381286] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:07:21.381482] [DEBUG] [LOCAL ] AWP: No existing data file found in primary storage. [2025-10-25T19:07:21.381587] [WARN ] [MAIN ] AWP: No existing data found, performing full refresh instead. [2025-10-25T19:07:21.381751] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-25T19:07:21.381841] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-25T19:07:21.381964] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-25T19:07:21.382053] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-25T19:07:21.750915] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:07:21.751293] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-25T19:07:23.058388] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T19:07:23.064273] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-25T19:07:24.186481] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T19:07:24.190790] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-25T19:07:25.342604] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T19:07:25.347970] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-25T19:07:26.441718] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T19:07:26.446883] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-25T19:07:27.280236] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T19:07:27.284925] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-25T19:07:28.381370] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:07:28.385864] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-25T19:07:29.895401] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T19:07:29.903080] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-25T19:07:31.140079] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T19:07:31.145185] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-25T19:07:32.258893] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T19:07:32.263895] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-25T19:07:33.348041] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T19:07:33.352137] [INFO ] [REMOTE ] AWP: Full fetch complete (31548 records). [2025-10-25T19:07:33.352264] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-25T19:07:33.721069] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-25T19:07:33.721169] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-25T19:07:33.721573] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-25T19:07:33.721700] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-25T19:07:33.722550] [DEBUG] [LOCAL ] AWP: Trimmed 31548 records to 21870 (keeping 200 days of data) [2025-10-25T19:07:33.841798] [DEBUG] [LOCAL ] AWP: Primary data saved (21870 records). [2025-10-25T19:07:33.841957] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-25T19:07:33.842065] [INFO ] [MAIN ] Update Progress: 193/2366 symbols. AWP took 12.6s. Estimated remaining time: 1h 49m 56s [2025-10-25T19:07:34.015546] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:07:34.015780] [DEBUG] [LOCAL ] AWR: No existing data file found in primary storage. [2025-10-25T19:07:34.015869] [WARN ] [MAIN ] AWR: No existing data found, performing full refresh instead. [2025-10-25T19:07:34.015985] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-25T19:07:34.016056] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-25T19:07:34.016137] [DEBUG] [LOCAL ] AWR: No primary data file found to delete. [2025-10-25T19:07:34.016207] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-25T19:07:34.369674] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:07:34.370129] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-25T19:07:35.537161] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T19:07:35.541785] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-25T19:07:36.660467] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T19:07:36.664839] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-25T19:07:37.772520] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-25T19:07:37.778056] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-25T19:07:38.964076] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-25T19:07:38.970241] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-25T19:07:40.166477] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T19:07:40.171348] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-25T19:07:41.318087] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T19:07:41.323263] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-25T19:07:42.669617] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T19:07:42.675210] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-25T19:07:43.761593] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T19:07:43.766834] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-25T19:07:44.734583] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:07:44.740740] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-25T19:07:45.847834] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T19:07:45.852740] [INFO ] [REMOTE ] AWR: Full fetch complete (32478 records). [2025-10-25T19:07:45.852860] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-25T19:07:46.258840] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-25T19:07:46.259012] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-25T19:07:46.259729] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-25T19:07:46.259819] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-25T19:07:46.261242] [DEBUG] [LOCAL ] AWR: Trimmed 32478 records to 22990 (keeping 200 days of data) [2025-10-25T19:07:46.414000] [DEBUG] [LOCAL ] AWR: Primary data saved (22990 records). [2025-10-25T19:07:46.414227] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-25T19:07:46.414360] [INFO ] [MAIN ] Update Progress: 194/2366 symbols. AWR took 12.6s. Estimated remaining time: 1h 51m 40s [2025-10-25T19:07:46.586406] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:07:46.586740] [DEBUG] [LOCAL ] AX: No existing data file found in primary storage. [2025-10-25T19:07:46.586816] [WARN ] [MAIN ] AX: No existing data found, performing full refresh instead. [2025-10-25T19:07:46.586975] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-25T19:07:46.587052] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-25T19:07:46.587135] [DEBUG] [LOCAL ] AX: No primary data file found to delete. [2025-10-25T19:07:46.587207] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-25T19:07:46.964674] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:07:46.965230] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-25T19:07:48.601020] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T19:07:48.608824] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-25T19:07:49.772207] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T19:07:49.778207] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-25T19:07:51.147010] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T19:07:51.154231] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-25T19:07:52.560259] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T19:07:52.567448] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-25T19:07:53.818816] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T19:07:53.824861] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-25T19:07:55.016220] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T19:07:55.021807] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-25T19:07:56.373170] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T19:07:56.380248] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-25T19:07:57.586029] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T19:07:57.592987] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-25T19:07:58.892567] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T19:07:58.899149] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-25T19:08:00.112253] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T19:08:00.117450] [INFO ] [REMOTE ] AX: Full fetch complete (42011 records). [2025-10-25T19:08:00.117614] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-25T19:08:00.524235] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-25T19:08:00.524365] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-25T19:08:00.524903] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-25T19:08:00.524986] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-25T19:08:00.526080] [DEBUG] [LOCAL ] AX: Trimmed 42011 records to 28100 (keeping 200 days of data) [2025-10-25T19:08:00.687498] [DEBUG] [LOCAL ] AX: Primary data saved (28100 records). [2025-10-25T19:08:00.687714] [INFO ] [MAIN ] AX: Full history saved. [2025-10-25T19:08:00.687837] [INFO ] [MAIN ] Update Progress: 195/2366 symbols. AX took 14.3s. Estimated remaining time: 1h 53m 42s [2025-10-25T19:08:00.854335] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:08:00.854520] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-10-25T19:08:00.854590] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-10-25T19:08:00.854752] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-25T19:08:00.854824] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-25T19:08:00.854903] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-25T19:08:00.855008] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-25T19:08:01.205166] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:08:01.205558] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-25T19:08:03.655261] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-25T19:08:03.664671] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-25T19:08:05.544938] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T19:08:05.556876] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-25T19:08:07.250730] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T19:08:07.261275] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-25T19:08:08.180918] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T19:08:08.191573] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-25T19:08:09.258181] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:08:09.268771] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-25T19:08:10.156391] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T19:08:10.166385] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-25T19:08:11.018636] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T19:08:11.029760] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-25T19:08:12.017425] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T19:08:12.028191] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-25T19:08:12.925807] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T19:08:12.936829] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-25T19:08:13.856016] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T19:08:13.870581] [INFO ] [REMOTE ] AXL: Full fetch complete (73214 records). [2025-10-25T19:08:13.870820] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-25T19:08:14.261178] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-25T19:08:14.261314] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-25T19:08:14.262069] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-25T19:08:14.262159] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-25T19:08:14.263755] [DEBUG] [LOCAL ] AXL: Trimmed 73214 records to 51299 (keeping 200 days of data) [2025-10-25T19:08:14.536771] [DEBUG] [LOCAL ] AXL: Primary data saved (51299 records). [2025-10-25T19:08:14.536931] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-25T19:08:14.537033] [INFO ] [MAIN ] Update Progress: 196/2366 symbols. AXL took 13.8s. Estimated remaining time: 1h 55m 37s [2025-10-25T19:08:14.704122] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:08:14.704303] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-10-25T19:08:14.704380] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-10-25T19:08:14.704466] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-25T19:08:14.704533] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-25T19:08:14.704590] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-25T19:08:14.704673] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-25T19:08:15.073207] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:08:15.073611] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-25T19:08:17.416583] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-25T19:08:17.427401] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-25T19:08:19.542019] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-25T19:08:19.551948] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-25T19:08:21.665375] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-25T19:08:21.676415] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-25T19:08:22.902564] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T19:08:22.913682] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-25T19:08:23.975964] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T19:08:23.986997] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-25T19:08:25.147945] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T19:08:25.158496] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-25T19:08:26.085192] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:08:26.097865] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-25T19:08:27.133193] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T19:08:27.145145] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-25T19:08:28.107365] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T19:08:28.118614] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-25T19:08:29.026300] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T19:08:29.035858] [INFO ] [REMOTE ] AXP: Full fetch complete (77103 records). [2025-10-25T19:08:29.036003] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-25T19:08:29.424316] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-25T19:08:29.424434] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-25T19:08:29.425193] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-25T19:08:29.425300] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-25T19:08:29.426819] [DEBUG] [LOCAL ] AXP: Trimmed 77103 records to 53922 (keeping 200 days of data) [2025-10-25T19:08:29.756722] [DEBUG] [LOCAL ] AXP: Primary data saved (53922 records). [2025-10-25T19:08:29.756883] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-25T19:08:29.756994] [INFO ] [MAIN ] Update Progress: 197/2366 symbols. AXP took 15.2s. Estimated remaining time: 1h 57m 46s [2025-10-25T19:08:29.924111] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:08:29.924297] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-25T19:08:29.924374] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-25T19:08:29.924508] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-25T19:08:29.924580] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-25T19:08:29.924690] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-25T19:08:29.924762] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-25T19:08:30.275000] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:08:30.275361] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-25T19:08:31.001237] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T19:08:31.002792] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-25T19:08:31.639028] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-25T19:08:31.640286] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-25T19:08:32.295466] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-25T19:08:32.297614] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-25T19:08:33.023995] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T19:08:33.025512] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-25T19:08:33.625860] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T19:08:33.627202] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-25T19:08:34.239953] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T19:08:34.241468] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-25T19:08:34.894191] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-25T19:08:34.895568] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-25T19:08:35.419666] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-25T19:08:35.420870] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-25T19:08:36.106592] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T19:08:36.108232] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-25T19:08:36.664971] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T19:08:36.665943] [INFO ] [REMOTE ] AXR: Full fetch complete (4326 records). [2025-10-25T19:08:36.666045] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-25T19:08:37.012783] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-25T19:08:37.012885] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-25T19:08:37.013008] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-25T19:08:37.013077] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-25T19:08:37.013454] [DEBUG] [LOCAL ] AXR: Trimmed 4326 records to 2937 (keeping 200 days of data) [2025-10-25T19:08:37.029765] [DEBUG] [LOCAL ] AXR: Primary data saved (2937 records). [2025-10-25T19:08:37.029847] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-25T19:08:37.029942] [INFO ] [MAIN ] Update Progress: 198/2366 symbols. AXR took 7.3s. Estimated remaining time: 1h 58m 27s [2025-10-25T19:08:37.198639] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:08:37.198822] [DEBUG] [LOCAL ] AXS: No existing data file found in primary storage. [2025-10-25T19:08:37.198896] [WARN ] [MAIN ] AXS: No existing data found, performing full refresh instead. [2025-10-25T19:08:37.199010] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-25T19:08:37.199080] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-25T19:08:37.199175] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-10-25T19:08:37.199253] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-25T19:08:37.547607] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:08:37.547998] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-25T19:08:39.086310] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T19:08:39.094146] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-25T19:08:40.612299] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T19:08:40.619781] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-25T19:08:42.235827] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T19:08:42.243849] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-25T19:08:43.826472] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T19:08:43.834776] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-25T19:08:45.254954] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T19:08:45.262801] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-25T19:08:46.907562] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T19:08:46.915718] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-25T19:08:48.522188] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T19:08:48.530768] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-25T19:08:49.978961] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T19:08:49.987212] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-25T19:08:51.515427] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T19:08:51.524117] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-25T19:08:52.971773] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T19:08:52.979395] [INFO ] [REMOTE ] AXS: Full fetch complete (56257 records). [2025-10-25T19:08:52.979595] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-25T19:08:53.389022] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-25T19:08:53.389146] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-25T19:08:53.389751] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-25T19:08:53.389834] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-25T19:08:53.391039] [DEBUG] [LOCAL ] AXS: Trimmed 56257 records to 39390 (keeping 200 days of data) [2025-10-25T19:08:53.641257] [DEBUG] [LOCAL ] AXS: Primary data saved (39390 records). [2025-10-25T19:08:53.641444] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-25T19:08:53.641559] [INFO ] [MAIN ] Update Progress: 199/2366 symbols. AXS took 16.6s. Estimated remaining time: 2h 0m 49s [2025-10-25T19:08:53.827974] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:08:53.828182] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-10-25T19:08:53.828255] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-10-25T19:08:53.828368] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-25T19:08:53.828439] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-25T19:08:53.828521] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-25T19:08:53.828590] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-25T19:08:54.172595] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:08:54.172977] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-25T19:08:55.771717] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T19:08:55.781378] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-25T19:08:57.393989] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T19:08:57.405796] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-25T19:08:59.178902] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T19:08:59.189596] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-25T19:09:00.160755] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T19:09:00.171492] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-25T19:09:02.231610] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-25T19:09:02.243447] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-25T19:09:03.389436] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T19:09:03.399975] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-25T19:09:04.037256] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T19:09:04.052090] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-25T19:09:05.160210] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T19:09:05.172139] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-25T19:09:06.039390] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T19:09:06.050474] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-25T19:09:06.927232] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:09:06.939118] [INFO ] [REMOTE ] AXTA: Full fetch complete (75500 records). [2025-10-25T19:09:06.939294] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-25T19:09:07.323795] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-25T19:09:07.323927] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-25T19:09:07.324672] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-25T19:09:07.324753] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-25T19:09:07.326241] [DEBUG] [LOCAL ] AXTA: Trimmed 75500 records to 53069 (keeping 200 days of data) [2025-10-25T19:09:07.622848] [DEBUG] [LOCAL ] AXTA: Primary data saved (53069 records). [2025-10-25T19:09:07.623026] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-25T19:09:07.623140] [INFO ] [MAIN ] Update Progress: 200/2366 symbols. AXTA took 14.0s. Estimated remaining time: 2h 2m 41s [2025-10-25T19:09:07.791790] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:09:07.791996] [DEBUG] [LOCAL ] AYI: No existing data file found in primary storage. [2025-10-25T19:09:07.792068] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-10-25T19:09:07.792180] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-25T19:09:07.792252] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-25T19:09:07.792333] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-25T19:09:07.792404] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-25T19:09:08.163719] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:09:08.164054] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-25T19:09:09.617287] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T19:09:09.624731] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-25T19:09:10.914851] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T19:09:10.920866] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-25T19:09:12.415507] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T19:09:12.422065] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-25T19:09:14.170150] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T19:09:14.178776] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-25T19:09:15.411853] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T19:09:15.416838] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-25T19:09:16.843015] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T19:09:16.849261] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-25T19:09:18.086921] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T19:09:18.092393] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-25T19:09:19.264573] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T19:09:19.272131] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-25T19:09:20.510953] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T19:09:20.516095] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-25T19:09:21.743795] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T19:09:21.748230] [INFO ] [REMOTE ] AYI: Full fetch complete (36452 records). [2025-10-25T19:09:21.748337] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-25T19:09:22.124568] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-25T19:09:22.124703] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-25T19:09:22.125144] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-25T19:09:22.125223] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-25T19:09:22.126095] [DEBUG] [LOCAL ] AYI: Trimmed 36452 records to 24296 (keeping 200 days of data) [2025-10-25T19:09:22.276800] [DEBUG] [LOCAL ] AYI: Primary data saved (24296 records). [2025-10-25T19:09:22.276995] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-25T19:09:22.277105] [INFO ] [MAIN ] Update Progress: 201/2366 symbols. AYI took 14.7s. Estimated remaining time: 2h 4m 38s [2025-10-25T19:09:22.447885] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:09:22.448081] [DEBUG] [LOCAL ] AZO: No existing data file found in primary storage. [2025-10-25T19:09:22.448154] [WARN ] [MAIN ] AZO: No existing data found, performing full refresh instead. [2025-10-25T19:09:22.448269] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-25T19:09:22.448340] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-25T19:09:22.448423] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-25T19:09:22.448494] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-25T19:09:22.810803] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:09:22.811214] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-25T19:09:23.737033] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T19:09:23.739843] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-25T19:09:24.646158] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T19:09:24.648506] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-25T19:09:25.787738] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T19:09:25.791432] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-25T19:09:26.897238] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T19:09:26.900883] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-25T19:09:27.881181] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T19:09:27.884188] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-25T19:09:28.951233] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:09:28.954400] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-25T19:09:29.976301] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T19:09:29.979402] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-25T19:09:30.888529] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T19:09:30.892479] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-25T19:09:31.860860] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:09:31.864141] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-25T19:09:32.761343] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:09:32.763981] [INFO ] [REMOTE ] AZO: Full fetch complete (16017 records). [2025-10-25T19:09:32.764108] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-25T19:09:33.126934] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-25T19:09:33.127053] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-25T19:09:33.127374] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-25T19:09:33.127457] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-25T19:09:33.128191] [DEBUG] [LOCAL ] AZO: Trimmed 16017 records to 11011 (keeping 200 days of data) [2025-10-25T19:09:33.194506] [DEBUG] [LOCAL ] AZO: Primary data saved (11011 records). [2025-10-25T19:09:33.194699] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-25T19:09:33.194844] [INFO ] [MAIN ] Update Progress: 202/2366 symbols. AZO took 10.9s. Estimated remaining time: 2h 5m 55s [2025-10-25T19:09:33.365698] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:09:33.365892] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-10-25T19:09:33.365964] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-10-25T19:09:33.366078] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-25T19:09:33.366131] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-25T19:09:33.366207] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-10-25T19:09:33.366278] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-25T19:09:33.719596] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:09:33.719998] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-25T19:09:34.831872] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T19:09:34.836084] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-25T19:09:36.070792] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T19:09:36.077631] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-25T19:09:37.175555] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T19:09:37.182892] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-25T19:09:38.389446] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T19:09:38.395238] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-25T19:09:39.452849] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T19:09:39.457371] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-25T19:09:40.624315] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T19:09:40.628858] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-25T19:09:41.964416] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T19:09:41.974202] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-25T19:09:43.204740] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T19:09:43.210188] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-25T19:09:44.372012] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T19:09:44.376551] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-25T19:09:45.659843] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T19:09:45.665244] [INFO ] [REMOTE ] AZZ: Full fetch complete (32192 records). [2025-10-25T19:09:45.665347] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-25T19:09:46.035078] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-25T19:09:46.035191] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-25T19:09:46.035595] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-25T19:09:46.035692] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-25T19:09:46.036444] [DEBUG] [LOCAL ] AZZ: Trimmed 32192 records to 23290 (keeping 200 days of data) [2025-10-25T19:09:46.176501] [DEBUG] [LOCAL ] AZZ: Primary data saved (23290 records). [2025-10-25T19:09:46.176688] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-25T19:09:46.176829] [INFO ] [MAIN ] Update Progress: 203/2366 symbols. AZZ took 13.0s. Estimated remaining time: 2h 7m 33s [2025-10-25T19:09:46.347731] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:09:46.347918] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-25T19:09:46.347988] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-25T19:09:46.348097] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-25T19:09:46.348168] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-25T19:09:46.348241] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-25T19:09:46.348304] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-25T19:09:46.704444] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:09:46.704839] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-25T19:09:47.983960] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T19:09:47.989756] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-25T19:09:48.316593] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:09:48.317105] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-25T19:09:48.317192] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:09:48.317289] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-25T19:09:48.317384] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:09:48.317456] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-25T19:09:48.317553] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-25T19:09:48.317665] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-25T19:09:48.317769] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-25T19:09:48.317867] [INFO ] [MAIN ] Update Progress: 204/2366 symbols. B took 2.1s. Estimated remaining time: 2h 7m 14s [2025-10-25T19:09:48.507052] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:09:48.507269] [DEBUG] [LOCAL ] BA: No existing data file found in primary storage. [2025-10-25T19:09:48.507362] [WARN ] [MAIN ] BA: No existing data found, performing full refresh instead. [2025-10-25T19:09:48.507462] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-25T19:09:48.507530] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-25T19:09:48.507589] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-10-25T19:09:48.507677] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-25T19:09:48.871957] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:09:48.872286] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-25T19:09:51.198280] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-25T19:09:51.208590] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-25T19:09:53.561797] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-25T19:09:53.572168] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-25T19:09:55.792792] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-25T19:09:55.803965] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-25T19:09:56.708387] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-25T19:09:56.720605] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-25T19:09:57.668803] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T19:09:57.680122] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-25T19:09:58.590314] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T19:09:58.605863] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-25T19:09:59.756692] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T19:09:59.768220] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-25T19:10:00.800227] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:10:00.811864] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-25T19:10:02.692951] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-25T19:10:02.706139] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-25T19:10:03.789247] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T19:10:03.800526] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-25T19:10:03.800840] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-25T19:10:04.259463] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-25T19:10:04.259608] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-25T19:10:04.260384] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-25T19:10:04.260467] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-25T19:10:04.261953] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54570 (keeping 200 days of data) [2025-10-25T19:10:04.579610] [DEBUG] [LOCAL ] BA: Primary data saved (54570 records). [2025-10-25T19:10:04.579790] [INFO ] [MAIN ] BA: Full history saved. [2025-10-25T19:10:04.579883] [INFO ] [MAIN ] Update Progress: 205/2366 symbols. BA took 16.3s. Estimated remaining time: 2h 9m 25s [2025-10-25T19:10:04.749006] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:10:04.749207] [DEBUG] [LOCAL ] BABA: No existing data file found in primary storage. [2025-10-25T19:10:04.749281] [WARN ] [MAIN ] BABA: No existing data found, performing full refresh instead. [2025-10-25T19:10:04.749395] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-25T19:10:04.749466] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-25T19:10:04.749550] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-25T19:10:04.749620] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-25T19:10:05.104994] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:10:05.105342] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-25T19:10:07.518008] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-25T19:10:07.528586] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-25T19:10:10.016633] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-25T19:10:10.027870] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-25T19:10:12.580826] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-25T19:10:12.592379] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-25T19:10:13.574066] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:10:13.585977] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-25T19:10:14.541448] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T19:10:14.553250] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-25T19:10:15.581008] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T19:10:15.592163] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-25T19:10:16.702074] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T19:10:16.714938] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-25T19:10:17.790011] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T19:10:17.801430] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-25T19:10:18.775577] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:10:18.786953] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-25T19:10:19.691833] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:10:19.701790] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-25T19:10:19.701969] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-25T19:10:20.085750] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-25T19:10:20.085862] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-25T19:10:20.086565] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-25T19:10:20.086662] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-25T19:10:20.088081] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-25T19:10:20.430332] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-25T19:10:20.430565] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-25T19:10:20.430724] [INFO ] [MAIN ] Update Progress: 206/2366 symbols. BABA took 15.9s. Estimated remaining time: 2h 11m 30s [2025-10-25T19:10:20.601549] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:10:20.601855] [DEBUG] [LOCAL ] BAC: No existing data file found in primary storage. [2025-10-25T19:10:20.601960] [WARN ] [MAIN ] BAC: No existing data found, performing full refresh instead. [2025-10-25T19:10:20.602084] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-25T19:10:20.602157] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-25T19:10:20.602240] [DEBUG] [LOCAL ] BAC: No primary data file found to delete. [2025-10-25T19:10:20.602314] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-25T19:10:20.971098] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:10:20.971499] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-25T19:10:23.218631] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-25T19:10:23.229909] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-25T19:10:25.385262] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-25T19:10:25.395894] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-25T19:10:27.780942] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-25T19:10:27.794187] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-25T19:10:28.907401] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T19:10:28.919419] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-25T19:10:30.009986] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T19:10:30.021099] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-25T19:10:31.019553] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T19:10:31.030204] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-25T19:10:32.194270] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T19:10:32.206094] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-25T19:10:33.308009] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T19:10:33.319411] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-25T19:10:34.376669] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T19:10:34.388606] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-25T19:10:35.374727] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:10:35.384748] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-25T19:10:35.384914] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-25T19:10:35.785618] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-25T19:10:35.785761] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-25T19:10:35.786549] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-25T19:10:35.786635] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-25T19:10:35.788252] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54588 (keeping 200 days of data) [2025-10-25T19:10:36.115991] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-25T19:10:36.116150] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-25T19:10:36.116261] [INFO ] [MAIN ] Update Progress: 207/2366 symbols. BAC took 15.7s. Estimated remaining time: 2h 13m 32s [2025-10-25T19:10:36.294870] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:10:36.295066] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-25T19:10:36.295138] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-25T19:10:36.295253] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-25T19:10:36.295325] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-25T19:10:36.295451] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-25T19:10:36.295526] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-25T19:10:36.657540] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:10:36.657925] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-25T19:10:38.577783] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T19:10:38.587700] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-25T19:10:40.287968] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T19:10:40.300847] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-25T19:10:42.249374] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T19:10:42.260676] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-25T19:10:43.448766] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-25T19:10:43.459743] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-25T19:10:44.667094] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T19:10:44.677907] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-25T19:10:45.596423] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T19:10:45.607291] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-25T19:10:46.594829] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T19:10:46.606415] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-25T19:10:47.463809] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T19:10:47.474841] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-25T19:10:48.399793] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T19:10:48.410816] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-25T19:10:49.297438] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:10:49.306874] [INFO ] [REMOTE ] BAH: Full fetch complete (75249 records). [2025-10-25T19:10:49.307056] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-25T19:10:49.695280] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-25T19:10:49.695393] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-25T19:10:49.696147] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-25T19:10:49.696231] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-25T19:10:49.697673] [DEBUG] [LOCAL ] BAH: Trimmed 75249 records to 52412 (keeping 200 days of data) [2025-10-25T19:10:50.008611] [DEBUG] [LOCAL ] BAH: Primary data saved (52412 records). [2025-10-25T19:10:50.008790] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-25T19:10:50.008906] [INFO ] [MAIN ] Update Progress: 208/2366 symbols. BAH took 13.9s. Estimated remaining time: 2h 15m 14s [2025-10-25T19:10:50.176979] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:10:50.177167] [DEBUG] [LOCAL ] BAK: No existing data file found in primary storage. [2025-10-25T19:10:50.177240] [WARN ] [MAIN ] BAK: No existing data found, performing full refresh instead. [2025-10-25T19:10:50.177379] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-25T19:10:50.177454] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-25T19:10:50.177538] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-10-25T19:10:50.177611] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-25T19:10:50.529285] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:10:50.529712] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-25T19:10:52.101380] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T19:10:52.112555] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-25T19:10:53.596441] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T19:10:53.604465] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-25T19:10:55.252059] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T19:10:55.260202] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-25T19:10:56.813452] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T19:10:56.821933] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-25T19:10:58.232019] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T19:10:58.240298] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-25T19:10:59.696689] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T19:10:59.704853] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-25T19:11:01.289469] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-25T19:11:01.298554] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-25T19:11:02.695315] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T19:11:02.703953] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-25T19:11:03.948544] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T19:11:03.957336] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-25T19:11:05.598696] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-25T19:11:05.606117] [INFO ] [REMOTE ] BAK: Full fetch complete (56838 records). [2025-10-25T19:11:05.606267] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-25T19:11:05.986757] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-25T19:11:05.986869] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-25T19:11:05.990479] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-25T19:11:05.990616] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-25T19:11:05.992101] [DEBUG] [LOCAL ] BAK: Trimmed 56838 records to 39995 (keeping 200 days of data) [2025-10-25T19:11:06.203179] [DEBUG] [LOCAL ] BAK: Primary data saved (39995 records). [2025-10-25T19:11:06.203375] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-25T19:11:06.203522] [INFO ] [MAIN ] Update Progress: 209/2366 symbols. BAK took 16.2s. Estimated remaining time: 2h 17m 18s [2025-10-25T19:11:06.369749] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:11:06.369971] [DEBUG] [LOCAL ] BALL: No existing data file found in primary storage. [2025-10-25T19:11:06.370062] [WARN ] [MAIN ] BALL: No existing data found, performing full refresh instead. [2025-10-25T19:11:06.370210] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-25T19:11:06.370302] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-25T19:11:06.370407] [DEBUG] [LOCAL ] BALL: No primary data file found to delete. [2025-10-25T19:11:06.370508] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-25T19:11:06.733763] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:11:06.734195] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-25T19:11:08.449273] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T19:11:08.460180] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-25T19:11:10.076491] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T19:11:10.086450] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-25T19:11:11.912677] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T19:11:11.924762] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-25T19:11:12.885665] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T19:11:12.896766] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-25T19:11:13.849703] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T19:11:13.860885] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-25T19:11:14.732639] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T19:11:14.743243] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-25T19:11:15.296707] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-25T19:11:15.308473] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-25T19:11:16.132556] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T19:11:16.143785] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-25T19:11:17.157482] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T19:11:17.168497] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-25T19:11:18.300790] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T19:11:18.311017] [INFO ] [REMOTE ] BALL: Full fetch complete (75615 records). [2025-10-25T19:11:18.311191] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-25T19:11:18.702857] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-25T19:11:18.702977] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-25T19:11:18.703815] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-25T19:11:18.703901] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-25T19:11:18.705342] [DEBUG] [LOCAL ] BALL: Trimmed 75615 records to 52693 (keeping 200 days of data) [2025-10-25T19:11:19.009050] [DEBUG] [LOCAL ] BALL: Primary data saved (52693 records). [2025-10-25T19:11:19.009211] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-25T19:11:19.009336] [INFO ] [MAIN ] Update Progress: 210/2366 symbols. BALL took 12.8s. Estimated remaining time: 2h 18m 47s [2025-10-25T19:11:19.177622] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:11:19.177831] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-25T19:11:19.177905] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-25T19:11:19.177997] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-25T19:11:19.178068] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-25T19:11:19.178129] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-25T19:11:19.178172] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-25T19:11:19.536492] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:11:19.536873] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-25T19:11:20.995103] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T19:11:21.001120] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-25T19:11:21.750577] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T19:11:21.752581] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-25T19:11:22.603710] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-25T19:11:22.606043] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-25T19:11:23.318365] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T19:11:23.320568] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-25T19:11:24.266402] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T19:11:24.271347] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-25T19:11:25.288600] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T19:11:25.291819] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-25T19:11:26.159979] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T19:11:26.163037] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-25T19:11:26.785525] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-25T19:11:26.787414] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-25T19:11:27.639357] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T19:11:27.642481] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-25T19:11:28.742743] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T19:11:28.746486] [INFO ] [REMOTE ] BALY: Full fetch complete (16191 records). [2025-10-25T19:11:28.746583] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-25T19:11:28.947417] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T19:11:28.947757] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-25T19:11:28.947850] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-25T19:11:28.947925] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-25T19:11:28.948019] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-25T19:11:28.948091] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-25T19:11:28.948194] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-25T19:11:28.948293] [INFO ] [MAIN ] Update Progress: 211/2366 symbols. BALY took 9.9s. Estimated remaining time: 2h 19m 45s [2025-10-25T19:11:29.133151] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:11:29.133343] [DEBUG] [LOCAL ] BAM: No existing data file found in primary storage. [2025-10-25T19:11:29.133418] [WARN ] [MAIN ] BAM: No existing data found, performing full refresh instead. [2025-10-25T19:11:29.133506] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-25T19:11:29.133572] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-25T19:11:29.133699] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-25T19:11:29.133770] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-25T19:11:29.481580] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:11:29.481960] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-25T19:11:31.199072] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T19:11:31.208816] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-25T19:11:32.947380] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T19:11:32.957383] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-25T19:11:34.819324] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T19:11:34.830261] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-25T19:11:35.814280] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:11:35.825193] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-25T19:11:36.717523] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T19:11:36.728588] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-25T19:11:37.651199] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T19:11:37.662052] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-25T19:11:38.590510] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:11:38.601968] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-25T19:11:39.623363] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T19:11:39.634047] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-25T19:11:40.591756] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T19:11:40.603098] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-25T19:11:41.690817] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-25T19:11:41.702632] [INFO ] [REMOTE ] BAM: Full fetch complete (75293 records). [2025-10-25T19:11:41.702931] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-25T19:11:42.227131] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-25T19:11:42.227265] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-25T19:11:42.228083] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-25T19:11:42.228169] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-25T19:11:42.229685] [DEBUG] [LOCAL ] BAM: Trimmed 75293 records to 52844 (keeping 200 days of data) [2025-10-25T19:11:42.544108] [DEBUG] [LOCAL ] BAM: Primary data saved (52844 records). [2025-10-25T19:11:42.544279] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-25T19:11:42.544392] [INFO ] [MAIN ] Update Progress: 212/2366 symbols. BAM took 13.6s. Estimated remaining time: 2h 21m 20s [2025-10-25T19:11:42.713572] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:11:42.713805] [DEBUG] [LOCAL ] BANC: No existing data file found in primary storage. [2025-10-25T19:11:42.713882] [WARN ] [MAIN ] BANC: No existing data found, performing full refresh instead. [2025-10-25T19:11:42.714003] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-25T19:11:42.714076] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-25T19:11:42.714135] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-25T19:11:42.714197] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-25T19:11:43.059740] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:11:43.060074] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-25T19:11:44.816956] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T19:11:44.828140] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-25T19:11:46.453608] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T19:11:46.463292] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-25T19:11:48.254213] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T19:11:48.265047] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-25T19:11:49.248075] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:11:49.259160] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-25T19:11:50.190934] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T19:11:50.202512] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-25T19:11:51.013730] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-25T19:11:51.024199] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-25T19:11:52.031857] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T19:11:52.043245] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-25T19:11:53.057820] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T19:11:53.068859] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-25T19:11:54.049722] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T19:11:54.061831] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-25T19:11:54.971973] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T19:11:54.983380] [INFO ] [REMOTE ] BANC: Full fetch complete (74644 records). [2025-10-25T19:11:54.983607] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-25T19:11:55.407707] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-25T19:11:55.407876] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-25T19:11:55.408701] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-25T19:11:55.408883] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-25T19:11:55.410978] [DEBUG] [LOCAL ] BANC: Trimmed 74644 records to 52164 (keeping 200 days of data) [2025-10-25T19:11:55.716351] [DEBUG] [LOCAL ] BANC: Primary data saved (52164 records). [2025-10-25T19:11:55.716521] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-25T19:11:55.716633] [INFO ] [MAIN ] Update Progress: 213/2366 symbols. BANC took 13.2s. Estimated remaining time: 2h 22m 49s [2025-10-25T19:11:55.883073] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:11:55.883301] [DEBUG] [LOCAL ] BAP: No existing data file found in primary storage. [2025-10-25T19:11:55.883399] [WARN ] [MAIN ] BAP: No existing data found, performing full refresh instead. [2025-10-25T19:11:55.883535] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-25T19:11:55.883627] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-25T19:11:55.883747] [DEBUG] [LOCAL ] BAP: No primary data file found to delete. [2025-10-25T19:11:55.883843] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-25T19:11:56.232552] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:11:56.233098] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-25T19:11:57.503414] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T19:11:57.508743] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-25T19:11:58.760093] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T19:11:58.765897] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-25T19:12:00.070900] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-25T19:12:00.077135] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-25T19:12:01.626259] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T19:12:01.632799] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-25T19:12:03.076554] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-25T19:12:03.082510] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-25T19:12:04.422904] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T19:12:04.429199] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-25T19:12:05.814555] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T19:12:05.820997] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-25T19:12:07.143393] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-25T19:12:07.149803] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-25T19:12:08.610759] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T19:12:08.617191] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-25T19:12:09.858545] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T19:12:09.863755] [INFO ] [REMOTE ] BAP: Full fetch complete (37267 records). [2025-10-25T19:12:09.863898] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-25T19:12:10.255144] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-25T19:12:10.255297] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-25T19:12:10.255919] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-25T19:12:10.256004] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-25T19:12:10.257169] [DEBUG] [LOCAL ] BAP: Trimmed 37267 records to 25783 (keeping 200 days of data) [2025-10-25T19:12:10.409125] [DEBUG] [LOCAL ] BAP: Primary data saved (25783 records). [2025-10-25T19:12:10.409292] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-25T19:12:10.409402] [INFO ] [MAIN ] Update Progress: 214/2366 symbols. BAP took 14.7s. Estimated remaining time: 2h 24m 33s [2025-10-25T19:12:10.587971] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:12:10.588168] [DEBUG] [LOCAL ] BARK: No existing data file found in primary storage. [2025-10-25T19:12:10.588239] [WARN ] [MAIN ] BARK: No existing data found, performing full refresh instead. [2025-10-25T19:12:10.588354] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-25T19:12:10.588424] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-25T19:12:10.588505] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-10-25T19:12:10.588575] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-25T19:12:10.947697] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:12:10.948038] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-25T19:12:12.432572] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T19:12:12.442020] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-25T19:12:13.909503] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T19:12:13.918290] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-25T19:12:15.453173] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T19:12:15.461781] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-25T19:12:17.013454] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T19:12:17.021938] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-25T19:12:18.467055] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T19:12:18.474583] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-25T19:12:20.417977] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-25T19:12:20.427723] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-25T19:12:22.079762] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T19:12:22.089185] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-25T19:12:23.504873] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T19:12:23.512426] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-25T19:12:24.902677] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T19:12:24.911066] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-25T19:12:26.414497] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T19:12:26.422630] [INFO ] [REMOTE ] BARK: Full fetch complete (55986 records). [2025-10-25T19:12:26.422956] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-25T19:12:26.828415] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-25T19:12:26.828571] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-25T19:12:26.829306] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-25T19:12:26.829394] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-25T19:12:26.831000] [DEBUG] [LOCAL ] BARK: Trimmed 55986 records to 38672 (keeping 200 days of data) [2025-10-25T19:12:27.057392] [DEBUG] [LOCAL ] BARK: Primary data saved (38672 records). [2025-10-25T19:12:27.057639] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-25T19:12:27.057799] [INFO ] [MAIN ] Update Progress: 215/2366 symbols. BARK took 16.6s. Estimated remaining time: 2h 26m 35s [2025-10-25T19:12:27.232085] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:12:27.232365] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-10-25T19:12:27.232441] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-10-25T19:12:27.232575] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-25T19:12:27.232678] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-25T19:12:27.232767] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-25T19:12:27.232841] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-25T19:12:27.605229] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:12:27.605746] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-25T19:12:29.431045] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T19:12:29.441434] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-25T19:12:31.363436] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T19:12:31.373408] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-25T19:12:33.295432] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T19:12:33.306809] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-25T19:12:34.291844] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T19:12:34.303319] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-25T19:12:35.486182] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T19:12:35.497383] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-25T19:12:36.456711] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T19:12:36.467442] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-25T19:12:37.453526] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T19:12:37.465982] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-25T19:12:38.532051] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T19:12:38.543379] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-25T19:12:39.560394] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T19:12:39.571806] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-25T19:12:40.524794] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T19:12:40.534520] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-10-25T19:12:40.534731] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-25T19:12:40.925169] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-25T19:12:40.925283] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-25T19:12:40.926074] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-25T19:12:40.926154] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-25T19:12:40.927615] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 54316 (keeping 200 days of data) [2025-10-25T19:12:41.241856] [DEBUG] [LOCAL ] BAX: Primary data saved (54316 records). [2025-10-25T19:12:41.242019] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-25T19:12:41.242130] [INFO ] [MAIN ] Update Progress: 216/2366 symbols. BAX took 14.2s. Estimated remaining time: 2h 28m 11s [2025-10-25T19:12:41.408298] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:12:41.408488] [DEBUG] [LOCAL ] BB: No existing data file found in primary storage. [2025-10-25T19:12:41.408560] [WARN ] [MAIN ] BB: No existing data found, performing full refresh instead. [2025-10-25T19:12:41.408689] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-25T19:12:41.408778] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-25T19:12:41.408861] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-10-25T19:12:41.408930] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-25T19:12:41.761039] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:12:41.761430] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-25T19:12:43.871194] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-25T19:12:43.883706] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-25T19:12:45.919332] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-25T19:12:45.929841] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-25T19:12:48.193158] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-25T19:12:48.203979] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-25T19:12:49.087607] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T19:12:49.099321] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-25T19:12:50.271940] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T19:12:50.287547] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-25T19:12:51.205194] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T19:12:51.216108] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-25T19:12:52.175098] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T19:12:52.186835] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-25T19:12:53.194504] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T19:12:53.205602] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-25T19:12:53.992833] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T19:12:54.004235] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-25T19:12:55.092766] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-25T19:12:55.102506] [INFO ] [REMOTE ] BB: Full fetch complete (76961 records). [2025-10-25T19:12:55.102684] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-25T19:12:55.493788] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-25T19:12:55.493900] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-25T19:12:55.494625] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-25T19:12:55.494721] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-25T19:12:55.496146] [DEBUG] [LOCAL ] BB: Trimmed 76961 records to 53644 (keeping 200 days of data) [2025-10-25T19:12:55.788345] [DEBUG] [LOCAL ] BB: Primary data saved (53644 records). [2025-10-25T19:12:55.788502] [INFO ] [MAIN ] BB: Full history saved. [2025-10-25T19:12:55.788615] [INFO ] [MAIN ] Update Progress: 217/2366 symbols. BB took 14.5s. Estimated remaining time: 2h 29m 50s [2025-10-25T19:12:55.956772] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:12:55.956951] [DEBUG] [LOCAL ] BBAI: No existing data file found in primary storage. [2025-10-25T19:12:55.957025] [WARN ] [MAIN ] BBAI: No existing data found, performing full refresh instead. [2025-10-25T19:12:55.957113] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-25T19:12:55.957180] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-25T19:12:55.957272] [DEBUG] [LOCAL ] BBAI: No primary data file found to delete. [2025-10-25T19:12:55.957369] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-25T19:12:56.317128] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:12:56.317543] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-25T19:12:59.054928] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-25T19:12:59.065332] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-25T19:13:01.480148] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-25T19:13:01.490152] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-25T19:13:04.322853] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-10-25T19:13:04.333747] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-25T19:13:06.854559] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-25T19:13:06.865549] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-25T19:13:09.587523] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-25T19:13:09.602141] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-25T19:13:13.065607] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (3.46 seconds). [2025-10-25T19:13:13.077455] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-25T19:13:16.225373] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-10-25T19:13:16.237482] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-25T19:13:18.737338] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-25T19:13:18.750908] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-25T19:13:21.332633] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-25T19:13:21.345142] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-25T19:13:23.900309] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-25T19:13:23.910837] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-25T19:13:23.911090] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-25T19:13:24.374807] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-25T19:13:24.375003] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-25T19:13:24.375927] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-25T19:13:24.376019] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-25T19:13:24.378389] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-25T19:13:24.706672] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-25T19:13:24.706925] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-25T19:13:24.707071] [INFO ] [MAIN ] Update Progress: 218/2366 symbols. BBAI took 28.9s. Estimated remaining time: 2h 33m 50s [2025-10-25T19:13:24.886345] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:13:24.886670] [DEBUG] [LOCAL ] BBAR: No existing data file found in primary storage. [2025-10-25T19:13:24.886751] [WARN ] [MAIN ] BBAR: No existing data found, performing full refresh instead. [2025-10-25T19:13:24.886881] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-25T19:13:24.886957] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-25T19:13:24.887042] [DEBUG] [LOCAL ] BBAR: No primary data file found to delete. [2025-10-25T19:13:24.887117] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-25T19:13:25.271984] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:13:25.272396] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-25T19:13:27.019510] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T19:13:27.030977] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-25T19:13:28.635907] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T19:13:28.646274] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-25T19:13:30.115185] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T19:13:30.124022] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-25T19:13:31.664198] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T19:13:31.673202] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-25T19:13:33.329419] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T19:13:33.339345] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-25T19:13:34.921183] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T19:13:34.930553] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-25T19:13:36.608006] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T19:13:36.617758] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-25T19:13:38.254267] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T19:13:38.264563] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-25T19:13:39.981207] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T19:13:39.992969] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-25T19:13:41.638382] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T19:13:41.647194] [INFO ] [REMOTE ] BBAR: Full fetch complete (61235 records). [2025-10-25T19:13:41.647539] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-25T19:13:42.038587] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-25T19:13:42.038729] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-25T19:13:42.039335] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-25T19:13:42.039415] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-25T19:13:42.040616] [DEBUG] [LOCAL ] BBAR: Trimmed 61235 records to 43302 (keeping 200 days of data) [2025-10-25T19:13:42.303657] [DEBUG] [LOCAL ] BBAR: Primary data saved (43302 records). [2025-10-25T19:13:42.303875] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-25T19:13:42.304038] [INFO ] [MAIN ] Update Progress: 219/2366 symbols. BBAR took 17.6s. Estimated remaining time: 2h 35m 56s [2025-10-25T19:13:42.477402] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:13:42.477741] [DEBUG] [LOCAL ] BBD: No existing data file found in primary storage. [2025-10-25T19:13:42.477820] [WARN ] [MAIN ] BBD: No existing data found, performing full refresh instead. [2025-10-25T19:13:42.477952] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-25T19:13:42.478032] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-25T19:13:42.478118] [DEBUG] [LOCAL ] BBD: No primary data file found to delete. [2025-10-25T19:13:42.478192] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-25T19:13:42.840888] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:13:42.841286] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-25T19:13:44.599710] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T19:13:44.610710] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-25T19:13:46.272931] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T19:13:46.283758] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-25T19:13:48.436806] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-25T19:13:48.448382] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-25T19:13:50.351979] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-25T19:13:50.363588] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-25T19:13:52.220177] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-25T19:13:52.232335] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-25T19:13:53.947600] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-25T19:13:53.964535] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-25T19:13:55.946820] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-25T19:13:55.959248] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-25T19:13:57.838728] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-25T19:13:57.849854] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-25T19:13:59.635790] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T19:13:59.646967] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-25T19:14:01.650222] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-25T19:14:01.659834] [INFO ] [REMOTE ] BBD: Full fetch complete (77271 records). [2025-10-25T19:14:01.659980] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-25T19:14:02.064217] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-25T19:14:02.064357] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-25T19:14:02.065189] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-25T19:14:02.065276] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-25T19:14:02.066881] [DEBUG] [LOCAL ] BBD: Trimmed 77271 records to 54051 (keeping 200 days of data) [2025-10-25T19:14:02.393617] [DEBUG] [LOCAL ] BBD: Primary data saved (54051 records). [2025-10-25T19:14:02.393963] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-25T19:14:02.394116] [INFO ] [MAIN ] Update Progress: 220/2366 symbols. BBD took 20.1s. Estimated remaining time: 2h 38m 25s [2025-10-25T19:14:02.569807] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:02.570009] [DEBUG] [LOCAL ] BBDC: No existing data file found in primary storage. [2025-10-25T19:14:02.570078] [WARN ] [MAIN ] BBDC: No existing data found, performing full refresh instead. [2025-10-25T19:14:02.570192] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-25T19:14:02.570262] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-25T19:14:02.570342] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-25T19:14:02.570415] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-25T19:14:02.921534] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:14:02.921870] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-25T19:14:04.381137] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T19:14:04.388891] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-25T19:14:05.939967] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T19:14:05.949929] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-25T19:14:07.452517] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T19:14:07.461735] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-25T19:14:08.948435] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T19:14:08.957420] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-25T19:14:10.289059] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T19:14:10.295867] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-25T19:14:11.781883] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T19:14:11.790282] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-25T19:14:13.147220] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T19:14:13.153535] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-25T19:14:14.511258] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T19:14:14.518014] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-25T19:14:16.038547] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T19:14:16.046956] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-25T19:14:17.439316] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-25T19:14:17.445886] [INFO ] [REMOTE ] BBDC: Full fetch complete (48873 records). [2025-10-25T19:14:17.446000] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-25T19:14:17.823366] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-25T19:14:17.823494] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-25T19:14:17.824029] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-25T19:14:17.824110] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-25T19:14:17.825123] [DEBUG] [LOCAL ] BBDC: Trimmed 48873 records to 33245 (keeping 200 days of data) [2025-10-25T19:14:18.011993] [DEBUG] [LOCAL ] BBDC: Primary data saved (33245 records). [2025-10-25T19:14:18.012160] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-25T19:14:18.012273] [INFO ] [MAIN ] Update Progress: 221/2366 symbols. BBDC took 15.6s. Estimated remaining time: 2h 40m 9s [2025-10-25T19:14:18.178770] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:18.179005] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-25T19:14:18.179078] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-25T19:14:18.179190] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-25T19:14:18.179261] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-25T19:14:18.179343] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-25T19:14:18.179414] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-25T19:14:18.525897] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:14:18.526229] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-25T19:14:19.427772] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T19:14:19.429856] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-25T19:14:20.079824] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-25T19:14:20.081566] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-25T19:14:20.753323] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T19:14:20.755158] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-25T19:14:21.613803] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T19:14:21.616282] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-25T19:14:22.358924] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T19:14:22.361145] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-25T19:14:23.144821] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-25T19:14:23.146679] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-25T19:14:23.867336] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T19:14:23.869137] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-25T19:14:24.515456] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-25T19:14:24.516886] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-25T19:14:25.191554] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-25T19:14:25.193275] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-25T19:14:25.923915] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T19:14:25.925501] [INFO ] [REMOTE ] BBDO: Full fetch complete (7402 records). [2025-10-25T19:14:25.925602] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-25T19:14:26.290992] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-25T19:14:26.291122] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-25T19:14:26.291341] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-25T19:14:26.291415] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-25T19:14:26.291873] [DEBUG] [LOCAL ] BBDO: Trimmed 7402 records to 4992 (keeping 200 days of data) [2025-10-25T19:14:26.320581] [DEBUG] [LOCAL ] BBDO: Primary data saved (4992 records). [2025-10-25T19:14:26.320737] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-25T19:14:26.320851] [INFO ] [MAIN ] Update Progress: 222/2366 symbols. BBDO took 8.3s. Estimated remaining time: 2h 40m 42s [2025-10-25T19:14:26.485370] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:26.485592] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-25T19:14:26.485683] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-25T19:14:26.485839] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-25T19:14:26.485913] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-25T19:14:26.485970] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-25T19:14:26.486035] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-25T19:14:26.839739] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:14:26.840071] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-25T19:14:27.836356] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T19:14:27.840168] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-25T19:14:28.841935] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-25T19:14:28.845721] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-25T19:14:30.031402] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T19:14:30.035303] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-25T19:14:31.129514] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T19:14:31.136970] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-25T19:14:32.435993] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T19:14:32.440274] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-25T19:14:34.387348] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-25T19:14:34.391815] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-25T19:14:35.678393] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-25T19:14:35.683035] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-25T19:14:36.815814] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T19:14:36.820511] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-25T19:14:37.906208] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T19:14:37.911521] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-25T19:14:38.844812] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:14:38.847818] [INFO ] [REMOTE ] BBN: Full fetch complete (25012 records). [2025-10-25T19:14:38.847911] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-25T19:14:39.214708] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-25T19:14:39.214822] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-25T19:14:39.215157] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-25T19:14:39.215240] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-25T19:14:39.215926] [DEBUG] [LOCAL ] BBN: Trimmed 25012 records to 17992 (keeping 200 days of data) [2025-10-25T19:14:39.319884] [DEBUG] [LOCAL ] BBN: Primary data saved (17992 records). [2025-10-25T19:14:39.320052] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-25T19:14:39.320164] [INFO ] [MAIN ] Update Progress: 223/2366 symbols. BBN took 13.0s. Estimated remaining time: 2h 41m 59s [2025-10-25T19:14:39.492835] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:39.493051] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-25T19:14:39.493124] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-25T19:14:39.493244] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-25T19:14:39.493314] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-25T19:14:39.493397] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-25T19:14:39.493487] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-25T19:14:39.860756] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:14:39.861126] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-25T19:14:40.147860] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:14:40.148232] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-25T19:14:40.148338] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:14:40.148411] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-25T19:14:40.148481] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:14:40.148558] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-25T19:14:40.148682] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-25T19:14:40.148756] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-25T19:14:40.148848] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-25T19:14:40.148962] [INFO ] [MAIN ] Update Progress: 224/2366 symbols. BBT took 0.8s. Estimated remaining time: 2h 41m 19s [2025-10-25T19:14:40.327295] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:40.327499] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-25T19:14:40.327572] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-25T19:14:40.327692] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-25T19:14:40.327767] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-25T19:14:40.327854] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-25T19:14:40.327926] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-25T19:14:40.698910] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:14:40.699242] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-25T19:14:41.415758] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T19:14:41.417308] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-25T19:14:42.152299] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T19:14:42.153857] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-25T19:14:42.850429] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-25T19:14:42.851870] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-25T19:14:43.461728] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T19:14:43.463115] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-25T19:14:44.051102] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T19:14:44.052564] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-25T19:14:44.715243] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T19:14:44.716469] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-25T19:14:45.546741] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T19:14:45.549129] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-25T19:14:46.344186] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T19:14:46.345894] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-25T19:14:47.320521] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:14:47.323150] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-25T19:14:48.347707] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T19:14:48.350330] [INFO ] [REMOTE ] BBU: Full fetch complete (7546 records). [2025-10-25T19:14:48.350425] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-25T19:14:48.706678] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-25T19:14:48.706792] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-25T19:14:48.706995] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-25T19:14:48.707063] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-25T19:14:48.707551] [DEBUG] [LOCAL ] BBU: Trimmed 7546 records to 5880 (keeping 200 days of data) [2025-10-25T19:14:48.740935] [DEBUG] [LOCAL ] BBU: Primary data saved (5880 records). [2025-10-25T19:14:48.741061] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-25T19:14:48.741169] [INFO ] [MAIN ] Update Progress: 225/2366 symbols. BBU took 8.6s. Estimated remaining time: 2h 41m 53s [2025-10-25T19:14:48.918774] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:48.919007] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-25T19:14:48.919086] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-25T19:14:48.919204] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-25T19:14:48.919287] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-25T19:14:48.919372] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-25T19:14:48.919445] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-25T19:14:49.278182] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:14:49.278539] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-25T19:14:50.192034] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T19:14:50.194496] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-25T19:14:51.042483] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-25T19:14:51.045036] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-25T19:14:52.069409] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T19:14:52.074894] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-25T19:14:53.137375] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T19:14:53.141167] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-25T19:14:54.158863] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T19:14:54.162496] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-25T19:14:55.099543] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:14:55.102702] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-25T19:14:55.975035] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T19:14:55.978412] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-25T19:14:56.832879] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T19:14:56.836125] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-25T19:14:57.900914] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T19:14:57.905247] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-25T19:14:59.063534] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T19:14:59.067492] [INFO ] [REMOTE ] BBUC: Full fetch complete (19286 records). [2025-10-25T19:14:59.067615] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-25T19:14:59.449921] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-25T19:14:59.450030] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-25T19:14:59.450301] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-25T19:14:59.450386] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-25T19:14:59.450997] [DEBUG] [LOCAL ] BBUC: Trimmed 19286 records to 14138 (keeping 200 days of data) [2025-10-25T19:14:59.531229] [DEBUG] [LOCAL ] BBUC: Primary data saved (14138 records). [2025-10-25T19:14:59.531377] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-25T19:14:59.531487] [INFO ] [MAIN ] Update Progress: 226/2366 symbols. BBUC took 10.8s. Estimated remaining time: 2h 42m 48s [2025-10-25T19:14:59.696380] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:14:59.696556] [DEBUG] [LOCAL ] BBVA: No existing data file found in primary storage. [2025-10-25T19:14:59.696627] [WARN ] [MAIN ] BBVA: No existing data found, performing full refresh instead. [2025-10-25T19:14:59.696756] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-25T19:14:59.696825] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-25T19:14:59.696903] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-25T19:14:59.696969] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-25T19:15:00.045217] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:15:00.045554] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-25T19:15:01.994440] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-25T19:15:02.008432] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-25T19:15:03.733301] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T19:15:03.742876] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-25T19:15:05.797164] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-25T19:15:05.808210] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-25T19:15:06.846590] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T19:15:06.857727] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-25T19:15:07.896495] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T19:15:07.906706] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-25T19:15:08.867200] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T19:15:08.877031] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-25T19:15:09.964866] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T19:15:09.975839] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-25T19:15:10.930247] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T19:15:10.941940] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-25T19:15:11.851037] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T19:15:11.861255] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-25T19:15:12.763520] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:15:12.774189] [INFO ] [REMOTE ] BBVA: Full fetch complete (71910 records). [2025-10-25T19:15:12.774390] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-25T19:15:13.156495] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-25T19:15:13.156626] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-25T19:15:13.157319] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-25T19:15:13.157413] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-25T19:15:13.158755] [DEBUG] [LOCAL ] BBVA: Trimmed 71910 records to 49816 (keeping 200 days of data) [2025-10-25T19:15:13.436921] [DEBUG] [LOCAL ] BBVA: Primary data saved (49816 records). [2025-10-25T19:15:13.437077] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-25T19:15:13.437199] [INFO ] [MAIN ] Update Progress: 227/2366 symbols. BBVA took 13.9s. Estimated remaining time: 2h 44m 11s [2025-10-25T19:15:13.606263] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:15:13.606472] [DEBUG] [LOCAL ] BBW: No existing data file found in primary storage. [2025-10-25T19:15:13.606544] [WARN ] [MAIN ] BBW: No existing data found, performing full refresh instead. [2025-10-25T19:15:13.606678] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-25T19:15:13.606750] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-25T19:15:13.606829] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-25T19:15:13.606898] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-25T19:15:13.954879] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:15:13.955202] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-25T19:15:15.297854] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T19:15:15.304283] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-25T19:15:16.744560] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T19:15:16.751309] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-25T19:15:18.217778] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T19:15:18.225903] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-25T19:15:19.709877] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T19:15:19.717526] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-25T19:15:20.965027] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T19:15:20.972351] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-25T19:15:22.219997] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T19:15:22.225485] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-25T19:15:23.430502] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T19:15:23.435544] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-25T19:15:24.770319] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-25T19:15:24.776313] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-25T19:15:26.391367] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T19:15:26.399992] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-25T19:15:27.819533] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T19:15:27.826619] [INFO ] [REMOTE ] BBW: Full fetch complete (39508 records). [2025-10-25T19:15:27.826913] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-25T19:15:28.237275] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-25T19:15:28.237388] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-25T19:15:28.237905] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-25T19:15:28.237983] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-25T19:15:28.238996] [DEBUG] [LOCAL ] BBW: Trimmed 39508 records to 27551 (keeping 200 days of data) [2025-10-25T19:15:28.400401] [DEBUG] [LOCAL ] BBW: Primary data saved (27551 records). [2025-10-25T19:15:28.400555] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-25T19:15:28.400692] [INFO ] [MAIN ] Update Progress: 228/2366 symbols. BBW took 15.0s. Estimated remaining time: 2h 45m 44s [2025-10-25T19:15:28.570742] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:15:28.570971] [DEBUG] [LOCAL ] BBWI: No existing data file found in primary storage. [2025-10-25T19:15:28.571042] [WARN ] [MAIN ] BBWI: No existing data found, performing full refresh instead. [2025-10-25T19:15:28.571153] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-25T19:15:28.571223] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-25T19:15:28.571304] [DEBUG] [LOCAL ] BBWI: No primary data file found to delete. [2025-10-25T19:15:28.571371] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-25T19:15:28.927069] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:15:28.927390] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-25T19:15:30.729400] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T19:15:30.739709] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-25T19:15:32.485502] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-25T19:15:32.496919] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-25T19:15:34.462682] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T19:15:34.474097] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-25T19:15:35.614560] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T19:15:35.625961] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-25T19:15:36.703088] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T19:15:36.714878] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-25T19:15:37.688194] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:15:37.699230] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-25T19:15:38.844932] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T19:15:38.857189] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-25T19:15:39.855633] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T19:15:39.867310] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-25T19:15:40.841688] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:15:40.853160] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-25T19:15:41.915588] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T19:15:41.925672] [INFO ] [REMOTE ] BBWI: Full fetch complete (77632 records). [2025-10-25T19:15:41.925862] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-25T19:15:42.322701] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-25T19:15:42.322858] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-25T19:15:42.323711] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-25T19:15:42.323803] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-25T19:15:42.325381] [DEBUG] [LOCAL ] BBWI: Trimmed 77632 records to 54371 (keeping 200 days of data) [2025-10-25T19:15:42.645185] [DEBUG] [LOCAL ] BBWI: Primary data saved (54371 records). [2025-10-25T19:15:42.645371] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-25T19:15:42.645496] [INFO ] [MAIN ] Update Progress: 229/2366 symbols. BBWI took 14.2s. Estimated remaining time: 2h 47m 9s [2025-10-25T19:15:42.815052] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:15:42.815263] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-10-25T19:15:42.815336] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-10-25T19:15:42.815447] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-25T19:15:42.815520] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-25T19:15:42.815603] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-25T19:15:42.815696] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-25T19:15:43.165705] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:15:43.166030] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-25T19:15:45.030430] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-25T19:15:45.041119] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-25T19:15:46.936250] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T19:15:46.946393] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-25T19:15:48.860354] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T19:15:48.871274] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-25T19:15:50.071723] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T19:15:50.082866] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-25T19:15:51.382611] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T19:15:51.393852] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-25T19:15:52.329335] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:15:52.340150] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-25T19:15:53.327087] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T19:15:53.338900] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-25T19:15:54.460357] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T19:15:54.471603] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-25T19:15:55.462345] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T19:15:55.473806] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-25T19:15:56.444211] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:15:56.453896] [INFO ] [REMOTE ] BBY: Full fetch complete (77403 records). [2025-10-25T19:15:56.454054] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-25T19:15:56.857133] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-25T19:15:56.857284] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-25T19:15:56.858214] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-25T19:15:56.858308] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-25T19:15:56.859834] [DEBUG] [LOCAL ] BBY: Trimmed 77403 records to 54210 (keeping 200 days of data) [2025-10-25T19:15:57.187395] [DEBUG] [LOCAL ] BBY: Primary data saved (54210 records). [2025-10-25T19:15:57.187583] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-25T19:15:57.187716] [INFO ] [MAIN ] Update Progress: 230/2366 symbols. BBY took 14.5s. Estimated remaining time: 2h 48m 35s [2025-10-25T19:15:57.361206] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:15:57.361433] [DEBUG] [LOCAL ] BC: No existing data file found in primary storage. [2025-10-25T19:15:57.361506] [WARN ] [MAIN ] BC: No existing data found, performing full refresh instead. [2025-10-25T19:15:57.361619] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-25T19:15:57.361719] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-25T19:15:57.361803] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-25T19:15:57.361871] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-25T19:15:57.737029] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:15:57.737378] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-25T19:15:59.414891] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T19:15:59.423803] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-25T19:16:01.247335] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T19:16:01.255958] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-25T19:16:03.493119] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-25T19:16:03.502386] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-25T19:16:05.157919] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T19:16:05.168829] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-25T19:16:06.826715] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T19:16:06.836405] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-25T19:16:08.491039] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T19:16:08.500505] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-25T19:16:10.287531] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-25T19:16:10.297634] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-25T19:16:11.974313] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T19:16:11.988235] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-25T19:16:13.581430] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T19:16:13.590425] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-25T19:16:15.210921] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T19:16:15.218829] [INFO ] [REMOTE ] BC: Full fetch complete (63840 records). [2025-10-25T19:16:15.219007] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-25T19:16:15.601241] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-25T19:16:15.601366] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-25T19:16:15.602062] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-25T19:16:15.602162] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-25T19:16:15.603572] [DEBUG] [LOCAL ] BC: Trimmed 63840 records to 44612 (keeping 200 days of data) [2025-10-25T19:16:15.863837] [DEBUG] [LOCAL ] BC: Primary data saved (44612 records). [2025-10-25T19:16:15.864006] [INFO ] [MAIN ] BC: Full history saved. [2025-10-25T19:16:15.864145] [INFO ] [MAIN ] Update Progress: 231/2366 symbols. BC took 18.7s. Estimated remaining time: 2h 50m 40s [2025-10-25T19:16:16.030621] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:16:16.030899] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-10-25T19:16:16.030991] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-10-25T19:16:16.031147] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-25T19:16:16.031257] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-25T19:16:16.031367] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-25T19:16:16.031459] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-25T19:16:16.385744] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:16:16.386156] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-25T19:16:17.762462] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T19:16:17.769180] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-25T19:16:19.345808] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T19:16:19.352847] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-25T19:16:21.839804] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-25T19:16:21.847625] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-25T19:16:23.373605] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T19:16:23.381261] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-25T19:16:24.796512] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T19:16:24.804013] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-25T19:16:26.323003] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T19:16:26.330817] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-25T19:16:27.897027] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T19:16:27.905321] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-25T19:16:29.405991] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T19:16:29.414336] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-25T19:16:30.931329] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T19:16:30.939029] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-25T19:16:32.496484] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-25T19:16:32.503524] [INFO ] [REMOTE ] BCAT: Full fetch complete (50104 records). [2025-10-25T19:16:32.503680] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-25T19:16:32.881837] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-25T19:16:32.881951] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-25T19:16:32.882492] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-25T19:16:32.882567] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-25T19:16:32.883616] [DEBUG] [LOCAL ] BCAT: Trimmed 50104 records to 34675 (keeping 200 days of data) [2025-10-25T19:16:33.085356] [DEBUG] [LOCAL ] BCAT: Primary data saved (34675 records). [2025-10-25T19:16:33.085522] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-25T19:16:33.085634] [INFO ] [MAIN ] Update Progress: 232/2366 symbols. BCAT took 17.2s. Estimated remaining time: 2h 52m 29s [2025-10-25T19:16:33.253733] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:16:33.253949] [DEBUG] [LOCAL ] BCC: No existing data file found in primary storage. [2025-10-25T19:16:33.254041] [WARN ] [MAIN ] BCC: No existing data found, performing full refresh instead. [2025-10-25T19:16:33.254211] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-25T19:16:33.254308] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-25T19:16:33.254431] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-25T19:16:33.254550] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-25T19:16:33.607670] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:16:33.608059] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-25T19:16:34.804285] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-25T19:16:34.810216] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-25T19:16:36.235767] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T19:16:36.241746] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-25T19:16:37.710579] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T19:16:37.717660] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-25T19:16:39.131302] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T19:16:39.137665] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-25T19:16:40.510039] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T19:16:40.516193] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-25T19:16:41.832490] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T19:16:41.839058] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-25T19:16:43.214261] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T19:16:43.221186] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-25T19:16:44.625514] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T19:16:44.632418] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-25T19:16:45.947726] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T19:16:45.957906] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-25T19:16:47.370015] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T19:16:47.376462] [INFO ] [REMOTE ] BCC: Full fetch complete (41703 records). [2025-10-25T19:16:47.376636] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-25T19:16:47.755395] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-25T19:16:47.755519] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-25T19:16:47.756080] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-25T19:16:47.756189] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-25T19:16:47.757319] [DEBUG] [LOCAL ] BCC: Trimmed 41703 records to 29040 (keeping 200 days of data) [2025-10-25T19:16:47.931404] [DEBUG] [LOCAL ] BCC: Primary data saved (29040 records). [2025-10-25T19:16:47.931569] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-25T19:16:47.931704] [INFO ] [MAIN ] Update Progress: 233/2366 symbols. BCC took 14.8s. Estimated remaining time: 2h 53m 56s [2025-10-25T19:16:48.101865] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:16:48.102051] [DEBUG] [LOCAL ] BCE: No existing data file found in primary storage. [2025-10-25T19:16:48.102124] [WARN ] [MAIN ] BCE: No existing data found, performing full refresh instead. [2025-10-25T19:16:48.102237] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-25T19:16:48.102311] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-25T19:16:48.102393] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-25T19:16:48.102462] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-25T19:16:48.465082] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:16:48.465438] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-25T19:16:50.158683] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T19:16:50.169368] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-25T19:16:52.000145] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T19:16:52.010267] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-25T19:16:53.879233] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T19:16:53.890546] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-25T19:16:55.851624] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-25T19:16:55.863131] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-25T19:16:57.824550] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-25T19:16:57.835860] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-25T19:16:59.761323] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-25T19:16:59.771958] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-25T19:17:02.132591] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-25T19:17:02.144032] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-25T19:17:03.968737] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-25T19:17:03.979898] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-25T19:17:05.811140] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-25T19:17:05.822046] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-25T19:17:07.761031] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-25T19:17:07.770940] [INFO ] [REMOTE ] BCE: Full fetch complete (76092 records). [2025-10-25T19:17:07.771155] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-25T19:17:08.157622] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-25T19:17:08.157775] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-25T19:17:08.158604] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-25T19:17:08.158729] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-25T19:17:08.160342] [DEBUG] [LOCAL ] BCE: Trimmed 76092 records to 53017 (keeping 200 days of data) [2025-10-25T19:17:08.474913] [DEBUG] [LOCAL ] BCE: Primary data saved (53017 records). [2025-10-25T19:17:08.475102] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-25T19:17:08.475255] [INFO ] [MAIN ] Update Progress: 234/2366 symbols. BCE took 20.5s. Estimated remaining time: 2h 56m 13s [2025-10-25T19:17:08.643965] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:17:08.644187] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-25T19:17:08.644274] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-25T19:17:08.644427] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-25T19:17:08.644516] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-25T19:17:08.644624] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-25T19:17:08.644742] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-25T19:17:09.016790] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:17:09.017424] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-25T19:17:10.285922] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T19:17:10.290679] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-25T19:17:11.553272] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T19:17:11.558895] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-25T19:17:13.019117] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T19:17:13.025336] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-25T19:17:14.460622] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T19:17:14.471016] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-25T19:17:15.895610] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T19:17:15.902053] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-25T19:17:17.128485] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-25T19:17:17.134674] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-25T19:17:18.603321] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T19:17:18.610516] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-25T19:17:19.969282] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T19:17:19.975488] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-25T19:17:21.374023] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T19:17:21.380778] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-25T19:17:22.833748] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T19:17:22.839920] [INFO ] [REMOTE ] BCH: Full fetch complete (41885 records). [2025-10-25T19:17:22.840032] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-25T19:17:23.221455] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-25T19:17:23.221575] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-25T19:17:23.222162] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-25T19:17:23.222245] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-25T19:17:23.223168] [DEBUG] [LOCAL ] BCH: Trimmed 41885 records to 30400 (keeping 200 days of data) [2025-10-25T19:17:23.393982] [DEBUG] [LOCAL ] BCH: Primary data saved (30400 records). [2025-10-25T19:17:23.394174] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-25T19:17:23.394288] [INFO ] [MAIN ] Update Progress: 235/2366 symbols. BCH took 14.9s. Estimated remaining time: 2h 57m 39s [2025-10-25T19:17:23.570981] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:17:23.571202] [DEBUG] [LOCAL ] BCO: No existing data file found in primary storage. [2025-10-25T19:17:23.571275] [WARN ] [MAIN ] BCO: No existing data found, performing full refresh instead. [2025-10-25T19:17:23.571395] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-25T19:17:23.571446] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-25T19:17:23.571495] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-10-25T19:17:23.571560] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-25T19:17:23.915755] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:17:23.916086] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-25T19:17:25.122363] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T19:17:25.127101] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-25T19:17:26.329586] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-25T19:17:26.334709] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-25T19:17:27.646629] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T19:17:27.652545] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-25T19:17:29.047542] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T19:17:29.054362] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-25T19:17:30.357724] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T19:17:30.364124] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-25T19:17:31.728600] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T19:17:31.734920] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-25T19:17:32.995903] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T19:17:33.001156] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-25T19:17:34.193218] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-25T19:17:34.199272] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-25T19:17:35.427306] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T19:17:35.432524] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-25T19:17:36.531738] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T19:17:36.535367] [INFO ] [REMOTE ] BCO: Full fetch complete (35982 records). [2025-10-25T19:17:36.535477] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-25T19:17:36.907241] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-25T19:17:36.907371] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-25T19:17:36.907929] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-25T19:17:36.908018] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-25T19:17:36.909171] [DEBUG] [LOCAL ] BCO: Trimmed 35982 records to 25188 (keeping 200 days of data) [2025-10-25T19:17:37.057537] [DEBUG] [LOCAL ] BCO: Primary data saved (25188 records). [2025-10-25T19:17:37.057735] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-25T19:17:37.057894] [INFO ] [MAIN ] Update Progress: 236/2366 symbols. BCO took 13.7s. Estimated remaining time: 2h 58m 52s [2025-10-25T19:17:37.229333] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:17:37.230158] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-25T19:17:37.230239] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-25T19:17:37.230434] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-25T19:17:37.230520] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-25T19:17:37.230628] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-25T19:17:37.230746] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-25T19:17:37.583248] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:17:37.583570] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-25T19:17:39.697741] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-25T19:17:39.708518] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-25T19:17:41.533565] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T19:17:41.543905] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-25T19:17:43.747421] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-25T19:17:43.758505] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-25T19:17:44.734108] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:17:44.745089] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-25T19:17:45.696468] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T19:17:45.707639] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-25T19:17:46.805635] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:17:46.816418] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-25T19:17:47.807244] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T19:17:47.819792] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-25T19:17:48.875558] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T19:17:48.886796] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-25T19:17:50.000250] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T19:17:50.011605] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-25T19:17:50.980518] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:17:50.990398] [INFO ] [REMOTE ] BCS: Full fetch complete (77526 records). [2025-10-25T19:17:50.990564] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-25T19:17:51.381112] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-25T19:17:51.381221] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-25T19:17:51.382048] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-25T19:17:51.382141] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-25T19:17:51.383675] [DEBUG] [LOCAL ] BCS: Trimmed 77526 records to 54220 (keeping 200 days of data) [2025-10-25T19:17:51.701278] [DEBUG] [LOCAL ] BCS: Primary data saved (54220 records). [2025-10-25T19:17:51.701484] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-25T19:17:51.701670] [INFO ] [MAIN ] Update Progress: 237/2366 symbols. BCS took 14.6s. Estimated remaining time: 3h 0m 13s [2025-10-25T19:17:51.869278] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:17:51.869477] [DEBUG] [LOCAL ] BCSF: No existing data file found in primary storage. [2025-10-25T19:17:51.869567] [WARN ] [MAIN ] BCSF: No existing data found, performing full refresh instead. [2025-10-25T19:17:51.869740] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-25T19:17:51.869828] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-25T19:17:51.869938] [DEBUG] [LOCAL ] BCSF: No primary data file found to delete. [2025-10-25T19:17:51.870023] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-25T19:17:52.227405] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:17:52.227786] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-25T19:17:53.334836] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T19:17:53.339446] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-25T19:17:54.382095] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-25T19:17:54.386823] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-25T19:17:55.968697] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T19:17:55.975809] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-25T19:17:57.370793] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T19:17:57.377750] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-25T19:17:58.622316] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T19:17:58.628301] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-25T19:17:59.764785] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T19:17:59.774405] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-25T19:18:01.258376] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T19:18:01.264781] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-25T19:18:02.925920] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T19:18:02.931794] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-25T19:18:04.284349] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T19:18:04.293411] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-25T19:18:05.732221] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-25T19:18:05.738716] [INFO ] [REMOTE ] BCSF: Full fetch complete (39916 records). [2025-10-25T19:18:05.738828] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-25T19:18:06.109375] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-25T19:18:06.109509] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-25T19:18:06.110016] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-25T19:18:06.110098] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-25T19:18:06.111378] [DEBUG] [LOCAL ] BCSF: Trimmed 39916 records to 28577 (keeping 200 days of data) [2025-10-25T19:18:06.287969] [DEBUG] [LOCAL ] BCSF: Primary data saved (28577 records). [2025-10-25T19:18:06.288177] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-25T19:18:06.288312] [INFO ] [MAIN ] Update Progress: 238/2366 symbols. BCSF took 14.6s. Estimated remaining time: 3h 1m 33s [2025-10-25T19:18:06.544253] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:18:06.544501] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-10-25T19:18:06.544592] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-10-25T19:18:06.544770] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-25T19:18:06.544866] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-25T19:18:06.544970] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-25T19:18:06.545060] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-25T19:18:07.053102] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:18:07.053486] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-25T19:18:08.280114] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-25T19:18:08.286325] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-25T19:18:09.509005] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T19:18:09.514056] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-25T19:18:10.741170] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-25T19:18:10.746880] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-25T19:18:12.133199] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T19:18:12.139599] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-25T19:18:13.412074] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T19:18:13.416481] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-25T19:18:14.563942] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T19:18:14.569050] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-25T19:18:15.869677] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T19:18:15.875741] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-25T19:18:16.923030] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T19:18:16.927717] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-25T19:18:18.067275] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T19:18:18.072253] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-25T19:18:19.326578] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T19:18:19.332227] [INFO ] [REMOTE ] BCX: Full fetch complete (33614 records). [2025-10-25T19:18:19.332384] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-25T19:18:19.723422] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-25T19:18:19.723604] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-25T19:18:19.724149] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-25T19:18:19.724236] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-25T19:18:19.725693] [DEBUG] [LOCAL ] BCX: Trimmed 33614 records to 22345 (keeping 200 days of data) [2025-10-25T19:18:19.860694] [DEBUG] [LOCAL ] BCX: Primary data saved (22345 records). [2025-10-25T19:18:19.860906] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-25T19:18:19.861038] [INFO ] [MAIN ] Update Progress: 239/2366 symbols. BCX took 13.6s. Estimated remaining time: 3h 2m 43s [2025-10-25T19:18:20.036441] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:18:20.036730] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-10-25T19:18:20.036805] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-10-25T19:18:20.036927] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-25T19:18:20.036999] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-25T19:18:20.037082] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-25T19:18:20.037154] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-25T19:18:20.404217] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:18:20.404708] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-25T19:18:21.712800] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T19:18:21.719840] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-25T19:18:22.940615] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T19:18:22.946142] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-25T19:18:24.366314] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T19:18:24.374081] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-25T19:18:25.741762] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T19:18:25.749353] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-25T19:18:26.934937] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T19:18:26.941089] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-25T19:18:28.073282] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T19:18:28.079095] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-25T19:18:29.503145] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T19:18:29.509359] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-25T19:18:30.811065] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T19:18:30.817445] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-25T19:18:32.063042] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T19:18:32.069079] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-25T19:18:33.335046] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T19:18:33.342003] [INFO ] [REMOTE ] BDC: Full fetch complete (35616 records). [2025-10-25T19:18:33.342218] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-25T19:18:33.740884] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-25T19:18:33.741055] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-25T19:18:33.741593] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-25T19:18:33.741701] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-25T19:18:33.743224] [DEBUG] [LOCAL ] BDC: Trimmed 35616 records to 24242 (keeping 200 days of data) [2025-10-25T19:18:33.901811] [DEBUG] [LOCAL ] BDC: Primary data saved (24242 records). [2025-10-25T19:18:33.902088] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-25T19:18:33.902235] [INFO ] [MAIN ] Update Progress: 240/2366 symbols. BDC took 14.0s. Estimated remaining time: 3h 3m 57s [2025-10-25T19:18:34.081857] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:18:34.082161] [DEBUG] [LOCAL ] BDJ: No existing data file found in primary storage. [2025-10-25T19:18:34.082238] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-10-25T19:18:34.082366] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-25T19:18:34.082441] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-25T19:18:34.082529] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-10-25T19:18:34.082604] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-25T19:18:34.441252] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:18:34.441729] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-25T19:18:35.807564] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T19:18:35.814086] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-25T19:18:37.062152] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T19:18:37.071709] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-25T19:18:38.465760] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T19:18:38.472746] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-25T19:18:39.906309] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T19:18:39.913783] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-25T19:18:41.149568] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T19:18:41.159054] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-25T19:18:42.276068] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T19:18:42.282486] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-25T19:18:43.688361] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-25T19:18:43.695785] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-25T19:18:44.952258] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T19:18:44.959078] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-25T19:18:46.119690] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T19:18:46.125834] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-25T19:18:47.359825] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T19:18:47.365512] [INFO ] [REMOTE ] BDJ: Full fetch complete (42734 records). [2025-10-25T19:18:47.365639] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-25T19:18:47.748069] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-25T19:18:47.748203] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-25T19:18:47.748744] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-25T19:18:47.748826] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-25T19:18:47.749915] [DEBUG] [LOCAL ] BDJ: Trimmed 42734 records to 29651 (keeping 200 days of data) [2025-10-25T19:18:47.922519] [DEBUG] [LOCAL ] BDJ: Primary data saved (29651 records). [2025-10-25T19:18:47.922702] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-25T19:18:47.922815] [INFO ] [MAIN ] Update Progress: 241/2366 symbols. BDJ took 14.0s. Estimated remaining time: 3h 5m 9s [2025-10-25T19:18:48.089541] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:18:48.089745] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-10-25T19:18:48.089813] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-10-25T19:18:48.089924] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-25T19:18:48.089993] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-25T19:18:48.090053] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-25T19:18:48.090113] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-25T19:18:48.437028] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:18:48.437365] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-25T19:18:50.013708] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T19:18:50.023539] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-25T19:18:51.527915] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T19:18:51.537794] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-25T19:18:53.206425] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T19:18:53.217086] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-25T19:18:54.169159] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T19:18:54.182828] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-25T19:18:55.160463] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T19:18:55.171144] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-25T19:18:56.140677] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:18:56.151241] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-25T19:18:57.120457] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T19:18:57.131810] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-25T19:18:58.097662] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T19:18:58.108506] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-25T19:18:59.404735] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T19:18:59.415971] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-25T19:19:00.322753] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T19:19:00.336675] [INFO ] [REMOTE ] BDN: Full fetch complete (69398 records). [2025-10-25T19:19:00.336947] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-25T19:19:00.758105] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-25T19:19:00.758225] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-25T19:19:00.758944] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-25T19:19:00.759024] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-25T19:19:00.760354] [DEBUG] [LOCAL ] BDN: Trimmed 69398 records to 48337 (keeping 200 days of data) [2025-10-25T19:19:01.033046] [DEBUG] [LOCAL ] BDN: Primary data saved (48337 records). [2025-10-25T19:19:01.033217] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-25T19:19:01.033335] [INFO ] [MAIN ] Update Progress: 242/2366 symbols. BDN took 13.1s. Estimated remaining time: 3h 6m 13s [2025-10-25T19:19:01.224745] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:19:01.225010] [DEBUG] [LOCAL ] BDX: No existing data file found in primary storage. [2025-10-25T19:19:01.225579] [WARN ] [MAIN ] BDX: No existing data found, performing full refresh instead. [2025-10-25T19:19:01.225731] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-25T19:19:01.225806] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-25T19:19:01.225903] [DEBUG] [LOCAL ] BDX: No primary data file found to delete. [2025-10-25T19:19:01.225990] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-25T19:19:01.618479] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:19:01.618846] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-25T19:19:03.425169] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T19:19:03.435429] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-25T19:19:05.453625] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-25T19:19:05.463323] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-25T19:19:07.554513] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-25T19:19:07.565387] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-25T19:19:08.519380] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T19:19:08.530426] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-25T19:19:09.558408] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T19:19:09.570775] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-25T19:19:10.535820] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:19:10.546397] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-25T19:19:11.588098] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T19:19:11.600269] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-25T19:19:12.661637] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T19:19:12.673746] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-25T19:19:13.827927] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T19:19:13.840029] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-25T19:19:14.904600] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T19:19:14.915124] [INFO ] [REMOTE ] BDX: Full fetch complete (75451 records). [2025-10-25T19:19:14.915347] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-25T19:19:15.345515] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-25T19:19:15.345705] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-25T19:19:15.346789] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-25T19:19:15.346879] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-25T19:19:15.349111] [DEBUG] [LOCAL ] BDX: Trimmed 75451 records to 52874 (keeping 200 days of data) [2025-10-25T19:19:15.696996] [DEBUG] [LOCAL ] BDX: Primary data saved (52874 records). [2025-10-25T19:19:15.697251] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-25T19:19:15.697396] [INFO ] [MAIN ] Update Progress: 243/2366 symbols. BDX took 14.7s. Estimated remaining time: 3h 7m 30s [2025-10-25T19:19:15.877624] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:19:15.877923] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-25T19:19:15.877999] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-25T19:19:15.878129] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-25T19:19:15.878204] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-25T19:19:15.878292] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-25T19:19:15.878367] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-25T19:19:16.246490] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:19:16.246962] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-25T19:19:18.303988] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-25T19:19:18.315210] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-25T19:19:20.249808] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T19:19:20.260678] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-25T19:19:22.424941] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-25T19:19:22.436227] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-25T19:19:24.325156] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-25T19:19:24.336788] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-25T19:19:26.296943] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-25T19:19:26.308255] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-25T19:19:28.267682] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-25T19:19:28.278503] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-25T19:19:30.423736] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-25T19:19:30.435342] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-25T19:19:32.639118] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-25T19:19:32.650558] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-25T19:19:35.033969] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-25T19:19:35.045462] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-25T19:19:36.019874] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:19:36.030011] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-25T19:19:36.030175] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-25T19:19:36.426889] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-25T19:19:36.427006] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-25T19:19:36.427862] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-25T19:19:36.427950] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-25T19:19:36.429435] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 54441 (keeping 200 days of data) [2025-10-25T19:19:36.734461] [DEBUG] [LOCAL ] BE: Primary data saved (54441 records). [2025-10-25T19:19:36.734616] [INFO ] [MAIN ] BE: Full history saved. [2025-10-25T19:19:36.734749] [INFO ] [MAIN ] Update Progress: 244/2366 symbols. BE took 21.0s. Estimated remaining time: 3h 9m 42s [2025-10-25T19:19:36.902238] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:19:36.902468] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-25T19:19:36.902542] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-25T19:19:36.902692] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-25T19:19:36.902761] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-25T19:19:36.902845] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-25T19:19:36.902928] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-25T19:19:37.254780] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:19:37.255189] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-25T19:19:37.646230] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-25T19:19:37.647071] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-25T19:19:38.105976] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-25T19:19:38.106887] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-25T19:19:38.604038] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-25T19:19:38.605286] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-25T19:19:39.136043] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-25T19:19:39.137258] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-25T19:19:39.549254] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-25T19:19:39.550314] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-25T19:19:40.020086] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T19:19:40.021055] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-25T19:19:40.328107] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-25T19:19:40.329071] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-25T19:19:40.624566] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-25T19:19:40.625401] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-25T19:19:41.125561] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-25T19:19:41.126608] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-25T19:19:41.695544] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T19:19:41.696467] [INFO ] [REMOTE ] BEDU: Full fetch complete (1337 records). [2025-10-25T19:19:41.696558] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-25T19:19:41.902064] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-25T19:19:41.902322] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-25T19:19:41.902401] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-25T19:19:41.902475] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-25T19:19:41.902567] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-25T19:19:41.902666] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-25T19:19:41.902757] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-25T19:19:41.902855] [INFO ] [MAIN ] Update Progress: 245/2366 symbols. BEDU took 5.2s. Estimated remaining time: 3h 9m 35s [2025-10-25T19:19:42.077531] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:19:42.077816] [DEBUG] [LOCAL ] BEKE: No existing data file found in primary storage. [2025-10-25T19:19:42.077889] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-10-25T19:19:42.078004] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-25T19:19:42.078076] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-25T19:19:42.078159] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-10-25T19:19:42.078229] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-25T19:19:42.454341] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:19:42.454768] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-25T19:19:44.147312] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T19:19:44.157906] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-25T19:19:45.945727] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T19:19:45.956128] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-25T19:19:47.987428] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-25T19:19:47.998569] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-25T19:19:49.050607] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T19:19:49.061900] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-25T19:19:50.001914] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T19:19:50.013282] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-25T19:19:50.761163] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T19:19:50.771921] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-25T19:19:51.664538] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T19:19:51.676305] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-25T19:19:52.638783] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:19:52.650096] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-25T19:19:54.450792] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-25T19:19:54.462098] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-25T19:19:55.374498] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T19:19:55.384198] [INFO ] [REMOTE ] BEKE: Full fetch complete (77330 records). [2025-10-25T19:19:55.384354] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-25T19:19:55.775259] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-25T19:19:55.775377] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-25T19:19:55.776215] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-25T19:19:55.776299] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-25T19:19:55.777841] [DEBUG] [LOCAL ] BEKE: Trimmed 77330 records to 53965 (keeping 200 days of data) [2025-10-25T19:19:56.100136] [DEBUG] [LOCAL ] BEKE: Primary data saved (53965 records). [2025-10-25T19:19:56.100295] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-25T19:19:56.100407] [INFO ] [MAIN ] Update Progress: 246/2366 symbols. BEKE took 14.2s. Estimated remaining time: 3h 10m 46s [2025-10-25T19:19:56.277726] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:19:56.277938] [DEBUG] [LOCAL ] BEN: No existing data file found in primary storage. [2025-10-25T19:19:56.278012] [WARN ] [MAIN ] BEN: No existing data found, performing full refresh instead. [2025-10-25T19:19:56.278148] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-25T19:19:56.278218] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-25T19:19:56.278308] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-25T19:19:56.278379] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-25T19:19:56.636519] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:19:56.636873] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-25T19:19:58.384465] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T19:19:58.394969] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-25T19:20:00.090761] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T19:20:00.100907] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-25T19:20:02.167502] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T19:20:02.178816] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-25T19:20:03.273417] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T19:20:03.286300] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-25T19:20:04.382485] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T19:20:04.396504] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-25T19:20:05.379461] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T19:20:05.390892] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-25T19:20:06.470351] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T19:20:06.482914] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-25T19:20:07.488228] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T19:20:07.499408] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-25T19:20:08.578082] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T19:20:08.590043] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-25T19:20:09.511774] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T19:20:09.521873] [INFO ] [REMOTE ] BEN: Full fetch complete (77062 records). [2025-10-25T19:20:09.522057] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-25T19:20:09.929438] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-25T19:20:09.929757] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-25T19:20:09.930528] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-25T19:20:09.930609] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-25T19:20:09.932276] [DEBUG] [LOCAL ] BEN: Trimmed 77062 records to 53886 (keeping 200 days of data) [2025-10-25T19:20:10.249730] [DEBUG] [LOCAL ] BEN: Primary data saved (53886 records). [2025-10-25T19:20:10.249888] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-25T19:20:10.250002] [INFO ] [MAIN ] Update Progress: 247/2366 symbols. BEN took 14.1s. Estimated remaining time: 3h 11m 55s [2025-10-25T19:20:10.416103] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:20:10.416315] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-10-25T19:20:10.416391] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-10-25T19:20:10.416503] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-25T19:20:10.416573] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-25T19:20:10.416680] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-25T19:20:10.416792] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-25T19:20:10.766231] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:20:10.766556] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-25T19:20:12.530955] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T19:20:12.541717] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-25T19:20:13.907471] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T19:20:13.915914] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-25T19:20:15.540530] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T19:20:15.550082] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-25T19:20:17.333052] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T19:20:17.341934] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-25T19:20:18.950786] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T19:20:18.959008] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-25T19:20:20.478827] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T19:20:20.487140] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-25T19:20:22.130780] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T19:20:22.143345] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-25T19:20:23.687442] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T19:20:23.695383] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-25T19:20:25.139337] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T19:20:25.147600] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-25T19:20:26.892526] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T19:20:26.901217] [INFO ] [REMOTE ] BEP: Full fetch complete (59222 records). [2025-10-25T19:20:26.901360] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-25T19:20:27.282214] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-25T19:20:27.282342] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-25T19:20:27.282955] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-25T19:20:27.283037] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-25T19:20:27.284339] [DEBUG] [LOCAL ] BEP: Trimmed 59222 records to 39485 (keeping 200 days of data) [2025-10-25T19:20:27.514087] [DEBUG] [LOCAL ] BEP: Primary data saved (39485 records). [2025-10-25T19:20:27.514265] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-25T19:20:27.514395] [INFO ] [MAIN ] Update Progress: 248/2366 symbols. BEP took 17.3s. Estimated remaining time: 3h 13m 31s [2025-10-25T19:20:27.693260] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:20:27.693475] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-25T19:20:27.693546] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-25T19:20:27.693635] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-25T19:20:27.693718] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-25T19:20:27.693773] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-25T19:20:27.693842] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-25T19:20:28.064323] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:20:28.064876] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-25T19:20:29.894735] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T19:20:29.904894] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-25T19:20:31.490448] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T19:20:31.500107] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-25T19:20:33.410694] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T19:20:33.421169] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-25T19:20:35.212963] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T19:20:35.223036] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-25T19:20:36.838159] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T19:20:36.848047] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-25T19:20:38.528229] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-25T19:20:38.537869] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-25T19:20:40.365182] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T19:20:40.375343] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-25T19:20:42.187136] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T19:20:42.196872] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-25T19:20:43.758361] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T19:20:43.768369] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-25T19:20:45.368260] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-25T19:20:45.377366] [INFO ] [REMOTE ] BEPC: Full fetch complete (68835 records). [2025-10-25T19:20:45.377557] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-25T19:20:45.760376] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-25T19:20:45.760511] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-25T19:20:45.761281] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-25T19:20:45.761382] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-25T19:20:45.762850] [DEBUG] [LOCAL ] BEPC: Trimmed 68835 records to 47001 (keeping 200 days of data) [2025-10-25T19:20:46.033910] [DEBUG] [LOCAL ] BEPC: Primary data saved (47001 records). [2025-10-25T19:20:46.034078] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-25T19:20:46.034193] [INFO ] [MAIN ] Update Progress: 249/2366 symbols. BEPC took 18.5s. Estimated remaining time: 3h 15m 16s [2025-10-25T19:20:46.203839] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:20:46.204085] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-10-25T19:20:46.204158] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-10-25T19:20:46.204276] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-25T19:20:46.204347] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-25T19:20:46.204435] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-25T19:20:46.204503] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-25T19:20:46.557302] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:20:46.557725] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-25T19:20:47.202600] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T19:20:47.204439] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-25T19:20:47.923541] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T19:20:47.925178] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-25T19:20:48.723757] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T19:20:48.725858] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-25T19:20:49.503446] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-25T19:20:49.505972] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-25T19:20:50.165375] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T19:20:50.168566] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-25T19:20:50.876496] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-25T19:20:50.878493] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-25T19:20:51.522474] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T19:20:51.524020] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-25T19:20:52.111786] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T19:20:52.114674] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-25T19:20:52.854292] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-25T19:20:52.856547] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-25T19:20:53.529964] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T19:20:53.531446] [INFO ] [REMOTE ] BEPH: Full fetch complete (7546 records). [2025-10-25T19:20:53.531538] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-25T19:20:53.910070] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-25T19:20:53.910193] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-25T19:20:53.910402] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-25T19:20:53.910472] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-25T19:20:53.910949] [DEBUG] [LOCAL ] BEPH: Trimmed 7546 records to 4959 (keeping 200 days of data) [2025-10-25T19:20:53.940256] [DEBUG] [LOCAL ] BEPH: Primary data saved (4959 records). [2025-10-25T19:20:53.940383] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-25T19:20:53.940493] [INFO ] [MAIN ] Update Progress: 250/2366 symbols. BEPH took 7.9s. Estimated remaining time: 3h 15m 31s [2025-10-25T19:20:54.111906] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:20:54.112100] [DEBUG] [LOCAL ] BEPI: No existing data file found in primary storage. [2025-10-25T19:20:54.112170] [WARN ] [MAIN ] BEPI: No existing data found, performing full refresh instead. [2025-10-25T19:20:54.112283] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-25T19:20:54.112350] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-25T19:20:54.112410] [DEBUG] [LOCAL ] BEPI: No primary data file found to delete. [2025-10-25T19:20:54.112473] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-25T19:20:54.468486] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:20:54.468851] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-25T19:20:55.020747] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-25T19:20:55.022049] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-25T19:20:55.575171] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-25T19:20:55.576486] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-25T19:20:56.136296] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-25T19:20:56.137438] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-25T19:20:56.873245] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T19:20:56.874975] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-25T19:20:57.616409] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T19:20:57.618330] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-25T19:20:58.311251] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-25T19:20:58.312861] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-25T19:20:58.955845] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T19:20:58.957258] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-25T19:20:59.546378] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T19:20:59.547760] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-25T19:21:00.124591] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-25T19:21:00.125985] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-25T19:21:00.706215] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T19:21:00.707351] [INFO ] [REMOTE ] BEPI: Full fetch complete (4683 records). [2025-10-25T19:21:00.707457] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-25T19:21:01.087002] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-25T19:21:01.087110] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-25T19:21:01.087280] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-25T19:21:01.087350] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-25T19:21:01.087856] [DEBUG] [LOCAL ] BEPI: Trimmed 4683 records to 3610 (keeping 200 days of data) [2025-10-25T19:21:01.108939] [DEBUG] [LOCAL ] BEPI: Primary data saved (3610 records). [2025-10-25T19:21:01.109031] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-25T19:21:01.109134] [INFO ] [MAIN ] Update Progress: 251/2366 symbols. BEPI took 7.2s. Estimated remaining time: 3h 15m 39s [2025-10-25T19:21:01.284324] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:21:01.284562] [DEBUG] [LOCAL ] BEPJ: No existing data file found in primary storage. [2025-10-25T19:21:01.284664] [WARN ] [MAIN ] BEPJ: No existing data found, performing full refresh instead. [2025-10-25T19:21:01.284806] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-25T19:21:01.284883] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-25T19:21:01.284970] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-10-25T19:21:01.285057] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-25T19:21:01.674676] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:21:01.675043] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-25T19:21:02.309632] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-25T19:21:02.311038] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-25T19:21:02.935634] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T19:21:02.936945] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-25T19:21:03.512144] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T19:21:03.513504] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-25T19:21:04.111045] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T19:21:04.112419] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-25T19:21:04.700431] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T19:21:04.701775] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-25T19:21:05.428313] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T19:21:05.430220] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-25T19:21:06.116282] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-25T19:21:06.118131] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-25T19:21:06.662293] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-25T19:21:06.663502] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-25T19:21:07.279629] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T19:21:07.280930] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-25T19:21:07.780707] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-25T19:21:07.781561] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4386 records). [2025-10-25T19:21:07.781670] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-25T19:21:08.135029] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-25T19:21:08.135161] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-25T19:21:08.135336] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-25T19:21:08.135407] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-25T19:21:08.135830] [DEBUG] [LOCAL ] BEPJ: Trimmed 4386 records to 3102 (keeping 200 days of data) [2025-10-25T19:21:08.154308] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3102 records). [2025-10-25T19:21:08.154402] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-25T19:21:08.154509] [INFO ] [MAIN ] Update Progress: 252/2366 symbols. BEPJ took 7.0s. Estimated remaining time: 3h 15m 46s [2025-10-25T19:21:08.318634] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:21:08.318869] [DEBUG] [LOCAL ] BFAM: No existing data file found in primary storage. [2025-10-25T19:21:08.318942] [WARN ] [MAIN ] BFAM: No existing data found, performing full refresh instead. [2025-10-25T19:21:08.319058] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-25T19:21:08.319129] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-25T19:21:08.319210] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-25T19:21:08.319280] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-25T19:21:08.668152] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:21:08.668494] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-25T19:21:10.079968] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T19:21:10.086698] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-25T19:21:11.445063] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-25T19:21:11.454410] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-25T19:21:12.879087] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T19:21:12.885629] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-25T19:21:14.415523] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T19:21:14.423859] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-25T19:21:15.948739] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T19:21:15.956241] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-25T19:21:17.397537] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T19:21:17.404254] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-25T19:21:18.762802] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T19:21:18.770467] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-25T19:21:20.170443] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T19:21:20.179959] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-25T19:21:21.742124] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T19:21:21.749979] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-25T19:21:23.254608] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T19:21:23.261546] [INFO ] [REMOTE ] BFAM: Full fetch complete (47486 records). [2025-10-25T19:21:23.261750] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-25T19:21:23.656474] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-25T19:21:23.656594] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-25T19:21:23.657401] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-25T19:21:23.657493] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-25T19:21:23.658852] [DEBUG] [LOCAL ] BFAM: Trimmed 47486 records to 34346 (keeping 200 days of data) [2025-10-25T19:21:23.857385] [DEBUG] [LOCAL ] BFAM: Primary data saved (34346 records). [2025-10-25T19:21:23.857592] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-25T19:21:23.857740] [INFO ] [MAIN ] Update Progress: 253/2366 symbols. BFAM took 15.7s. Estimated remaining time: 3h 17m 5s [2025-10-25T19:21:24.026063] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:21:24.026290] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-10-25T19:21:24.026363] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-10-25T19:21:24.026476] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-25T19:21:24.026547] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-25T19:21:24.026629] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-25T19:21:24.026721] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-25T19:21:24.382151] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:21:24.382523] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-25T19:21:25.908828] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T19:21:25.917021] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-25T19:21:27.566757] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T19:21:27.575143] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-25T19:21:29.368447] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T19:21:29.377957] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-25T19:21:31.124285] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T19:21:31.134938] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-25T19:21:32.798893] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T19:21:32.808203] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-25T19:21:34.330108] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T19:21:34.339299] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-25T19:21:35.944764] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T19:21:35.953911] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-25T19:21:37.509739] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T19:21:37.517597] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-25T19:21:38.930451] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T19:21:38.939609] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-25T19:21:40.518859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T19:21:40.527886] [INFO ] [REMOTE ] BFH: Full fetch complete (60243 records). [2025-10-25T19:21:40.528059] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-25T19:21:40.979426] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-25T19:21:40.979565] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-25T19:21:40.980234] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-25T19:21:40.980319] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-25T19:21:40.981718] [DEBUG] [LOCAL ] BFH: Trimmed 60243 records to 42050 (keeping 200 days of data) [2025-10-25T19:21:41.223167] [DEBUG] [LOCAL ] BFH: Primary data saved (42050 records). [2025-10-25T19:21:41.223344] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-25T19:21:41.223477] [INFO ] [MAIN ] Update Progress: 254/2366 symbols. BFH took 17.4s. Estimated remaining time: 3h 18m 37s [2025-10-25T19:21:41.396843] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:21:41.397060] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-25T19:21:41.397151] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-25T19:21:41.397286] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-25T19:21:41.397377] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-25T19:21:41.397484] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-25T19:21:41.397591] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-25T19:21:41.745216] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:21:41.745596] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-25T19:21:42.602802] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T19:21:42.606179] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-25T19:21:43.421295] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-25T19:21:43.423973] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-25T19:21:44.426458] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-25T19:21:44.430328] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-25T19:21:45.641115] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T19:21:45.645997] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-25T19:21:46.654883] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T19:21:46.657951] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-25T19:21:47.606675] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T19:21:47.610060] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-25T19:21:48.515296] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T19:21:48.518511] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-25T19:21:49.543160] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T19:21:49.546779] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-25T19:21:50.597545] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T19:21:50.601421] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-25T19:21:51.616115] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T19:21:51.619418] [INFO ] [REMOTE ] BFK: Full fetch complete (19283 records). [2025-10-25T19:21:51.619542] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-25T19:21:51.986708] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-25T19:21:51.986835] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-25T19:21:51.987194] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-25T19:21:51.987286] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-25T19:21:51.988115] [DEBUG] [LOCAL ] BFK: Trimmed 19283 records to 14046 (keeping 200 days of data) [2025-10-25T19:21:52.068703] [DEBUG] [LOCAL ] BFK: Primary data saved (14046 records). [2025-10-25T19:21:52.068874] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-25T19:21:52.068989] [INFO ] [MAIN ] Update Progress: 255/2366 symbols. BFK took 10.8s. Estimated remaining time: 3h 19m 15s [2025-10-25T19:21:52.236581] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:21:52.236819] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-10-25T19:21:52.236893] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-10-25T19:21:52.237024] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-25T19:21:52.237096] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-25T19:21:52.237177] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-25T19:21:52.237243] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-25T19:21:52.613069] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:21:52.613475] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-25T19:21:54.627003] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-25T19:21:54.637269] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-25T19:21:56.447905] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T19:21:56.457996] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-25T19:21:58.344222] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-25T19:21:58.360601] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-25T19:21:59.286205] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T19:21:59.297994] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-25T19:22:00.171504] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T19:22:00.183219] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-25T19:22:01.185623] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T19:22:01.196371] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-25T19:22:02.506327] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-25T19:22:02.517976] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-25T19:22:03.732349] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T19:22:03.743376] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-25T19:22:04.690838] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T19:22:04.703737] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-25T19:22:05.659338] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T19:22:05.669048] [INFO ] [REMOTE ] BFLY: Full fetch complete (75498 records). [2025-10-25T19:22:05.669208] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-25T19:22:06.072851] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-25T19:22:06.072992] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-25T19:22:06.073741] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-25T19:22:06.073824] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-25T19:22:06.075245] [DEBUG] [LOCAL ] BFLY: Trimmed 75498 records to 52623 (keeping 200 days of data) [2025-10-25T19:22:06.364021] [DEBUG] [LOCAL ] BFLY: Primary data saved (52623 records). [2025-10-25T19:22:06.364203] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-25T19:22:06.364323] [INFO ] [MAIN ] Update Progress: 256/2366 symbols. BFLY took 14.3s. Estimated remaining time: 3h 20m 20s [2025-10-25T19:22:06.551628] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:22:06.551880] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-25T19:22:06.551956] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-25T19:22:06.552070] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-25T19:22:06.552146] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-25T19:22:06.552229] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-25T19:22:06.552298] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-25T19:22:06.902874] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:22:06.903227] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-25T19:22:07.761207] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T19:22:07.763473] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-25T19:22:08.598513] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-25T19:22:08.600806] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-25T19:22:09.489381] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-25T19:22:09.491788] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-25T19:22:10.412628] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T19:22:10.415368] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-25T19:22:11.301177] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T19:22:11.303519] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-25T19:22:12.143870] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T19:22:12.146240] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-25T19:22:12.905291] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-25T19:22:12.908443] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-25T19:22:13.911038] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T19:22:13.913591] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-25T19:22:14.879734] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:22:14.882844] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-25T19:22:15.763783] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:22:15.767599] [INFO ] [REMOTE ] BFS: Full fetch complete (13066 records). [2025-10-25T19:22:15.767855] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-25T19:22:16.144390] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-25T19:22:16.144504] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-25T19:22:16.144759] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-25T19:22:16.144839] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-25T19:22:16.145345] [DEBUG] [LOCAL ] BFS: Trimmed 13066 records to 9682 (keeping 200 days of data) [2025-10-25T19:22:16.202198] [DEBUG] [LOCAL ] BFS: Primary data saved (9682 records). [2025-10-25T19:22:16.202363] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-25T19:22:16.202477] [INFO ] [MAIN ] Update Progress: 257/2366 symbols. BFS took 9.8s. Estimated remaining time: 3h 20m 49s [2025-10-25T19:22:16.372686] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:22:16.372891] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-10-25T19:22:16.372961] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-10-25T19:22:16.373073] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-25T19:22:16.373143] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-25T19:22:16.373221] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-25T19:22:16.373289] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-25T19:22:16.768467] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:22:16.768881] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-25T19:22:17.695474] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T19:22:17.698259] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-25T19:22:18.810809] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-25T19:22:18.814466] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-25T19:22:19.698408] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T19:22:19.701422] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-25T19:22:20.661571] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T19:22:20.664486] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-25T19:22:21.618193] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T19:22:21.620678] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-25T19:22:22.685705] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:22:22.689146] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-25T19:22:23.554991] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T19:22:23.557890] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-25T19:22:24.527044] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T19:22:24.530368] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-25T19:22:25.645870] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T19:22:25.650215] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-25T19:22:26.644589] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:22:26.647314] [INFO ] [REMOTE ] BFZ: Full fetch complete (17732 records). [2025-10-25T19:22:26.647430] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-25T19:22:27.004974] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-25T19:22:27.005090] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-25T19:22:27.005364] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-25T19:22:27.005461] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-25T19:22:27.006033] [DEBUG] [LOCAL ] BFZ: Trimmed 17732 records to 12259 (keeping 200 days of data) [2025-10-25T19:22:27.075992] [DEBUG] [LOCAL ] BFZ: Primary data saved (12259 records). [2025-10-25T19:22:27.076149] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-25T19:22:27.076262] [INFO ] [MAIN ] Update Progress: 258/2366 symbols. BFZ took 10.9s. Estimated remaining time: 3h 21m 25s [2025-10-25T19:22:27.241953] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:22:27.242148] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-10-25T19:22:27.242220] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-10-25T19:22:27.242309] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-25T19:22:27.242378] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-25T19:22:27.242444] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-25T19:22:27.242483] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-25T19:22:27.630624] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:22:27.630975] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-25T19:22:29.425448] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T19:22:29.435483] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-25T19:22:31.132601] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T19:22:31.142503] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-25T19:22:33.160568] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-25T19:22:33.170785] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-25T19:22:34.243538] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T19:22:34.253785] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-25T19:22:35.216870] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T19:22:35.227370] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-25T19:22:36.219423] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T19:22:36.229622] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-25T19:22:37.195605] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T19:22:37.207281] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-25T19:22:38.157020] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T19:22:38.168024] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-25T19:22:39.084296] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T19:22:39.095113] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-25T19:22:39.974886] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:22:39.984162] [INFO ] [REMOTE ] BG: Full fetch complete (73042 records). [2025-10-25T19:22:39.984342] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-25T19:22:40.391065] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-25T19:22:40.391212] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-25T19:22:40.392065] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-25T19:22:40.392150] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-25T19:22:40.393740] [DEBUG] [LOCAL ] BG: Trimmed 73042 records to 51175 (keeping 200 days of data) [2025-10-25T19:22:40.699741] [DEBUG] [LOCAL ] BG: Primary data saved (51175 records). [2025-10-25T19:22:40.699949] [INFO ] [MAIN ] BG: Full history saved. [2025-10-25T19:22:40.700118] [INFO ] [MAIN ] Update Progress: 259/2366 symbols. BG took 13.6s. Estimated remaining time: 3h 22m 23s [2025-10-25T19:22:40.871251] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:22:40.871455] [DEBUG] [LOCAL ] BGB: No existing data file found in primary storage. [2025-10-25T19:22:40.871558] [WARN ] [MAIN ] BGB: No existing data found, performing full refresh instead. [2025-10-25T19:22:40.871712] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-25T19:22:40.871800] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-25T19:22:40.871902] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-25T19:22:40.871984] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-25T19:22:41.235803] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:22:41.236211] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-25T19:22:42.387026] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T19:22:42.391943] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-25T19:22:43.532623] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T19:22:43.537790] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-25T19:22:44.689445] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T19:22:44.693499] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-25T19:22:45.997116] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T19:22:46.003589] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-25T19:22:47.114196] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T19:22:47.119490] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-25T19:22:48.234402] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T19:22:48.237997] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-25T19:22:49.348226] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T19:22:49.352456] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-25T19:22:50.390327] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T19:22:50.394302] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-25T19:22:51.367412] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:22:51.371255] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-25T19:22:52.453344] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T19:22:52.457170] [INFO ] [REMOTE ] BGB: Full fetch complete (26540 records). [2025-10-25T19:22:52.457293] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-25T19:22:52.830490] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-25T19:22:52.830626] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-25T19:22:52.831042] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-25T19:22:52.831155] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-25T19:22:52.831899] [DEBUG] [LOCAL ] BGB: Trimmed 26540 records to 17817 (keeping 200 days of data) [2025-10-25T19:22:52.935501] [DEBUG] [LOCAL ] BGB: Primary data saved (17817 records). [2025-10-25T19:22:52.935707] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-25T19:22:52.935839] [INFO ] [MAIN ] Update Progress: 260/2366 symbols. BGB took 12.2s. Estimated remaining time: 3h 23m 10s [2025-10-25T19:22:53.104509] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:22:53.104716] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-10-25T19:22:53.104800] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-10-25T19:22:53.104911] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-25T19:22:53.104980] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-25T19:22:53.105059] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-25T19:22:53.105127] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-25T19:22:53.453531] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:22:53.453906] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-25T19:22:54.366069] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T19:22:54.368608] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-25T19:22:55.282505] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T19:22:55.285498] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-25T19:22:56.303174] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T19:22:56.306909] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-25T19:22:57.458120] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T19:22:57.463383] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-25T19:22:58.594290] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T19:22:58.598526] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-25T19:23:05.091974] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (6.49 seconds). [2025-10-25T19:23:05.095509] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-25T19:23:06.625752] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T19:23:06.630085] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-25T19:23:08.081579] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T19:23:08.085779] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-25T19:23:09.189477] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T19:23:09.193758] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-25T19:23:11.273635] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-25T19:23:11.277298] [INFO ] [REMOTE ] BGH: Full fetch complete (23009 records). [2025-10-25T19:23:11.277416] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-25T19:23:11.650892] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-25T19:23:11.651009] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-25T19:23:11.651340] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-25T19:23:11.651416] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-25T19:23:11.652084] [DEBUG] [LOCAL ] BGH: Trimmed 23009 records to 17283 (keeping 200 days of data) [2025-10-25T19:23:11.752598] [DEBUG] [LOCAL ] BGH: Primary data saved (17283 records). [2025-10-25T19:23:11.752784] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-25T19:23:11.752877] [INFO ] [MAIN ] Update Progress: 261/2366 symbols. BGH took 18.8s. Estimated remaining time: 3h 24m 49s [2025-10-25T19:23:11.932238] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:23:11.932436] [DEBUG] [LOCAL ] BGR: No existing data file found in primary storage. [2025-10-25T19:23:11.932509] [WARN ] [MAIN ] BGR: No existing data found, performing full refresh instead. [2025-10-25T19:23:11.932662] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-25T19:23:11.932738] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-25T19:23:11.932820] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-25T19:23:11.932892] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-25T19:23:12.311944] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:23:12.312293] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-25T19:23:13.406947] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T19:23:13.410272] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-25T19:23:14.648631] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T19:23:14.652212] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-25T19:23:15.646810] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T19:23:15.650138] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-25T19:23:16.784206] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T19:23:16.790348] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-25T19:23:17.855906] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:23:17.859537] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-25T19:23:18.978978] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T19:23:18.984295] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-25T19:23:20.019673] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T19:23:20.022772] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-25T19:23:21.071119] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T19:23:21.074537] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-25T19:23:22.085001] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T19:23:22.088588] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-25T19:23:23.070494] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T19:23:23.073231] [INFO ] [REMOTE ] BGR: Full fetch complete (19878 records). [2025-10-25T19:23:23.073324] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-25T19:23:23.433213] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-25T19:23:23.433334] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-25T19:23:23.433615] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-25T19:23:23.433718] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-25T19:23:23.434261] [DEBUG] [LOCAL ] BGR: Trimmed 19878 records to 13583 (keeping 200 days of data) [2025-10-25T19:23:23.512510] [DEBUG] [LOCAL ] BGR: Primary data saved (13583 records). [2025-10-25T19:23:23.512681] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-25T19:23:23.512817] [INFO ] [MAIN ] Update Progress: 262/2366 symbols. BGR took 11.8s. Estimated remaining time: 3h 25m 31s [2025-10-25T19:23:23.678100] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:23:23.678268] [DEBUG] [LOCAL ] BGS: No existing data file found in primary storage. [2025-10-25T19:23:23.678344] [WARN ] [MAIN ] BGS: No existing data found, performing full refresh instead. [2025-10-25T19:23:23.678460] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-25T19:23:23.678535] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-25T19:23:23.678613] [DEBUG] [LOCAL ] BGS: No primary data file found to delete. [2025-10-25T19:23:23.678718] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-25T19:23:24.030593] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:23:24.030933] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-25T19:23:25.844134] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T19:23:25.853384] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-25T19:23:27.768925] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T19:23:27.778223] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-25T19:23:30.000478] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-25T19:23:30.010793] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-25T19:23:31.074107] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T19:23:31.084475] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-25T19:23:32.015890] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T19:23:32.026455] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-25T19:23:32.919677] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T19:23:32.929887] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-25T19:23:33.913800] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T19:23:33.925094] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-25T19:23:34.861839] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T19:23:34.872704] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-25T19:23:36.121258] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T19:23:36.131984] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-25T19:23:37.113159] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T19:23:37.122697] [INFO ] [REMOTE ] BGS: Full fetch complete (72669 records). [2025-10-25T19:23:37.122868] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-25T19:23:37.524176] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-25T19:23:37.524299] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-25T19:23:37.525036] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-25T19:23:37.525117] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-25T19:23:37.526542] [DEBUG] [LOCAL ] BGS: Trimmed 72669 records to 51254 (keeping 200 days of data) [2025-10-25T19:23:37.816386] [DEBUG] [LOCAL ] BGS: Primary data saved (51254 records). [2025-10-25T19:23:37.816613] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-25T19:23:37.816904] [INFO ] [MAIN ] Update Progress: 263/2366 symbols. BGS took 14.3s. Estimated remaining time: 3h 26m 33s [2025-10-25T19:23:37.983785] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:23:37.983991] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-10-25T19:23:37.984067] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-10-25T19:23:37.984180] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-25T19:23:37.984255] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-25T19:23:37.984344] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-25T19:23:37.984416] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-25T19:23:38.328712] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:23:38.329059] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-25T19:23:39.023341] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-25T19:23:39.024783] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-25T19:23:39.556982] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-25T19:23:39.558123] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-25T19:23:40.288923] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T19:23:40.290874] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-25T19:23:40.904367] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T19:23:40.906347] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-25T19:23:41.467399] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-25T19:23:41.468828] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-25T19:23:42.630545] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T19:23:42.633042] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-25T19:23:43.530715] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T19:23:43.533585] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-25T19:23:44.282685] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-25T19:23:44.284352] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-25T19:23:45.677287] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T19:23:45.683975] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-25T19:23:46.743752] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T19:23:46.746737] [INFO ] [REMOTE ] BGSF: Full fetch complete (9740 records). [2025-10-25T19:23:46.746853] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-25T19:23:47.162143] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-25T19:23:47.162265] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-25T19:23:47.162547] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-25T19:23:47.162607] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-25T19:23:47.163078] [DEBUG] [LOCAL ] BGSF: Trimmed 9740 records to 8349 (keeping 200 days of data) [2025-10-25T19:23:47.212732] [DEBUG] [LOCAL ] BGSF: Primary data saved (8349 records). [2025-10-25T19:23:47.212898] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-25T19:23:47.213011] [INFO ] [MAIN ] Update Progress: 264/2366 symbols. BGSF took 9.4s. Estimated remaining time: 3h 26m 55s [2025-10-25T19:23:47.404338] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:23:47.404556] [DEBUG] [LOCAL ] BGT: No existing data file found in primary storage. [2025-10-25T19:23:47.404618] [WARN ] [MAIN ] BGT: No existing data found, performing full refresh instead. [2025-10-25T19:23:47.404769] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-25T19:23:47.404865] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-25T19:23:47.404968] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-10-25T19:23:47.405044] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-25T19:23:47.781736] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:23:47.782142] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-25T19:23:49.022748] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T19:23:49.028099] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-25T19:23:50.040938] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T19:23:50.044424] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-25T19:23:51.124139] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-25T19:23:51.128257] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-25T19:23:52.179873] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T19:23:52.183993] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-25T19:23:53.247350] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T19:23:53.251113] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-25T19:23:54.406875] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T19:23:54.411011] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-25T19:23:55.530060] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T19:23:55.534995] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-25T19:23:56.567218] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:23:56.575157] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-25T19:23:57.579108] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T19:23:57.583259] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-25T19:23:58.539765] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T19:23:58.542792] [INFO ] [REMOTE ] BGT: Full fetch complete (24166 records). [2025-10-25T19:23:58.542885] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-25T19:23:58.922129] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-25T19:23:58.922310] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-25T19:23:58.922848] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-25T19:23:58.922937] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-25T19:23:58.924089] [DEBUG] [LOCAL ] BGT: Trimmed 24166 records to 16371 (keeping 200 days of data) [2025-10-25T19:23:59.025309] [DEBUG] [LOCAL ] BGT: Primary data saved (16371 records). [2025-10-25T19:23:59.025556] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-25T19:23:59.025725] [INFO ] [MAIN ] Update Progress: 265/2366 symbols. BGT took 11.8s. Estimated remaining time: 3h 27m 36s [2025-10-25T19:23:59.202294] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:23:59.202545] [DEBUG] [LOCAL ] BGX: No existing data file found in primary storage. [2025-10-25T19:23:59.202619] [WARN ] [MAIN ] BGX: No existing data found, performing full refresh instead. [2025-10-25T19:23:59.202787] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-25T19:23:59.202862] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-25T19:23:59.202945] [DEBUG] [LOCAL ] BGX: No primary data file found to delete. [2025-10-25T19:23:59.203017] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-25T19:23:59.559687] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:23:59.560161] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-25T19:24:00.392803] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-25T19:24:00.395770] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-25T19:24:01.441094] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T19:24:01.444065] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-25T19:24:02.513832] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T19:24:02.517082] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-25T19:24:03.422380] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T19:24:03.425209] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-25T19:24:04.278833] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T19:24:04.281676] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-25T19:24:05.229125] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T19:24:05.232016] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-25T19:24:06.160045] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:24:06.162677] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-25T19:24:07.086956] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T19:24:07.090138] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-25T19:24:08.106527] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T19:24:08.110031] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-25T19:24:09.160428] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T19:24:09.163556] [INFO ] [REMOTE ] BGX: Full fetch complete (16484 records). [2025-10-25T19:24:09.163699] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-25T19:24:09.551677] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-25T19:24:09.551790] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-25T19:24:09.552097] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-25T19:24:09.552176] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-25T19:24:09.552758] [DEBUG] [LOCAL ] BGX: Trimmed 16484 records to 11319 (keeping 200 days of data) [2025-10-25T19:24:09.617421] [DEBUG] [LOCAL ] BGX: Primary data saved (11319 records). [2025-10-25T19:24:09.617566] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-25T19:24:09.617703] [INFO ] [MAIN ] Update Progress: 266/2366 symbols. BGX took 10.6s. Estimated remaining time: 3h 28m 7s [2025-10-25T19:24:09.798817] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:24:09.799032] [DEBUG] [LOCAL ] BGY: No existing data file found in primary storage. [2025-10-25T19:24:09.799107] [WARN ] [MAIN ] BGY: No existing data found, performing full refresh instead. [2025-10-25T19:24:09.799224] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-25T19:24:09.799299] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-25T19:24:09.799384] [DEBUG] [LOCAL ] BGY: No primary data file found to delete. [2025-10-25T19:24:09.799458] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-25T19:24:10.176578] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:24:10.177012] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-25T19:24:11.356711] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T19:24:11.361929] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-25T19:24:12.583381] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T19:24:12.588433] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-25T19:24:13.868421] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-25T19:24:13.874778] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-25T19:24:15.115611] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T19:24:15.121624] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-25T19:24:16.215750] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T19:24:16.220723] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-25T19:24:17.518334] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T19:24:17.523625] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-25T19:24:18.743427] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T19:24:18.749541] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-25T19:24:19.888318] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T19:24:19.893261] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-25T19:24:20.920773] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T19:24:20.924837] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-25T19:24:22.078335] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T19:24:22.082458] [INFO ] [REMOTE ] BGY: Full fetch complete (32790 records). [2025-10-25T19:24:22.082590] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-25T19:24:22.452959] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-25T19:24:22.453091] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-25T19:24:22.453514] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-25T19:24:22.453592] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-25T19:24:22.454438] [DEBUG] [LOCAL ] BGY: Trimmed 32790 records to 21577 (keeping 200 days of data) [2025-10-25T19:24:22.572440] [DEBUG] [LOCAL ] BGY: Primary data saved (21577 records). [2025-10-25T19:24:22.572596] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-25T19:24:22.572725] [INFO ] [MAIN ] Update Progress: 267/2366 symbols. BGY took 13.0s. Estimated remaining time: 3h 28m 56s [2025-10-25T19:24:22.744327] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:24:22.744503] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-25T19:24:22.744569] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-25T19:24:22.744843] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-25T19:24:22.744917] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-25T19:24:22.744999] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-25T19:24:22.745065] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-25T19:24:23.105758] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:24:23.106123] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-25T19:24:24.003296] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T19:24:24.006155] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-25T19:24:24.680221] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T19:24:24.681902] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-25T19:24:25.489185] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T19:24:25.491638] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-25T19:24:26.414903] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T19:24:26.417188] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-25T19:24:27.431562] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T19:24:27.436092] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-25T19:24:28.507889] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:24:28.512868] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-25T19:24:29.588801] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T19:24:29.593730] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-25T19:24:30.873262] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T19:24:30.879403] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-25T19:24:32.107877] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T19:24:32.112851] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-25T19:24:33.138525] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T19:24:33.141938] [INFO ] [REMOTE ] BH: Full fetch complete (19534 records). [2025-10-25T19:24:33.142064] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-25T19:24:33.524389] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-25T19:24:33.524537] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-25T19:24:33.524979] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-25T19:24:33.525065] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-25T19:24:33.525952] [DEBUG] [LOCAL ] BH: Trimmed 19534 records to 16651 (keeping 200 days of data) [2025-10-25T19:24:33.628262] [DEBUG] [LOCAL ] BH: Primary data saved (16651 records). [2025-10-25T19:24:33.628501] [INFO ] [MAIN ] BH: Full history saved. [2025-10-25T19:24:33.628664] [INFO ] [MAIN ] Update Progress: 268/2366 symbols. BH took 11.1s. Estimated remaining time: 3h 29m 30s [2025-10-25T19:24:33.801481] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:24:33.801741] [DEBUG] [LOCAL ] BHC: No existing data file found in primary storage. [2025-10-25T19:24:33.801817] [WARN ] [MAIN ] BHC: No existing data found, performing full refresh instead. [2025-10-25T19:24:33.801942] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-25T19:24:33.802016] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-25T19:24:33.802099] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-10-25T19:24:33.802174] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-25T19:24:34.181533] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:24:34.181914] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-25T19:24:35.740418] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T19:24:35.749265] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-25T19:24:37.468311] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T19:24:37.478125] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-25T19:24:39.154722] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T19:24:39.165386] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-25T19:24:40.157351] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T19:24:40.168622] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-25T19:24:41.147531] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T19:24:41.159552] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-25T19:24:42.038113] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T19:24:42.048805] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-25T19:24:42.952752] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T19:24:42.963607] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-25T19:24:43.687938] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-25T19:24:43.698713] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-25T19:24:44.777289] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T19:24:44.788200] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-25T19:24:45.678491] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:24:45.688361] [INFO ] [REMOTE ] BHC: Full fetch complete (67561 records). [2025-10-25T19:24:45.688595] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-25T19:24:46.124292] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-25T19:24:46.124466] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-25T19:24:46.125453] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-25T19:24:46.125544] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-25T19:24:46.127498] [DEBUG] [LOCAL ] BHC: Trimmed 67561 records to 47252 (keeping 200 days of data) [2025-10-25T19:24:46.397942] [DEBUG] [LOCAL ] BHC: Primary data saved (47252 records). [2025-10-25T19:24:46.398239] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-25T19:24:46.398389] [INFO ] [MAIN ] Update Progress: 269/2366 symbols. BHC took 12.8s. Estimated remaining time: 3h 30m 16s [2025-10-25T19:24:46.571627] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:24:46.571902] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-10-25T19:24:46.571978] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-10-25T19:24:46.572107] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-25T19:24:46.572181] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-25T19:24:46.572243] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-25T19:24:46.572313] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-25T19:24:46.947926] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:24:46.948379] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-25T19:24:48.252009] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T19:24:48.258405] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-25T19:24:49.616363] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-25T19:24:49.622773] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-25T19:24:51.094470] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T19:24:51.101443] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-25T19:24:52.563730] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T19:24:52.570531] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-25T19:24:53.853380] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-25T19:24:53.861131] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-25T19:24:55.143317] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T19:24:55.148667] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-25T19:24:56.390705] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T19:24:56.395930] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-25T19:24:57.656098] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T19:24:57.661817] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-25T19:24:58.898388] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T19:24:58.903469] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-25T19:25:00.108744] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T19:25:00.113026] [INFO ] [REMOTE ] BHE: Full fetch complete (36344 records). [2025-10-25T19:25:00.113170] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-25T19:25:00.485566] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-25T19:25:00.485699] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-25T19:25:00.486132] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-25T19:25:00.486207] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-25T19:25:00.487091] [DEBUG] [LOCAL ] BHE: Trimmed 36344 records to 23916 (keeping 200 days of data) [2025-10-25T19:25:00.625433] [DEBUG] [LOCAL ] BHE: Primary data saved (23916 records). [2025-10-25T19:25:00.625597] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-25T19:25:00.625749] [INFO ] [MAIN ] Update Progress: 270/2366 symbols. BHE took 14.2s. Estimated remaining time: 3h 31m 14s [2025-10-25T19:25:00.794395] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:25:00.794597] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-25T19:25:00.794690] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-25T19:25:00.794806] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-25T19:25:00.794876] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-25T19:25:00.794958] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-25T19:25:00.795028] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-25T19:25:01.158539] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:25:01.158924] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-25T19:25:02.562518] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T19:25:02.566140] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-25T19:25:03.612456] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T19:25:03.615989] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-25T19:25:04.881348] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T19:25:04.885246] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-25T19:25:06.045497] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T19:25:06.049410] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-25T19:25:07.401922] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-25T19:25:07.407214] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-25T19:25:08.659979] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T19:25:08.665592] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-25T19:25:10.003438] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T19:25:10.009967] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-25T19:25:11.425818] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T19:25:11.431720] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-25T19:25:12.686684] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T19:25:12.693381] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-25T19:25:13.936510] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T19:25:13.940999] [INFO ] [REMOTE ] BHK: Full fetch complete (30695 records). [2025-10-25T19:25:13.941132] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-25T19:25:14.303449] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-25T19:25:14.303584] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-25T19:25:14.304011] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-25T19:25:14.304106] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-25T19:25:14.304975] [DEBUG] [LOCAL ] BHK: Trimmed 30695 records to 24267 (keeping 200 days of data) [2025-10-25T19:25:14.441376] [DEBUG] [LOCAL ] BHK: Primary data saved (24267 records). [2025-10-25T19:25:14.441553] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-25T19:25:14.441704] [INFO ] [MAIN ] Update Progress: 271/2366 symbols. BHK took 13.8s. Estimated remaining time: 3h 32m 8s [2025-10-25T19:25:14.608527] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:25:14.608773] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-25T19:25:14.608862] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-25T19:25:14.608997] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-25T19:25:14.609092] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-25T19:25:14.609205] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-25T19:25:14.609292] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-25T19:25:14.968379] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:25:14.968822] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-25T19:25:17.316533] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-25T19:25:17.326978] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-25T19:25:19.317016] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-25T19:25:19.327703] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-25T19:25:21.303550] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-25T19:25:21.314931] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-25T19:25:23.557209] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-25T19:25:23.568426] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-25T19:25:25.574716] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-25T19:25:25.585890] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-25T19:25:27.513500] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-25T19:25:27.524200] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-25T19:25:29.809631] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-25T19:25:29.821263] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-25T19:25:32.051282] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-25T19:25:32.062796] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-25T19:25:33.974634] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-25T19:25:33.985934] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-25T19:25:36.136237] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-25T19:25:36.146267] [INFO ] [REMOTE ] BHP: Full fetch complete (77437 records). [2025-10-25T19:25:36.146455] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-25T19:25:36.540317] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-25T19:25:36.540442] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-25T19:25:36.541215] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-25T19:25:36.541294] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-25T19:25:36.542733] [DEBUG] [LOCAL ] BHP: Trimmed 77437 records to 54141 (keeping 200 days of data) [2025-10-25T19:25:36.858154] [DEBUG] [LOCAL ] BHP: Primary data saved (54141 records). [2025-10-25T19:25:36.858329] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-25T19:25:36.858441] [INFO ] [MAIN ] Update Progress: 272/2366 symbols. BHP took 22.4s. Estimated remaining time: 3h 34m 8s [2025-10-25T19:25:37.033555] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:25:37.033792] [DEBUG] [LOCAL ] BHR: No existing data file found in primary storage. [2025-10-25T19:25:37.033865] [WARN ] [MAIN ] BHR: No existing data found, performing full refresh instead. [2025-10-25T19:25:37.033982] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-25T19:25:37.034052] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-25T19:25:37.034115] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-25T19:25:37.034184] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-25T19:25:37.396031] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:25:37.396391] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-25T19:25:38.535222] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T19:25:38.540386] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-25T19:25:39.642576] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T19:25:39.646478] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-25T19:25:40.769281] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T19:25:40.776934] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-25T19:25:42.027930] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T19:25:42.033672] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-25T19:25:43.542210] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T19:25:43.547072] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-25T19:25:45.340426] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-25T19:25:45.345353] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-25T19:25:46.464251] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T19:25:46.468877] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-25T19:25:47.645848] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-25T19:25:47.650586] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-25T19:25:49.034376] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T19:25:49.040608] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-25T19:25:50.225371] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T19:25:50.230244] [INFO ] [REMOTE ] BHR: Full fetch complete (31250 records). [2025-10-25T19:25:50.230343] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-25T19:25:50.597342] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-25T19:25:50.597458] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-25T19:25:50.597904] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-25T19:25:50.597985] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-25T19:25:50.598766] [DEBUG] [LOCAL ] BHR: Trimmed 31250 records to 22412 (keeping 200 days of data) [2025-10-25T19:25:50.720088] [DEBUG] [LOCAL ] BHR: Primary data saved (22412 records). [2025-10-25T19:25:50.720241] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-25T19:25:50.720351] [INFO ] [MAIN ] Update Progress: 273/2366 symbols. BHR took 13.9s. Estimated remaining time: 3h 35m 1s [2025-10-25T19:25:50.888509] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:25:50.888740] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-25T19:25:50.888820] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-25T19:25:50.888929] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-25T19:25:50.888999] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-25T19:25:50.889085] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-25T19:25:50.889154] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-25T19:25:51.237754] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:25:51.238084] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-25T19:25:51.718348] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-25T19:25:51.719218] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-25T19:25:52.147549] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-25T19:25:52.148590] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-25T19:25:52.545606] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-25T19:25:52.546510] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-25T19:25:52.988853] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-25T19:25:52.989908] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-25T19:25:53.544000] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-25T19:25:53.545367] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-25T19:25:53.983320] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-25T19:25:53.984310] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-25T19:25:54.418467] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-25T19:25:54.419443] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-25T19:25:54.921892] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-25T19:25:54.922990] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-25T19:25:55.586834] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T19:25:55.588326] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-25T19:25:56.070901] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T19:25:56.071797] [INFO ] [REMOTE ] BHV: Full fetch complete (1419 records). [2025-10-25T19:25:56.071886] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-25T19:25:56.253425] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-25T19:25:56.253664] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-25T19:25:56.253737] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-25T19:25:56.253850] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-25T19:25:56.253947] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-25T19:25:56.254019] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-25T19:25:56.254100] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-25T19:25:56.254218] [INFO ] [MAIN ] Update Progress: 274/2366 symbols. BHV took 5.5s. Estimated remaining time: 3h 34m 50s [2025-10-25T19:25:56.426873] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:25:56.427087] [DEBUG] [LOCAL ] BHVN: No existing data file found in primary storage. [2025-10-25T19:25:56.427159] [WARN ] [MAIN ] BHVN: No existing data found, performing full refresh instead. [2025-10-25T19:25:56.427272] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-25T19:25:56.427363] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-25T19:25:56.427449] [DEBUG] [LOCAL ] BHVN: No primary data file found to delete. [2025-10-25T19:25:56.427516] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-25T19:25:56.779976] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:25:56.780363] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-25T19:25:58.428922] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T19:25:58.437535] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-25T19:26:00.020885] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T19:26:00.029065] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-25T19:26:01.855161] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T19:26:01.864442] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-25T19:26:03.758324] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-25T19:26:03.769060] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-25T19:26:05.688370] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-25T19:26:05.699006] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-25T19:26:07.512052] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T19:26:07.527878] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-25T19:26:09.238747] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-25T19:26:09.249927] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-25T19:26:11.201207] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-25T19:26:11.212149] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-25T19:26:12.943509] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T19:26:12.955043] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-25T19:26:14.753883] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-25T19:26:14.767421] [INFO ] [REMOTE ] BHVN: Full fetch complete (70776 records). [2025-10-25T19:26:14.767696] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-25T19:26:15.169453] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-25T19:26:15.169598] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-25T19:26:15.170390] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-25T19:26:15.170475] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-25T19:26:15.171992] [DEBUG] [LOCAL ] BHVN: Trimmed 70776 records to 51373 (keeping 200 days of data) [2025-10-25T19:26:15.457276] [DEBUG] [LOCAL ] BHVN: Primary data saved (51373 records). [2025-10-25T19:26:15.457459] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-25T19:26:15.457580] [INFO ] [MAIN ] Update Progress: 275/2366 symbols. BHVN took 19.2s. Estimated remaining time: 3h 36m 23s [2025-10-25T19:26:15.628871] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:26:15.629038] [DEBUG] [LOCAL ] BILL: No existing data file found in primary storage. [2025-10-25T19:26:15.629123] [WARN ] [MAIN ] BILL: No existing data found, performing full refresh instead. [2025-10-25T19:26:15.629238] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-25T19:26:15.629309] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-25T19:26:15.629392] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-10-25T19:26:15.629463] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-25T19:26:16.018488] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:26:16.018903] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-25T19:26:17.965900] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-25T19:26:17.977315] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-25T19:26:20.002380] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-25T19:26:20.012331] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-25T19:26:21.985824] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T19:26:21.996553] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-25T19:26:22.943486] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T19:26:22.954162] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-25T19:26:23.831932] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T19:26:23.843381] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-25T19:26:24.733812] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T19:26:24.744458] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-25T19:26:25.786215] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T19:26:25.797546] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-25T19:26:26.837527] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T19:26:26.848954] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-25T19:26:27.832213] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T19:26:27.843467] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-25T19:26:28.746491] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:26:28.756325] [INFO ] [REMOTE ] BILL: Full fetch complete (76124 records). [2025-10-25T19:26:28.756489] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-25T19:26:29.149597] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-25T19:26:29.149744] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-25T19:26:29.150505] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-25T19:26:29.150581] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-25T19:26:29.152143] [DEBUG] [LOCAL ] BILL: Trimmed 76124 records to 53268 (keeping 200 days of data) [2025-10-25T19:26:29.456559] [DEBUG] [LOCAL ] BILL: Primary data saved (53268 records). [2025-10-25T19:26:29.456749] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-25T19:26:29.456870] [INFO ] [MAIN ] Update Progress: 276/2366 symbols. BILL took 14.0s. Estimated remaining time: 3h 37m 16s [2025-10-25T19:26:29.656309] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:26:29.656541] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-25T19:26:29.656616] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-25T19:26:29.656773] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-25T19:26:29.656846] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-25T19:26:29.656929] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-25T19:26:29.657000] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-25T19:26:30.028423] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:26:30.028868] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-25T19:26:31.156699] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T19:26:31.160553] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-25T19:26:32.601561] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T19:26:32.606979] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-25T19:26:34.129740] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T19:26:34.136068] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-25T19:26:35.547768] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T19:26:35.554283] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-25T19:26:36.790294] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T19:26:36.796091] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-25T19:26:38.328908] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T19:26:38.335602] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-25T19:26:39.488912] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T19:26:39.494943] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-25T19:26:40.663043] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T19:26:40.668424] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-25T19:26:41.799607] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T19:26:41.804379] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-25T19:26:43.009004] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T19:26:43.012800] [INFO ] [REMOTE ] BIO: Full fetch complete (34575 records). [2025-10-25T19:26:43.012897] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-25T19:26:43.380611] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-25T19:26:43.380739] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-25T19:26:43.381157] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-25T19:26:43.381239] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-25T19:26:43.382095] [DEBUG] [LOCAL ] BIO: Trimmed 34575 records to 24067 (keeping 200 days of data) [2025-10-25T19:26:43.520409] [DEBUG] [LOCAL ] BIO: Primary data saved (24067 records). [2025-10-25T19:26:43.520562] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-25T19:26:43.520715] [INFO ] [MAIN ] Update Progress: 277/2366 symbols. BIO took 14.1s. Estimated remaining time: 3h 38m 9s [2025-10-25T19:26:43.693690] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:26:43.693888] [DEBUG] [LOCAL ] BIP: No existing data file found in primary storage. [2025-10-25T19:26:43.693961] [WARN ] [MAIN ] BIP: No existing data found, performing full refresh instead. [2025-10-25T19:26:43.694075] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-25T19:26:43.694147] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-25T19:26:43.694227] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-10-25T19:26:43.694315] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-25T19:26:44.054244] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:26:44.054564] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-25T19:26:45.598217] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T19:26:45.605370] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-25T19:26:47.230849] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T19:26:47.238916] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-25T19:26:48.920245] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T19:26:48.930398] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-25T19:26:50.599211] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T19:26:50.608855] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-25T19:26:52.136605] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T19:26:52.144486] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-25T19:26:53.539353] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T19:26:53.547144] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-25T19:26:55.161424] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T19:26:55.170185] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-25T19:26:56.771767] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T19:26:56.781073] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-25T19:26:58.397055] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T19:26:58.406069] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-25T19:27:00.019023] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T19:27:00.026480] [INFO ] [REMOTE ] BIP: Full fetch complete (57634 records). [2025-10-25T19:27:00.026622] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-25T19:27:00.436248] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-25T19:27:00.436379] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-25T19:27:00.437006] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-25T19:27:00.437089] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-25T19:27:00.438356] [DEBUG] [LOCAL ] BIP: Trimmed 57634 records to 39408 (keeping 200 days of data) [2025-10-25T19:27:00.667879] [DEBUG] [LOCAL ] BIP: Primary data saved (39408 records). [2025-10-25T19:27:00.668042] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-25T19:27:00.668171] [INFO ] [MAIN ] Update Progress: 278/2366 symbols. BIP took 17.1s. Estimated remaining time: 3h 39m 24s [2025-10-25T19:27:00.833909] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:27:00.834095] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-10-25T19:27:00.834167] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-10-25T19:27:00.834278] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-25T19:27:00.834349] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-25T19:27:00.834428] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-25T19:27:00.834496] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-25T19:27:01.178794] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:27:01.179114] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-25T19:27:02.880020] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T19:27:02.887868] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-25T19:27:04.506740] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T19:27:04.515042] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-25T19:27:06.285389] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T19:27:06.295014] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-25T19:27:08.020472] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T19:27:08.030008] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-25T19:27:09.536865] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T19:27:09.546133] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-25T19:27:11.015741] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T19:27:11.023898] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-25T19:27:12.545135] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T19:27:12.554398] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-25T19:27:14.105161] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T19:27:14.114101] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-25T19:27:15.725631] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T19:27:15.739140] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-25T19:27:17.307360] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T19:27:17.315195] [INFO ] [REMOTE ] BIPC: Full fetch complete (60227 records). [2025-10-25T19:27:17.315337] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-25T19:27:17.693130] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-25T19:27:17.693269] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-25T19:27:17.693941] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-25T19:27:17.694023] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-25T19:27:17.695420] [DEBUG] [LOCAL ] BIPC: Trimmed 60227 records to 41611 (keeping 200 days of data) [2025-10-25T19:27:17.942472] [DEBUG] [LOCAL ] BIPC: Primary data saved (41611 records). [2025-10-25T19:27:17.942693] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-25T19:27:17.942795] [INFO ] [MAIN ] Update Progress: 279/2366 symbols. BIPC took 17.3s. Estimated remaining time: 3h 40m 40s [2025-10-25T19:27:18.118376] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:27:18.118571] [DEBUG] [LOCAL ] BIPH: No existing data file found in primary storage. [2025-10-25T19:27:18.118663] [WARN ] [MAIN ] BIPH: No existing data found, performing full refresh instead. [2025-10-25T19:27:18.118808] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-25T19:27:18.118883] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-25T19:27:18.118964] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-10-25T19:27:18.119036] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-25T19:27:18.481812] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:27:18.482227] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-25T19:27:19.183042] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T19:27:19.184738] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-25T19:27:19.838135] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-25T19:27:19.839289] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-25T19:27:20.409484] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T19:27:20.410896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-25T19:27:21.114158] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-25T19:27:21.115947] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-25T19:27:21.744245] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T19:27:21.745601] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-25T19:27:22.274304] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-25T19:27:22.276049] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-25T19:27:22.805354] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-25T19:27:22.807099] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-25T19:27:23.355161] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T19:27:23.356396] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-25T19:27:23.919955] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-25T19:27:23.921821] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-25T19:27:24.474850] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-25T19:27:24.475801] [INFO ] [REMOTE ] BIPH: Full fetch complete (3683 records). [2025-10-25T19:27:24.475890] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-25T19:27:24.851913] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-25T19:27:24.852059] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-25T19:27:24.852262] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-25T19:27:24.852376] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-25T19:27:24.853008] [DEBUG] [LOCAL ] BIPH: Trimmed 3683 records to 2371 (keeping 200 days of data) [2025-10-25T19:27:24.867491] [DEBUG] [LOCAL ] BIPH: Primary data saved (2371 records). [2025-10-25T19:27:24.867624] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-25T19:27:24.867888] [INFO ] [MAIN ] Update Progress: 280/2366 symbols. BIPH took 6.9s. Estimated remaining time: 3h 40m 38s [2025-10-25T19:27:25.043842] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:27:25.044066] [DEBUG] [LOCAL ] BIPI: No existing data file found in primary storage. [2025-10-25T19:27:25.044140] [WARN ] [MAIN ] BIPI: No existing data found, performing full refresh instead. [2025-10-25T19:27:25.044297] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-25T19:27:25.044371] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-25T19:27:25.044456] [DEBUG] [LOCAL ] BIPI: No primary data file found to delete. [2025-10-25T19:27:25.044532] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-25T19:27:25.404706] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:27:25.405040] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-25T19:27:26.010700] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T19:27:26.012011] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-25T19:27:26.535756] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-25T19:27:26.537082] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-25T19:27:27.247534] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T19:27:27.249557] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-25T19:27:27.913441] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-25T19:27:27.915012] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-25T19:27:28.513578] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T19:27:28.514860] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-25T19:27:29.112518] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-25T19:27:29.113838] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-25T19:27:29.703430] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-25T19:27:29.704808] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-25T19:27:30.330004] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-25T19:27:30.331467] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-25T19:27:30.966717] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T19:27:30.968258] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-25T19:27:31.571272] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T19:27:31.572346] [INFO ] [REMOTE ] BIPI: Full fetch complete (4506 records). [2025-10-25T19:27:31.572435] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-25T19:27:31.928996] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-25T19:27:31.929113] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-25T19:27:31.929353] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-25T19:27:31.929435] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-25T19:27:31.929912] [DEBUG] [LOCAL ] BIPI: Trimmed 4506 records to 2842 (keeping 200 days of data) [2025-10-25T19:27:31.947048] [DEBUG] [LOCAL ] BIPI: Primary data saved (2842 records). [2025-10-25T19:27:31.947151] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-25T19:27:31.947259] [INFO ] [MAIN ] Update Progress: 281/2366 symbols. BIPI took 7.1s. Estimated remaining time: 3h 40m 37s [2025-10-25T19:27:32.118667] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:27:32.118887] [DEBUG] [LOCAL ] BIPJ: No existing data file found in primary storage. [2025-10-25T19:27:32.118981] [WARN ] [MAIN ] BIPJ: No existing data found, performing full refresh instead. [2025-10-25T19:27:32.119100] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-25T19:27:32.119173] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-25T19:27:32.119257] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-25T19:27:32.119330] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-25T19:27:32.474075] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:27:32.474440] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-25T19:27:33.042151] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-25T19:27:33.043353] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-25T19:27:33.648965] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T19:27:33.650498] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-25T19:27:34.278675] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T19:27:34.279888] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-25T19:27:35.001339] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T19:27:35.003133] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-25T19:27:35.602347] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T19:27:35.603912] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-25T19:27:36.302530] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-25T19:27:36.304376] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-25T19:27:36.962025] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-25T19:27:36.963766] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-25T19:27:37.516680] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T19:27:37.518249] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-25T19:27:38.120838] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-25T19:27:38.122885] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-25T19:27:38.656415] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-25T19:27:38.658273] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4156 records). [2025-10-25T19:27:38.658400] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-25T19:27:39.061250] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-25T19:27:39.061387] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-25T19:27:39.061748] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-25T19:27:39.061834] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-25T19:27:39.062331] [DEBUG] [LOCAL ] BIPJ: Trimmed 4156 records to 3116 (keeping 200 days of data) [2025-10-25T19:27:39.081723] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3116 records). [2025-10-25T19:27:39.081873] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-25T19:27:39.082037] [INFO ] [MAIN ] Update Progress: 282/2366 symbols. BIPJ took 7.1s. Estimated remaining time: 3h 40m 36s [2025-10-25T19:27:39.257431] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:27:39.257738] [DEBUG] [LOCAL ] BIRK: No existing data file found in primary storage. [2025-10-25T19:27:39.257817] [WARN ] [MAIN ] BIRK: No existing data found, performing full refresh instead. [2025-10-25T19:27:39.257947] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-25T19:27:39.258050] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-25T19:27:39.258135] [DEBUG] [LOCAL ] BIRK: No primary data file found to delete. [2025-10-25T19:27:39.258207] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-25T19:27:39.619347] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:27:39.619834] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-25T19:27:41.192577] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T19:27:41.203121] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-25T19:27:42.883420] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T19:27:42.893402] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-25T19:27:44.768778] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T19:27:44.780577] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-25T19:27:46.490102] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-25T19:27:46.501529] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-25T19:27:48.226364] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T19:27:48.238337] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-25T19:27:49.902497] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T19:27:49.914907] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-25T19:27:51.786444] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-25T19:27:51.798782] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-25T19:27:53.565574] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T19:27:53.577267] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-25T19:27:55.270610] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T19:27:55.282459] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-25T19:27:57.001931] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-25T19:27:57.015989] [INFO ] [REMOTE ] BIRK: Full fetch complete (73422 records). [2025-10-25T19:27:57.016297] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-25T19:27:57.414584] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-25T19:27:57.414761] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-25T19:27:57.415787] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-25T19:27:57.415875] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-25T19:27:57.417955] [DEBUG] [LOCAL ] BIRK: Trimmed 73422 records to 51897 (keeping 200 days of data) [2025-10-25T19:27:57.723890] [DEBUG] [LOCAL ] BIRK: Primary data saved (51897 records). [2025-10-25T19:27:57.724115] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-25T19:27:57.724331] [INFO ] [MAIN ] Update Progress: 283/2366 symbols. BIRK took 18.6s. Estimated remaining time: 3h 42m 0s [2025-10-25T19:27:57.903046] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:27:57.903342] [DEBUG] [LOCAL ] BIT: No existing data file found in primary storage. [2025-10-25T19:27:57.903419] [WARN ] [MAIN ] BIT: No existing data found, performing full refresh instead. [2025-10-25T19:27:57.903639] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-25T19:27:57.903740] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-25T19:27:57.903823] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-10-25T19:27:57.903895] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-25T19:27:58.273467] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:27:58.273969] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-25T19:27:59.360781] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T19:27:59.365574] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-25T19:28:00.494616] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T19:28:00.499242] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-25T19:28:01.818241] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T19:28:01.824308] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-25T19:28:02.940270] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T19:28:02.945494] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-25T19:28:04.203125] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T19:28:04.208093] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-25T19:28:05.237923] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T19:28:05.241889] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-25T19:28:06.438888] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T19:28:06.444419] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-25T19:28:07.814416] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T19:28:07.821633] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-25T19:28:09.264895] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T19:28:09.273239] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-25T19:28:10.528864] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T19:28:10.534570] [INFO ] [REMOTE ] BIT: Full fetch complete (32409 records). [2025-10-25T19:28:10.534810] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-25T19:28:10.939531] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-25T19:28:10.939659] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-25T19:28:10.940107] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-25T19:28:10.940183] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-25T19:28:10.940950] [DEBUG] [LOCAL ] BIT: Trimmed 32409 records to 24068 (keeping 200 days of data) [2025-10-25T19:28:11.079053] [DEBUG] [LOCAL ] BIT: Primary data saved (24068 records). [2025-10-25T19:28:11.079201] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-25T19:28:11.079312] [INFO ] [MAIN ] Update Progress: 284/2366 symbols. BIT took 13.4s. Estimated remaining time: 3h 42m 45s [2025-10-25T19:28:11.247772] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:28:11.247944] [DEBUG] [LOCAL ] BJ: No existing data file found in primary storage. [2025-10-25T19:28:11.248015] [WARN ] [MAIN ] BJ: No existing data found, performing full refresh instead. [2025-10-25T19:28:11.248125] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-25T19:28:11.248192] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-25T19:28:11.248272] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-10-25T19:28:11.248341] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-25T19:28:11.593232] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:28:11.593696] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-25T19:28:13.538194] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T19:28:13.547968] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-25T19:28:15.103263] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T19:28:15.113007] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-25T19:28:16.999256] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-25T19:28:17.010341] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-25T19:28:19.195523] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-25T19:28:19.206596] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-25T19:28:21.291353] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-25T19:28:21.302221] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-25T19:28:23.113409] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T19:28:23.123787] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-25T19:28:24.888040] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-25T19:28:24.899363] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-25T19:28:26.705624] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T19:28:26.717277] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-25T19:28:28.452537] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-25T19:28:28.463548] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-25T19:28:30.199635] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T19:28:30.209437] [INFO ] [REMOTE ] BJ: Full fetch complete (74408 records). [2025-10-25T19:28:30.209611] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-25T19:28:30.592410] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-25T19:28:30.592541] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-25T19:28:30.593284] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-25T19:28:30.593366] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-25T19:28:30.594784] [DEBUG] [LOCAL ] BJ: Trimmed 74408 records to 52222 (keeping 200 days of data) [2025-10-25T19:28:30.889554] [DEBUG] [LOCAL ] BJ: Primary data saved (52222 records). [2025-10-25T19:28:30.889728] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-25T19:28:30.889843] [INFO ] [MAIN ] Update Progress: 285/2366 symbols. BJ took 19.8s. Estimated remaining time: 3h 44m 16s [2025-10-25T19:28:31.053258] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:28:31.053435] [DEBUG] [LOCAL ] BK: No existing data file found in primary storage. [2025-10-25T19:28:31.053505] [WARN ] [MAIN ] BK: No existing data found, performing full refresh instead. [2025-10-25T19:28:31.053616] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-25T19:28:31.053704] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-25T19:28:31.053784] [DEBUG] [LOCAL ] BK: No primary data file found to delete. [2025-10-25T19:28:31.053852] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-25T19:28:31.400726] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:28:31.401043] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-25T19:28:33.275197] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T19:28:33.285566] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-25T19:28:35.093067] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T19:28:35.103018] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-25T19:28:37.014890] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T19:28:37.026059] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-25T19:28:38.009333] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:28:38.020609] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-25T19:28:39.094828] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:28:39.107027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-25T19:28:40.070259] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T19:28:40.081004] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-25T19:28:41.230347] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T19:28:41.242046] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-25T19:28:42.292512] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T19:28:42.303889] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-25T19:28:43.331391] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T19:28:43.343391] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-25T19:28:44.247974] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:28:44.257756] [INFO ] [REMOTE ] BK: Full fetch complete (77670 records). [2025-10-25T19:28:44.257917] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-25T19:28:44.640858] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-25T19:28:44.640970] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-25T19:28:44.641742] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-25T19:28:44.641822] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-25T19:28:44.643227] [DEBUG] [LOCAL ] BK: Trimmed 77670 records to 54317 (keeping 200 days of data) [2025-10-25T19:28:44.965785] [DEBUG] [LOCAL ] BK: Primary data saved (54317 records). [2025-10-25T19:28:44.965965] [INFO ] [MAIN ] BK: Full history saved. [2025-10-25T19:28:44.966082] [INFO ] [MAIN ] Update Progress: 286/2366 symbols. BK took 14.1s. Estimated remaining time: 3h 45m 5s [2025-10-25T19:28:45.155574] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:28:45.155791] [DEBUG] [LOCAL ] BKD: No existing data file found in primary storage. [2025-10-25T19:28:45.155862] [WARN ] [MAIN ] BKD: No existing data found, performing full refresh instead. [2025-10-25T19:28:45.155979] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-25T19:28:45.156052] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-25T19:28:45.156134] [DEBUG] [LOCAL ] BKD: No primary data file found to delete. [2025-10-25T19:28:45.156204] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-25T19:28:45.542011] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:28:45.542328] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-25T19:28:47.022907] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T19:28:47.035126] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-25T19:28:48.681069] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T19:28:48.690240] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-25T19:28:50.281373] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T19:28:50.292051] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-25T19:28:51.253919] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T19:28:51.264915] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-25T19:28:52.328774] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T19:28:52.339165] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-25T19:28:53.384939] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T19:28:53.395183] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-25T19:28:54.284050] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T19:28:54.295875] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-25T19:28:55.133260] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T19:28:55.144046] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-25T19:28:56.251293] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T19:28:56.264056] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-25T19:28:57.234765] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:28:57.244435] [INFO ] [REMOTE ] BKD: Full fetch complete (72046 records). [2025-10-25T19:28:57.244701] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-25T19:28:57.654297] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-25T19:28:57.654561] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-25T19:28:57.655491] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-25T19:28:57.655585] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-25T19:28:57.657720] [DEBUG] [LOCAL ] BKD: Trimmed 72046 records to 51079 (keeping 200 days of data) [2025-10-25T19:28:57.957859] [DEBUG] [LOCAL ] BKD: Primary data saved (51079 records). [2025-10-25T19:28:57.958216] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-25T19:28:57.958367] [INFO ] [MAIN ] Update Progress: 287/2366 symbols. BKD took 13.0s. Estimated remaining time: 3h 45m 46s [2025-10-25T19:28:58.148828] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:28:58.149125] [DEBUG] [LOCAL ] BKE: No existing data file found in primary storage. [2025-10-25T19:28:58.149201] [WARN ] [MAIN ] BKE: No existing data found, performing full refresh instead. [2025-10-25T19:28:58.149331] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-25T19:28:58.149405] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-25T19:28:58.149496] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-25T19:28:58.149574] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-25T19:28:58.509860] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:28:58.510269] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-25T19:29:00.245052] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T19:29:00.253635] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-25T19:29:01.914224] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T19:29:01.922211] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-25T19:29:03.518473] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T19:29:03.527381] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-25T19:29:05.122216] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T19:29:05.130355] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-25T19:29:06.586352] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T19:29:06.593870] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-25T19:29:08.009348] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T19:29:08.017075] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-25T19:29:09.529435] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T19:29:09.536539] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-25T19:29:11.053716] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T19:29:11.061537] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-25T19:29:12.629389] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T19:29:12.637029] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-25T19:29:14.056131] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T19:29:14.062152] [INFO ] [REMOTE ] BKE: Full fetch complete (50095 records). [2025-10-25T19:29:14.062276] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-25T19:29:14.436842] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-25T19:29:14.436974] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-25T19:29:14.437522] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-25T19:29:14.437599] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-25T19:29:14.438686] [DEBUG] [LOCAL ] BKE: Trimmed 50095 records to 34000 (keeping 200 days of data) [2025-10-25T19:29:14.639095] [DEBUG] [LOCAL ] BKE: Primary data saved (34000 records). [2025-10-25T19:29:14.639257] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-25T19:29:14.639371] [INFO ] [MAIN ] Update Progress: 288/2366 symbols. BKE took 16.7s. Estimated remaining time: 3h 46m 53s [2025-10-25T19:29:14.802683] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:29:14.802871] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-25T19:29:14.802940] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-25T19:29:14.803052] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-25T19:29:14.803122] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-25T19:29:14.803201] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-25T19:29:14.803271] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-25T19:29:15.150368] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:29:15.150751] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-25T19:29:16.797426] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T19:29:16.804979] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-25T19:29:18.253848] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T19:29:18.260911] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-25T19:29:19.842412] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T19:29:19.849970] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-25T19:29:21.632864] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T19:29:21.640728] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-25T19:29:23.128979] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-25T19:29:23.136346] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-25T19:29:24.663809] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T19:29:24.671174] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-25T19:29:26.319463] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T19:29:26.328797] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-25T19:29:27.958779] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T19:29:27.967954] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-25T19:29:29.543031] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T19:29:29.551279] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-25T19:29:31.090565] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T19:29:31.098195] [INFO ] [REMOTE ] BKH: Full fetch complete (53302 records). [2025-10-25T19:29:31.098330] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-25T19:29:31.479517] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-25T19:29:31.479628] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-25T19:29:31.480227] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-25T19:29:31.480305] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-25T19:29:31.481433] [DEBUG] [LOCAL ] BKH: Trimmed 53302 records to 37992 (keeping 200 days of data) [2025-10-25T19:29:31.703337] [DEBUG] [LOCAL ] BKH: Primary data saved (37992 records). [2025-10-25T19:29:31.703554] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-25T19:29:31.703706] [INFO ] [MAIN ] Update Progress: 289/2366 symbols. BKH took 17.1s. Estimated remaining time: 3h 48m 2s [2025-10-25T19:29:31.872458] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:29:31.872673] [DEBUG] [LOCAL ] BKKT: No existing data file found in primary storage. [2025-10-25T19:29:31.872750] [WARN ] [MAIN ] BKKT: No existing data found, performing full refresh instead. [2025-10-25T19:29:31.872862] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-25T19:29:31.872932] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-25T19:29:31.873013] [DEBUG] [LOCAL ] BKKT: No primary data file found to delete. [2025-10-25T19:29:31.873082] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-25T19:29:32.221593] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:29:32.221962] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-25T19:29:33.843450] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T19:29:33.850797] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-25T19:29:35.351027] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T19:29:35.356956] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-25T19:29:37.125581] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T19:29:37.134697] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-25T19:29:38.489917] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-25T19:29:38.495489] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-25T19:29:39.942027] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T19:29:39.948498] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-25T19:29:41.408627] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T19:29:41.415851] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-25T19:29:43.500253] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-25T19:29:43.514822] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-25T19:29:45.392833] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-25T19:29:45.403238] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-25T19:29:47.379264] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-25T19:29:47.389405] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-25T19:29:49.699030] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-25T19:29:49.708265] [INFO ] [REMOTE ] BKKT: Full fetch complete (52220 records). [2025-10-25T19:29:49.708393] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-25T19:29:50.107142] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-25T19:29:50.107253] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-25T19:29:50.107849] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-25T19:29:50.107929] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-25T19:29:50.109013] [DEBUG] [LOCAL ] BKKT: Trimmed 52220 records to 38106 (keeping 200 days of data) [2025-10-25T19:29:50.321428] [DEBUG] [LOCAL ] BKKT: Primary data saved (38106 records). [2025-10-25T19:29:50.321603] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-25T19:29:50.321761] [INFO ] [MAIN ] Update Progress: 290/2366 symbols. BKKT took 18.6s. Estimated remaining time: 3h 49m 21s [2025-10-25T19:29:50.487166] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:29:50.487371] [DEBUG] [LOCAL ] BKN: No existing data file found in primary storage. [2025-10-25T19:29:50.487458] [WARN ] [MAIN ] BKN: No existing data found, performing full refresh instead. [2025-10-25T19:29:50.487613] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-25T19:29:50.487716] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-25T19:29:50.487840] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-10-25T19:29:50.487928] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-25T19:29:50.841785] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:29:50.842134] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-25T19:29:51.719560] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T19:29:51.722794] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-25T19:29:52.439119] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T19:29:52.441041] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-25T19:29:53.374525] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T19:29:53.377158] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-25T19:29:54.186373] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T19:29:54.189076] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-25T19:29:55.025236] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T19:29:55.027484] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-25T19:29:55.931009] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T19:29:55.933229] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-25T19:29:56.777703] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T19:29:56.781259] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-25T19:29:57.515533] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T19:29:57.518012] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-25T19:29:58.397483] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-25T19:29:58.399832] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-25T19:29:59.126566] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T19:29:59.128292] [INFO ] [REMOTE ] BKN: Full fetch complete (11046 records). [2025-10-25T19:29:59.128395] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-25T19:29:59.497110] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-25T19:29:59.497252] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-25T19:29:59.497714] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-25T19:29:59.497816] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-25T19:29:59.498382] [DEBUG] [LOCAL ] BKN: Trimmed 11046 records to 7384 (keeping 200 days of data) [2025-10-25T19:29:59.546602] [DEBUG] [LOCAL ] BKN: Primary data saved (7384 records). [2025-10-25T19:29:59.546878] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-25T19:29:59.547019] [INFO ] [MAIN ] Update Progress: 291/2366 symbols. BKN took 9.2s. Estimated remaining time: 3h 49m 33s [2025-10-25T19:29:59.723809] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:29:59.724090] [DEBUG] [LOCAL ] BKSY: No existing data file found in primary storage. [2025-10-25T19:29:59.724198] [WARN ] [MAIN ] BKSY: No existing data found, performing full refresh instead. [2025-10-25T19:29:59.724330] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-25T19:29:59.724459] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-25T19:29:59.724546] [DEBUG] [LOCAL ] BKSY: No primary data file found to delete. [2025-10-25T19:29:59.724618] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-25T19:30:00.132593] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:30:00.133253] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-25T19:30:02.104191] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T19:30:02.113751] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-25T19:30:04.163328] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-25T19:30:04.173147] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-25T19:30:06.163554] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T19:30:06.173791] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-25T19:30:07.170974] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T19:30:07.181245] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-25T19:30:08.113575] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T19:30:08.123197] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-25T19:30:09.062346] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:30:09.072459] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-25T19:30:10.080846] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T19:30:10.092055] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-25T19:30:11.095510] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T19:30:11.106037] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-25T19:30:12.099539] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T19:30:12.110386] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-25T19:30:13.144082] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T19:30:13.153716] [INFO ] [REMOTE ] BKSY: Full fetch complete (70687 records). [2025-10-25T19:30:13.153920] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-25T19:30:13.559368] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-25T19:30:13.559501] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-25T19:30:13.560324] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-25T19:30:13.560412] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-25T19:30:13.561839] [DEBUG] [LOCAL ] BKSY: Trimmed 70687 records to 49624 (keeping 200 days of data) [2025-10-25T19:30:13.842972] [DEBUG] [LOCAL ] BKSY: Primary data saved (49624 records). [2025-10-25T19:30:13.843156] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-25T19:30:13.843276] [INFO ] [MAIN ] Update Progress: 292/2366 symbols. BKSY took 14.3s. Estimated remaining time: 3h 50m 21s [2025-10-25T19:30:14.021968] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:30:14.022181] [DEBUG] [LOCAL ] BKT: No existing data file found in primary storage. [2025-10-25T19:30:14.022253] [WARN ] [MAIN ] BKT: No existing data found, performing full refresh instead. [2025-10-25T19:30:14.022396] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-25T19:30:14.022473] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-25T19:30:14.022556] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-10-25T19:30:14.022669] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-25T19:30:14.385559] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:30:14.385993] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-25T19:30:15.181751] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T19:30:15.184149] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-25T19:30:16.222130] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-25T19:30:16.226238] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-25T19:30:17.122742] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T19:30:17.125245] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-25T19:30:18.119739] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T19:30:18.122955] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-25T19:30:19.081004] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T19:30:19.085063] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-25T19:30:19.945243] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T19:30:19.948545] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-25T19:30:20.543928] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-25T19:30:20.546524] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-25T19:30:21.341017] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T19:30:21.344356] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-25T19:30:22.404749] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T19:30:22.409481] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-25T19:30:23.677126] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T19:30:23.681304] [INFO ] [REMOTE ] BKT: Full fetch complete (16745 records). [2025-10-25T19:30:23.681409] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-25T19:30:24.042228] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-25T19:30:24.042337] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-25T19:30:24.042687] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-25T19:30:24.042770] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-25T19:30:24.043449] [DEBUG] [LOCAL ] BKT: Trimmed 16745 records to 12963 (keeping 200 days of data) [2025-10-25T19:30:24.117596] [DEBUG] [LOCAL ] BKT: Primary data saved (12963 records). [2025-10-25T19:30:24.117800] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-25T19:30:24.117955] [INFO ] [MAIN ] Update Progress: 293/2366 symbols. BKT took 10.3s. Estimated remaining time: 3h 50m 40s [2025-10-25T19:30:24.290409] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:30:24.290619] [DEBUG] [LOCAL ] BKU: No existing data file found in primary storage. [2025-10-25T19:30:24.290727] [WARN ] [MAIN ] BKU: No existing data found, performing full refresh instead. [2025-10-25T19:30:24.290913] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-25T19:30:24.290999] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-25T19:30:24.291110] [DEBUG] [LOCAL ] BKU: No primary data file found to delete. [2025-10-25T19:30:24.291190] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-25T19:30:24.646165] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:30:24.646492] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-25T19:30:26.362006] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T19:30:26.370850] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-25T19:30:27.816951] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T19:30:27.825715] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-25T19:30:29.533208] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T19:30:29.542100] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-25T19:30:31.244349] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T19:30:31.254052] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-25T19:30:32.835358] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T19:30:32.844185] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-25T19:30:34.670864] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T19:30:34.679765] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-25T19:30:36.281373] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T19:30:36.291023] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-25T19:30:37.770275] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T19:30:37.782214] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-25T19:30:39.319190] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T19:30:39.327768] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-25T19:30:40.975818] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T19:30:40.984463] [INFO ] [REMOTE ] BKU: Full fetch complete (61080 records). [2025-10-25T19:30:40.984635] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-25T19:30:41.380833] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-25T19:30:41.380950] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-25T19:30:41.381689] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-25T19:30:41.381773] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-25T19:30:41.383042] [DEBUG] [LOCAL ] BKU: Trimmed 61080 records to 42767 (keeping 200 days of data) [2025-10-25T19:30:41.633732] [DEBUG] [LOCAL ] BKU: Primary data saved (42767 records). [2025-10-25T19:30:41.633884] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-25T19:30:41.633997] [INFO ] [MAIN ] Update Progress: 294/2366 symbols. BKU took 17.5s. Estimated remaining time: 3h 51m 50s [2025-10-25T19:30:41.804135] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:30:41.804339] [DEBUG] [LOCAL ] BKV: No existing data file found in primary storage. [2025-10-25T19:30:41.804418] [WARN ] [MAIN ] BKV: No existing data found, performing full refresh instead. [2025-10-25T19:30:41.804755] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-25T19:30:41.804831] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-25T19:30:41.804914] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-25T19:30:41.804990] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-25T19:30:42.156224] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:30:42.156596] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-25T19:30:43.609735] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T19:30:43.616261] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-25T19:30:45.113103] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T19:30:45.119958] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-25T19:30:46.619282] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T19:30:46.627319] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-25T19:30:48.046447] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T19:30:48.053599] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-25T19:30:49.494967] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-25T19:30:49.501834] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-25T19:30:51.709197] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-25T19:30:51.716228] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-25T19:30:53.212927] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T19:30:53.220127] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-25T19:30:54.374271] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T19:30:54.382301] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-25T19:30:55.727266] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T19:30:55.733576] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-25T19:30:57.021512] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T19:30:57.027420] [INFO ] [REMOTE ] BKV: Full fetch complete (44834 records). [2025-10-25T19:30:57.027535] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-25T19:30:57.398919] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-25T19:30:57.399022] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-25T19:30:57.399538] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-25T19:30:57.399615] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-25T19:30:57.400546] [DEBUG] [LOCAL ] BKV: Trimmed 44834 records to 29719 (keeping 200 days of data) [2025-10-25T19:30:57.564832] [DEBUG] [LOCAL ] BKV: Primary data saved (29719 records). [2025-10-25T19:30:57.564980] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-25T19:30:57.565094] [INFO ] [MAIN ] Update Progress: 295/2366 symbols. BKV took 15.9s. Estimated remaining time: 3h 52m 48s [2025-10-25T19:30:57.734810] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:30:57.734980] [DEBUG] [LOCAL ] BLCO: No existing data file found in primary storage. [2025-10-25T19:30:57.735078] [WARN ] [MAIN ] BLCO: No existing data found, performing full refresh instead. [2025-10-25T19:30:57.735197] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-25T19:30:57.735270] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-25T19:30:57.735351] [DEBUG] [LOCAL ] BLCO: No primary data file found to delete. [2025-10-25T19:30:57.735421] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-25T19:30:58.087382] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:30:58.087872] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-25T19:30:59.465723] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T19:30:59.472907] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-25T19:31:01.389735] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T19:31:01.397906] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-25T19:31:03.132580] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T19:31:03.140797] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-25T19:31:04.856453] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T19:31:04.865195] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-25T19:31:06.496004] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T19:31:06.504065] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-25T19:31:07.931741] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T19:31:07.939292] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-25T19:31:09.410113] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T19:31:09.418480] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-25T19:31:10.860862] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T19:31:10.868082] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-25T19:31:12.294131] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T19:31:12.301114] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-25T19:31:13.644736] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-25T19:31:13.650923] [INFO ] [REMOTE ] BLCO: Full fetch complete (52153 records). [2025-10-25T19:31:13.651082] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-25T19:31:14.062398] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-25T19:31:14.062536] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-25T19:31:14.063223] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-25T19:31:14.063306] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-25T19:31:14.064502] [DEBUG] [LOCAL ] BLCO: Trimmed 52153 records to 35220 (keeping 200 days of data) [2025-10-25T19:31:14.274873] [DEBUG] [LOCAL ] BLCO: Primary data saved (35220 records). [2025-10-25T19:31:14.275045] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-25T19:31:14.275160] [INFO ] [MAIN ] Update Progress: 296/2366 symbols. BLCO took 16.7s. Estimated remaining time: 3h 53m 50s [2025-10-25T19:31:14.441559] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:31:14.441806] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-10-25T19:31:14.441897] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-10-25T19:31:14.442013] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-25T19:31:14.442086] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-25T19:31:14.442168] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-25T19:31:14.442245] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-25T19:31:14.826190] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:31:14.826596] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-25T19:31:16.154952] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-25T19:31:16.160309] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-25T19:31:17.701787] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T19:31:17.707715] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-25T19:31:19.049443] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T19:31:19.055927] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-25T19:31:20.472473] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T19:31:20.478298] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-25T19:31:21.747403] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T19:31:21.753092] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-25T19:31:23.093166] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T19:31:23.100101] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-25T19:31:24.601037] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T19:31:24.607828] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-25T19:31:25.944737] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T19:31:25.951370] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-25T19:31:27.258322] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T19:31:27.264298] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-25T19:31:28.420534] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T19:31:28.425102] [INFO ] [REMOTE ] BLD: Full fetch complete (39836 records). [2025-10-25T19:31:28.425215] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-25T19:31:28.799509] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-25T19:31:28.799633] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-25T19:31:28.800263] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-25T19:31:28.800345] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-25T19:31:28.801281] [DEBUG] [LOCAL ] BLD: Trimmed 39836 records to 27346 (keeping 200 days of data) [2025-10-25T19:31:28.957501] [DEBUG] [LOCAL ] BLD: Primary data saved (27346 records). [2025-10-25T19:31:28.957676] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-25T19:31:28.957800] [INFO ] [MAIN ] Update Progress: 297/2366 symbols. BLD took 14.7s. Estimated remaining time: 3h 54m 39s [2025-10-25T19:31:29.126437] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:31:29.126605] [DEBUG] [LOCAL ] BLDR: No existing data file found in primary storage. [2025-10-25T19:31:29.126695] [WARN ] [MAIN ] BLDR: No existing data found, performing full refresh instead. [2025-10-25T19:31:29.126806] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-25T19:31:29.126898] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-25T19:31:29.126989] [DEBUG] [LOCAL ] BLDR: No primary data file found to delete. [2025-10-25T19:31:29.127057] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-25T19:31:29.489912] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:31:29.490279] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-25T19:31:31.485142] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T19:31:31.495327] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-25T19:31:33.280461] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T19:31:33.290437] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-25T19:31:35.239724] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T19:31:35.250196] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-25T19:31:36.335812] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T19:31:36.346800] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-25T19:31:37.322099] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T19:31:37.333301] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-25T19:31:38.571840] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-25T19:31:38.582230] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-25T19:31:39.632681] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T19:31:39.645962] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-25T19:31:40.656025] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T19:31:40.668224] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-25T19:31:41.584420] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T19:31:41.597148] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-25T19:31:42.473353] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:31:42.482954] [INFO ] [REMOTE ] BLDR: Full fetch complete (74779 records). [2025-10-25T19:31:42.483121] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-25T19:31:42.867844] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-25T19:31:42.867975] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-25T19:31:42.868791] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-25T19:31:42.868876] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-25T19:31:42.870265] [DEBUG] [LOCAL ] BLDR: Trimmed 74779 records to 52578 (keeping 200 days of data) [2025-10-25T19:31:43.182356] [DEBUG] [LOCAL ] BLDR: Primary data saved (52578 records). [2025-10-25T19:31:43.182535] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-25T19:31:43.182637] [INFO ] [MAIN ] Update Progress: 298/2366 symbols. BLDR took 14.2s. Estimated remaining time: 3h 55m 23s [2025-10-25T19:31:43.352240] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:31:43.352473] [DEBUG] [LOCAL ] BLE: No existing data file found in primary storage. [2025-10-25T19:31:43.352546] [WARN ] [MAIN ] BLE: No existing data found, performing full refresh instead. [2025-10-25T19:31:43.352631] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-25T19:31:43.352721] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-25T19:31:43.352788] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-10-25T19:31:43.352828] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-25T19:31:43.699017] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:31:43.699327] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-25T19:31:44.749299] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T19:31:44.752267] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-25T19:31:45.605973] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-25T19:31:45.608535] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-25T19:31:46.744033] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T19:31:46.748398] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-25T19:31:47.986034] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T19:31:47.991942] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-25T19:31:48.922869] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T19:31:48.926338] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-25T19:31:50.014613] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T19:31:50.019135] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-25T19:31:50.972618] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T19:31:50.976132] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-25T19:31:51.813393] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T19:31:51.816552] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-25T19:31:52.750431] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T19:31:52.753696] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-25T19:31:53.751670] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T19:31:53.754481] [INFO ] [REMOTE ] BLE: Full fetch complete (19498 records). [2025-10-25T19:31:53.754599] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-25T19:31:54.150636] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-25T19:31:54.150918] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-25T19:31:54.151733] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-25T19:31:54.151855] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-25T19:31:54.152934] [DEBUG] [LOCAL ] BLE: Trimmed 19498 records to 13757 (keeping 200 days of data) [2025-10-25T19:31:54.236030] [DEBUG] [LOCAL ] BLE: Primary data saved (13757 records). [2025-10-25T19:31:54.236213] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-25T19:31:54.236337] [INFO ] [MAIN ] Update Progress: 299/2366 symbols. BLE took 11.1s. Estimated remaining time: 3h 55m 46s [2025-10-25T19:31:54.425080] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:31:54.425282] [DEBUG] [LOCAL ] BLK: No existing data file found in primary storage. [2025-10-25T19:31:54.425381] [WARN ] [MAIN ] BLK: No existing data found, performing full refresh instead. [2025-10-25T19:31:54.425499] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-25T19:31:54.425570] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-25T19:31:54.425677] [DEBUG] [LOCAL ] BLK: No primary data file found to delete. [2025-10-25T19:31:54.425752] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-25T19:31:54.779748] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:31:54.780147] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-25T19:31:56.875028] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-25T19:31:56.883149] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-25T19:31:58.672526] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T19:31:58.683709] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-25T19:32:00.551746] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T19:32:00.561731] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-25T19:32:02.495342] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-25T19:32:02.504424] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-25T19:32:04.208586] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T19:32:04.216314] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-25T19:32:05.901684] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-25T19:32:05.909272] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-25T19:32:07.845666] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-25T19:32:07.858112] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-25T19:32:09.374101] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T19:32:09.380539] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-25T19:32:11.018186] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T19:32:11.025251] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-25T19:32:12.784037] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-25T19:32:12.790766] [INFO ] [REMOTE ] BLK: Full fetch complete (52835 records). [2025-10-25T19:32:12.790914] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-25T19:32:13.183868] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-25T19:32:13.183981] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-25T19:32:13.184763] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-25T19:32:13.184867] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-25T19:32:13.185939] [DEBUG] [LOCAL ] BLK: Trimmed 52835 records to 34575 (keeping 200 days of data) [2025-10-25T19:32:13.400359] [DEBUG] [LOCAL ] BLK: Primary data saved (34575 records). [2025-10-25T19:32:13.400522] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-25T19:32:13.400663] [INFO ] [MAIN ] Update Progress: 300/2366 symbols. BLK took 19.2s. Estimated remaining time: 3h 57m 4s [2025-10-25T19:32:13.574724] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:32:13.574908] [DEBUG] [LOCAL ] BLND: No existing data file found in primary storage. [2025-10-25T19:32:13.574978] [WARN ] [MAIN ] BLND: No existing data found, performing full refresh instead. [2025-10-25T19:32:13.575089] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-25T19:32:13.575159] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-25T19:32:13.575219] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-10-25T19:32:13.575281] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-25T19:32:13.941505] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:32:13.942139] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-25T19:32:15.693479] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T19:32:15.703518] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-25T19:32:17.510678] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T19:32:17.520218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-25T19:32:19.392445] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T19:32:19.403171] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-25T19:32:21.338094] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-25T19:32:21.348504] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-25T19:32:23.081157] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T19:32:23.091788] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-25T19:32:24.632140] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T19:32:24.642042] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-25T19:32:26.394022] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T19:32:26.403972] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-25T19:32:28.035458] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T19:32:28.046597] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-25T19:32:29.765829] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T19:32:29.776568] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-25T19:32:31.507976] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-25T19:32:31.517209] [INFO ] [REMOTE ] BLND: Full fetch complete (72205 records). [2025-10-25T19:32:31.517367] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-25T19:32:31.906577] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-25T19:32:31.906879] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-25T19:32:31.907871] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-25T19:32:31.907952] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-25T19:32:31.909541] [DEBUG] [LOCAL ] BLND: Trimmed 72205 records to 49966 (keeping 200 days of data) [2025-10-25T19:32:32.190970] [DEBUG] [LOCAL ] BLND: Primary data saved (49966 records). [2025-10-25T19:32:32.191176] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-25T19:32:32.191338] [INFO ] [MAIN ] Update Progress: 301/2366 symbols. BLND took 18.8s. Estimated remaining time: 3h 58m 19s [2025-10-25T19:32:32.368200] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:32:32.368457] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-25T19:32:32.368548] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-25T19:32:32.368721] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-25T19:32:32.368819] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-25T19:32:32.368958] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-25T19:32:32.369045] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-25T19:32:32.769153] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:32:32.769674] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-25T19:32:33.062853] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:32:33.063531] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-25T19:32:33.063693] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:32:33.063799] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-25T19:32:33.063887] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:32:33.063986] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-25T19:32:33.064127] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-25T19:32:33.064250] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-25T19:32:33.064360] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-25T19:32:33.064516] [INFO ] [MAIN ] Update Progress: 302/2366 symbols. BLSH took 0.9s. Estimated remaining time: 3h 57m 30s [2025-10-25T19:32:33.351135] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:32:33.351567] [DEBUG] [LOCAL ] BLW: No existing data file found in primary storage. [2025-10-25T19:32:33.351679] [WARN ] [MAIN ] BLW: No existing data found, performing full refresh instead. [2025-10-25T19:32:33.351821] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-25T19:32:33.351898] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-25T19:32:33.351988] [DEBUG] [LOCAL ] BLW: No primary data file found to delete. [2025-10-25T19:32:33.352062] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-25T19:32:33.757361] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:32:33.757747] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-25T19:32:34.714157] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-25T19:32:34.717385] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-25T19:32:35.633275] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-25T19:32:35.636494] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-25T19:32:36.655199] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T19:32:36.658839] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-25T19:32:37.767465] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T19:32:37.771637] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-25T19:32:38.633279] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T19:32:38.636098] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-25T19:32:39.621790] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T19:32:39.625333] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-25T19:32:40.554572] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:32:40.557703] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-25T19:32:41.518129] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:32:41.521433] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-25T19:32:42.628187] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T19:32:42.632172] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-25T19:32:43.580342] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T19:32:43.583474] [INFO ] [REMOTE ] BLW: Full fetch complete (19134 records). [2025-10-25T19:32:43.583571] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-25T19:32:43.954366] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-25T19:32:43.954486] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-25T19:32:43.954797] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-25T19:32:43.954878] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-25T19:32:43.955507] [DEBUG] [LOCAL ] BLW: Trimmed 19134 records to 13127 (keeping 200 days of data) [2025-10-25T19:32:44.032960] [DEBUG] [LOCAL ] BLW: Primary data saved (13127 records). [2025-10-25T19:32:44.033130] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-25T19:32:44.033262] [INFO ] [MAIN ] Update Progress: 303/2366 symbols. BLW took 11.0s. Estimated remaining time: 3h 57m 51s [2025-10-25T19:32:44.197705] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:32:44.197940] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-10-25T19:32:44.198013] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-10-25T19:32:44.198126] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-25T19:32:44.198197] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-25T19:32:44.198279] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-10-25T19:32:44.198349] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-25T19:32:44.547852] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:32:44.548243] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-25T19:32:45.660871] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T19:32:45.664963] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-25T19:32:46.645217] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T19:32:46.648879] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-25T19:32:47.929312] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-25T19:32:47.934179] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-25T19:32:49.081448] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T19:32:49.086497] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-25T19:32:50.155890] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:32:50.160181] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-25T19:32:51.206045] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T19:32:51.210053] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-25T19:32:52.307353] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T19:32:52.311541] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-25T19:32:53.422082] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T19:32:53.426412] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-25T19:32:54.411320] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T19:32:54.415502] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-25T19:32:55.406023] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:32:55.410261] [INFO ] [REMOTE ] BLX: Full fetch complete (22402 records). [2025-10-25T19:32:55.410432] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-25T19:32:55.795702] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-25T19:32:55.795859] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-25T19:32:55.796408] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-25T19:32:55.796494] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-25T19:32:55.797403] [DEBUG] [LOCAL ] BLX: Trimmed 22402 records to 15597 (keeping 200 days of data) [2025-10-25T19:32:55.894395] [DEBUG] [LOCAL ] BLX: Primary data saved (15597 records). [2025-10-25T19:32:55.894639] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-25T19:32:55.894817] [INFO ] [MAIN ] Update Progress: 304/2366 symbols. BLX took 11.9s. Estimated remaining time: 3h 58m 18s [2025-10-25T19:32:56.078548] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:32:56.078848] [DEBUG] [LOCAL ] BMA: No existing data file found in primary storage. [2025-10-25T19:32:56.078930] [WARN ] [MAIN ] BMA: No existing data found, performing full refresh instead. [2025-10-25T19:32:56.079085] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-25T19:32:56.079164] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-25T19:32:56.079251] [DEBUG] [LOCAL ] BMA: No primary data file found to delete. [2025-10-25T19:32:56.079344] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-25T19:32:56.475147] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:32:56.475610] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-25T19:32:58.070813] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T19:32:58.079194] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-25T19:32:59.609824] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T19:32:59.617368] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-25T19:33:01.254228] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T19:33:01.261617] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-25T19:33:03.031448] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T19:33:03.040534] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-25T19:33:04.474734] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T19:33:04.482160] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-25T19:33:06.014800] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T19:33:06.022299] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-25T19:33:07.561161] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T19:33:07.569314] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-25T19:33:09.112206] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T19:33:09.120339] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-25T19:33:10.785818] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T19:33:10.795290] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-25T19:33:12.432538] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-25T19:33:12.441474] [INFO ] [REMOTE ] BMA: Full fetch complete (52441 records). [2025-10-25T19:33:12.441693] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-25T19:33:12.851890] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-25T19:33:12.852083] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-25T19:33:12.852908] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-25T19:33:12.852999] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-25T19:33:12.854828] [DEBUG] [LOCAL ] BMA: Trimmed 52441 records to 37210 (keeping 200 days of data) [2025-10-25T19:33:13.090251] [DEBUG] [LOCAL ] BMA: Primary data saved (37210 records). [2025-10-25T19:33:13.090527] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-25T19:33:13.090731] [INFO ] [MAIN ] Update Progress: 305/2366 symbols. BMA took 17.2s. Estimated remaining time: 3h 59m 20s [2025-10-25T19:33:13.268800] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:33:13.269076] [DEBUG] [LOCAL ] BME: No existing data file found in primary storage. [2025-10-25T19:33:13.269152] [WARN ] [MAIN ] BME: No existing data found, performing full refresh instead. [2025-10-25T19:33:13.269282] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-25T19:33:13.269357] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-25T19:33:13.269444] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-10-25T19:33:13.269519] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-25T19:33:13.643892] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:33:13.644392] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-25T19:33:14.667365] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T19:33:14.671018] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-25T19:33:15.626311] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T19:33:15.628551] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-25T19:33:16.594795] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T19:33:16.597471] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-25T19:33:17.542524] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T19:33:17.545627] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-25T19:33:18.485009] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T19:33:18.488241] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-25T19:33:19.337629] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T19:33:19.340364] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-25T19:33:20.297796] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T19:33:20.303429] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-25T19:33:21.294536] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T19:33:21.298170] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-25T19:33:22.156044] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T19:33:22.159486] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-25T19:33:23.006622] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T19:33:23.009589] [INFO ] [REMOTE ] BME: Full fetch complete (15576 records). [2025-10-25T19:33:23.009710] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-25T19:33:23.393263] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-25T19:33:23.393423] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-25T19:33:23.393815] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-25T19:33:23.393898] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-25T19:33:23.394617] [DEBUG] [LOCAL ] BME: Trimmed 15576 records to 11345 (keeping 200 days of data) [2025-10-25T19:33:23.467483] [DEBUG] [LOCAL ] BME: Primary data saved (11345 records). [2025-10-25T19:33:23.467754] [INFO ] [MAIN ] BME: Full history saved. [2025-10-25T19:33:23.467921] [INFO ] [MAIN ] Update Progress: 306/2366 symbols. BME took 10.4s. Estimated remaining time: 3h 59m 36s [2025-10-25T19:33:23.686770] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:33:23.687064] [DEBUG] [LOCAL ] BMEZ: No existing data file found in primary storage. [2025-10-25T19:33:23.687138] [WARN ] [MAIN ] BMEZ: No existing data found, performing full refresh instead. [2025-10-25T19:33:23.687267] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-25T19:33:23.687342] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-25T19:33:23.687611] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-25T19:33:23.687708] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-25T19:33:24.053946] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:33:24.054271] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-25T19:33:25.789788] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T19:33:25.797328] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-25T19:33:27.083282] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T19:33:27.089796] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-25T19:33:28.236304] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T19:33:28.243440] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-25T19:33:29.548934] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T19:33:29.556289] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-25T19:33:30.764484] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T19:33:30.769828] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-25T19:33:31.992387] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T19:33:31.998149] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-25T19:33:33.280412] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T19:33:33.286492] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-25T19:33:34.467489] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-25T19:33:34.473361] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-25T19:33:35.787452] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T19:33:35.793665] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-25T19:33:36.939875] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T19:33:36.944502] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39226 records). [2025-10-25T19:33:36.944609] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-25T19:33:37.328369] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-25T19:33:37.328480] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-25T19:33:37.329001] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-25T19:33:37.329082] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-25T19:33:37.330008] [DEBUG] [LOCAL ] BMEZ: Trimmed 39226 records to 25339 (keeping 200 days of data) [2025-10-25T19:33:37.481637] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25339 records). [2025-10-25T19:33:37.481816] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-25T19:33:37.481929] [INFO ] [MAIN ] Update Progress: 307/2366 symbols. BMEZ took 14.0s. Estimated remaining time: 4h 0m 16s [2025-10-25T19:33:37.654595] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:33:37.654833] [DEBUG] [LOCAL ] BMI: No existing data file found in primary storage. [2025-10-25T19:33:37.654911] [WARN ] [MAIN ] BMI: No existing data found, performing full refresh instead. [2025-10-25T19:33:37.655025] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-25T19:33:37.655096] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-25T19:33:37.655178] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-10-25T19:33:37.655248] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-25T19:33:38.018438] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:33:38.018835] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-25T19:33:39.323804] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T19:33:39.328253] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-25T19:33:40.487322] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T19:33:40.491631] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-25T19:33:41.751287] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-25T19:33:41.756830] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-25T19:33:43.081123] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T19:33:43.087731] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-25T19:33:44.294046] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T19:33:44.298939] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-25T19:33:45.686126] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T19:33:45.690692] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-25T19:33:47.110161] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T19:33:47.116489] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-25T19:33:48.356211] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T19:33:48.361467] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-25T19:33:49.732431] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T19:33:49.739217] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-25T19:33:51.461002] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-25T19:33:51.466398] [INFO ] [REMOTE ] BMI: Full fetch complete (34168 records). [2025-10-25T19:33:51.466533] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-25T19:33:51.864467] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-25T19:33:51.864586] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-25T19:33:51.865102] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-25T19:33:51.865182] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-25T19:33:51.866157] [DEBUG] [LOCAL ] BMI: Trimmed 34168 records to 25241 (keeping 200 days of data) [2025-10-25T19:33:52.014869] [DEBUG] [LOCAL ] BMI: Primary data saved (25241 records). [2025-10-25T19:33:52.015033] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-25T19:33:52.015166] [INFO ] [MAIN ] Update Progress: 308/2366 symbols. BMI took 14.5s. Estimated remaining time: 4h 0m 60s [2025-10-25T19:33:52.216090] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:33:52.216361] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-10-25T19:33:52.216433] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-10-25T19:33:52.216550] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-25T19:33:52.216623] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-25T19:33:52.216728] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-25T19:33:52.216800] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-25T19:33:52.581221] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:33:52.581552] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-25T19:33:53.313075] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T19:33:53.314337] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-25T19:33:53.739010] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T19:33:53.740224] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-25T19:33:54.326760] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-25T19:33:54.328008] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-25T19:33:55.088003] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T19:33:55.089691] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-25T19:33:55.575803] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-25T19:33:55.577120] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-25T19:33:56.148298] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T19:33:56.149574] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-25T19:33:56.718031] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T19:33:56.719375] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-25T19:33:57.260326] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-25T19:33:57.261699] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-25T19:33:57.833936] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T19:33:57.835332] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-25T19:33:58.400241] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T19:33:58.401875] [INFO ] [REMOTE ] BMN: Full fetch complete (3710 records). [2025-10-25T19:33:58.401984] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-25T19:33:58.776189] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-25T19:33:58.776324] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-25T19:33:58.776489] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-25T19:33:58.776565] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-25T19:33:58.776955] [DEBUG] [LOCAL ] BMN: Trimmed 3710 records to 2676 (keeping 200 days of data) [2025-10-25T19:33:58.793028] [DEBUG] [LOCAL ] BMN: Primary data saved (2676 records). [2025-10-25T19:33:58.793118] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-25T19:33:58.793224] [INFO ] [MAIN ] Update Progress: 309/2366 symbols. BMN took 6.8s. Estimated remaining time: 4h 0m 51s [2025-10-25T19:33:58.961926] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:33:58.962149] [DEBUG] [LOCAL ] BMO: No existing data file found in primary storage. [2025-10-25T19:33:58.962222] [WARN ] [MAIN ] BMO: No existing data found, performing full refresh instead. [2025-10-25T19:33:58.962308] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-25T19:33:58.962377] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-25T19:33:58.962435] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-10-25T19:33:58.962499] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-25T19:33:59.331851] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:33:59.332211] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-25T19:34:01.394756] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-25T19:34:01.403085] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-25T19:34:03.091039] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T19:34:03.100111] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-25T19:34:04.859019] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-25T19:34:04.868816] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-25T19:34:06.483248] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T19:34:06.493122] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-25T19:34:08.258385] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-25T19:34:08.266995] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-25T19:34:09.997971] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-25T19:34:10.005607] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-25T19:34:11.651084] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T19:34:11.660510] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-25T19:34:13.293206] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T19:34:13.303009] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-25T19:34:14.875539] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T19:34:14.884972] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-25T19:34:16.439590] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T19:34:16.446859] [INFO ] [REMOTE ] BMO: Full fetch complete (59852 records). [2025-10-25T19:34:16.447006] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-25T19:34:16.830388] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-25T19:34:16.830541] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-25T19:34:16.831277] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-25T19:34:16.831378] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-25T19:34:16.832920] [DEBUG] [LOCAL ] BMO: Trimmed 59852 records to 41424 (keeping 200 days of data) [2025-10-25T19:34:17.074475] [DEBUG] [LOCAL ] BMO: Primary data saved (41424 records). [2025-10-25T19:34:17.074678] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-25T19:34:17.074810] [INFO ] [MAIN ] Update Progress: 310/2366 symbols. BMO took 18.3s. Estimated remaining time: 4h 1m 59s [2025-10-25T19:34:17.242553] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:34:17.242767] [DEBUG] [LOCAL ] BMY: No existing data file found in primary storage. [2025-10-25T19:34:17.242840] [WARN ] [MAIN ] BMY: No existing data found, performing full refresh instead. [2025-10-25T19:34:17.242974] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-25T19:34:17.243047] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-25T19:34:17.243128] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-10-25T19:34:17.243197] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-25T19:34:17.616076] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:34:17.616482] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-25T19:34:19.910455] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-25T19:34:19.920888] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-25T19:34:21.720370] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T19:34:21.730581] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-25T19:34:23.883492] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-25T19:34:23.894420] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-25T19:34:25.032921] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T19:34:25.044021] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-25T19:34:25.973321] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T19:34:25.984527] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-25T19:34:26.960533] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T19:34:26.971538] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-25T19:34:28.089825] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T19:34:28.102425] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-25T19:34:28.980708] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-25T19:34:28.993048] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-25T19:34:30.106307] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T19:34:30.120529] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-25T19:34:31.186605] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T19:34:31.197182] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-25T19:34:31.197380] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-25T19:34:31.598236] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-25T19:34:31.598375] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-25T19:34:31.599308] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-25T19:34:31.599395] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-25T19:34:31.601122] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54537 (keeping 200 days of data) [2025-10-25T19:34:31.930841] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-25T19:34:31.931002] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-25T19:34:31.931120] [INFO ] [MAIN ] Update Progress: 311/2366 symbols. BMY took 14.9s. Estimated remaining time: 4h 2m 43s [2025-10-25T19:34:32.104348] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:34:32.104556] [DEBUG] [LOCAL ] BN: No existing data file found in primary storage. [2025-10-25T19:34:32.104627] [WARN ] [MAIN ] BN: No existing data found, performing full refresh instead. [2025-10-25T19:34:32.104778] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-25T19:34:32.104852] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-25T19:34:32.104933] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-25T19:34:32.105003] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-25T19:34:32.458727] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:34:32.459063] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-25T19:34:34.942061] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-25T19:34:34.952327] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-25T19:34:36.613772] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T19:34:36.623937] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-25T19:34:38.921369] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-25T19:34:38.932756] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-25T19:34:39.948482] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T19:34:39.960413] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-25T19:34:40.902568] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T19:34:40.913683] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-25T19:34:41.870404] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T19:34:41.881129] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-25T19:34:42.850708] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T19:34:42.863094] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-25T19:34:43.822115] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:34:43.833293] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-25T19:34:44.824606] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T19:34:44.837056] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-25T19:34:45.984530] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T19:34:45.994308] [INFO ] [REMOTE ] BN: Full fetch complete (76956 records). [2025-10-25T19:34:45.994460] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-25T19:34:46.396448] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-25T19:34:46.396587] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-25T19:34:46.397417] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-25T19:34:46.397506] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-25T19:34:46.399202] [DEBUG] [LOCAL ] BN: Trimmed 76956 records to 53759 (keeping 200 days of data) [2025-10-25T19:34:46.710978] [DEBUG] [LOCAL ] BN: Primary data saved (53759 records). [2025-10-25T19:34:46.711131] [INFO ] [MAIN ] BN: Full history saved. [2025-10-25T19:34:46.711244] [INFO ] [MAIN ] Update Progress: 312/2366 symbols. BN took 14.8s. Estimated remaining time: 4h 3m 27s [2025-10-25T19:34:46.875858] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:34:46.876060] [DEBUG] [LOCAL ] BNED: No existing data file found in primary storage. [2025-10-25T19:34:46.876133] [WARN ] [MAIN ] BNED: No existing data found, performing full refresh instead. [2025-10-25T19:34:46.876246] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-25T19:34:46.876319] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-25T19:34:46.876401] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-10-25T19:34:46.876504] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-25T19:34:47.222180] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:34:47.222567] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-25T19:34:48.735208] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T19:34:48.741843] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-25T19:34:50.059378] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-25T19:34:50.064907] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-25T19:34:51.405216] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T19:34:51.412436] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-25T19:34:52.782248] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T19:34:52.789313] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-25T19:34:54.153881] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T19:34:54.160358] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-25T19:34:55.440726] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T19:34:55.446845] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-25T19:34:57.052801] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T19:34:57.060253] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-25T19:34:58.413619] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T19:34:58.420537] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-25T19:34:59.704075] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T19:34:59.710140] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-25T19:35:00.909011] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T19:35:00.913240] [INFO ] [REMOTE ] BNED: Full fetch complete (41641 records). [2025-10-25T19:35:00.913361] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-25T19:35:01.292092] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-25T19:35:01.292211] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-25T19:35:01.292785] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-25T19:35:01.292865] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-25T19:35:01.293853] [DEBUG] [LOCAL ] BNED: Trimmed 41641 records to 28526 (keeping 200 days of data) [2025-10-25T19:35:01.458176] [DEBUG] [LOCAL ] BNED: Primary data saved (28526 records). [2025-10-25T19:35:01.458349] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-25T19:35:01.458469] [INFO ] [MAIN ] Update Progress: 313/2366 symbols. BNED took 14.7s. Estimated remaining time: 4h 4m 10s [2025-10-25T19:35:01.634483] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:35:01.634726] [DEBUG] [LOCAL ] BNH: No existing data file found in primary storage. [2025-10-25T19:35:01.634814] [WARN ] [MAIN ] BNH: No existing data found, performing full refresh instead. [2025-10-25T19:35:01.634956] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-25T19:35:01.635031] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-25T19:35:01.635113] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-10-25T19:35:01.635181] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-25T19:35:02.091132] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:35:02.091629] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-25T19:35:03.066783] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-25T19:35:03.068233] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-25T19:35:03.736536] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T19:35:03.738085] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-25T19:35:04.490906] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T19:35:04.492667] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-25T19:35:05.366305] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T19:35:05.368792] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-25T19:35:06.067074] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-25T19:35:06.068953] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-25T19:35:06.937617] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T19:35:06.939212] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-25T19:35:07.680757] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T19:35:07.682325] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-25T19:35:08.420530] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-25T19:35:08.422515] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-25T19:35:09.189637] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T19:35:09.191978] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-25T19:35:10.186281] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:35:10.187825] [INFO ] [REMOTE ] BNH: Full fetch complete (6842 records). [2025-10-25T19:35:10.187918] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-25T19:35:10.540026] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-25T19:35:10.540157] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-25T19:35:10.540399] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-25T19:35:10.540496] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-25T19:35:10.540982] [DEBUG] [LOCAL ] BNH: Trimmed 6842 records to 4742 (keeping 200 days of data) [2025-10-25T19:35:10.569108] [DEBUG] [LOCAL ] BNH: Primary data saved (4742 records). [2025-10-25T19:35:10.569243] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-25T19:35:10.569368] [INFO ] [MAIN ] Update Progress: 314/2366 symbols. BNH took 9.1s. Estimated remaining time: 4h 4m 15s [2025-10-25T19:35:10.739356] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:35:10.739546] [DEBUG] [LOCAL ] BNJ: No existing data file found in primary storage. [2025-10-25T19:35:10.739627] [WARN ] [MAIN ] BNJ: No existing data found, performing full refresh instead. [2025-10-25T19:35:10.739789] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-25T19:35:10.739860] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-25T19:35:10.739941] [DEBUG] [LOCAL ] BNJ: No primary data file found to delete. [2025-10-25T19:35:10.740013] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-25T19:35:11.093103] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:35:11.093737] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-25T19:35:11.780956] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-25T19:35:11.782291] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-25T19:35:12.380054] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T19:35:12.381370] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-25T19:35:13.056173] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T19:35:13.058174] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-25T19:35:13.702672] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-25T19:35:13.704160] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-25T19:35:14.362786] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T19:35:14.364116] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-25T19:35:14.996263] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-25T19:35:14.997511] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-25T19:35:15.732792] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T19:35:15.734030] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-25T19:35:16.336245] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-25T19:35:16.337582] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-25T19:35:16.965714] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T19:35:16.968362] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-25T19:35:17.512088] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T19:35:17.513580] [INFO ] [REMOTE ] BNJ: Full fetch complete (3845 records). [2025-10-25T19:35:17.513721] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-25T19:35:17.926943] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-25T19:35:17.927059] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-25T19:35:17.927193] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-25T19:35:17.927265] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-25T19:35:17.927704] [DEBUG] [LOCAL ] BNJ: Trimmed 3845 records to 2516 (keeping 200 days of data) [2025-10-25T19:35:17.942769] [DEBUG] [LOCAL ] BNJ: Primary data saved (2516 records). [2025-10-25T19:35:17.942865] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-25T19:35:17.942975] [INFO ] [MAIN ] Update Progress: 315/2366 symbols. BNJ took 7.4s. Estimated remaining time: 4h 4m 10s [2025-10-25T19:35:18.122313] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:35:18.122575] [DEBUG] [LOCAL ] BNL: No existing data file found in primary storage. [2025-10-25T19:35:18.122691] [WARN ] [MAIN ] BNL: No existing data found, performing full refresh instead. [2025-10-25T19:35:18.122810] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-25T19:35:18.122880] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-25T19:35:18.122983] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-10-25T19:35:18.123052] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-25T19:35:18.481838] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:35:18.482209] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-25T19:35:20.173836] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T19:35:20.182265] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-25T19:35:21.636135] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T19:35:21.644631] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-25T19:35:23.283964] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T19:35:23.293911] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-25T19:35:24.234298] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T19:35:24.244408] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-25T19:35:25.242137] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T19:35:25.252018] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-25T19:35:26.407280] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T19:35:26.416918] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-25T19:35:27.247466] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T19:35:27.257876] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-25T19:35:28.204378] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T19:35:28.214515] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-25T19:35:29.182251] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:35:29.192407] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-25T19:35:30.206553] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T19:35:30.215231] [INFO ] [REMOTE ] BNL: Full fetch complete (67208 records). [2025-10-25T19:35:30.215367] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-25T19:35:30.589978] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-25T19:35:30.590095] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-25T19:35:30.590789] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-25T19:35:30.590867] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-25T19:35:30.592144] [DEBUG] [LOCAL ] BNL: Trimmed 67208 records to 47664 (keeping 200 days of data) [2025-10-25T19:35:30.867935] [DEBUG] [LOCAL ] BNL: Primary data saved (47664 records). [2025-10-25T19:35:30.868531] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-25T19:35:30.868675] [INFO ] [MAIN ] Update Progress: 316/2366 symbols. BNL took 12.9s. Estimated remaining time: 4h 4m 40s [2025-10-25T19:35:31.032820] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:35:31.033006] [DEBUG] [LOCAL ] BNS: No existing data file found in primary storage. [2025-10-25T19:35:31.033074] [WARN ] [MAIN ] BNS: No existing data found, performing full refresh instead. [2025-10-25T19:35:31.033182] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-25T19:35:31.033252] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-25T19:35:31.033332] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-10-25T19:35:31.033399] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-25T19:35:31.378218] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:35:31.378586] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-25T19:35:33.323384] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T19:35:33.333462] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-25T19:35:34.923051] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T19:35:34.932761] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-25T19:35:36.751922] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T19:35:36.762512] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-25T19:35:37.869537] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T19:35:37.880626] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-25T19:35:38.911602] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T19:35:38.922510] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-25T19:35:39.976881] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T19:35:39.987250] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-25T19:35:40.894145] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T19:35:40.910939] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-25T19:35:41.768297] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T19:35:41.779146] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-25T19:35:42.793853] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T19:35:42.804810] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-25T19:35:43.721246] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T19:35:43.730733] [INFO ] [REMOTE ] BNS: Full fetch complete (74600 records). [2025-10-25T19:35:43.730900] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-25T19:35:44.114796] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-25T19:35:44.114930] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-25T19:35:44.115752] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-25T19:35:44.115833] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-25T19:35:44.117357] [DEBUG] [LOCAL ] BNS: Trimmed 74600 records to 52124 (keeping 200 days of data) [2025-10-25T19:35:44.427114] [DEBUG] [LOCAL ] BNS: Primary data saved (52124 records). [2025-10-25T19:35:44.427311] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-25T19:35:44.427430] [INFO ] [MAIN ] Update Progress: 317/2366 symbols. BNS took 13.6s. Estimated remaining time: 4h 5m 14s [2025-10-25T19:35:44.593533] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:35:44.593743] [DEBUG] [LOCAL ] BNT: No existing data file found in primary storage. [2025-10-25T19:35:44.593850] [WARN ] [MAIN ] BNT: No existing data found, performing full refresh instead. [2025-10-25T19:35:44.593965] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-25T19:35:44.594036] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-25T19:35:44.594117] [DEBUG] [LOCAL ] BNT: No primary data file found to delete. [2025-10-25T19:35:44.594186] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-25T19:35:44.941172] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:35:44.941558] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-25T19:35:45.614734] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-25T19:35:45.615904] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-25T19:35:46.198915] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T19:35:46.200081] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-25T19:35:46.902202] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-25T19:35:46.903865] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-25T19:35:47.641800] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T19:35:47.643610] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-25T19:35:48.312960] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-25T19:35:48.315023] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-25T19:35:48.812980] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-25T19:35:48.814225] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-25T19:35:49.480913] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-25T19:35:49.482473] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-25T19:35:49.984330] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-25T19:35:49.985597] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-25T19:35:50.648148] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T19:35:50.650812] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-25T19:35:51.375161] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T19:35:51.376699] [INFO ] [REMOTE ] BNT: Full fetch complete (4829 records). [2025-10-25T19:35:51.376825] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-25T19:35:51.740897] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-25T19:35:51.741040] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-25T19:35:51.741245] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-25T19:35:51.741341] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-25T19:35:51.741810] [DEBUG] [LOCAL ] BNT: Trimmed 4829 records to 3567 (keeping 200 days of data) [2025-10-25T19:35:51.766369] [DEBUG] [LOCAL ] BNT: Primary data saved (3567 records). [2025-10-25T19:35:51.766544] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-25T19:35:51.766717] [INFO ] [MAIN ] Update Progress: 318/2366 symbols. BNT took 7.3s. Estimated remaining time: 4h 5m 8s [2025-10-25T19:35:51.940562] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:35:51.940790] [DEBUG] [LOCAL ] BNY: No existing data file found in primary storage. [2025-10-25T19:35:51.940882] [WARN ] [MAIN ] BNY: No existing data found, performing full refresh instead. [2025-10-25T19:35:51.941019] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-25T19:35:51.941108] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-25T19:35:51.941218] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-25T19:35:51.941304] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-25T19:35:52.298607] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:35:52.298993] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-25T19:35:53.291805] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T19:35:53.293877] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-25T19:35:54.003403] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T19:35:54.005373] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-25T19:35:54.932137] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T19:35:54.934847] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-25T19:35:55.697361] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T19:35:55.699372] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-25T19:35:56.490075] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T19:35:56.493603] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-25T19:35:57.223557] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T19:35:57.225931] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-25T19:35:58.046029] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T19:35:58.049137] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-25T19:35:58.921774] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T19:35:58.924089] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-25T19:35:59.698818] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T19:35:59.701255] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-25T19:36:00.522806] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T19:36:00.524880] [INFO ] [REMOTE ] BNY: Full fetch complete (10362 records). [2025-10-25T19:36:00.524976] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-25T19:36:00.904316] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-25T19:36:00.904430] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-25T19:36:00.904692] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-25T19:36:00.904770] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-25T19:36:00.905268] [DEBUG] [LOCAL ] BNY: Trimmed 10362 records to 7303 (keeping 200 days of data) [2025-10-25T19:36:00.947168] [DEBUG] [LOCAL ] BNY: Primary data saved (7303 records). [2025-10-25T19:36:00.947306] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-25T19:36:00.947417] [INFO ] [MAIN ] Update Progress: 319/2366 symbols. BNY took 9.2s. Estimated remaining time: 4h 5m 14s [2025-10-25T19:36:01.113083] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:36:01.113271] [DEBUG] [LOCAL ] BOC: No existing data file found in primary storage. [2025-10-25T19:36:01.113342] [WARN ] [MAIN ] BOC: No existing data found, performing full refresh instead. [2025-10-25T19:36:01.113453] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-25T19:36:01.113522] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-25T19:36:01.113603] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-25T19:36:01.113692] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-25T19:36:01.477390] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:36:01.477808] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-25T19:36:02.749268] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T19:36:02.753218] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-25T19:36:03.813545] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T19:36:03.816998] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-25T19:36:04.875588] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T19:36:04.879783] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-25T19:36:06.067905] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-25T19:36:06.073217] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-25T19:36:07.086045] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T19:36:07.090545] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-25T19:36:08.165740] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T19:36:08.174538] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-25T19:36:09.302379] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T19:36:09.309874] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-25T19:36:10.205325] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T19:36:10.213894] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-25T19:36:11.469558] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-25T19:36:11.473774] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-25T19:36:12.570061] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T19:36:12.573862] [INFO ] [REMOTE ] BOC: Full fetch complete (25788 records). [2025-10-25T19:36:12.573984] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-25T19:36:12.943277] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-25T19:36:12.943397] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-25T19:36:12.943792] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-25T19:36:12.943873] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-25T19:36:12.944515] [DEBUG] [LOCAL ] BOC: Trimmed 25788 records to 18411 (keeping 200 days of data) [2025-10-25T19:36:13.046330] [DEBUG] [LOCAL ] BOC: Primary data saved (18411 records). [2025-10-25T19:36:13.046492] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-25T19:36:13.046583] [INFO ] [MAIN ] Update Progress: 320/2366 symbols. BOC took 12.1s. Estimated remaining time: 4h 5m 38s [2025-10-25T19:36:13.212324] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:36:13.212521] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-25T19:36:13.212594] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-25T19:36:13.212734] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-25T19:36:13.212812] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-25T19:36:13.212869] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-25T19:36:13.212910] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-25T19:36:13.559737] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:36:13.560036] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-25T19:36:14.912293] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T19:36:14.917174] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-25T19:36:15.962411] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T19:36:15.966547] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-25T19:36:17.080772] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-25T19:36:17.085189] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-25T19:36:18.340843] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T19:36:18.346611] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-25T19:36:19.351182] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T19:36:19.355478] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-25T19:36:20.431683] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T19:36:20.436957] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-25T19:36:21.561919] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T19:36:21.565904] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-25T19:36:22.590587] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T19:36:22.594268] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-25T19:36:23.785254] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T19:36:23.790731] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-25T19:36:24.900510] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T19:36:24.905041] [INFO ] [REMOTE ] BOE: Full fetch complete (26767 records). [2025-10-25T19:36:24.905146] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-25T19:36:25.305030] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-25T19:36:25.305162] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-25T19:36:25.305569] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-25T19:36:25.305660] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-25T19:36:25.306445] [DEBUG] [LOCAL ] BOE: Trimmed 26767 records to 18258 (keeping 200 days of data) [2025-10-25T19:36:25.416945] [DEBUG] [LOCAL ] BOE: Primary data saved (18258 records). [2025-10-25T19:36:25.417114] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-25T19:36:25.417231] [INFO ] [MAIN ] Update Progress: 321/2366 symbols. BOE took 12.4s. Estimated remaining time: 4h 6m 4s [2025-10-25T19:36:25.601949] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:36:25.602140] [DEBUG] [LOCAL ] BOH: No existing data file found in primary storage. [2025-10-25T19:36:25.602210] [WARN ] [MAIN ] BOH: No existing data found, performing full refresh instead. [2025-10-25T19:36:25.602347] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-25T19:36:25.602428] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-25T19:36:25.602519] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-25T19:36:25.602619] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-25T19:36:25.999786] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:36:26.000134] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-25T19:36:27.972491] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T19:36:27.979543] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-25T19:36:30.421556] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-25T19:36:30.427360] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-25T19:36:32.048896] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T19:36:32.060914] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-25T19:36:33.671079] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T19:36:33.680009] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-25T19:36:34.950078] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T19:36:34.956278] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-25T19:36:36.169193] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T19:36:36.175216] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-25T19:36:37.564890] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T19:36:37.572296] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-25T19:36:39.435125] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-25T19:36:39.442152] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-25T19:36:40.825729] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T19:36:40.832479] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-25T19:36:42.285503] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T19:36:42.291934] [INFO ] [REMOTE ] BOH: Full fetch complete (45431 records). [2025-10-25T19:36:42.292055] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-25T19:36:42.674766] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-25T19:36:42.674884] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-25T19:36:42.675450] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-25T19:36:42.675533] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-25T19:36:42.676517] [DEBUG] [LOCAL ] BOH: Trimmed 45431 records to 31145 (keeping 200 days of data) [2025-10-25T19:36:42.857367] [DEBUG] [LOCAL ] BOH: Primary data saved (31145 records). [2025-10-25T19:36:42.857524] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-25T19:36:42.857639] [INFO ] [MAIN ] Update Progress: 322/2366 symbols. BOH took 17.4s. Estimated remaining time: 4h 7m 1s [2025-10-25T19:36:43.029937] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:36:43.030136] [DEBUG] [LOCAL ] BOND: No existing data file found in primary storage. [2025-10-25T19:36:43.030207] [WARN ] [MAIN ] BOND: No existing data found, performing full refresh instead. [2025-10-25T19:36:43.030319] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-25T19:36:43.030390] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-25T19:36:43.030472] [DEBUG] [LOCAL ] BOND: No primary data file found to delete. [2025-10-25T19:36:43.030542] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-25T19:36:43.383922] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:36:43.384306] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-25T19:36:44.922873] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T19:36:44.929563] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-25T19:36:46.228518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-25T19:36:46.234879] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-25T19:36:47.714493] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-25T19:36:47.721434] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-25T19:36:49.138858] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T19:36:49.145962] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-25T19:36:50.567337] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T19:36:50.575200] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-25T19:36:52.433281] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-25T19:36:52.440319] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-25T19:36:53.895696] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T19:36:53.903190] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-25T19:36:55.648279] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-25T19:36:55.655339] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-25T19:36:57.037396] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T19:36:57.045091] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-25T19:36:58.521252] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-25T19:36:58.528916] [INFO ] [REMOTE ] BOND: Full fetch complete (46637 records). [2025-10-25T19:36:58.529103] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-25T19:36:58.910484] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-25T19:36:58.910605] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-25T19:36:58.911256] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-25T19:36:58.911351] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-25T19:36:58.912545] [DEBUG] [LOCAL ] BOND: Trimmed 46637 records to 32905 (keeping 200 days of data) [2025-10-25T19:36:59.117911] [DEBUG] [LOCAL ] BOND: Primary data saved (32905 records). [2025-10-25T19:36:59.118126] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-25T19:36:59.118274] [INFO ] [MAIN ] Update Progress: 323/2366 symbols. BOND took 16.3s. Estimated remaining time: 4h 7m 51s [2025-10-25T19:36:59.328236] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:36:59.328463] [DEBUG] [LOCAL ] BOOT: No existing data file found in primary storage. [2025-10-25T19:36:59.328535] [WARN ] [MAIN ] BOOT: No existing data found, performing full refresh instead. [2025-10-25T19:36:59.328683] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-25T19:36:59.328749] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-25T19:36:59.328824] [DEBUG] [LOCAL ] BOOT: No primary data file found to delete. [2025-10-25T19:36:59.328894] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-25T19:36:59.679040] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:36:59.679369] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-25T19:37:01.869487] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-25T19:37:01.878518] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-25T19:37:04.102915] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-25T19:37:04.112760] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-25T19:37:06.741067] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-25T19:37:06.751353] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-25T19:37:07.588004] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-25T19:37:07.599417] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-25T19:37:08.594422] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T19:37:08.604853] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-25T19:37:09.708217] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:37:09.717449] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-25T19:37:10.527904] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-25T19:37:10.537204] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-25T19:37:11.457849] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T19:37:11.465948] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-25T19:37:12.315684] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T19:37:12.323408] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-25T19:37:13.102037] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T19:37:13.108867] [INFO ] [REMOTE ] BOOT: Full fetch complete (59755 records). [2025-10-25T19:37:13.109043] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-25T19:37:13.512168] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-25T19:37:13.512312] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-25T19:37:13.512992] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-25T19:37:13.513077] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-25T19:37:13.514333] [DEBUG] [LOCAL ] BOOT: Trimmed 59755 records to 39928 (keeping 200 days of data) [2025-10-25T19:37:13.756127] [DEBUG] [LOCAL ] BOOT: Primary data saved (39928 records). [2025-10-25T19:37:13.756326] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-25T19:37:13.756455] [INFO ] [MAIN ] Update Progress: 324/2366 symbols. BOOT took 14.6s. Estimated remaining time: 4h 8m 30s [2025-10-25T19:37:13.938356] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:37:13.938578] [DEBUG] [LOCAL ] BORR: No existing data file found in primary storage. [2025-10-25T19:37:13.938678] [WARN ] [MAIN ] BORR: No existing data found, performing full refresh instead. [2025-10-25T19:37:13.938798] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-25T19:37:13.938871] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-25T19:37:13.938954] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-25T19:37:13.939025] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-25T19:37:14.350932] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:37:14.351304] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-25T19:37:16.211817] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-25T19:37:16.222172] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-25T19:37:18.014248] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T19:37:18.024067] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-25T19:37:19.704727] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T19:37:19.716073] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-25T19:37:20.753746] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T19:37:20.764549] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-25T19:37:21.767760] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T19:37:21.778489] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-25T19:37:22.666470] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T19:37:22.676795] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-25T19:37:23.686984] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T19:37:23.698018] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-25T19:37:25.258116] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T19:37:25.269198] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-25T19:37:26.183765] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T19:37:26.194841] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-25T19:37:27.203134] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T19:37:27.213006] [INFO ] [REMOTE ] BORR: Full fetch complete (74540 records). [2025-10-25T19:37:27.213192] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-25T19:37:27.632083] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-25T19:37:27.632223] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-25T19:37:27.633113] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-25T19:37:27.633197] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-25T19:37:27.634705] [DEBUG] [LOCAL ] BORR: Trimmed 74540 records to 51836 (keeping 200 days of data) [2025-10-25T19:37:27.930982] [DEBUG] [LOCAL ] BORR: Primary data saved (51836 records). [2025-10-25T19:37:27.931151] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-25T19:37:27.931280] [INFO ] [MAIN ] Update Progress: 325/2366 symbols. BORR took 14.2s. Estimated remaining time: 4h 9m 6s [2025-10-25T19:37:28.118139] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:37:28.118464] [DEBUG] [LOCAL ] BOW: No existing data file found in primary storage. [2025-10-25T19:37:28.118539] [WARN ] [MAIN ] BOW: No existing data found, performing full refresh instead. [2025-10-25T19:37:28.118685] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-25T19:37:28.118761] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-25T19:37:28.118845] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-10-25T19:37:28.118914] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-25T19:37:28.500024] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:37:28.500440] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-25T19:37:29.860633] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-25T19:37:29.865880] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-25T19:37:30.830985] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-25T19:37:30.834432] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-25T19:37:32.149562] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T19:37:32.156122] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-25T19:37:33.370318] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T19:37:33.378381] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-25T19:37:34.674748] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T19:37:34.680521] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-25T19:37:35.779552] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:37:35.784749] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-25T19:37:36.897565] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T19:37:36.904134] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-25T19:37:38.207131] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T19:37:38.213233] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-25T19:37:39.423675] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T19:37:39.429116] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-25T19:37:40.567988] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T19:37:40.573563] [INFO ] [REMOTE ] BOW: Full fetch complete (32063 records). [2025-10-25T19:37:40.573739] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-25T19:37:40.961550] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-25T19:37:40.961750] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-25T19:37:40.962348] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-25T19:37:40.962482] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-25T19:37:40.963905] [DEBUG] [LOCAL ] BOW: Trimmed 32063 records to 23072 (keeping 200 days of data) [2025-10-25T19:37:41.100255] [DEBUG] [LOCAL ] BOW: Primary data saved (23072 records). [2025-10-25T19:37:41.100470] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-25T19:37:41.100613] [INFO ] [MAIN ] Update Progress: 326/2366 symbols. BOW took 13.2s. Estimated remaining time: 4h 9m 35s [2025-10-25T19:37:41.280698] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:37:41.280997] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-25T19:37:41.281074] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-25T19:37:41.281204] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-25T19:37:41.281281] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-25T19:37:41.281345] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-25T19:37:41.281414] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-25T19:37:41.666764] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:37:41.667183] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-25T19:37:43.390110] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T19:37:43.400959] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-25T19:37:44.944447] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T19:37:44.953924] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-25T19:37:46.762830] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T19:37:46.774144] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-25T19:37:47.703803] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T19:37:47.714954] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-25T19:37:48.639731] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T19:37:48.654531] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-25T19:37:49.345482] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-25T19:37:49.357103] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-25T19:37:50.850493] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T19:37:50.861402] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-25T19:37:51.767735] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T19:37:51.778639] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-25T19:37:52.678145] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T19:37:52.693063] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-25T19:37:53.578190] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:37:53.588084] [INFO ] [REMOTE ] BOX: Full fetch complete (72310 records). [2025-10-25T19:37:53.588335] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-25T19:37:54.021463] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-25T19:37:54.021634] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-25T19:37:54.022670] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-25T19:37:54.022762] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-25T19:37:54.024767] [DEBUG] [LOCAL ] BOX: Trimmed 72310 records to 50788 (keeping 200 days of data) [2025-10-25T19:37:54.342678] [DEBUG] [LOCAL ] BOX: Primary data saved (50788 records). [2025-10-25T19:37:54.342924] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-25T19:37:54.343071] [INFO ] [MAIN ] Update Progress: 327/2366 symbols. BOX took 13.2s. Estimated remaining time: 4h 10m 5s [2025-10-25T19:37:54.518478] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:37:54.518830] [DEBUG] [LOCAL ] BP: No existing data file found in primary storage. [2025-10-25T19:37:54.518911] [WARN ] [MAIN ] BP: No existing data found, performing full refresh instead. [2025-10-25T19:37:54.519042] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-25T19:37:54.519118] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-25T19:37:54.519205] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-25T19:37:54.519279] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-25T19:37:54.882151] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:37:54.882551] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-25T19:37:57.280673] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-25T19:37:57.291451] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-25T19:37:59.489125] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-25T19:37:59.499212] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-25T19:38:02.113437] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-25T19:38:02.124971] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-25T19:38:03.207138] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T19:38:03.219532] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-25T19:38:04.381717] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T19:38:04.393182] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-25T19:38:05.294611] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T19:38:05.305782] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-25T19:38:06.392309] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T19:38:06.412192] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-25T19:38:07.441028] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:38:07.453663] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-25T19:38:08.786035] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T19:38:08.798166] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-25T19:38:09.821095] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T19:38:09.832354] [INFO ] [REMOTE ] BP: Full fetch complete (77881 records). [2025-10-25T19:38:09.832607] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-25T19:38:10.238531] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-25T19:38:10.238705] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-25T19:38:10.239576] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-25T19:38:10.239695] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-25T19:38:10.241699] [DEBUG] [LOCAL ] BP: Trimmed 77881 records to 54486 (keeping 200 days of data) [2025-10-25T19:38:10.575321] [DEBUG] [LOCAL ] BP: Primary data saved (54486 records). [2025-10-25T19:38:10.575554] [INFO ] [MAIN ] BP: Full history saved. [2025-10-25T19:38:10.575719] [INFO ] [MAIN ] Update Progress: 328/2366 symbols. BP took 16.2s. Estimated remaining time: 4h 10m 53s [2025-10-25T19:38:10.743561] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:38:10.743898] [DEBUG] [LOCAL ] BR: No existing data file found in primary storage. [2025-10-25T19:38:10.743972] [WARN ] [MAIN ] BR: No existing data found, performing full refresh instead. [2025-10-25T19:38:10.744095] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-25T19:38:10.744167] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-25T19:38:10.744252] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-10-25T19:38:10.744322] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-25T19:38:11.106157] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:38:11.106516] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-25T19:38:12.858674] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T19:38:12.865921] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-25T19:38:14.470438] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T19:38:14.477736] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-25T19:38:16.121092] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T19:38:16.129417] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-25T19:38:18.080104] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-25T19:38:18.088899] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-25T19:38:19.764970] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T19:38:19.773268] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-25T19:38:21.258411] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T19:38:21.266821] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-25T19:38:22.682522] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T19:38:22.690466] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-25T19:38:23.998091] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T19:38:24.006337] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-25T19:38:25.518108] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T19:38:25.526343] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-25T19:38:27.141741] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T19:38:27.148276] [INFO ] [REMOTE ] BR: Full fetch complete (49994 records). [2025-10-25T19:38:27.148404] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-25T19:38:27.525083] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-25T19:38:27.525197] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-25T19:38:27.525775] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-25T19:38:27.525854] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-25T19:38:27.526901] [DEBUG] [LOCAL ] BR: Trimmed 49994 records to 35008 (keeping 200 days of data) [2025-10-25T19:38:27.736828] [DEBUG] [LOCAL ] BR: Primary data saved (35008 records). [2025-10-25T19:38:27.736994] [INFO ] [MAIN ] BR: Full history saved. [2025-10-25T19:38:27.737108] [INFO ] [MAIN ] Update Progress: 329/2366 symbols. BR took 17.2s. Estimated remaining time: 4h 11m 46s [2025-10-25T19:38:27.905736] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:38:27.905915] [DEBUG] [LOCAL ] BRBR: No existing data file found in primary storage. [2025-10-25T19:38:27.905994] [WARN ] [MAIN ] BRBR: No existing data found, performing full refresh instead. [2025-10-25T19:38:27.906110] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-25T19:38:27.906204] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-25T19:38:27.906290] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-25T19:38:27.906357] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-25T19:38:28.261199] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:38:28.261536] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-25T19:38:30.203287] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T19:38:30.213076] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-25T19:38:32.049600] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T19:38:32.058492] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-25T19:38:33.853208] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T19:38:33.864121] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-25T19:38:35.518732] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T19:38:35.529181] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-25T19:38:37.268332] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T19:38:37.279298] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-25T19:38:38.849146] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T19:38:38.859539] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-25T19:38:40.732694] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-25T19:38:40.745457] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-25T19:38:42.635505] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-25T19:38:42.648046] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-25T19:38:44.424368] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T19:38:44.436705] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-25T19:38:46.289407] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-25T19:38:46.300733] [INFO ] [REMOTE ] BRBR: Full fetch complete (73255 records). [2025-10-25T19:38:46.301052] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-25T19:38:46.738319] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-25T19:38:46.738485] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-25T19:38:46.739447] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-25T19:38:46.739538] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-25T19:38:46.741561] [DEBUG] [LOCAL ] BRBR: Trimmed 73255 records to 52567 (keeping 200 days of data) [2025-10-25T19:38:47.055385] [DEBUG] [LOCAL ] BRBR: Primary data saved (52567 records). [2025-10-25T19:38:47.055573] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-25T19:38:47.055718] [INFO ] [MAIN ] Update Progress: 330/2366 symbols. BRBR took 19.3s. Estimated remaining time: 4h 12m 52s [2025-10-25T19:38:47.224192] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:38:47.224392] [DEBUG] [LOCAL ] BRC: No existing data file found in primary storage. [2025-10-25T19:38:47.224465] [WARN ] [MAIN ] BRC: No existing data found, performing full refresh instead. [2025-10-25T19:38:47.224583] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-25T19:38:47.224680] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-25T19:38:47.224766] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-25T19:38:47.224853] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-25T19:38:47.576661] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:38:47.577024] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-25T19:38:48.942402] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T19:38:48.946533] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-25T19:38:50.076539] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T19:38:50.081244] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-25T19:38:51.367261] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T19:38:51.374065] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-25T19:38:52.667302] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T19:38:52.672286] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-25T19:38:53.737631] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:38:53.745253] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-25T19:38:54.932565] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T19:38:54.937266] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-25T19:38:56.090533] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T19:38:56.094870] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-25T19:38:57.214672] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T19:38:57.220063] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-25T19:38:58.388015] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T19:38:58.392682] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-25T19:38:59.445570] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T19:38:59.449320] [INFO ] [REMOTE ] BRC: Full fetch complete (28277 records). [2025-10-25T19:38:59.449421] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-25T19:38:59.812898] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-25T19:38:59.813010] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-25T19:38:59.813398] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-25T19:38:59.813474] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-25T19:38:59.814185] [DEBUG] [LOCAL ] BRC: Trimmed 28277 records to 18498 (keeping 200 days of data) [2025-10-25T19:38:59.936483] [DEBUG] [LOCAL ] BRC: Primary data saved (18498 records). [2025-10-25T19:38:59.936756] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-25T19:38:59.936917] [INFO ] [MAIN ] Update Progress: 331/2366 symbols. BRC took 12.9s. Estimated remaining time: 4h 13m 18s [2025-10-25T19:39:00.112689] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:00.112879] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-25T19:39:00.112930] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-25T19:39:00.113037] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-25T19:39:00.113111] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-25T19:39:00.113192] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-25T19:39:00.113264] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-25T19:39:00.460723] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:00.461045] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-25T19:39:02.478750] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-25T19:39:02.486571] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-25T19:39:03.986508] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T19:39:03.997174] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-25T19:39:05.556512] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T19:39:05.565281] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-25T19:39:07.212218] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T19:39:07.220461] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-25T19:39:09.022454] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T19:39:09.030920] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-25T19:39:10.560068] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T19:39:10.568162] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-25T19:39:12.141665] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T19:39:12.151963] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-25T19:39:13.891139] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T19:39:13.900635] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-25T19:39:15.571927] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T19:39:15.581152] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-25T19:39:17.306261] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-25T19:39:17.313379] [INFO ] [REMOTE ] BRCC: Full fetch complete (57260 records). [2025-10-25T19:39:17.313567] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-25T19:39:17.690514] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-25T19:39:17.690670] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-25T19:39:17.691299] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-25T19:39:17.691377] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-25T19:39:17.692674] [DEBUG] [LOCAL ] BRCC: Trimmed 57260 records to 40534 (keeping 200 days of data) [2025-10-25T19:39:17.910417] [DEBUG] [LOCAL ] BRCC: Primary data saved (40534 records). [2025-10-25T19:39:17.910580] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-25T19:39:17.910731] [INFO ] [MAIN ] Update Progress: 332/2366 symbols. BRCC took 18.0s. Estimated remaining time: 4h 14m 15s [2025-10-25T19:39:18.085624] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:18.085876] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-25T19:39:18.085950] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-25T19:39:18.086067] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-25T19:39:18.086139] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-25T19:39:18.086199] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-25T19:39:18.086262] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-25T19:39:18.449311] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:18.449686] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-25T19:39:18.793749] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:39:18.794090] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-25T19:39:18.794180] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:39:18.794255] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-25T19:39:18.794322] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:39:18.794395] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-25T19:39:18.794485] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-25T19:39:18.794555] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-25T19:39:18.794635] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-25T19:39:18.794751] [INFO ] [MAIN ] Update Progress: 333/2366 symbols. BRCE took 0.9s. Estimated remaining time: 4h 13m 27s [2025-10-25T19:39:18.974034] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:18.974235] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-25T19:39:18.974307] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-25T19:39:18.974426] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-25T19:39:18.974497] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-25T19:39:18.974577] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-25T19:39:18.974682] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-25T19:39:19.340582] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:19.340938] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-25T19:39:19.678611] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:39:19.678963] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-25T19:39:19.679048] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:39:19.679119] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-25T19:39:19.679186] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:39:19.679257] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-25T19:39:19.679346] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-25T19:39:19.679417] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-25T19:39:19.679496] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-25T19:39:19.679586] [INFO ] [MAIN ] Update Progress: 334/2366 symbols. BRIE took 0.9s. Estimated remaining time: 4h 12m 39s [2025-10-25T19:39:19.845207] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:19.845387] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-25T19:39:19.845464] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-25T19:39:19.845571] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-25T19:39:19.845659] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-25T19:39:19.845733] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-25T19:39:19.845794] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-25T19:39:20.197764] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:20.198116] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-25T19:39:22.184330] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T19:39:22.194887] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-25T19:39:24.050381] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T19:39:24.061049] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-25T19:39:25.980765] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T19:39:25.991632] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-25T19:39:27.083925] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T19:39:27.095129] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-25T19:39:28.289511] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T19:39:28.300328] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-25T19:39:29.372237] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:39:29.382490] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-25T19:39:30.436862] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T19:39:30.450079] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-25T19:39:31.405845] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:39:31.417061] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-25T19:39:32.411864] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T19:39:32.423124] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-25T19:39:33.349859] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:39:33.359468] [INFO ] [REMOTE ] BRO: Full fetch complete (75144 records). [2025-10-25T19:39:33.359625] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-25T19:39:33.748274] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-25T19:39:33.748406] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-25T19:39:33.749240] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-25T19:39:33.749324] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-25T19:39:33.750806] [DEBUG] [LOCAL ] BRO: Trimmed 75144 records to 52866 (keeping 200 days of data) [2025-10-25T19:39:34.067536] [DEBUG] [LOCAL ] BRO: Primary data saved (52866 records). [2025-10-25T19:39:34.067716] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-25T19:39:34.067845] [INFO ] [MAIN ] Update Progress: 335/2366 symbols. BRO took 14.4s. Estimated remaining time: 4h 13m 14s [2025-10-25T19:39:34.237004] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:34.237214] [DEBUG] [LOCAL ] BROS: No existing data file found in primary storage. [2025-10-25T19:39:34.237286] [WARN ] [MAIN ] BROS: No existing data found, performing full refresh instead. [2025-10-25T19:39:34.237407] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-25T19:39:34.237480] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-25T19:39:34.237560] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-10-25T19:39:34.237628] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-25T19:39:34.581988] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:34.582329] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-25T19:39:36.479681] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T19:39:36.490153] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-25T19:39:38.433333] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T19:39:38.444405] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-25T19:39:40.414071] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T19:39:40.425923] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-25T19:39:41.524494] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T19:39:41.535537] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-25T19:39:42.553614] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T19:39:42.567718] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-25T19:39:43.521867] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T19:39:43.534056] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-25T19:39:44.516471] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T19:39:44.529271] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-25T19:39:45.525081] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T19:39:45.537505] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-25T19:39:46.602189] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T19:39:46.616905] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-25T19:39:47.591499] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:39:47.604197] [INFO ] [REMOTE ] BROS: Full fetch complete (77274 records). [2025-10-25T19:39:47.604468] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-25T19:39:48.045540] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-25T19:39:48.045733] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-25T19:39:48.046713] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-25T19:39:48.046803] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-25T19:39:48.049079] [DEBUG] [LOCAL ] BROS: Trimmed 77274 records to 54077 (keeping 200 days of data) [2025-10-25T19:39:48.376958] [DEBUG] [LOCAL ] BROS: Primary data saved (54077 records). [2025-10-25T19:39:48.377231] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-25T19:39:48.377382] [INFO ] [MAIN ] Update Progress: 336/2366 symbols. BROS took 14.3s. Estimated remaining time: 4h 13m 47s [2025-10-25T19:39:48.575036] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:48.575305] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-25T19:39:48.575382] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-25T19:39:48.575515] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-25T19:39:48.575603] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-25T19:39:48.575720] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-25T19:39:48.575797] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-25T19:39:48.967633] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:48.968148] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-25T19:39:49.278148] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:39:49.278576] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-25T19:39:49.278695] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:39:49.278781] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-25T19:39:49.278852] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:39:49.278971] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-25T19:39:49.279077] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-25T19:39:49.279150] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-25T19:39:49.279238] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-25T19:39:49.279349] [INFO ] [MAIN ] Update Progress: 337/2366 symbols. BRSL took 0.9s. Estimated remaining time: 4h 13m 0s [2025-10-25T19:39:49.456474] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:39:49.456810] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-10-25T19:39:49.456888] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-10-25T19:39:49.457046] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-25T19:39:49.457125] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-25T19:39:49.457213] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-25T19:39:49.457290] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-25T19:39:49.844187] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:39:49.844627] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-25T19:39:51.257370] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T19:39:51.266205] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-25T19:39:52.791369] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T19:39:52.799336] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-25T19:39:54.476835] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T19:39:54.485530] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-25T19:39:55.392868] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T19:39:55.401960] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-25T19:39:56.261774] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T19:39:56.268909] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-25T19:39:57.104408] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T19:39:57.111553] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-25T19:39:57.962188] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T19:39:57.972920] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-25T19:39:58.879635] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T19:39:58.887754] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-25T19:39:59.754570] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T19:39:59.762546] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-25T19:40:00.677384] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T19:40:00.684154] [INFO ] [REMOTE ] BRSP: Full fetch complete (53952 records). [2025-10-25T19:40:00.684285] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-25T19:40:01.081695] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-25T19:40:01.081822] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-25T19:40:01.082498] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-25T19:40:01.082581] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-25T19:40:01.084005] [DEBUG] [LOCAL ] BRSP: Trimmed 53952 records to 36936 (keeping 200 days of data) [2025-10-25T19:40:01.294010] [DEBUG] [LOCAL ] BRSP: Primary data saved (36936 records). [2025-10-25T19:40:01.294188] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-25T19:40:01.294307] [INFO ] [MAIN ] Update Progress: 338/2366 symbols. BRSP took 12.0s. Estimated remaining time: 4h 13m 20s [2025-10-25T19:40:01.469692] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:40:01.469905] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-25T19:40:01.469975] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-25T19:40:01.470091] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-25T19:40:01.470182] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-25T19:40:01.470263] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-25T19:40:01.470330] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-25T19:40:01.843277] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:40:01.843723] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-25T19:40:02.978022] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T19:40:02.979873] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-25T19:40:03.652630] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T19:40:03.653996] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-25T19:40:04.393817] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-25T19:40:04.395767] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-25T19:40:05.295209] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-25T19:40:05.297325] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-25T19:40:06.011331] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T19:40:06.013356] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-25T19:40:06.700848] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-25T19:40:06.702769] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-25T19:40:07.403038] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T19:40:07.405851] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-25T19:40:08.168474] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T19:40:08.170664] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-25T19:40:08.911446] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-25T19:40:08.914044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-25T19:40:09.746512] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T19:40:09.749141] [INFO ] [REMOTE ] BRT: Full fetch complete (7144 records). [2025-10-25T19:40:09.749236] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-25T19:40:10.123002] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-25T19:40:10.123178] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-25T19:40:10.123959] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-25T19:40:10.124041] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-25T19:40:10.124838] [DEBUG] [LOCAL ] BRT: Trimmed 7144 records to 5335 (keeping 200 days of data) [2025-10-25T19:40:10.158711] [DEBUG] [LOCAL ] BRT: Primary data saved (5335 records). [2025-10-25T19:40:10.158931] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-25T19:40:10.159072] [INFO ] [MAIN ] Update Progress: 339/2366 symbols. BRT took 8.9s. Estimated remaining time: 4h 13m 21s [2025-10-25T19:40:10.336418] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:40:10.336726] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-25T19:40:10.336836] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-25T19:40:10.336966] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-25T19:40:10.337041] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-25T19:40:10.337125] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-25T19:40:10.337177] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-25T19:40:10.727838] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:40:10.728267] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-25T19:40:12.124414] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T19:40:12.130722] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-25T19:40:13.152076] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T19:40:13.156261] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-25T19:40:14.318019] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T19:40:14.322557] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-25T19:40:15.503445] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T19:40:15.507981] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-25T19:40:16.722318] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T19:40:16.725823] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-25T19:40:17.817553] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T19:40:17.821705] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-25T19:40:19.098774] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T19:40:19.108161] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-25T19:40:20.263739] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T19:40:20.268683] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-25T19:40:21.616194] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T19:40:21.622918] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-25T19:40:22.841604] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T19:40:22.846473] [INFO ] [REMOTE ] BRW: Full fetch complete (30207 records). [2025-10-25T19:40:22.846572] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-25T19:40:23.213018] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-25T19:40:23.213134] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-25T19:40:23.213565] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-25T19:40:23.213664] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-25T19:40:23.214458] [DEBUG] [LOCAL ] BRW: Trimmed 30207 records to 21283 (keeping 200 days of data) [2025-10-25T19:40:23.333459] [DEBUG] [LOCAL ] BRW: Primary data saved (21283 records). [2025-10-25T19:40:23.333613] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-25T19:40:23.333745] [INFO ] [MAIN ] Update Progress: 340/2366 symbols. BRW took 13.2s. Estimated remaining time: 4h 13m 47s [2025-10-25T19:40:23.509825] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:40:23.510022] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-10-25T19:40:23.510134] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-10-25T19:40:23.510250] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-25T19:40:23.510321] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-25T19:40:23.510401] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-25T19:40:23.510469] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-25T19:40:23.870006] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:40:23.870379] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-25T19:40:25.877474] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-25T19:40:25.887631] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-25T19:40:27.538109] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T19:40:27.548017] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-25T19:40:29.595308] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-25T19:40:29.606088] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-25T19:40:31.439078] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T19:40:31.450135] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-25T19:40:33.278973] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-25T19:40:33.289884] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-25T19:40:35.086227] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-25T19:40:35.101343] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-25T19:40:36.617336] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T19:40:36.628770] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-25T19:40:38.343580] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T19:40:38.354569] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-25T19:40:40.084396] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T19:40:40.095188] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-25T19:40:41.721527] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T19:40:41.731171] [INFO ] [REMOTE ] BRX: Full fetch complete (75153 records). [2025-10-25T19:40:41.731344] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-25T19:40:42.114833] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-25T19:40:42.114952] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-25T19:40:42.115793] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-25T19:40:42.115877] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-25T19:40:42.117306] [DEBUG] [LOCAL ] BRX: Trimmed 75153 records to 52579 (keeping 200 days of data) [2025-10-25T19:40:42.429140] [DEBUG] [LOCAL ] BRX: Primary data saved (52579 records). [2025-10-25T19:40:42.429387] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-25T19:40:42.429548] [INFO ] [MAIN ] Update Progress: 341/2366 symbols. BRX took 19.1s. Estimated remaining time: 4h 14m 48s [2025-10-25T19:40:42.627029] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:40:42.627237] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-25T19:40:42.627312] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-25T19:40:42.627426] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-25T19:40:42.627499] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-25T19:40:42.627599] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-25T19:40:42.627690] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-25T19:40:43.024258] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:40:43.024610] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-25T19:40:44.560345] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T19:40:44.565717] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-25T19:40:46.030781] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T19:40:46.036760] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-25T19:40:47.030491] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T19:40:47.038137] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-25T19:40:48.671763] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T19:40:48.680105] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-25T19:40:50.147449] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T19:40:50.155062] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-25T19:40:51.450931] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T19:40:51.458911] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-25T19:40:53.041305] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-25T19:40:53.049274] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-25T19:40:54.375172] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-25T19:40:54.384583] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-25T19:40:55.747544] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-25T19:40:55.754776] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-25T19:40:57.179129] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T19:40:57.185042] [INFO ] [REMOTE ] BSAC: Full fetch complete (45282 records). [2025-10-25T19:40:57.185187] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-25T19:40:57.563961] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-25T19:40:57.564094] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-25T19:40:57.564705] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-25T19:40:57.564792] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-25T19:40:57.566034] [DEBUG] [LOCAL ] BSAC: Trimmed 45282 records to 33212 (keeping 200 days of data) [2025-10-25T19:40:57.754813] [DEBUG] [LOCAL ] BSAC: Primary data saved (33212 records). [2025-10-25T19:40:57.755008] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-25T19:40:57.755136] [INFO ] [MAIN ] Update Progress: 342/2366 symbols. BSAC took 15.3s. Estimated remaining time: 4h 15m 27s [2025-10-25T19:40:57.928233] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:40:57.928430] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-25T19:40:57.928503] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-25T19:40:57.928625] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-25T19:40:57.928720] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-25T19:40:57.928804] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-25T19:40:57.928879] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-25T19:40:58.289064] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:40:58.289423] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-25T19:41:00.014719] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T19:41:00.022422] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-25T19:41:01.727207] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T19:41:01.734404] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-25T19:41:03.271485] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T19:41:03.278358] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-25T19:41:04.744017] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T19:41:04.751486] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-25T19:41:06.100809] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-25T19:41:06.108352] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-25T19:41:07.426504] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T19:41:07.433346] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-25T19:41:09.054708] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T19:41:09.063377] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-25T19:41:10.625464] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T19:41:10.634088] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-25T19:41:12.268029] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T19:41:12.276122] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-25T19:41:13.961465] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T19:41:13.968108] [INFO ] [REMOTE ] BSBR: Full fetch complete (50898 records). [2025-10-25T19:41:13.968233] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-25T19:41:14.338346] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-25T19:41:14.338466] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-25T19:41:14.339031] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-25T19:41:14.339112] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-25T19:41:14.340224] [DEBUG] [LOCAL ] BSBR: Trimmed 50898 records to 36230 (keeping 200 days of data) [2025-10-25T19:41:14.540363] [DEBUG] [LOCAL ] BSBR: Primary data saved (36230 records). [2025-10-25T19:41:14.540522] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-25T19:41:14.540635] [INFO ] [MAIN ] Update Progress: 343/2366 symbols. BSBR took 16.8s. Estimated remaining time: 4h 16m 13s [2025-10-25T19:41:14.708299] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:41:14.708471] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-25T19:41:14.708541] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-25T19:41:14.708673] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-25T19:41:14.708747] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-25T19:41:14.708826] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-25T19:41:14.708875] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-25T19:41:15.059631] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:41:15.060024] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-25T19:41:16.236560] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T19:41:16.238822] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-25T19:41:17.263015] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T19:41:17.266317] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-25T19:41:18.208362] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T19:41:18.212402] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-25T19:41:19.241004] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T19:41:19.244125] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-25T19:41:20.112722] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T19:41:20.114874] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-25T19:41:20.946957] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T19:41:20.949109] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-25T19:41:21.780091] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T19:41:21.782555] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-25T19:41:22.480054] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-25T19:41:22.481954] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-25T19:41:23.302717] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-25T19:41:23.305829] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-25T19:41:24.196801] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:41:24.200315] [INFO ] [REMOTE ] BSL: Full fetch complete (13002 records). [2025-10-25T19:41:24.200436] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-25T19:41:24.563802] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-25T19:41:24.563919] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-25T19:41:24.564236] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-25T19:41:24.564311] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-25T19:41:24.564859] [DEBUG] [LOCAL ] BSL: Trimmed 13002 records to 8034 (keeping 200 days of data) [2025-10-25T19:41:24.612504] [DEBUG] [LOCAL ] BSL: Primary data saved (8034 records). [2025-10-25T19:41:24.612640] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-25T19:41:24.612786] [INFO ] [MAIN ] Update Progress: 344/2366 symbols. BSL took 10.1s. Estimated remaining time: 4h 16m 20s [2025-10-25T19:41:24.779857] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:41:24.780040] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-25T19:41:24.780109] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-25T19:41:24.780221] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-25T19:41:24.780291] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-25T19:41:24.780369] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-25T19:41:24.780438] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-25T19:41:25.125688] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:41:25.126004] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-25T19:41:26.697324] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T19:41:26.704181] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-25T19:41:28.183358] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T19:41:28.190619] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-25T19:41:29.636032] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T19:41:29.646782] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-25T19:41:30.992995] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T19:41:31.001370] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-25T19:41:32.413705] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T19:41:32.420715] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-25T19:41:33.743396] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T19:41:33.749884] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-25T19:41:35.299470] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T19:41:35.307084] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-25T19:41:37.087596] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T19:41:37.095719] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-25T19:41:38.806079] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T19:41:38.813593] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-25T19:41:40.092756] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T19:41:40.098916] [INFO ] [REMOTE ] BSM: Full fetch complete (46634 records). [2025-10-25T19:41:40.099079] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-25T19:41:40.489681] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-25T19:41:40.489797] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-25T19:41:40.490370] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-25T19:41:40.490447] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-25T19:41:40.491530] [DEBUG] [LOCAL ] BSM: Trimmed 46634 records to 32602 (keeping 200 days of data) [2025-10-25T19:41:40.677626] [DEBUG] [LOCAL ] BSM: Primary data saved (32602 records). [2025-10-25T19:41:40.677843] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-25T19:41:40.677975] [INFO ] [MAIN ] Update Progress: 345/2366 symbols. BSM took 16.1s. Estimated remaining time: 4h 17m 2s [2025-10-25T19:41:40.845954] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:41:40.846195] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-25T19:41:40.846276] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-25T19:41:40.846395] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-25T19:41:40.846463] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-25T19:41:40.846551] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-25T19:41:40.846629] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-25T19:41:41.194947] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:41:41.195282] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-25T19:41:42.477952] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T19:41:42.483094] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-25T19:41:43.572709] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T19:41:43.577596] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-25T19:41:44.840016] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-25T19:41:44.847725] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-25T19:41:46.126364] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T19:41:46.131926] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-25T19:41:47.305910] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T19:41:47.310690] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-25T19:41:48.398116] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T19:41:48.402510] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-25T19:41:49.660672] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T19:41:49.665309] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-25T19:41:50.757973] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T19:41:50.762480] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-25T19:41:51.922826] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T19:41:51.927940] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-25T19:41:53.131870] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T19:41:53.135401] [INFO ] [REMOTE ] BST: Full fetch complete (28239 records). [2025-10-25T19:41:53.135519] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-25T19:41:53.526470] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-25T19:41:53.526589] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-25T19:41:53.527093] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-25T19:41:53.527176] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-25T19:41:53.528011] [DEBUG] [LOCAL ] BST: Trimmed 28239 records to 18604 (keeping 200 days of data) [2025-10-25T19:41:53.635484] [DEBUG] [LOCAL ] BST: Primary data saved (18604 records). [2025-10-25T19:41:53.635662] [INFO ] [MAIN ] BST: Full history saved. [2025-10-25T19:41:53.635779] [INFO ] [MAIN ] Update Progress: 346/2366 symbols. BST took 13.0s. Estimated remaining time: 4h 17m 26s [2025-10-25T19:41:53.808362] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:41:53.808550] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-25T19:41:53.808620] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-25T19:41:53.808752] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-25T19:41:53.808822] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-25T19:41:53.808903] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-25T19:41:53.809035] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-25T19:41:54.167889] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:41:54.168289] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-25T19:41:55.436388] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T19:41:55.442345] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-25T19:41:56.647347] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-25T19:41:56.652484] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-25T19:41:58.104425] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T19:41:58.110535] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-25T19:41:59.463232] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T19:41:59.469192] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-25T19:42:00.837980] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T19:42:00.843330] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-25T19:42:02.181715] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T19:42:02.187664] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-25T19:42:03.568313] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T19:42:03.574584] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-25T19:42:04.912766] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T19:42:04.918258] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-25T19:42:06.063516] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T19:42:06.069298] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-25T19:42:07.299398] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T19:42:07.304176] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36268 records). [2025-10-25T19:42:07.304284] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-25T19:42:07.673780] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-25T19:42:07.673908] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-25T19:42:07.674463] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-25T19:42:07.674592] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-25T19:42:07.675675] [DEBUG] [LOCAL ] BSTZ: Trimmed 36268 records to 24689 (keeping 200 days of data) [2025-10-25T19:42:07.817240] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24689 records). [2025-10-25T19:42:07.817410] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-25T19:42:07.817594] [INFO ] [MAIN ] Update Progress: 347/2366 symbols. BSTZ took 14.2s. Estimated remaining time: 4h 17m 56s [2025-10-25T19:42:07.984301] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:42:07.984513] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-25T19:42:07.984623] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-25T19:42:07.984788] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-25T19:42:07.984870] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-25T19:42:07.984973] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-25T19:42:07.985058] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-25T19:42:08.336531] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:42:08.336988] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-25T19:42:10.171778] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T19:42:10.182206] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-25T19:42:12.120504] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T19:42:12.131340] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-25T19:42:14.121018] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T19:42:14.134178] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-25T19:42:15.104839] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T19:42:15.115890] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-25T19:42:16.114913] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T19:42:16.126189] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-25T19:42:17.083783] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T19:42:17.094919] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-25T19:42:18.175319] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T19:42:18.187715] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-25T19:42:19.259906] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T19:42:19.271762] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-25T19:42:20.298874] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T19:42:20.314753] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-25T19:42:21.281721] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T19:42:21.292190] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-25T19:42:21.292362] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-25T19:42:21.719975] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-25T19:42:21.720105] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-25T19:42:21.720992] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-25T19:42:21.721083] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-25T19:42:21.722690] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 54468 (keeping 200 days of data) [2025-10-25T19:42:22.034941] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-10-25T19:42:22.035107] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-25T19:42:22.035223] [INFO ] [MAIN ] Update Progress: 348/2366 symbols. BSX took 14.2s. Estimated remaining time: 4h 18m 26s [2025-10-25T19:42:22.218673] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:42:22.218904] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-10-25T19:42:22.218980] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-10-25T19:42:22.219120] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-25T19:42:22.219191] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-25T19:42:22.219273] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-25T19:42:22.219344] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-25T19:42:22.567110] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:42:22.567453] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-25T19:42:23.738262] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T19:42:23.741206] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-25T19:42:24.698948] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T19:42:24.701478] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-25T19:42:25.373220] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T19:42:25.374836] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-25T19:42:26.067276] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-25T19:42:26.069392] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-25T19:42:26.845415] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-25T19:42:26.847431] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-25T19:42:27.570887] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T19:42:27.572599] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-25T19:42:28.278001] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T19:42:28.279894] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-25T19:42:29.075913] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T19:42:29.077681] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-25T19:42:29.870202] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T19:42:29.872166] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-25T19:42:30.604127] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T19:42:30.605875] [INFO ] [REMOTE ] BTA: Full fetch complete (9103 records). [2025-10-25T19:42:30.605965] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-25T19:42:30.962243] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-25T19:42:30.962351] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-25T19:42:30.962612] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-25T19:42:30.962722] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-25T19:42:30.963159] [DEBUG] [LOCAL ] BTA: Trimmed 9103 records to 5808 (keeping 200 days of data) [2025-10-25T19:42:30.997031] [DEBUG] [LOCAL ] BTA: Primary data saved (5808 records). [2025-10-25T19:42:30.997151] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-25T19:42:30.997240] [INFO ] [MAIN ] Update Progress: 349/2366 symbols. BTA took 9.0s. Estimated remaining time: 4h 18m 26s [2025-10-25T19:42:31.162963] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:42:31.163171] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-25T19:42:31.163241] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-25T19:42:31.163354] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-25T19:42:31.163402] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-25T19:42:31.163476] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-25T19:42:31.163580] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-25T19:42:31.518286] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:42:31.518739] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-25T19:42:33.351149] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T19:42:33.361374] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-25T19:42:35.196039] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T19:42:35.205799] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-25T19:42:39.407746] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (4.20 seconds). [2025-10-25T19:42:39.418932] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-25T19:42:41.093883] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T19:42:41.104779] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-25T19:42:42.806263] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T19:42:42.817344] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-25T19:42:44.551771] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-25T19:42:44.562537] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-25T19:42:46.687053] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-25T19:42:46.698670] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-25T19:42:48.491829] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T19:42:48.502937] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-25T19:42:50.317352] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-25T19:42:50.328802] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-25T19:42:53.383982] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-25T19:42:53.395084] [INFO ] [REMOTE ] BTE: Full fetch complete (76357 records). [2025-10-25T19:42:53.395266] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-25T19:42:53.781723] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-25T19:42:53.781834] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-25T19:42:53.782606] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-25T19:42:53.782706] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-25T19:42:53.784183] [DEBUG] [LOCAL ] BTE: Trimmed 76357 records to 53462 (keeping 200 days of data) [2025-10-25T19:42:54.080985] [DEBUG] [LOCAL ] BTE: Primary data saved (53462 records). [2025-10-25T19:42:54.081145] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-25T19:42:54.081258] [INFO ] [MAIN ] Update Progress: 350/2366 symbols. BTE took 23.1s. Estimated remaining time: 4h 19m 47s [2025-10-25T19:42:54.252510] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:42:54.252735] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-10-25T19:42:54.252812] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-10-25T19:42:54.252921] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-25T19:42:54.253000] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-25T19:42:54.253119] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-25T19:42:54.253190] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-25T19:42:54.603080] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:42:54.603430] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-25T19:42:56.506612] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T19:42:56.517158] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-25T19:42:58.339382] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T19:42:58.349749] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-25T19:43:00.445577] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T19:43:00.457131] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-25T19:43:01.960840] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T19:43:01.977535] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-25T19:43:03.054036] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T19:43:03.065237] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-25T19:43:04.143232] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T19:43:04.153852] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-25T19:43:05.247750] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T19:43:05.259288] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-25T19:43:06.243002] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T19:43:06.254340] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-25T19:43:07.176683] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T19:43:07.188011] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-25T19:43:08.068427] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:43:08.078084] [INFO ] [REMOTE ] BTI: Full fetch complete (77657 records). [2025-10-25T19:43:08.078295] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-25T19:43:08.460927] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-25T19:43:08.461035] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-25T19:43:08.461820] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-25T19:43:08.461899] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-25T19:43:08.463315] [DEBUG] [LOCAL ] BTI: Trimmed 77657 records to 54367 (keeping 200 days of data) [2025-10-25T19:43:08.781177] [DEBUG] [LOCAL ] BTI: Primary data saved (54367 records). [2025-10-25T19:43:08.781349] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-25T19:43:08.781475] [INFO ] [MAIN ] Update Progress: 351/2366 symbols. BTI took 14.7s. Estimated remaining time: 4h 20m 19s [2025-10-25T19:43:08.947941] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:43:08.948116] [DEBUG] [LOCAL ] BTO: No existing data file found in primary storage. [2025-10-25T19:43:08.948187] [WARN ] [MAIN ] BTO: No existing data found, performing full refresh instead. [2025-10-25T19:43:08.948295] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-25T19:43:08.948372] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-25T19:43:08.948467] [DEBUG] [LOCAL ] BTO: No primary data file found to delete. [2025-10-25T19:43:08.948533] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-25T19:43:09.297884] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:43:09.298206] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-25T19:43:10.470396] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T19:43:10.472927] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-25T19:43:11.550297] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T19:43:11.552943] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-25T19:43:12.447549] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-25T19:43:12.450549] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-25T19:43:13.398886] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T19:43:13.401888] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-25T19:43:14.417939] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T19:43:14.421589] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-25T19:43:15.322118] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T19:43:15.324719] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-25T19:43:16.256529] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:43:16.259192] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-25T19:43:17.173146] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T19:43:17.175570] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-25T19:43:18.078900] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T19:43:18.081582] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-25T19:43:18.939033] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T19:43:18.941359] [INFO ] [REMOTE ] BTO: Full fetch complete (13250 records). [2025-10-25T19:43:18.941471] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-25T19:43:19.297214] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-25T19:43:19.297331] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-25T19:43:19.297703] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-25T19:43:19.297782] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-25T19:43:19.298301] [DEBUG] [LOCAL ] BTO: Trimmed 13250 records to 8816 (keeping 200 days of data) [2025-10-25T19:43:19.350014] [DEBUG] [LOCAL ] BTO: Primary data saved (8816 records). [2025-10-25T19:43:19.350172] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-25T19:43:19.350287] [INFO ] [MAIN ] Update Progress: 352/2366 symbols. BTO took 10.6s. Estimated remaining time: 4h 20m 28s [2025-10-25T19:43:19.515178] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:43:19.515364] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-25T19:43:19.515434] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-25T19:43:19.515567] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-25T19:43:19.515639] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-25T19:43:19.515744] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-25T19:43:19.515814] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-25T19:43:19.881877] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:43:19.882191] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-25T19:43:21.107131] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T19:43:21.110836] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-25T19:43:22.160904] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T19:43:22.164442] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-25T19:43:23.314231] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T19:43:23.318547] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-25T19:43:24.444757] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T19:43:24.452481] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-25T19:43:25.468179] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T19:43:25.474553] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-25T19:43:26.545913] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:43:26.550042] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-25T19:43:27.625410] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T19:43:27.629151] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-25T19:43:28.676975] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T19:43:28.680808] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-25T19:43:29.671446] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T19:43:29.675860] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-25T19:43:30.674874] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T19:43:30.678735] [INFO ] [REMOTE ] BTT: Full fetch complete (22568 records). [2025-10-25T19:43:30.678894] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-25T19:43:31.073941] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-25T19:43:31.074053] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-25T19:43:31.074435] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-25T19:43:31.074515] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-25T19:43:31.075145] [DEBUG] [LOCAL ] BTT: Trimmed 22568 records to 15596 (keeping 200 days of data) [2025-10-25T19:43:31.167115] [DEBUG] [LOCAL ] BTT: Primary data saved (15596 records). [2025-10-25T19:43:31.167290] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-25T19:43:31.167410] [INFO ] [MAIN ] Update Progress: 353/2366 symbols. BTT took 11.8s. Estimated remaining time: 4h 20m 43s [2025-10-25T19:43:31.336908] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:43:31.337113] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-25T19:43:31.337184] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-25T19:43:31.337298] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-25T19:43:31.337368] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-25T19:43:31.337449] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-25T19:43:31.337517] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-25T19:43:31.689754] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:43:31.690117] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-25T19:43:33.513402] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T19:43:33.523745] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-25T19:43:35.386958] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T19:43:35.397337] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-25T19:43:37.292868] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T19:43:37.304059] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-25T19:43:38.268833] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T19:43:38.280072] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-25T19:43:39.172083] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T19:43:39.183351] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-25T19:43:40.224905] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T19:43:40.235940] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-25T19:43:41.225614] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T19:43:41.237795] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-25T19:43:42.221814] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T19:43:42.234338] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-25T19:43:43.260825] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T19:43:43.273091] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-25T19:43:44.164696] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:43:44.174461] [INFO ] [REMOTE ] BTU: Full fetch complete (77303 records). [2025-10-25T19:43:44.174632] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-25T19:43:44.562116] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-25T19:43:44.562244] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-25T19:43:44.563030] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-25T19:43:44.563109] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-25T19:43:44.564509] [DEBUG] [LOCAL ] BTU: Trimmed 77303 records to 54106 (keeping 200 days of data) [2025-10-25T19:43:44.879016] [DEBUG] [LOCAL ] BTU: Primary data saved (54106 records). [2025-10-25T19:43:44.879193] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-25T19:43:44.879313] [INFO ] [MAIN ] Update Progress: 354/2366 symbols. BTU took 13.7s. Estimated remaining time: 4h 21m 9s [2025-10-25T19:43:45.044753] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:43:45.044945] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-25T19:43:45.045015] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-25T19:43:45.045124] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-25T19:43:45.045194] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-25T19:43:45.045275] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-25T19:43:45.045344] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-25T19:43:45.393579] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:43:45.393947] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-25T19:43:45.746967] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:43:45.747271] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-25T19:43:45.747357] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:43:45.747404] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-25T19:43:45.747466] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:43:45.747539] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-25T19:43:45.747631] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-25T19:43:45.747718] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-25T19:43:45.747797] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-25T19:43:45.747932] [INFO ] [MAIN ] Update Progress: 355/2366 symbols. BTX took 0.9s. Estimated remaining time: 4h 20m 22s [2025-10-25T19:43:45.916900] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:43:45.917094] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-10-25T19:43:45.917166] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-10-25T19:43:45.917277] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-25T19:43:45.917348] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-25T19:43:45.917431] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-10-25T19:43:45.917499] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-25T19:43:46.267312] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:43:46.267628] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-25T19:43:47.662530] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T19:43:47.667682] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-25T19:43:48.835846] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-25T19:43:48.840818] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-25T19:43:50.065578] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-25T19:43:50.071134] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-25T19:43:51.453340] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T19:43:51.461717] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-25T19:43:53.072121] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T19:43:53.077847] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-25T19:43:54.175168] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:43:54.179897] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-25T19:43:55.309503] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T19:43:55.317432] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-25T19:43:56.541370] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T19:43:56.546433] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-25T19:43:57.691748] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T19:43:57.696864] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-25T19:43:58.806308] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T19:43:58.813154] [INFO ] [REMOTE ] BTZ: Full fetch complete (33204 records). [2025-10-25T19:43:58.813331] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-25T19:43:59.190461] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-25T19:43:59.190582] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-25T19:43:59.191094] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-25T19:43:59.191179] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-25T19:43:59.192026] [DEBUG] [LOCAL ] BTZ: Trimmed 33204 records to 22639 (keeping 200 days of data) [2025-10-25T19:43:59.332174] [DEBUG] [LOCAL ] BTZ: Primary data saved (22639 records). [2025-10-25T19:43:59.332337] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-25T19:43:59.332456] [INFO ] [MAIN ] Update Progress: 356/2366 symbols. BTZ took 13.6s. Estimated remaining time: 4h 20m 47s [2025-10-25T19:43:59.518301] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:43:59.518635] [DEBUG] [LOCAL ] BUD: No existing data file found in primary storage. [2025-10-25T19:43:59.518750] [WARN ] [MAIN ] BUD: No existing data found, performing full refresh instead. [2025-10-25T19:43:59.518873] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-25T19:43:59.518945] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-25T19:43:59.519029] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-10-25T19:43:59.519097] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-25T19:43:59.874093] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:43:59.874467] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-25T19:44:02.022912] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-25T19:44:02.033592] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-25T19:44:03.828135] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T19:44:03.837968] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-25T19:44:05.936556] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T19:44:05.948102] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-25T19:44:06.939898] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T19:44:06.951428] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-25T19:44:07.924768] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T19:44:07.935902] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-25T19:44:08.856183] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T19:44:08.871236] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-25T19:44:09.842707] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T19:44:09.854241] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-25T19:44:10.817358] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:44:10.828622] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-25T19:44:11.766600] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T19:44:11.778585] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-25T19:44:12.788363] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T19:44:12.802193] [INFO ] [REMOTE ] BUD: Full fetch complete (76482 records). [2025-10-25T19:44:12.802441] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-25T19:44:13.224814] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-25T19:44:13.224927] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-25T19:44:13.225690] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-25T19:44:13.225773] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-25T19:44:13.227166] [DEBUG] [LOCAL ] BUD: Trimmed 76482 records to 53363 (keeping 200 days of data) [2025-10-25T19:44:13.522518] [DEBUG] [LOCAL ] BUD: Primary data saved (53363 records). [2025-10-25T19:44:13.522696] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-25T19:44:13.522811] [INFO ] [MAIN ] Update Progress: 357/2366 symbols. BUD took 14.2s. Estimated remaining time: 4h 21m 15s [2025-10-25T19:44:13.687615] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:44:13.687813] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-10-25T19:44:13.687900] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-10-25T19:44:13.688017] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-25T19:44:13.688088] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-25T19:44:13.688168] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-25T19:44:13.688237] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-25T19:44:14.032187] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:44:14.032528] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-25T19:44:15.123174] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T19:44:15.126067] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-25T19:44:16.031027] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T19:44:16.033723] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-25T19:44:16.920137] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-25T19:44:16.922911] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-25T19:44:17.875315] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T19:44:17.880415] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-25T19:44:18.725219] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T19:44:18.728256] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-25T19:44:19.794859] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T19:44:19.798005] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-25T19:44:20.816978] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T19:44:20.820473] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-25T19:44:21.835874] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T19:44:21.838995] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-25T19:44:22.838388] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T19:44:22.841948] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-25T19:44:23.728857] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:44:23.731860] [INFO ] [REMOTE ] BUI: Full fetch complete (16498 records). [2025-10-25T19:44:23.731952] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-25T19:44:24.133666] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-25T19:44:24.133854] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-25T19:44:24.134442] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-25T19:44:24.134530] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-25T19:44:24.135465] [DEBUG] [LOCAL ] BUI: Trimmed 16498 records to 11930 (keeping 200 days of data) [2025-10-25T19:44:24.216420] [DEBUG] [LOCAL ] BUI: Primary data saved (11930 records). [2025-10-25T19:44:24.216684] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-25T19:44:24.216835] [INFO ] [MAIN ] Update Progress: 358/2366 symbols. BUI took 10.7s. Estimated remaining time: 4h 21m 24s [2025-10-25T19:44:24.395087] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:44:24.395362] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-10-25T19:44:24.395437] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-10-25T19:44:24.395567] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-25T19:44:24.395667] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-25T19:44:24.395769] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-10-25T19:44:24.395842] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-25T19:44:24.777450] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:44:24.778020] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-25T19:44:26.333157] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T19:44:26.342405] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-25T19:44:27.926467] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T19:44:27.938527] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-25T19:44:29.644435] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T19:44:29.654867] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-25T19:44:31.389309] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T19:44:31.398923] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-25T19:44:33.766515] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-25T19:44:33.776550] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-25T19:44:35.191606] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T19:44:35.203013] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-25T19:44:37.656153] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-25T19:44:37.666507] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-25T19:44:39.444964] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T19:44:39.455025] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-25T19:44:40.875107] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T19:44:40.884807] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-25T19:44:42.446980] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-25T19:44:42.456393] [INFO ] [REMOTE ] BUR: Full fetch complete (64673 records). [2025-10-25T19:44:42.456597] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-25T19:44:42.902177] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-25T19:44:42.902337] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-25T19:44:42.903205] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-25T19:44:42.903305] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-25T19:44:42.905193] [DEBUG] [LOCAL ] BUR: Trimmed 64673 records to 46177 (keeping 200 days of data) [2025-10-25T19:44:43.187218] [DEBUG] [LOCAL ] BUR: Primary data saved (46177 records). [2025-10-25T19:44:43.187448] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-25T19:44:43.187587] [INFO ] [MAIN ] Update Progress: 359/2366 symbols. BUR took 19.0s. Estimated remaining time: 4h 22m 18s [2025-10-25T19:44:43.367059] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:44:43.367374] [DEBUG] [LOCAL ] BURL: No existing data file found in primary storage. [2025-10-25T19:44:43.367454] [WARN ] [MAIN ] BURL: No existing data found, performing full refresh instead. [2025-10-25T19:44:43.367623] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-25T19:44:43.367724] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-25T19:44:43.367813] [DEBUG] [LOCAL ] BURL: No primary data file found to delete. [2025-10-25T19:44:43.367920] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-25T19:44:43.748665] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:44:43.749150] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-25T19:44:45.329774] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T19:44:45.338084] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-25T19:44:47.054713] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T19:44:47.063333] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-25T19:44:49.017846] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T19:44:49.028170] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-25T19:44:50.995992] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-25T19:44:51.007858] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-25T19:44:52.897064] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-25T19:44:52.907352] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-25T19:44:54.504808] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T19:44:54.514107] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-25T19:44:56.142841] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T19:44:56.152838] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-25T19:44:57.806626] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-25T19:44:57.816614] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-25T19:44:59.590439] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T19:44:59.600220] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-25T19:45:01.550566] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-25T19:45:01.558672] [INFO ] [REMOTE ] BURL: Full fetch complete (65732 records). [2025-10-25T19:45:01.558828] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-25T19:45:01.974717] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-25T19:45:01.975115] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-25T19:45:01.976504] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-25T19:45:01.976623] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-25T19:45:01.978971] [DEBUG] [LOCAL ] BURL: Trimmed 65732 records to 45994 (keeping 200 days of data) [2025-10-25T19:45:02.304256] [DEBUG] [LOCAL ] BURL: Primary data saved (45994 records). [2025-10-25T19:45:02.304481] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-25T19:45:02.304601] [INFO ] [MAIN ] Update Progress: 360/2366 symbols. BURL took 19.1s. Estimated remaining time: 4h 23m 13s [2025-10-25T19:45:02.487667] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:45:02.488028] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-25T19:45:02.488112] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-25T19:45:02.488245] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-25T19:45:02.488322] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-25T19:45:02.488408] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-25T19:45:02.488482] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-25T19:45:02.927563] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:45:02.928107] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-25T19:45:03.989741] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-25T19:45:03.992542] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-25T19:45:04.887602] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T19:45:04.890383] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-25T19:45:05.873869] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T19:45:05.877183] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-25T19:45:07.017311] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T19:45:07.022221] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-25T19:45:08.183831] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T19:45:08.188091] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-25T19:45:09.233541] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T19:45:09.237687] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-25T19:45:10.252764] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T19:45:10.256717] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-25T19:45:11.222622] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T19:45:11.225962] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-25T19:45:12.279114] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T19:45:12.282795] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-25T19:45:13.195161] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T19:45:13.198199] [INFO ] [REMOTE ] BUXX: Full fetch complete (20780 records). [2025-10-25T19:45:13.198306] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-25T19:45:13.571385] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-25T19:45:13.571555] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-25T19:45:13.571933] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-25T19:45:13.572047] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-25T19:45:13.572718] [DEBUG] [LOCAL ] BUXX: Trimmed 20780 records to 15540 (keeping 200 days of data) [2025-10-25T19:45:13.664197] [DEBUG] [LOCAL ] BUXX: Primary data saved (15540 records). [2025-10-25T19:45:13.664371] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-25T19:45:13.664487] [INFO ] [MAIN ] Update Progress: 361/2366 symbols. BUXX took 11.4s. Estimated remaining time: 4h 23m 25s [2025-10-25T19:45:13.832464] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:45:13.832677] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-25T19:45:13.832750] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-25T19:45:13.832836] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-25T19:45:13.832904] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-25T19:45:13.832991] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-25T19:45:13.833061] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-25T19:45:14.187374] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:45:14.187736] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-25T19:45:15.598506] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T19:45:15.604775] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-25T19:45:17.138982] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T19:45:17.149868] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-25T19:45:18.715582] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T19:45:18.724811] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-25T19:45:20.481548] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-25T19:45:20.489820] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-25T19:45:21.953721] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T19:45:21.963774] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-25T19:45:23.430269] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T19:45:23.437781] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-25T19:45:24.904577] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T19:45:24.913425] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-25T19:45:26.492166] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T19:45:26.500787] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-25T19:45:28.044460] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T19:45:28.053619] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-25T19:45:29.547284] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-25T19:45:29.554696] [INFO ] [REMOTE ] BV: Full fetch complete (55106 records). [2025-10-25T19:45:29.554853] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-25T19:45:29.944328] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-25T19:45:29.944486] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-25T19:45:29.945096] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-25T19:45:29.945176] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-25T19:45:29.946316] [DEBUG] [LOCAL ] BV: Trimmed 55106 records to 39038 (keeping 200 days of data) [2025-10-25T19:45:30.165952] [DEBUG] [LOCAL ] BV: Primary data saved (39038 records). [2025-10-25T19:45:30.166131] [INFO ] [MAIN ] BV: Full history saved. [2025-10-25T19:45:30.166282] [INFO ] [MAIN ] Update Progress: 362/2366 symbols. BV took 16.5s. Estimated remaining time: 4h 24m 5s [2025-10-25T19:45:30.337915] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:45:30.338106] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-25T19:45:30.338179] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-25T19:45:30.338291] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-25T19:45:30.338362] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-25T19:45:30.338444] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-25T19:45:30.338515] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-25T19:45:30.701540] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:45:30.702118] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-25T19:45:32.366338] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T19:45:32.375014] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-25T19:45:33.950989] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T19:45:33.959120] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-25T19:45:35.260395] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-25T19:45:35.269594] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-25T19:45:36.119188] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T19:45:36.129040] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-25T19:45:37.216209] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T19:45:37.225232] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-25T19:45:38.232037] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T19:45:38.241027] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-25T19:45:39.239017] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T19:45:39.249004] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-25T19:45:40.065548] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T19:45:40.075517] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-25T19:45:40.947489] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T19:45:40.958340] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-25T19:45:41.890565] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:45:41.899596] [INFO ] [REMOTE ] BVN: Full fetch complete (63614 records). [2025-10-25T19:45:41.899770] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-25T19:45:42.283317] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-25T19:45:42.283440] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-25T19:45:42.284118] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-25T19:45:42.284199] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-25T19:45:42.285528] [DEBUG] [LOCAL ] BVN: Trimmed 63614 records to 45245 (keeping 200 days of data) [2025-10-25T19:45:42.539765] [DEBUG] [LOCAL ] BVN: Primary data saved (45245 records). [2025-10-25T19:45:42.539926] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-25T19:45:42.540044] [INFO ] [MAIN ] Update Progress: 363/2366 symbols. BVN took 12.4s. Estimated remaining time: 4h 24m 21s [2025-10-25T19:45:42.707273] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:45:42.707489] [DEBUG] [LOCAL ] BW: No existing data file found in primary storage. [2025-10-25T19:45:42.707560] [WARN ] [MAIN ] BW: No existing data found, performing full refresh instead. [2025-10-25T19:45:42.707706] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-25T19:45:42.707780] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-25T19:45:42.707879] [DEBUG] [LOCAL ] BW: No primary data file found to delete. [2025-10-25T19:45:42.707952] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-25T19:45:43.059211] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:45:43.059555] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-25T19:45:44.688561] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T19:45:44.696939] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-25T19:45:46.317879] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T19:45:46.325893] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-25T19:45:47.873911] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T19:45:47.882762] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-25T19:45:48.759927] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T19:45:48.769366] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-25T19:45:49.670932] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T19:45:49.678548] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-25T19:45:50.547226] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T19:45:50.554802] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-25T19:45:51.401850] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T19:45:51.408795] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-25T19:45:52.300162] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T19:45:52.309796] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-25T19:45:53.312206] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T19:45:53.322581] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-25T19:45:54.223228] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:45:54.236244] [INFO ] [REMOTE ] BW: Full fetch complete (59310 records). [2025-10-25T19:45:54.236456] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-25T19:45:54.643590] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-25T19:45:54.643724] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-25T19:45:54.644378] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-25T19:45:54.644458] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-25T19:45:54.645716] [DEBUG] [LOCAL ] BW: Trimmed 59310 records to 40994 (keeping 200 days of data) [2025-10-25T19:45:54.864778] [DEBUG] [LOCAL ] BW: Primary data saved (40994 records). [2025-10-25T19:45:54.864931] [INFO ] [MAIN ] BW: Full history saved. [2025-10-25T19:45:54.865064] [INFO ] [MAIN ] Update Progress: 364/2366 symbols. BW took 12.3s. Estimated remaining time: 4h 24m 38s [2025-10-25T19:45:55.031880] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:45:55.032074] [DEBUG] [LOCAL ] BWA: No existing data file found in primary storage. [2025-10-25T19:45:55.032142] [WARN ] [MAIN ] BWA: No existing data found, performing full refresh instead. [2025-10-25T19:45:55.032234] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-25T19:45:55.032378] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-25T19:45:55.032470] [DEBUG] [LOCAL ] BWA: No primary data file found to delete. [2025-10-25T19:45:55.032535] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-25T19:45:55.387777] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:45:55.388198] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-25T19:45:57.288811] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T19:45:57.299411] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-25T19:45:59.197905] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T19:45:59.207888] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-25T19:46:01.179832] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T19:46:01.190924] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-25T19:46:02.814886] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T19:46:02.825927] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-25T19:46:04.050143] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T19:46:04.061310] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-25T19:46:05.166344] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T19:46:05.178701] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-25T19:46:06.278717] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T19:46:06.289887] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-25T19:46:07.178426] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T19:46:07.189637] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-25T19:46:08.145624] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T19:46:08.157727] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-25T19:46:09.174678] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T19:46:09.190181] [INFO ] [REMOTE ] BWA: Full fetch complete (75881 records). [2025-10-25T19:46:09.190452] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-25T19:46:09.831139] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-25T19:46:09.831285] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-25T19:46:09.832405] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-25T19:46:09.832511] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-25T19:46:09.834365] [DEBUG] [LOCAL ] BWA: Trimmed 75881 records to 52824 (keeping 200 days of data) [2025-10-25T19:46:10.174696] [DEBUG] [LOCAL ] BWA: Primary data saved (52824 records). [2025-10-25T19:46:10.174879] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-25T19:46:10.175010] [INFO ] [MAIN ] Update Progress: 365/2366 symbols. BWA took 15.3s. Estimated remaining time: 4h 25m 10s [2025-10-25T19:46:10.351493] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:46:10.351711] [DEBUG] [LOCAL ] BWG: No existing data file found in primary storage. [2025-10-25T19:46:10.351783] [WARN ] [MAIN ] BWG: No existing data found, performing full refresh instead. [2025-10-25T19:46:10.351871] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-25T19:46:10.351939] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-25T19:46:10.351998] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-25T19:46:10.352038] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-25T19:46:10.696895] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:46:10.697259] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-25T19:46:11.971868] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T19:46:11.975866] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-25T19:46:13.069967] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T19:46:13.072849] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-25T19:46:14.062033] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T19:46:14.064543] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-25T19:46:14.990982] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T19:46:14.994314] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-25T19:46:16.126320] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T19:46:16.129924] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-25T19:46:17.055671] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T19:46:17.058593] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-25T19:46:18.139173] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T19:46:18.143021] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-25T19:46:19.103691] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:46:19.107065] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-25T19:46:20.224674] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T19:46:20.228388] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-25T19:46:21.085664] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T19:46:21.087871] [INFO ] [REMOTE ] BWG: Full fetch complete (17591 records). [2025-10-25T19:46:21.087972] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-25T19:46:21.445615] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-25T19:46:21.445755] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-25T19:46:21.446076] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-25T19:46:21.446156] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-25T19:46:21.446799] [DEBUG] [LOCAL ] BWG: Trimmed 17591 records to 12755 (keeping 200 days of data) [2025-10-25T19:46:21.518531] [DEBUG] [LOCAL ] BWG: Primary data saved (12755 records). [2025-10-25T19:46:21.518710] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-25T19:46:21.518827] [INFO ] [MAIN ] Update Progress: 366/2366 symbols. BWG took 11.3s. Estimated remaining time: 4h 25m 21s [2025-10-25T19:46:21.682404] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:46:21.682587] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-25T19:46:21.682683] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-25T19:46:21.682797] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-25T19:46:21.682869] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-25T19:46:21.682950] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-25T19:46:21.683022] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-25T19:46:22.031017] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:46:22.031344] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-25T19:46:23.528290] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T19:46:23.535913] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-25T19:46:25.007068] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T19:46:25.014182] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-25T19:46:26.595138] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T19:46:26.603740] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-25T19:46:27.960010] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-25T19:46:27.966943] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-25T19:46:29.471247] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T19:46:29.479177] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-25T19:46:31.076074] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T19:46:31.084121] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-25T19:46:32.572173] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T19:46:32.579875] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-25T19:46:34.012720] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T19:46:34.020016] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-25T19:46:35.466244] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-25T19:46:35.473259] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-25T19:46:36.915902] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-25T19:46:36.921914] [INFO ] [REMOTE ] BWLP: Full fetch complete (47755 records). [2025-10-25T19:46:36.922033] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-25T19:46:37.314625] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-25T19:46:37.314797] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-25T19:46:37.315430] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-25T19:46:37.315529] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-25T19:46:37.316724] [DEBUG] [LOCAL ] BWLP: Trimmed 47755 records to 32471 (keeping 200 days of data) [2025-10-25T19:46:37.501557] [DEBUG] [LOCAL ] BWLP: Primary data saved (32471 records). [2025-10-25T19:46:37.501760] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-25T19:46:37.501896] [INFO ] [MAIN ] Update Progress: 367/2366 symbols. BWLP took 16.0s. Estimated remaining time: 4h 25m 57s [2025-10-25T19:46:37.667964] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:46:37.668196] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-10-25T19:46:37.668282] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-10-25T19:46:37.668439] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-25T19:46:37.668531] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-25T19:46:37.668635] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-25T19:46:37.668753] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-25T19:46:38.023424] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:46:38.023836] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-25T19:46:38.833914] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-25T19:46:38.836516] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-25T19:46:39.509176] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T19:46:39.510919] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-25T19:46:40.194234] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-25T19:46:40.195861] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-25T19:46:41.052947] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T19:46:41.055116] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-25T19:46:41.931338] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T19:46:41.934421] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-25T19:46:42.837345] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T19:46:42.839763] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-25T19:46:43.813925] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T19:46:43.817129] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-25T19:46:44.722319] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T19:46:44.725221] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-25T19:46:45.453729] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-25T19:46:45.455835] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-25T19:46:46.197597] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T19:46:46.199392] [INFO ] [REMOTE ] BWMX: Full fetch complete (9949 records). [2025-10-25T19:46:46.199488] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-25T19:46:46.588523] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-25T19:46:46.588674] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-25T19:46:46.589034] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-25T19:46:46.589131] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-25T19:46:46.589707] [DEBUG] [LOCAL ] BWMX: Trimmed 9949 records to 7964 (keeping 200 days of data) [2025-10-25T19:46:46.637022] [DEBUG] [LOCAL ] BWMX: Primary data saved (7964 records). [2025-10-25T19:46:46.637208] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-25T19:46:46.637349] [INFO ] [MAIN ] Update Progress: 368/2366 symbols. BWMX took 9.1s. Estimated remaining time: 4h 25m 55s [2025-10-25T19:46:46.809028] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:46:46.809288] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-10-25T19:46:46.809376] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-10-25T19:46:46.809517] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-25T19:46:46.809607] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-25T19:46:46.809730] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-10-25T19:46:46.809817] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-25T19:46:47.183964] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:46:47.184376] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-25T19:46:47.752082] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-25T19:46:47.753267] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-25T19:46:48.370515] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T19:46:48.371932] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-25T19:46:49.077768] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T19:46:49.079384] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-25T19:46:49.774406] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-25T19:46:49.775925] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-25T19:46:50.600315] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T19:46:50.602799] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-25T19:46:51.293142] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-25T19:46:51.294991] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-25T19:46:51.876480] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T19:46:51.877621] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-25T19:46:52.672773] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T19:46:52.674697] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-25T19:46:53.353028] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-25T19:46:53.354539] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-25T19:46:53.863288] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-25T19:46:53.864335] [INFO ] [REMOTE ] BWNB: Full fetch complete (5586 records). [2025-10-25T19:46:53.864438] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-25T19:46:54.232785] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-25T19:46:54.232908] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-25T19:46:54.233095] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-25T19:46:54.233174] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-25T19:46:54.233668] [DEBUG] [LOCAL ] BWNB: Trimmed 5586 records to 4083 (keeping 200 days of data) [2025-10-25T19:46:54.257886] [DEBUG] [LOCAL ] BWNB: Primary data saved (4083 records). [2025-10-25T19:46:54.258053] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-25T19:46:54.258189] [INFO ] [MAIN ] Update Progress: 369/2366 symbols. BWNB took 7.6s. Estimated remaining time: 4h 25m 45s [2025-10-25T19:46:54.426674] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:46:54.426868] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-10-25T19:46:54.426943] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-10-25T19:46:54.427067] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-25T19:46:54.427138] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-25T19:46:54.427218] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-25T19:46:54.427294] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-25T19:46:54.780128] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:46:54.780551] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-25T19:46:55.318223] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-25T19:46:55.319355] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-25T19:46:55.938789] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T19:46:55.940044] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-25T19:46:56.397102] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T19:46:56.399121] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-25T19:46:57.116007] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T19:46:57.117783] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-25T19:46:57.912589] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T19:46:57.915066] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-25T19:46:58.785275] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T19:46:58.787389] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-25T19:46:59.370510] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T19:46:59.371919] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-25T19:47:00.116128] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-25T19:47:00.118226] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-25T19:47:00.763665] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-25T19:47:00.765002] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-25T19:47:01.763395] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T19:47:01.765833] [INFO ] [REMOTE ] BWSN: Full fetch complete (6425 records). [2025-10-25T19:47:01.765996] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-25T19:47:02.318849] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-25T19:47:02.319004] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-25T19:47:02.319322] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-25T19:47:02.319424] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-25T19:47:02.320179] [DEBUG] [LOCAL ] BWSN: Trimmed 6425 records to 5117 (keeping 200 days of data) [2025-10-25T19:47:02.354896] [DEBUG] [LOCAL ] BWSN: Primary data saved (5117 records). [2025-10-25T19:47:02.355120] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-25T19:47:02.355290] [INFO ] [MAIN ] Update Progress: 370/2366 symbols. BWSN took 8.1s. Estimated remaining time: 4h 25m 38s [2025-10-25T19:47:02.555354] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:47:02.555679] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-10-25T19:47:02.555769] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-10-25T19:47:02.555938] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-25T19:47:02.556033] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-25T19:47:02.556140] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-25T19:47:02.556229] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-25T19:47:02.949270] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:47:02.949601] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-25T19:47:04.869812] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T19:47:04.878972] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-25T19:47:06.585798] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T19:47:06.594728] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-25T19:47:08.463007] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T19:47:08.472734] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-25T19:47:09.450394] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T19:47:09.461349] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-25T19:47:10.354936] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T19:47:10.365332] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-25T19:47:11.305240] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:47:11.315267] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-25T19:47:12.471944] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T19:47:12.483170] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-25T19:47:13.451236] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T19:47:13.462613] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-25T19:47:14.395757] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T19:47:14.405921] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-25T19:47:15.295963] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:47:15.305253] [INFO ] [REMOTE ] BWXT: Full fetch complete (68084 records). [2025-10-25T19:47:15.305443] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-25T19:47:15.692730] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-25T19:47:15.692856] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-25T19:47:15.693573] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-25T19:47:15.693679] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-25T19:47:15.695007] [DEBUG] [LOCAL ] BWXT: Trimmed 68084 records to 47929 (keeping 200 days of data) [2025-10-25T19:47:15.978798] [DEBUG] [LOCAL ] BWXT: Primary data saved (47929 records). [2025-10-25T19:47:15.978969] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-25T19:47:15.979090] [INFO ] [MAIN ] Update Progress: 371/2366 symbols. BWXT took 13.6s. Estimated remaining time: 4h 25m 60s [2025-10-25T19:47:16.171687] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:47:16.171927] [DEBUG] [LOCAL ] BX: No existing data file found in primary storage. [2025-10-25T19:47:16.172009] [WARN ] [MAIN ] BX: No existing data found, performing full refresh instead. [2025-10-25T19:47:16.172136] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-25T19:47:16.172212] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-25T19:47:16.172297] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-10-25T19:47:16.172370] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-25T19:47:16.555313] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:47:16.555706] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-25T19:47:18.484172] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-25T19:47:18.494830] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-25T19:47:20.391713] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T19:47:20.402113] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-25T19:47:22.607226] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-25T19:47:22.618602] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-25T19:47:23.694420] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T19:47:23.705574] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-25T19:47:24.706716] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T19:47:24.718121] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-25T19:47:25.734253] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T19:47:25.748690] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-25T19:47:26.827919] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T19:47:26.839774] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-25T19:47:27.886984] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T19:47:27.898524] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-25T19:47:29.068209] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T19:47:29.080054] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-25T19:47:30.029988] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T19:47:30.039996] [INFO ] [REMOTE ] BX: Full fetch complete (77611 records). [2025-10-25T19:47:30.040196] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-25T19:47:30.441107] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-25T19:47:30.441233] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-25T19:47:30.442051] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-25T19:47:30.442131] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-25T19:47:30.443529] [DEBUG] [LOCAL ] BX: Trimmed 77611 records to 54263 (keeping 200 days of data) [2025-10-25T19:47:30.787793] [DEBUG] [LOCAL ] BX: Primary data saved (54263 records). [2025-10-25T19:47:30.788016] [INFO ] [MAIN ] BX: Full history saved. [2025-10-25T19:47:30.788185] [INFO ] [MAIN ] Update Progress: 372/2366 symbols. BX took 14.8s. Estimated remaining time: 4h 26m 28s [2025-10-25T19:47:30.964225] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:47:30.964467] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-10-25T19:47:30.964557] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-10-25T19:47:30.964716] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-25T19:47:30.964806] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-25T19:47:30.964912] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-25T19:47:30.965002] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-25T19:47:31.351631] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:47:31.352051] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-25T19:47:32.191301] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-25T19:47:32.194023] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-25T19:47:33.046945] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-25T19:47:33.049717] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-25T19:47:33.975536] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T19:47:33.978841] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-25T19:47:35.048121] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T19:47:35.052066] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-25T19:47:36.032714] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T19:47:36.037803] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-25T19:47:37.090944] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T19:47:37.094147] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-25T19:47:38.255108] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T19:47:38.258966] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-25T19:47:39.414367] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T19:47:39.418004] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-25T19:47:40.382454] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T19:47:40.385987] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-25T19:47:41.410071] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T19:47:41.412507] [INFO ] [REMOTE ] BXC: Full fetch complete (18286 records). [2025-10-25T19:47:41.412607] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-25T19:47:41.810073] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-25T19:47:41.810202] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-25T19:47:41.810538] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-25T19:47:41.810664] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-25T19:47:41.811454] [DEBUG] [LOCAL ] BXC: Trimmed 18286 records to 13507 (keeping 200 days of data) [2025-10-25T19:47:41.888304] [DEBUG] [LOCAL ] BXC: Primary data saved (13507 records). [2025-10-25T19:47:41.888474] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-25T19:47:41.888599] [INFO ] [MAIN ] Update Progress: 373/2366 symbols. BXC took 11.1s. Estimated remaining time: 4h 26m 37s [2025-10-25T19:47:42.066734] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:47:42.066944] [DEBUG] [LOCAL ] BXMT: No existing data file found in primary storage. [2025-10-25T19:47:42.067017] [WARN ] [MAIN ] BXMT: No existing data found, performing full refresh instead. [2025-10-25T19:47:42.067137] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-25T19:47:42.067244] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-25T19:47:42.067337] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-25T19:47:42.067430] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-25T19:47:42.420881] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:47:42.421267] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-25T19:47:44.304256] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T19:47:44.314279] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-25T19:47:46.735423] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-25T19:47:46.745002] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-25T19:47:48.610129] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T19:47:48.620571] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-25T19:47:49.665984] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T19:47:49.682387] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-25T19:47:50.707217] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T19:47:50.717806] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-25T19:47:51.434442] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T19:47:51.444502] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-25T19:47:52.483726] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T19:47:52.494179] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-25T19:47:53.238499] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-25T19:47:53.249567] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-25T19:47:54.216363] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:47:54.227544] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-25T19:47:55.219750] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:47:55.233232] [INFO ] [REMOTE ] BXMT: Full fetch complete (69850 records). [2025-10-25T19:47:55.233446] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-25T19:47:55.661500] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-25T19:47:55.661622] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-25T19:47:55.662684] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-25T19:47:55.662770] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-25T19:47:55.664301] [DEBUG] [LOCAL ] BXMT: Trimmed 69850 records to 47958 (keeping 200 days of data) [2025-10-25T19:47:55.958028] [DEBUG] [LOCAL ] BXMT: Primary data saved (47958 records). [2025-10-25T19:47:55.958185] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-25T19:47:55.958302] [INFO ] [MAIN ] Update Progress: 374/2366 symbols. BXMT took 14.1s. Estimated remaining time: 4h 27m 1s [2025-10-25T19:47:56.122168] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:47:56.122369] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-10-25T19:47:56.122441] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-10-25T19:47:56.122556] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-25T19:47:56.122634] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-25T19:47:56.122736] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-25T19:47:56.122805] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-25T19:47:56.465074] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:47:56.465436] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-25T19:47:57.610325] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T19:47:57.614862] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-25T19:47:58.642163] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T19:47:58.646682] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-25T19:47:59.912171] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T19:47:59.917331] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-25T19:48:01.321502] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T19:48:01.327269] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-25T19:48:03.414334] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-25T19:48:03.419098] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-25T19:48:04.743276] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T19:48:04.748022] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-25T19:48:05.958480] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T19:48:05.963464] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-25T19:48:07.027588] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T19:48:07.033072] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-25T19:48:08.122151] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T19:48:08.126845] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-25T19:48:09.291201] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T19:48:09.295111] [INFO ] [REMOTE ] BXMX: Full fetch complete (28540 records). [2025-10-25T19:48:09.295218] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-25T19:48:09.661029] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-25T19:48:09.661175] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-25T19:48:09.661693] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-25T19:48:09.661784] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-25T19:48:09.662732] [DEBUG] [LOCAL ] BXMX: Trimmed 28540 records to 19411 (keeping 200 days of data) [2025-10-25T19:48:09.776338] [DEBUG] [LOCAL ] BXMX: Primary data saved (19411 records). [2025-10-25T19:48:09.776514] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-25T19:48:09.776691] [INFO ] [MAIN ] Update Progress: 375/2366 symbols. BXMX took 13.8s. Estimated remaining time: 4h 27m 24s [2025-10-25T19:48:09.941071] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:48:09.941272] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-25T19:48:09.941378] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-25T19:48:09.941529] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-25T19:48:09.941616] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-25T19:48:09.941751] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-25T19:48:09.941830] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-25T19:48:10.301091] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:48:10.301480] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-25T19:48:12.184996] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T19:48:12.194582] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-25T19:48:13.922823] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T19:48:13.932066] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-25T19:48:15.899486] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T19:48:15.911355] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-25T19:48:16.929094] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T19:48:16.939987] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-25T19:48:18.027896] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T19:48:18.041360] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-25T19:48:18.997001] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T19:48:19.007420] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-25T19:48:19.964286] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T19:48:19.974852] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-25T19:48:20.872419] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T19:48:20.883175] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-25T19:48:21.856729] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:48:21.867401] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-25T19:48:22.754909] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:48:22.763941] [INFO ] [REMOTE ] BXP: Full fetch complete (72203 records). [2025-10-25T19:48:22.764083] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-25T19:48:23.145251] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-25T19:48:23.145372] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-25T19:48:23.146192] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-25T19:48:23.146279] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-25T19:48:23.147794] [DEBUG] [LOCAL ] BXP: Trimmed 72203 records to 50526 (keeping 200 days of data) [2025-10-25T19:48:23.445737] [DEBUG] [LOCAL ] BXP: Primary data saved (50526 records). [2025-10-25T19:48:23.445910] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-25T19:48:23.446047] [INFO ] [MAIN ] Update Progress: 376/2366 symbols. BXP took 13.7s. Estimated remaining time: 4h 27m 45s [2025-10-25T19:48:23.618141] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:48:23.618554] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-10-25T19:48:23.618661] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-10-25T19:48:23.618796] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-25T19:48:23.618886] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-25T19:48:23.619048] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-25T19:48:23.619140] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-25T19:48:23.969525] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:48:23.969989] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-25T19:48:25.835585] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T19:48:25.845312] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-25T19:48:27.465792] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T19:48:27.474851] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-25T19:48:29.222256] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T19:48:29.232506] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-25T19:48:31.053506] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T19:48:31.064211] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-25T19:48:32.685766] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T19:48:32.695253] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-25T19:48:34.364173] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T19:48:34.373745] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-25T19:48:36.033844] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-25T19:48:36.043813] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-25T19:48:37.807321] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T19:48:37.818070] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-25T19:48:39.734906] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-25T19:48:39.746074] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-25T19:48:41.584005] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-25T19:48:41.593862] [INFO ] [REMOTE ] BXSL: Full fetch complete (70088 records). [2025-10-25T19:48:41.594037] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-25T19:48:41.978390] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-25T19:48:41.978506] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-25T19:48:41.979266] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-25T19:48:41.979350] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-25T19:48:41.980734] [DEBUG] [LOCAL ] BXSL: Trimmed 70088 records to 48967 (keeping 200 days of data) [2025-10-25T19:48:42.266954] [DEBUG] [LOCAL ] BXSL: Primary data saved (48967 records). [2025-10-25T19:48:42.267123] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-25T19:48:42.267260] [INFO ] [MAIN ] Update Progress: 377/2366 symbols. BXSL took 18.8s. Estimated remaining time: 4h 28m 34s [2025-10-25T19:48:42.433692] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:48:42.433891] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-25T19:48:42.433965] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-25T19:48:42.434077] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-25T19:48:42.434184] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-25T19:48:42.434289] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-25T19:48:42.434377] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-25T19:48:42.814982] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:48:42.816721] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-25T19:48:43.957688] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T19:48:43.962054] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-25T19:48:44.891796] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T19:48:44.895009] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-25T19:48:45.937391] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T19:48:45.943637] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-25T19:48:47.234692] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T19:48:47.240593] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-25T19:48:48.361291] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T19:48:48.365530] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-25T19:48:49.603601] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-25T19:48:49.609350] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-25T19:48:50.844337] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T19:48:50.850781] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-25T19:48:53.555493] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-25T19:48:53.560120] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-25T19:48:54.724034] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T19:48:54.730093] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-25T19:48:55.914405] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T19:48:55.918446] [INFO ] [REMOTE ] BY: Full fetch complete (29691 records). [2025-10-25T19:48:55.918542] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-25T19:48:56.283153] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-25T19:48:56.283266] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-25T19:48:56.283709] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-25T19:48:56.283787] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-25T19:48:56.284523] [DEBUG] [LOCAL ] BY: Trimmed 29691 records to 22005 (keeping 200 days of data) [2025-10-25T19:48:56.409796] [DEBUG] [LOCAL ] BY: Primary data saved (22005 records). [2025-10-25T19:48:56.409950] [INFO ] [MAIN ] BY: Full history saved. [2025-10-25T19:48:56.410065] [INFO ] [MAIN ] Update Progress: 378/2366 symbols. BY took 14.1s. Estimated remaining time: 4h 28m 58s [2025-10-25T19:48:56.574741] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:48:56.574938] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-25T19:48:56.575007] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-25T19:48:56.575116] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-25T19:48:56.575186] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-25T19:48:56.575266] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-25T19:48:56.575334] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-25T19:48:56.922822] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:48:56.923153] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-25T19:49:00.475255] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (3.55 seconds). [2025-10-25T19:49:00.486689] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-25T19:49:02.348236] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T19:49:02.358053] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-25T19:49:04.082133] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T19:49:04.092629] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-25T19:49:05.633608] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T19:49:05.643484] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-25T19:49:07.300017] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T19:49:07.309100] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-25T19:49:09.026197] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-25T19:49:09.035254] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-25T19:49:10.932385] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-25T19:49:10.943392] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-25T19:49:12.602605] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T19:49:12.612506] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-25T19:49:14.386415] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T19:49:14.399387] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-25T19:49:15.944565] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T19:49:15.953819] [INFO ] [REMOTE ] BYD: Full fetch complete (65570 records). [2025-10-25T19:49:15.954014] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-25T19:49:16.366999] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-25T19:49:16.367120] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-25T19:49:16.367976] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-25T19:49:16.368061] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-25T19:49:16.369495] [DEBUG] [LOCAL ] BYD: Trimmed 65570 records to 45697 (keeping 200 days of data) [2025-10-25T19:49:16.643671] [DEBUG] [LOCAL ] BYD: Primary data saved (45697 records). [2025-10-25T19:49:16.643831] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-25T19:49:16.643950] [INFO ] [MAIN ] Update Progress: 379/2366 symbols. BYD took 20.2s. Estimated remaining time: 4h 29m 53s [2025-10-25T19:49:16.821786] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:49:16.821989] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-10-25T19:49:16.822068] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-10-25T19:49:16.822200] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-25T19:49:16.822302] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-25T19:49:16.822389] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-25T19:49:16.822459] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-25T19:49:17.180071] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:49:17.180420] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-25T19:49:18.229342] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T19:49:18.232609] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-25T19:49:18.904912] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T19:49:18.907397] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-25T19:49:20.027188] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T19:49:20.032474] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-25T19:49:21.065126] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T19:49:21.070455] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-25T19:49:22.318764] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T19:49:22.322181] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-25T19:49:23.187736] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T19:49:23.190877] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-25T19:49:24.120409] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:49:24.123555] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-25T19:49:25.011228] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T19:49:25.014668] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-25T19:49:25.932774] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T19:49:25.936157] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-25T19:49:26.869021] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:49:26.871423] [INFO ] [REMOTE ] BYM: Full fetch complete (17197 records). [2025-10-25T19:49:26.871514] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-25T19:49:27.268349] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-25T19:49:27.268459] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-25T19:49:27.268826] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-25T19:49:27.268921] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-25T19:49:27.269485] [DEBUG] [LOCAL ] BYM: Trimmed 17197 records to 11502 (keeping 200 days of data) [2025-10-25T19:49:27.336225] [DEBUG] [LOCAL ] BYM: Primary data saved (11502 records). [2025-10-25T19:49:27.336385] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-25T19:49:27.336480] [INFO ] [MAIN ] Update Progress: 380/2366 symbols. BYM took 10.7s. Estimated remaining time: 4h 29m 58s [2025-10-25T19:49:27.515746] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:49:27.515940] [DEBUG] [LOCAL ] BZH: No existing data file found in primary storage. [2025-10-25T19:49:27.516013] [WARN ] [MAIN ] BZH: No existing data found, performing full refresh instead. [2025-10-25T19:49:27.516125] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-25T19:49:27.516195] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-25T19:49:27.516276] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-25T19:49:27.516354] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-25T19:49:27.897089] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:49:27.897442] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-25T19:49:29.229853] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-25T19:49:29.235783] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-25T19:49:30.708675] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T19:49:30.716396] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-25T19:49:32.105511] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T19:49:32.112754] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-25T19:49:33.703420] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T19:49:33.710859] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-25T19:49:35.183205] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T19:49:35.190930] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-25T19:49:36.514786] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T19:49:36.521363] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-25T19:49:37.972939] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T19:49:37.980454] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-25T19:49:39.444835] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T19:49:39.452377] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-25T19:49:40.881191] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T19:49:40.888782] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-25T19:49:42.694090] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-25T19:49:42.703044] [INFO ] [REMOTE ] BZH: Full fetch complete (47152 records). [2025-10-25T19:49:42.703354] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-25T19:49:43.139099] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-25T19:49:43.139304] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-25T19:49:43.140077] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-25T19:49:43.140184] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-25T19:49:43.141964] [DEBUG] [LOCAL ] BZH: Trimmed 47152 records to 32434 (keeping 200 days of data) [2025-10-25T19:49:43.340546] [DEBUG] [LOCAL ] BZH: Primary data saved (32434 records). [2025-10-25T19:49:43.340812] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-25T19:49:43.340961] [INFO ] [MAIN ] Update Progress: 381/2366 symbols. BZH took 16.0s. Estimated remaining time: 4h 30m 31s [2025-10-25T19:49:43.527180] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:49:43.527500] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-10-25T19:49:43.527582] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-10-25T19:49:43.527738] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-25T19:49:43.527816] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-25T19:49:43.527936] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-25T19:49:43.528013] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-25T19:49:43.901233] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:49:43.901711] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-25T19:49:45.985459] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-25T19:49:46.000520] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-25T19:49:48.163726] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-25T19:49:48.173591] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-25T19:49:50.552177] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-25T19:49:50.564324] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-25T19:49:51.563092] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T19:49:51.574884] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-25T19:49:52.561311] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T19:49:52.573109] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-25T19:49:53.596868] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T19:49:53.608332] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-25T19:49:54.708015] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T19:49:54.719878] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-25T19:49:55.812865] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T19:49:55.827033] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-25T19:49:56.893034] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T19:49:56.906791] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-25T19:49:58.407369] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T19:49:58.417280] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-25T19:49:58.417436] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-25T19:49:58.832782] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-25T19:49:58.832957] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-25T19:49:58.833977] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-25T19:49:58.834071] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-25T19:49:58.836444] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 54521 (keeping 200 days of data) [2025-10-25T19:49:59.183099] [DEBUG] [LOCAL ] C: Primary data saved (54521 records). [2025-10-25T19:49:59.183329] [INFO ] [MAIN ] C: Full history saved. [2025-10-25T19:49:59.183469] [INFO ] [MAIN ] Update Progress: 382/2366 symbols. C took 15.8s. Estimated remaining time: 4h 31m 3s [2025-10-25T19:49:59.355215] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:49:59.355481] [DEBUG] [LOCAL ] CAAP: No existing data file found in primary storage. [2025-10-25T19:49:59.355557] [WARN ] [MAIN ] CAAP: No existing data found, performing full refresh instead. [2025-10-25T19:49:59.355714] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-25T19:49:59.355792] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-25T19:49:59.355877] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-25T19:49:59.355949] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-25T19:49:59.728835] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:49:59.729291] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-25T19:50:00.937283] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T19:50:00.942629] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-25T19:50:02.403403] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T19:50:02.407316] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-25T19:50:03.654236] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T19:50:03.659180] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-25T19:50:04.997228] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-25T19:50:05.001977] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-25T19:50:06.176383] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T19:50:06.181240] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-25T19:50:07.269981] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T19:50:07.274079] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-25T19:50:08.291339] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T19:50:08.297799] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-25T19:50:09.353051] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T19:50:09.357039] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-25T19:50:10.798637] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T19:50:10.804871] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-25T19:50:11.990752] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T19:50:11.995267] [INFO ] [REMOTE ] CAAP: Full fetch complete (28018 records). [2025-10-25T19:50:11.995408] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-25T19:50:12.371548] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-25T19:50:12.371708] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-25T19:50:12.372176] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-25T19:50:12.372274] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-25T19:50:12.373073] [DEBUG] [LOCAL ] CAAP: Trimmed 28018 records to 20243 (keeping 200 days of data) [2025-10-25T19:50:12.484775] [DEBUG] [LOCAL ] CAAP: Primary data saved (20243 records). [2025-10-25T19:50:12.484944] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-25T19:50:12.485078] [INFO ] [MAIN ] Update Progress: 383/2366 symbols. CAAP took 13.3s. Estimated remaining time: 4h 31m 21s [2025-10-25T19:50:12.666201] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:50:12.666414] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-10-25T19:50:12.666504] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-10-25T19:50:12.666672] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-25T19:50:12.666769] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-25T19:50:12.666875] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-10-25T19:50:12.666967] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-25T19:50:13.028933] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:50:13.029347] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-25T19:50:14.003880] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T19:50:14.006474] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-25T19:50:15.137722] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T19:50:15.141354] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-25T19:50:16.127213] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T19:50:16.131438] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-25T19:50:17.201620] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T19:50:17.206631] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-25T19:50:18.511532] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T19:50:18.517150] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-25T19:50:19.669100] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T19:50:19.673617] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-25T19:50:20.722380] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T19:50:20.727451] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-25T19:50:21.826286] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T19:50:21.830505] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-25T19:50:22.849963] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T19:50:22.853334] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-25T19:50:23.786224] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:50:23.788789] [INFO ] [REMOTE ] CABO: Full fetch complete (23220 records). [2025-10-25T19:50:23.788887] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-25T19:50:24.157142] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-25T19:50:24.157268] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-25T19:50:24.157706] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-25T19:50:24.157791] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-25T19:50:24.158533] [DEBUG] [LOCAL ] CABO: Trimmed 23220 records to 16835 (keeping 200 days of data) [2025-10-25T19:50:24.257000] [DEBUG] [LOCAL ] CABO: Primary data saved (16835 records). [2025-10-25T19:50:24.257154] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-25T19:50:24.257276] [INFO ] [MAIN ] Update Progress: 384/2366 symbols. CABO took 11.8s. Estimated remaining time: 4h 31m 31s [2025-10-25T19:50:24.423794] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:50:24.423959] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-10-25T19:50:24.424028] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-10-25T19:50:24.424148] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-25T19:50:24.424220] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-25T19:50:24.424299] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-25T19:50:24.424367] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-25T19:50:24.784479] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:50:24.784906] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-25T19:50:26.221174] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T19:50:26.227621] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-25T19:50:27.596180] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T19:50:27.604393] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-25T19:50:29.159440] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T19:50:29.167287] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-25T19:50:30.932849] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T19:50:30.941124] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-25T19:50:32.422421] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T19:50:32.428441] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-25T19:50:33.687249] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-25T19:50:33.692151] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-25T19:50:34.874939] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T19:50:34.879760] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-25T19:50:35.984674] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T19:50:35.989521] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-25T19:50:36.943504] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T19:50:36.947971] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-25T19:50:38.089455] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T19:50:38.093251] [INFO ] [REMOTE ] CACI: Full fetch complete (38524 records). [2025-10-25T19:50:38.093351] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-25T19:50:38.466669] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-25T19:50:38.466793] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-25T19:50:38.467311] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-25T19:50:38.467391] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-25T19:50:38.468280] [DEBUG] [LOCAL ] CACI: Trimmed 38524 records to 22875 (keeping 200 days of data) [2025-10-25T19:50:38.623041] [DEBUG] [LOCAL ] CACI: Primary data saved (22875 records). [2025-10-25T19:50:38.623226] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-25T19:50:38.623350] [INFO ] [MAIN ] Update Progress: 385/2366 symbols. CACI took 14.4s. Estimated remaining time: 4h 31m 54s [2025-10-25T19:50:38.825936] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:50:38.826250] [DEBUG] [LOCAL ] CADE: No existing data file found in primary storage. [2025-10-25T19:50:38.826342] [WARN ] [MAIN ] CADE: No existing data found, performing full refresh instead. [2025-10-25T19:50:38.826485] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-25T19:50:38.826577] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-25T19:50:38.826706] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-10-25T19:50:38.826794] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-25T19:50:39.366276] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:50:39.366855] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-25T19:50:41.078893] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T19:50:41.088168] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-25T19:50:42.598695] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T19:50:42.607399] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-25T19:50:44.153432] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T19:50:44.163029] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-25T19:50:45.135185] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T19:50:45.145690] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-25T19:50:46.151408] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T19:50:46.161256] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-25T19:50:47.332143] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T19:50:47.342464] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-25T19:50:48.276129] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T19:50:48.288411] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-25T19:50:49.193207] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T19:50:49.203492] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-25T19:50:50.187431] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T19:50:50.198304] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-25T19:50:51.199552] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T19:50:51.209194] [INFO ] [REMOTE ] CADE: Full fetch complete (70791 records). [2025-10-25T19:50:51.209365] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-25T19:50:51.599637] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-25T19:50:51.599781] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-25T19:50:51.600534] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-25T19:50:51.600612] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-25T19:50:51.602020] [DEBUG] [LOCAL ] CADE: Trimmed 70791 records to 50431 (keeping 200 days of data) [2025-10-25T19:50:51.897048] [DEBUG] [LOCAL ] CADE: Primary data saved (50431 records). [2025-10-25T19:50:51.897225] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-25T19:50:51.897320] [INFO ] [MAIN ] Update Progress: 386/2366 symbols. CADE took 13.3s. Estimated remaining time: 4h 32m 12s [2025-10-25T19:50:52.065831] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:50:52.066031] [DEBUG] [LOCAL ] CAE: No existing data file found in primary storage. [2025-10-25T19:50:52.066103] [WARN ] [MAIN ] CAE: No existing data found, performing full refresh instead. [2025-10-25T19:50:52.066198] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-25T19:50:52.066264] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-25T19:50:52.066324] [DEBUG] [LOCAL ] CAE: No primary data file found to delete. [2025-10-25T19:50:52.066386] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-25T19:50:52.423926] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:50:52.424272] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-25T19:50:53.853854] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T19:50:53.860982] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-25T19:50:55.278807] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T19:50:55.286307] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-25T19:50:56.922520] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T19:50:56.931218] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-25T19:50:58.411716] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T19:50:58.420828] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-25T19:50:59.849776] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T19:50:59.858514] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-25T19:51:01.411946] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T19:51:01.420369] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-25T19:51:02.937296] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T19:51:02.946133] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-25T19:51:04.366401] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T19:51:04.374872] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-25T19:51:06.026688] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T19:51:06.035215] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-25T19:51:07.659720] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T19:51:07.667053] [INFO ] [REMOTE ] CAE: Full fetch complete (56544 records). [2025-10-25T19:51:07.667210] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-25T19:51:08.059552] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-25T19:51:08.059699] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-25T19:51:08.060381] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-25T19:51:08.060461] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-25T19:51:08.061692] [DEBUG] [LOCAL ] CAE: Trimmed 56544 records to 39531 (keeping 200 days of data) [2025-10-25T19:51:08.283386] [DEBUG] [LOCAL ] CAE: Primary data saved (39531 records). [2025-10-25T19:51:08.283560] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-25T19:51:08.283705] [INFO ] [MAIN ] Update Progress: 387/2366 symbols. CAE took 16.4s. Estimated remaining time: 4h 32m 45s [2025-10-25T19:51:08.467970] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:51:08.468216] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-10-25T19:51:08.468290] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-10-25T19:51:08.468414] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-25T19:51:08.468488] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-25T19:51:08.468570] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-25T19:51:08.468666] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-25T19:51:08.828118] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:51:08.828483] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-25T19:51:09.507400] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-25T19:51:09.509099] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-25T19:51:10.176989] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T19:51:10.178859] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-25T19:51:10.817469] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-25T19:51:10.819045] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-25T19:51:11.539011] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T19:51:11.540762] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-25T19:51:12.208052] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-25T19:51:12.209697] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-25T19:51:12.935446] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T19:51:12.936824] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-25T19:51:13.498332] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-25T19:51:13.499786] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-25T19:51:14.052693] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T19:51:14.054180] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-25T19:51:14.690497] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T19:51:14.692070] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-25T19:51:15.386238] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-25T19:51:15.387558] [INFO ] [REMOTE ] CAF: Full fetch complete (5538 records). [2025-10-25T19:51:15.387679] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-25T19:51:15.744721] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-25T19:51:15.744834] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-25T19:51:15.745044] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-25T19:51:15.745128] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-25T19:51:15.745530] [DEBUG] [LOCAL ] CAF: Trimmed 5538 records to 3518 (keeping 200 days of data) [2025-10-25T19:51:15.765460] [DEBUG] [LOCAL ] CAF: Primary data saved (3518 records). [2025-10-25T19:51:15.765554] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-25T19:51:15.765680] [INFO ] [MAIN ] Update Progress: 388/2366 symbols. CAF took 7.5s. Estimated remaining time: 4h 32m 33s [2025-10-25T19:51:15.940104] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:51:15.940298] [DEBUG] [LOCAL ] CAG: No existing data file found in primary storage. [2025-10-25T19:51:15.940369] [WARN ] [MAIN ] CAG: No existing data found, performing full refresh instead. [2025-10-25T19:51:15.940478] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-25T19:51:15.940547] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-25T19:51:15.940607] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-25T19:51:15.940689] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-25T19:51:16.314937] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:51:16.315341] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-25T19:51:18.096745] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T19:51:18.107053] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-25T19:51:19.825811] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T19:51:19.836955] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-25T19:51:22.137193] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-25T19:51:22.148472] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-25T19:51:23.263615] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T19:51:23.274837] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-25T19:51:24.348520] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:51:24.359730] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-25T19:51:25.016781] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T19:51:25.027599] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-25T19:51:26.112818] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T19:51:26.124839] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-25T19:51:27.181951] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T19:51:27.193894] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-25T19:51:28.333288] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T19:51:28.344479] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-25T19:51:29.127435] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T19:51:29.138118] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-25T19:51:29.138397] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-25T19:51:29.560066] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-25T19:51:29.560237] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-25T19:51:29.561388] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-25T19:51:29.561496] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-25T19:51:29.563904] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 54446 (keeping 200 days of data) [2025-10-25T19:51:29.882484] [DEBUG] [LOCAL ] CAG: Primary data saved (54446 records). [2025-10-25T19:51:29.882669] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-25T19:51:29.882789] [INFO ] [MAIN ] Update Progress: 389/2366 symbols. CAG took 14.1s. Estimated remaining time: 4h 32m 54s [2025-10-25T19:51:30.048371] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:51:30.048551] [DEBUG] [LOCAL ] CAH: No existing data file found in primary storage. [2025-10-25T19:51:30.048620] [WARN ] [MAIN ] CAH: No existing data found, performing full refresh instead. [2025-10-25T19:51:30.048749] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-25T19:51:30.048826] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-25T19:51:30.048905] [DEBUG] [LOCAL ] CAH: No primary data file found to delete. [2025-10-25T19:51:30.048974] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-25T19:51:30.396847] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:51:30.397180] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-25T19:51:32.236262] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T19:51:32.246256] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-25T19:51:33.974166] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T19:51:33.983912] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-25T19:51:35.911865] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T19:51:35.922573] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-25T19:51:36.452780] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-25T19:51:36.463569] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-25T19:51:37.581566] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T19:51:37.592362] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-25T19:51:38.564307] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:51:38.574591] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-25T19:51:39.599749] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T19:51:39.610722] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-25T19:51:40.649356] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T19:51:40.660460] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-25T19:51:41.643498] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T19:51:41.654501] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-25T19:51:42.631269] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T19:51:42.640529] [INFO ] [REMOTE ] CAH: Full fetch complete (74856 records). [2025-10-25T19:51:42.640694] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-25T19:51:43.035660] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-25T19:51:43.035820] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-25T19:51:43.036615] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-25T19:51:43.036713] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-25T19:51:43.038168] [DEBUG] [LOCAL ] CAH: Trimmed 74856 records to 52161 (keeping 200 days of data) [2025-10-25T19:51:43.353734] [DEBUG] [LOCAL ] CAH: Primary data saved (52161 records). [2025-10-25T19:51:43.353898] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-25T19:51:43.354021] [INFO ] [MAIN ] Update Progress: 390/2366 symbols. CAH took 13.5s. Estimated remaining time: 4h 33m 12s [2025-10-25T19:51:43.528679] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:51:43.528853] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-10-25T19:51:43.528925] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-10-25T19:51:43.529079] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-25T19:51:43.529162] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-25T19:51:43.529249] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-25T19:51:43.529327] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-25T19:51:43.902414] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:51:43.902804] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-25T19:51:45.410389] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T19:51:45.418356] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-25T19:51:46.968999] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T19:51:46.976951] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-25T19:51:48.613075] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T19:51:48.622828] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-25T19:51:50.341440] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T19:51:50.350970] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-25T19:51:52.262767] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-25T19:51:52.271896] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-25T19:51:53.808233] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T19:51:53.817164] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-25T19:51:55.332518] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T19:51:55.342760] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-25T19:51:56.800601] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T19:51:56.809258] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-25T19:51:58.486444] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-25T19:51:58.495994] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-25T19:52:00.069062] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T19:52:00.076769] [INFO ] [REMOTE ] CAL: Full fetch complete (61885 records). [2025-10-25T19:52:00.076929] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-25T19:52:00.460621] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-25T19:52:00.460778] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-25T19:52:00.461462] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-25T19:52:00.461545] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-25T19:52:00.462934] [DEBUG] [LOCAL ] CAL: Trimmed 61885 records to 43308 (keeping 200 days of data) [2025-10-25T19:52:00.711847] [DEBUG] [LOCAL ] CAL: Primary data saved (43308 records). [2025-10-25T19:52:00.711982] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-25T19:52:00.712098] [INFO ] [MAIN ] Update Progress: 391/2366 symbols. CAL took 17.4s. Estimated remaining time: 4h 33m 50s [2025-10-25T19:52:00.877630] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:52:00.877834] [DEBUG] [LOCAL ] CALX: No existing data file found in primary storage. [2025-10-25T19:52:00.877925] [WARN ] [MAIN ] CALX: No existing data found, performing full refresh instead. [2025-10-25T19:52:00.878040] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-25T19:52:00.878138] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-25T19:52:00.878221] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-10-25T19:52:00.878294] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-25T19:52:01.228197] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:52:01.228584] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-25T19:52:02.769742] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T19:52:02.776747] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-25T19:52:04.325442] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T19:52:04.332638] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-25T19:52:05.886391] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T19:52:05.894910] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-25T19:52:07.464549] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T19:52:07.473615] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-25T19:52:09.007272] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T19:52:09.015506] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-25T19:52:10.397751] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T19:52:10.405667] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-25T19:52:12.008174] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T19:52:12.022198] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-25T19:52:13.578375] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T19:52:13.586595] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-25T19:52:15.194338] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T19:52:15.201735] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-25T19:52:16.814599] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T19:52:16.820799] [INFO ] [REMOTE ] CALX: Full fetch complete (54067 records). [2025-10-25T19:52:16.820957] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-25T19:52:17.196017] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-25T19:52:17.196129] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-25T19:52:17.196741] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-25T19:52:17.196820] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-25T19:52:17.197965] [DEBUG] [LOCAL ] CALX: Trimmed 54067 records to 37702 (keeping 200 days of data) [2025-10-25T19:52:17.405211] [DEBUG] [LOCAL ] CALX: Primary data saved (37702 records). [2025-10-25T19:52:17.405372] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-25T19:52:17.405490] [INFO ] [MAIN ] Update Progress: 392/2366 symbols. CALX took 16.7s. Estimated remaining time: 4h 34m 24s [2025-10-25T19:52:17.570196] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:52:17.570376] [DEBUG] [LOCAL ] CANG: No existing data file found in primary storage. [2025-10-25T19:52:17.570446] [WARN ] [MAIN ] CANG: No existing data found, performing full refresh instead. [2025-10-25T19:52:17.570555] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-25T19:52:17.570624] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-25T19:52:17.570728] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-25T19:52:17.570776] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-25T19:52:17.915863] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:52:17.916212] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-25T19:52:19.239193] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T19:52:19.245777] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-25T19:52:20.453852] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T19:52:20.462823] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-25T19:52:21.843549] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T19:52:21.852840] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-25T19:52:22.929336] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T19:52:22.933863] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-25T19:52:24.145086] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T19:52:24.150888] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-25T19:52:25.561530] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T19:52:25.569126] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-25T19:52:27.017877] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T19:52:27.025327] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-25T19:52:28.106675] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T19:52:28.112554] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-25T19:52:29.485210] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T19:52:29.492159] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-25T19:52:30.927036] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T19:52:30.932248] [INFO ] [REMOTE ] CANG: Full fetch complete (39148 records). [2025-10-25T19:52:30.932353] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-25T19:52:31.303193] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-25T19:52:31.303305] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-25T19:52:31.303808] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-25T19:52:31.303885] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-25T19:52:31.304730] [DEBUG] [LOCAL ] CANG: Trimmed 39148 records to 27307 (keeping 200 days of data) [2025-10-25T19:52:31.445385] [DEBUG] [LOCAL ] CANG: Primary data saved (27307 records). [2025-10-25T19:52:31.445539] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-25T19:52:31.445676] [INFO ] [MAIN ] Update Progress: 393/2366 symbols. CANG took 14.0s. Estimated remaining time: 4h 34m 44s [2025-10-25T19:52:31.615170] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:52:31.615368] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-10-25T19:52:31.615457] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-10-25T19:52:31.615566] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-25T19:52:31.615635] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-25T19:52:31.615730] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-25T19:52:31.615792] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-25T19:52:31.971229] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:52:31.971597] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-25T19:52:32.787899] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T19:52:32.790085] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-25T19:52:33.913359] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T19:52:33.915155] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-25T19:52:34.728710] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T19:52:34.731010] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-25T19:52:35.542840] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T19:52:35.547354] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-25T19:52:36.266382] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T19:52:36.268957] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-25T19:52:36.977171] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-25T19:52:36.978935] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-25T19:52:37.693300] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T19:52:37.695209] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-25T19:52:38.481040] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T19:52:38.483286] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-25T19:52:39.175069] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T19:52:39.176862] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-25T19:52:39.918706] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T19:52:39.920408] [INFO ] [REMOTE ] CAPL: Full fetch complete (8728 records). [2025-10-25T19:52:39.920519] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-25T19:52:40.282683] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-25T19:52:40.282793] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-25T19:52:40.283033] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-25T19:52:40.283108] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-25T19:52:40.283567] [DEBUG] [LOCAL ] CAPL: Trimmed 8728 records to 5468 (keeping 200 days of data) [2025-10-25T19:52:40.315698] [DEBUG] [LOCAL ] CAPL: Primary data saved (5468 records). [2025-10-25T19:52:40.315800] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-25T19:52:40.315913] [INFO ] [MAIN ] Update Progress: 394/2366 symbols. CAPL took 8.9s. Estimated remaining time: 4h 34m 38s [2025-10-25T19:52:40.481553] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:52:40.481743] [DEBUG] [LOCAL ] CARR: No existing data file found in primary storage. [2025-10-25T19:52:40.481815] [WARN ] [MAIN ] CARR: No existing data found, performing full refresh instead. [2025-10-25T19:52:40.481926] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-25T19:52:40.482019] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-25T19:52:40.482100] [DEBUG] [LOCAL ] CARR: No primary data file found to delete. [2025-10-25T19:52:40.482169] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-25T19:52:40.833179] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:52:40.833505] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-25T19:52:42.725247] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-25T19:52:42.736080] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-25T19:52:44.471146] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T19:52:44.482464] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-25T19:52:46.385416] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T19:52:46.396491] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-25T19:52:47.601407] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T19:52:47.612472] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-25T19:52:48.789374] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T19:52:48.800586] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-25T19:52:49.766969] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:52:49.777586] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-25T19:52:50.749132] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T19:52:50.760618] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-25T19:52:51.792324] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:52:51.805710] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-25T19:52:52.779986] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T19:52:52.791948] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-25T19:52:53.602898] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T19:52:53.612524] [INFO ] [REMOTE ] CARR: Full fetch complete (77771 records). [2025-10-25T19:52:53.612705] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-25T19:52:54.013979] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-25T19:52:54.014102] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-25T19:52:54.014960] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-25T19:52:54.015050] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-25T19:52:54.016568] [DEBUG] [LOCAL ] CARR: Trimmed 77771 records to 54382 (keeping 200 days of data) [2025-10-25T19:52:54.334397] [DEBUG] [LOCAL ] CARR: Primary data saved (54382 records). [2025-10-25T19:52:54.334584] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-25T19:52:54.334748] [INFO ] [MAIN ] Update Progress: 395/2366 symbols. CARR took 14.0s. Estimated remaining time: 4h 34m 58s [2025-10-25T19:52:54.514881] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:52:54.515077] [DEBUG] [LOCAL ] CARS: No existing data file found in primary storage. [2025-10-25T19:52:54.515146] [WARN ] [MAIN ] CARS: No existing data found, performing full refresh instead. [2025-10-25T19:52:54.515284] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-25T19:52:54.515363] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-25T19:52:54.515425] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-25T19:52:54.515489] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-25T19:52:54.887714] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:52:54.888071] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-25T19:52:56.252104] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-25T19:52:56.258591] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-25T19:52:57.562958] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-25T19:52:57.569576] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-25T19:52:59.091528] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T19:52:59.100746] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-25T19:53:00.965372] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-25T19:53:00.976751] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-25T19:53:03.015955] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-25T19:53:03.024971] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-25T19:53:04.674897] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T19:53:04.683309] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-25T19:53:06.149117] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T19:53:06.157251] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-25T19:53:07.733817] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T19:53:07.742425] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-25T19:53:09.242153] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T19:53:09.250137] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-25T19:53:10.774831] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-25T19:53:10.782565] [INFO ] [REMOTE ] CARS: Full fetch complete (56643 records). [2025-10-25T19:53:10.782713] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-25T19:53:11.185586] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-25T19:53:11.185747] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-25T19:53:11.186427] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-25T19:53:11.186488] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-25T19:53:11.187939] [DEBUG] [LOCAL ] CARS: Trimmed 56643 records to 40381 (keeping 200 days of data) [2025-10-25T19:53:11.412789] [DEBUG] [LOCAL ] CARS: Primary data saved (40381 records). [2025-10-25T19:53:11.412949] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-25T19:53:11.413042] [INFO ] [MAIN ] Update Progress: 396/2366 symbols. CARS took 17.1s. Estimated remaining time: 4h 35m 33s [2025-10-25T19:53:11.611836] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:53:11.612038] [DEBUG] [LOCAL ] CAT: No existing data file found in primary storage. [2025-10-25T19:53:11.612111] [WARN ] [MAIN ] CAT: No existing data found, performing full refresh instead. [2025-10-25T19:53:11.612205] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-25T19:53:11.612299] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-25T19:53:11.612372] [DEBUG] [LOCAL ] CAT: No primary data file found to delete. [2025-10-25T19:53:11.612439] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-25T19:53:11.985284] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:53:11.985628] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-25T19:53:13.953528] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T19:53:13.964008] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-25T19:53:16.081943] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-25T19:53:16.092125] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-25T19:53:18.194121] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T19:53:18.205173] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-25T19:53:19.360635] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T19:53:19.371725] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-25T19:53:20.444549] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:53:20.455459] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-25T19:53:21.554329] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:53:21.564694] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-25T19:53:22.450367] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T19:53:22.462284] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-25T19:53:23.445735] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T19:53:23.463966] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-25T19:53:24.563513] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T19:53:24.575011] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-25T19:53:25.575883] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T19:53:25.585518] [INFO ] [REMOTE ] CAT: Full fetch complete (76865 records). [2025-10-25T19:53:25.585689] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-25T19:53:25.971745] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-25T19:53:25.971865] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-25T19:53:25.972637] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-25T19:53:25.972743] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-25T19:53:25.974214] [DEBUG] [LOCAL ] CAT: Trimmed 76865 records to 53692 (keeping 200 days of data) [2025-10-25T19:53:26.307423] [DEBUG] [LOCAL ] CAT: Primary data saved (53692 records). [2025-10-25T19:53:26.307627] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-25T19:53:26.307780] [INFO ] [MAIN ] Update Progress: 397/2366 symbols. CAT took 14.9s. Estimated remaining time: 4h 35m 57s [2025-10-25T19:53:26.476915] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:53:26.477131] [DEBUG] [LOCAL ] CATO: No existing data file found in primary storage. [2025-10-25T19:53:26.477205] [WARN ] [MAIN ] CATO: No existing data found, performing full refresh instead. [2025-10-25T19:53:26.477321] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-25T19:53:26.477394] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-25T19:53:26.477479] [DEBUG] [LOCAL ] CATO: No primary data file found to delete. [2025-10-25T19:53:26.477555] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-25T19:53:26.830938] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:53:26.831266] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-25T19:53:27.672363] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-25T19:53:27.674680] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-25T19:53:28.503971] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-25T19:53:28.506299] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-25T19:53:29.498789] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T19:53:29.501791] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-25T19:53:30.336776] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-25T19:53:30.338953] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-25T19:53:31.056233] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T19:53:31.058512] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-25T19:53:31.874773] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T19:53:31.876708] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-25T19:53:32.695536] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T19:53:32.698562] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-25T19:53:33.623413] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T19:53:33.626088] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-25T19:53:34.467390] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T19:53:34.469943] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-25T19:53:35.197935] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T19:53:35.199588] [INFO ] [REMOTE ] CATO: Full fetch complete (10569 records). [2025-10-25T19:53:35.199706] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-25T19:53:35.553437] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-25T19:53:35.553546] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-25T19:53:35.553852] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-25T19:53:35.553931] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-25T19:53:35.554402] [DEBUG] [LOCAL ] CATO: Trimmed 10569 records to 6701 (keeping 200 days of data) [2025-10-25T19:53:35.590577] [DEBUG] [LOCAL ] CATO: Primary data saved (6701 records). [2025-10-25T19:53:35.590761] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-25T19:53:35.590876] [INFO ] [MAIN ] Update Progress: 398/2366 symbols. CATO took 9.3s. Estimated remaining time: 4h 35m 53s [2025-10-25T19:53:35.756249] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:53:35.756428] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-10-25T19:53:35.756498] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-10-25T19:53:35.756611] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-25T19:53:35.756702] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-25T19:53:35.756784] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-25T19:53:35.756852] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-25T19:53:36.106174] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:53:36.106523] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-25T19:53:38.038269] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-25T19:53:38.048630] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-25T19:53:39.965204] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T19:53:39.975152] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-25T19:53:42.002972] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-25T19:53:42.014209] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-25T19:53:43.299310] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T19:53:43.310530] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-25T19:53:44.230004] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T19:53:44.241186] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-25T19:53:45.282262] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T19:53:45.292919] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-25T19:53:46.402528] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T19:53:46.414071] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-25T19:53:47.375801] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T19:53:47.387087] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-25T19:53:48.835390] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-25T19:53:48.846598] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-25T19:53:49.779248] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:53:49.789331] [INFO ] [REMOTE ] CAVA: Full fetch complete (77448 records). [2025-10-25T19:53:49.789485] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-25T19:53:50.193408] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-25T19:53:50.193519] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-25T19:53:50.194305] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-25T19:53:50.194385] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-25T19:53:50.195801] [DEBUG] [LOCAL ] CAVA: Trimmed 77448 records to 54321 (keeping 200 days of data) [2025-10-25T19:53:50.502164] [DEBUG] [LOCAL ] CAVA: Primary data saved (54321 records). [2025-10-25T19:53:50.502336] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-25T19:53:50.502470] [INFO ] [MAIN ] Update Progress: 399/2366 symbols. CAVA took 14.9s. Estimated remaining time: 4h 36m 17s [2025-10-25T19:53:50.681718] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:53:50.681904] [DEBUG] [LOCAL ] CB: No existing data file found in primary storage. [2025-10-25T19:53:50.681994] [WARN ] [MAIN ] CB: No existing data found, performing full refresh instead. [2025-10-25T19:53:50.682126] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-25T19:53:50.682212] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-25T19:53:50.682311] [DEBUG] [LOCAL ] CB: No primary data file found to delete. [2025-10-25T19:53:50.682393] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-25T19:53:51.050468] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:53:51.050912] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-25T19:53:52.922066] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T19:53:52.932795] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-25T19:53:54.731736] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T19:53:54.740957] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-25T19:53:56.935277] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-25T19:53:56.946140] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-25T19:53:58.031472] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T19:53:58.042545] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-25T19:53:58.843735] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T19:53:58.853953] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-25T19:53:59.794356] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:53:59.804680] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-25T19:54:00.755469] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T19:54:00.766580] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-25T19:54:01.798540] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T19:54:01.809170] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-25T19:54:02.767939] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T19:54:02.778803] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-25T19:54:03.637113] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T19:54:03.646454] [INFO ] [REMOTE ] CB: Full fetch complete (72870 records). [2025-10-25T19:54:03.646619] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-25T19:54:04.035803] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-25T19:54:04.035923] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-25T19:54:04.036681] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-25T19:54:04.036761] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-25T19:54:04.038161] [DEBUG] [LOCAL ] CB: Trimmed 72870 records to 50705 (keeping 200 days of data) [2025-10-25T19:54:04.349325] [DEBUG] [LOCAL ] CB: Primary data saved (50705 records). [2025-10-25T19:54:04.349560] [INFO ] [MAIN ] CB: Full history saved. [2025-10-25T19:54:04.349731] [INFO ] [MAIN ] Update Progress: 400/2366 symbols. CB took 13.8s. Estimated remaining time: 4h 36m 35s [2025-10-25T19:54:04.520614] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:54:04.520889] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-10-25T19:54:04.520977] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-10-25T19:54:04.521116] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-25T19:54:04.521209] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-25T19:54:04.521316] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-25T19:54:04.521409] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-25T19:54:04.874535] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:54:04.874921] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-25T19:54:05.821321] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T19:54:05.825580] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-25T19:54:06.803152] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T19:54:06.806224] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-25T19:54:07.764622] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T19:54:07.769009] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-25T19:54:08.681832] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T19:54:08.685264] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-25T19:54:09.641484] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T19:54:09.644634] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-25T19:54:10.583041] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:54:10.585763] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-25T19:54:11.452555] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T19:54:11.455530] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-25T19:54:12.408591] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T19:54:12.411554] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-25T19:54:13.304452] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-25T19:54:13.307267] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-25T19:54:14.232679] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:54:14.234822] [INFO ] [REMOTE ] CBAN: Full fetch complete (16288 records). [2025-10-25T19:54:14.234923] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-25T19:54:14.594529] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-25T19:54:14.594636] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-25T19:54:14.594981] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-25T19:54:14.595060] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-25T19:54:14.595577] [DEBUG] [LOCAL ] CBAN: Trimmed 16288 records to 10315 (keeping 200 days of data) [2025-10-25T19:54:14.654200] [DEBUG] [LOCAL ] CBAN: Primary data saved (10315 records). [2025-10-25T19:54:14.654350] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-25T19:54:14.654465] [INFO ] [MAIN ] Update Progress: 401/2366 symbols. CBAN took 10.3s. Estimated remaining time: 4h 36m 35s [2025-10-25T19:54:14.820834] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:54:14.821045] [DEBUG] [LOCAL ] CBL: No existing data file found in primary storage. [2025-10-25T19:54:14.821115] [WARN ] [MAIN ] CBL: No existing data found, performing full refresh instead. [2025-10-25T19:54:14.821261] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-25T19:54:14.821331] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-25T19:54:14.821410] [DEBUG] [LOCAL ] CBL: No primary data file found to delete. [2025-10-25T19:54:14.821477] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-25T19:54:15.171886] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:54:15.172228] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-25T19:54:16.408110] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T19:54:16.415142] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-25T19:54:17.680261] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T19:54:17.684552] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-25T19:54:18.841375] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T19:54:18.846245] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-25T19:54:19.966679] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T19:54:19.970944] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-25T19:54:20.818119] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T19:54:20.821936] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-25T19:54:21.640959] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T19:54:21.644920] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-25T19:54:22.556378] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T19:54:22.560825] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-25T19:54:23.613783] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T19:54:23.618107] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-25T19:54:24.595493] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T19:54:24.599353] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-25T19:54:25.221622] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T19:54:25.224754] [INFO ] [REMOTE ] CBL: Full fetch complete (24674 records). [2025-10-25T19:54:25.224866] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-25T19:54:25.601398] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-25T19:54:25.601528] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-25T19:54:25.601925] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-25T19:54:25.602003] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-25T19:54:25.602713] [DEBUG] [LOCAL ] CBL: Trimmed 24674 records to 16198 (keeping 200 days of data) [2025-10-25T19:54:25.697224] [DEBUG] [LOCAL ] CBL: Primary data saved (16198 records). [2025-10-25T19:54:25.697408] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-25T19:54:25.697529] [INFO ] [MAIN ] Update Progress: 402/2366 symbols. CBL took 11.0s. Estimated remaining time: 4h 36m 40s [2025-10-25T19:54:25.869521] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:54:25.869719] [DEBUG] [LOCAL ] CBNA: No existing data file found in primary storage. [2025-10-25T19:54:25.869793] [WARN ] [MAIN ] CBNA: No existing data found, performing full refresh instead. [2025-10-25T19:54:25.869918] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-25T19:54:25.870006] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-25T19:54:25.870111] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-10-25T19:54:25.870179] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-25T19:54:26.230888] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:54:26.231272] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-25T19:54:26.952333] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T19:54:26.953897] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-25T19:54:27.489130] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-25T19:54:27.490449] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-25T19:54:28.064677] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T19:54:28.065904] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-25T19:54:28.674697] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T19:54:28.676219] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-25T19:54:29.389300] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T19:54:29.390917] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-25T19:54:30.066254] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-25T19:54:30.067937] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-25T19:54:30.676264] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-25T19:54:30.677516] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-25T19:54:31.340360] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-25T19:54:31.342525] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-25T19:54:31.965772] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T19:54:31.966992] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-25T19:54:32.509352] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T19:54:32.510330] [INFO ] [REMOTE ] CBNA: Full fetch complete (4222 records). [2025-10-25T19:54:32.510436] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-25T19:54:32.862216] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-25T19:54:32.862353] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-25T19:54:32.862542] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-25T19:54:32.862662] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-25T19:54:32.863091] [DEBUG] [LOCAL ] CBNA: Trimmed 4222 records to 2868 (keeping 200 days of data) [2025-10-25T19:54:32.879183] [DEBUG] [LOCAL ] CBNA: Primary data saved (2868 records). [2025-10-25T19:54:32.879290] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-25T19:54:32.879416] [INFO ] [MAIN ] Update Progress: 403/2366 symbols. CBNA took 7.2s. Estimated remaining time: 4h 36m 25s [2025-10-25T19:54:33.045960] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:54:33.046186] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-25T19:54:33.046273] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-25T19:54:33.046412] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-25T19:54:33.046502] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-25T19:54:33.046614] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-25T19:54:33.046717] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-25T19:54:33.398392] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:54:33.398761] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-25T19:54:33.699510] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:54:33.699864] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-25T19:54:33.699978] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:54:33.700069] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-25T19:54:33.700155] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:54:33.700248] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-25T19:54:33.700375] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-25T19:54:33.700471] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-25T19:54:33.700576] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-25T19:54:33.700725] [INFO ] [MAIN ] Update Progress: 404/2366 symbols. CBO took 0.8s. Estimated remaining time: 4h 35m 40s [2025-10-25T19:54:33.866681] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:54:33.866853] [DEBUG] [LOCAL ] CBRE: No existing data file found in primary storage. [2025-10-25T19:54:33.866922] [WARN ] [MAIN ] CBRE: No existing data found, performing full refresh instead. [2025-10-25T19:54:33.867027] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-25T19:54:33.867109] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-25T19:54:33.867168] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-10-25T19:54:33.867229] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-25T19:54:34.213835] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:54:34.214181] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-25T19:54:36.182190] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T19:54:36.192442] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-25T19:54:37.958791] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-25T19:54:37.968770] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-25T19:54:40.059523] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-25T19:54:40.070486] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-25T19:54:40.975545] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T19:54:40.986553] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-25T19:54:41.959255] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T19:54:41.970184] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-25T19:54:42.943441] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T19:54:42.953399] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-25T19:54:44.008746] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T19:54:44.019920] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-25T19:54:44.945414] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T19:54:44.955856] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-25T19:54:46.084111] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T19:54:46.094608] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-25T19:54:46.932966] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T19:54:46.942119] [INFO ] [REMOTE ] CBRE: Full fetch complete (73755 records). [2025-10-25T19:54:46.942263] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-25T19:54:47.336284] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-25T19:54:47.336390] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-25T19:54:47.337155] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-25T19:54:47.337234] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-25T19:54:47.338622] [DEBUG] [LOCAL ] CBRE: Trimmed 73755 records to 51042 (keeping 200 days of data) [2025-10-25T19:54:47.631339] [DEBUG] [LOCAL ] CBRE: Primary data saved (51042 records). [2025-10-25T19:54:47.631494] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-25T19:54:47.631610] [INFO ] [MAIN ] Update Progress: 405/2366 symbols. CBRE took 13.9s. Estimated remaining time: 4h 35m 58s [2025-10-25T19:54:47.798763] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:54:47.798975] [DEBUG] [LOCAL ] CBT: No existing data file found in primary storage. [2025-10-25T19:54:47.799045] [WARN ] [MAIN ] CBT: No existing data found, performing full refresh instead. [2025-10-25T19:54:47.799154] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-25T19:54:47.799223] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-25T19:54:47.799304] [DEBUG] [LOCAL ] CBT: No primary data file found to delete. [2025-10-25T19:54:47.799375] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-25T19:54:48.173974] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:54:48.174291] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-25T19:54:49.618688] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T19:54:49.624988] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-25T19:54:51.079108] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T19:54:51.086106] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-25T19:54:52.659031] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T19:54:52.670091] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-25T19:54:54.206745] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T19:54:54.213993] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-25T19:54:55.734772] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T19:54:55.743161] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-25T19:54:57.226719] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T19:54:57.233455] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-25T19:54:58.543397] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-25T19:54:58.550572] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-25T19:55:00.088921] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T19:55:00.096740] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-25T19:55:01.849489] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-25T19:55:01.856757] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-25T19:55:03.687398] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-25T19:55:03.694003] [INFO ] [REMOTE ] CBT: Full fetch complete (45786 records). [2025-10-25T19:55:03.694207] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-25T19:55:04.238576] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-25T19:55:04.238726] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-25T19:55:04.239300] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-25T19:55:04.239383] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-25T19:55:04.240820] [DEBUG] [LOCAL ] CBT: Trimmed 45786 records to 31300 (keeping 200 days of data) [2025-10-25T19:55:04.456110] [DEBUG] [LOCAL ] CBT: Primary data saved (31300 records). [2025-10-25T19:55:04.456314] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-25T19:55:04.456437] [INFO ] [MAIN ] Update Progress: 406/2366 symbols. CBT took 16.8s. Estimated remaining time: 4h 36m 30s [2025-10-25T19:55:04.624300] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:55:04.624479] [DEBUG] [LOCAL ] CBU: No existing data file found in primary storage. [2025-10-25T19:55:04.624551] [WARN ] [MAIN ] CBU: No existing data found, performing full refresh instead. [2025-10-25T19:55:04.624688] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-25T19:55:04.624762] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-25T19:55:04.624900] [DEBUG] [LOCAL ] CBU: No primary data file found to delete. [2025-10-25T19:55:04.624974] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-25T19:55:04.978070] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:55:04.978668] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-25T19:55:06.158125] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T19:55:06.165165] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-25T19:55:07.293370] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T19:55:07.297479] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-25T19:55:08.616061] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T19:55:08.621760] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-25T19:55:09.971768] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T19:55:09.977221] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-25T19:55:11.051837] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:55:11.056580] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-25T19:55:12.152037] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T19:55:12.158891] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-25T19:55:13.520206] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T19:55:13.526275] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-25T19:55:14.789983] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T19:55:14.796735] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-25T19:55:16.040579] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T19:55:16.046137] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-25T19:55:17.216000] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T19:55:17.221234] [INFO ] [REMOTE ] CBU: Full fetch complete (32662 records). [2025-10-25T19:55:17.221396] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-25T19:55:17.587202] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-25T19:55:17.587327] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-25T19:55:17.587811] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-25T19:55:17.587916] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-25T19:55:17.588816] [DEBUG] [LOCAL ] CBU: Trimmed 32662 records to 22844 (keeping 200 days of data) [2025-10-25T19:55:17.733702] [DEBUG] [LOCAL ] CBU: Primary data saved (22844 records). [2025-10-25T19:55:17.733866] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-25T19:55:17.733983] [INFO ] [MAIN ] Update Progress: 407/2366 symbols. CBU took 13.3s. Estimated remaining time: 4h 36m 45s [2025-10-25T19:55:17.901202] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:55:17.901387] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-25T19:55:17.901454] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-25T19:55:17.901565] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-25T19:55:17.901634] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-25T19:55:17.901729] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-25T19:55:17.901803] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-25T19:55:18.260528] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:55:18.260947] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-25T19:55:18.591204] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:55:18.591559] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-25T19:55:18.591684] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:55:18.591782] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-25T19:55:18.591891] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:55:18.591982] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-25T19:55:18.592097] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-25T19:55:18.592187] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-25T19:55:18.592290] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-25T19:55:18.592418] [INFO ] [MAIN ] Update Progress: 408/2366 symbols. CBX took 0.9s. Estimated remaining time: 4h 35m 59s [2025-10-25T19:55:18.763754] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:55:18.763948] [DEBUG] [LOCAL ] CBZ: No existing data file found in primary storage. [2025-10-25T19:55:18.764045] [WARN ] [MAIN ] CBZ: No existing data found, performing full refresh instead. [2025-10-25T19:55:18.764199] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-25T19:55:18.764282] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-25T19:55:18.764391] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-25T19:55:18.764480] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-25T19:55:19.120275] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:55:19.120760] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-25T19:55:20.329447] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T19:55:20.334168] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-25T19:55:21.728887] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T19:55:21.734382] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-25T19:55:23.010577] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-25T19:55:23.017338] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-25T19:55:24.444798] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T19:55:24.452465] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-25T19:55:25.736419] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-25T19:55:25.742547] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-25T19:55:27.235845] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T19:55:27.242786] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-25T19:55:28.762148] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T19:55:28.769854] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-25T19:55:30.155403] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T19:55:30.163498] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-25T19:55:31.800828] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T19:55:31.809435] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-25T19:55:33.272286] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T19:55:33.279622] [INFO ] [REMOTE ] CBZ: Full fetch complete (46500 records). [2025-10-25T19:55:33.279925] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-25T19:55:33.651405] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-25T19:55:33.651529] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-25T19:55:33.652129] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-25T19:55:33.652210] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-25T19:55:33.653254] [DEBUG] [LOCAL ] CBZ: Trimmed 46500 records to 34714 (keeping 200 days of data) [2025-10-25T19:55:33.847708] [DEBUG] [LOCAL ] CBZ: Primary data saved (34714 records). [2025-10-25T19:55:33.847924] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-25T19:55:33.848040] [INFO ] [MAIN ] Update Progress: 409/2366 symbols. CBZ took 15.3s. Estimated remaining time: 4h 36m 24s [2025-10-25T19:55:34.014210] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:55:34.014405] [DEBUG] [LOCAL ] CC: No existing data file found in primary storage. [2025-10-25T19:55:34.014475] [WARN ] [MAIN ] CC: No existing data found, performing full refresh instead. [2025-10-25T19:55:34.014587] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-25T19:55:34.014682] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-25T19:55:34.014766] [DEBUG] [LOCAL ] CC: No primary data file found to delete. [2025-10-25T19:55:34.014836] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-25T19:55:34.368792] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:55:34.369160] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-25T19:55:35.872038] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T19:55:35.886921] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-25T19:55:37.602184] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T19:55:37.611936] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-25T19:55:39.392910] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T19:55:39.403897] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-25T19:55:40.408905] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T19:55:40.419906] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-25T19:55:41.465618] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T19:55:41.476794] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-25T19:55:42.370692] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T19:55:42.381456] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-25T19:55:43.408153] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T19:55:43.420712] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-25T19:55:44.364023] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T19:55:44.375718] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-25T19:55:45.331635] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T19:55:45.342670] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-25T19:55:46.261102] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T19:55:46.270546] [INFO ] [REMOTE ] CC: Full fetch complete (76205 records). [2025-10-25T19:55:46.270707] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-25T19:55:46.662296] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-25T19:55:46.662420] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-25T19:55:46.663237] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-25T19:55:46.663315] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-25T19:55:46.664706] [DEBUG] [LOCAL ] CC: Trimmed 76205 records to 53764 (keeping 200 days of data) [2025-10-25T19:55:46.979406] [DEBUG] [LOCAL ] CC: Primary data saved (53764 records). [2025-10-25T19:55:46.979574] [INFO ] [MAIN ] CC: Full history saved. [2025-10-25T19:55:46.979720] [INFO ] [MAIN ] Update Progress: 410/2366 symbols. CC took 13.1s. Estimated remaining time: 4h 36m 37s [2025-10-25T19:55:47.149905] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:55:47.150090] [DEBUG] [LOCAL ] CCI: No existing data file found in primary storage. [2025-10-25T19:55:47.150168] [WARN ] [MAIN ] CCI: No existing data found, performing full refresh instead. [2025-10-25T19:55:47.150302] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-25T19:55:47.150393] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-25T19:55:47.150479] [DEBUG] [LOCAL ] CCI: No primary data file found to delete. [2025-10-25T19:55:47.150555] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-25T19:55:47.500168] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:55:47.500487] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-25T19:55:49.398269] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T19:55:49.408663] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-25T19:55:51.124813] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T19:55:51.134804] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-25T19:55:53.139573] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T19:55:53.150756] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-25T19:55:54.173824] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T19:55:54.185072] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-25T19:55:55.148310] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T19:55:55.159713] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-25T19:55:56.157137] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T19:55:56.168193] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-25T19:55:57.172234] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T19:55:57.183901] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-25T19:55:58.126454] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T19:55:58.138293] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-25T19:55:59.082931] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T19:55:59.094360] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-25T19:55:59.987587] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T19:55:59.997470] [INFO ] [REMOTE ] CCI: Full fetch complete (77095 records). [2025-10-25T19:55:59.997697] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-25T19:56:00.386371] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-25T19:56:00.386517] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-25T19:56:00.387395] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-25T19:56:00.387478] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-25T19:56:00.389106] [DEBUG] [LOCAL ] CCI: Trimmed 77095 records to 53881 (keeping 200 days of data) [2025-10-25T19:56:00.710024] [DEBUG] [LOCAL ] CCI: Primary data saved (53881 records). [2025-10-25T19:56:00.710192] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-25T19:56:00.710311] [INFO ] [MAIN ] Update Progress: 411/2366 symbols. CCI took 13.7s. Estimated remaining time: 4h 36m 54s [2025-10-25T19:56:00.878117] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:56:00.878334] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-25T19:56:00.878407] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-25T19:56:00.878547] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-25T19:56:00.878616] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-25T19:56:00.878712] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-25T19:56:00.878783] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-25T19:56:01.265581] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:56:01.265991] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-25T19:56:01.812567] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-25T19:56:01.813617] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-25T19:56:02.288505] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T19:56:02.289485] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-25T19:56:02.697506] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-25T19:56:02.698689] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-25T19:56:03.209157] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-25T19:56:03.210221] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-25T19:56:03.872952] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T19:56:03.874854] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-25T19:56:04.348684] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T19:56:04.349669] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-25T19:56:04.858508] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-25T19:56:04.859579] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-25T19:56:05.448931] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T19:56:05.450818] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-25T19:56:06.004349] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-25T19:56:06.005457] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-25T19:56:06.545342] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T19:56:06.546536] [INFO ] [REMOTE ] CCIA: Full fetch complete (2179 records). [2025-10-25T19:56:06.546689] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-25T19:56:06.735676] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T19:56:06.735970] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-25T19:56:06.736148] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-25T19:56:06.736237] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-25T19:56:06.736343] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-25T19:56:06.736432] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-25T19:56:06.736520] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-25T19:56:06.736669] [INFO ] [MAIN ] Update Progress: 412/2366 symbols. CCIA took 6.0s. Estimated remaining time: 4h 36m 34s [2025-10-25T19:56:06.914359] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:56:06.914631] [DEBUG] [LOCAL ] CCIF: No existing data file found in primary storage. [2025-10-25T19:56:06.914729] [WARN ] [MAIN ] CCIF: No existing data found, performing full refresh instead. [2025-10-25T19:56:06.914835] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-25T19:56:06.915240] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-25T19:56:06.915505] [DEBUG] [LOCAL ] CCIF: No primary data file found to delete. [2025-10-25T19:56:06.915581] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-25T19:56:07.274605] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:56:07.275071] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-25T19:56:08.327855] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T19:56:08.332989] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-25T19:56:09.412540] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T19:56:09.415986] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-25T19:56:10.400961] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T19:56:10.404952] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-25T19:56:11.476002] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T19:56:11.479804] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-25T19:56:12.634992] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T19:56:12.641484] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-25T19:56:13.687115] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T19:56:13.690974] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-25T19:56:14.782123] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T19:56:14.787535] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-25T19:56:15.907898] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T19:56:15.911948] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-25T19:56:16.985866] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T19:56:16.990273] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-25T19:56:18.032255] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-25T19:56:18.036416] [INFO ] [REMOTE ] CCIF: Full fetch complete (21998 records). [2025-10-25T19:56:18.036530] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-25T19:56:18.420875] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-25T19:56:18.420989] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-25T19:56:18.421382] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-25T19:56:18.421459] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-25T19:56:18.422105] [DEBUG] [LOCAL ] CCIF: Trimmed 21998 records to 15444 (keeping 200 days of data) [2025-10-25T19:56:18.508264] [DEBUG] [LOCAL ] CCIF: Primary data saved (15444 records). [2025-10-25T19:56:18.508423] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-25T19:56:18.508540] [INFO ] [MAIN ] Update Progress: 413/2366 symbols. CCIF took 11.8s. Estimated remaining time: 4h 36m 41s [2025-10-25T19:56:18.676314] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:56:18.676495] [DEBUG] [LOCAL ] CCJ: No existing data file found in primary storage. [2025-10-25T19:56:18.676564] [WARN ] [MAIN ] CCJ: No existing data found, performing full refresh instead. [2025-10-25T19:56:18.676693] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-25T19:56:18.676763] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-25T19:56:18.676840] [DEBUG] [LOCAL ] CCJ: No primary data file found to delete. [2025-10-25T19:56:18.676924] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-25T19:56:19.036240] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:56:19.036674] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-25T19:56:21.199218] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-25T19:56:21.209840] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-25T19:56:23.137507] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T19:56:23.147833] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-25T19:56:25.052319] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T19:56:25.063434] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-25T19:56:26.105875] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T19:56:26.117939] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-25T19:56:27.248967] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T19:56:27.261065] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-25T19:56:28.066759] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-25T19:56:28.078620] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-25T19:56:29.015928] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T19:56:29.027488] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-25T19:56:30.040276] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T19:56:30.051625] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-25T19:56:31.157298] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T19:56:31.168876] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-25T19:56:32.250808] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T19:56:32.261129] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-25T19:56:32.261327] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-25T19:56:32.659764] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-25T19:56:32.659885] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-25T19:56:32.660718] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-25T19:56:32.660799] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-25T19:56:32.662202] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 54470 (keeping 200 days of data) [2025-10-25T19:56:32.977514] [DEBUG] [LOCAL ] CCJ: Primary data saved (54470 records). [2025-10-25T19:56:32.977728] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-25T19:56:32.977864] [INFO ] [MAIN ] Update Progress: 414/2366 symbols. CCJ took 14.5s. Estimated remaining time: 4h 37m 0s [2025-10-25T19:56:33.167785] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:56:33.168034] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-10-25T19:56:33.168110] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-10-25T19:56:33.168259] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-25T19:56:33.168341] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-25T19:56:33.168433] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-25T19:56:33.168528] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-25T19:56:33.540708] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:56:33.541081] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-25T19:56:35.275966] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T19:56:35.285279] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-25T19:56:36.937343] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T19:56:36.946918] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-25T19:56:38.855476] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T19:56:38.865408] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-25T19:56:40.607417] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T19:56:40.617636] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-25T19:56:42.078622] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T19:56:42.088919] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-25T19:56:43.710678] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T19:56:43.720063] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-25T19:56:45.508668] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-25T19:56:45.518904] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-25T19:56:47.276009] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T19:56:47.285527] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-25T19:56:49.005916] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T19:56:49.016257] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-25T19:56:50.769367] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T19:56:50.778566] [INFO ] [REMOTE ] CCK: Full fetch complete (68226 records). [2025-10-25T19:56:50.778787] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-25T19:56:51.166849] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-25T19:56:51.166961] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-25T19:56:51.167684] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-25T19:56:51.167762] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-25T19:56:51.169018] [DEBUG] [LOCAL ] CCK: Trimmed 68226 records to 47246 (keeping 200 days of data) [2025-10-25T19:56:51.443321] [DEBUG] [LOCAL ] CCK: Primary data saved (47246 records). [2025-10-25T19:56:51.443475] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-25T19:56:51.443590] [INFO ] [MAIN ] Update Progress: 415/2366 symbols. CCK took 18.5s. Estimated remaining time: 4h 37m 38s [2025-10-25T19:56:51.613424] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:56:51.613661] [DEBUG] [LOCAL ] CCL: No existing data file found in primary storage. [2025-10-25T19:56:51.613734] [WARN ] [MAIN ] CCL: No existing data found, performing full refresh instead. [2025-10-25T19:56:51.613832] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-25T19:56:51.613904] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-25T19:56:51.613960] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-10-25T19:56:51.614007] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-25T19:56:51.965909] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:56:51.966282] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-25T19:56:54.223885] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-25T19:56:54.234625] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-25T19:56:56.607593] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-25T19:56:56.617898] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-25T19:56:59.293451] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-25T19:56:59.304456] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-25T19:57:00.388906] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T19:57:00.405782] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-25T19:57:01.541661] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T19:57:01.553223] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-25T19:57:02.495401] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:57:02.506886] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-25T19:57:03.617929] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T19:57:03.629761] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-25T19:57:04.747264] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T19:57:04.758821] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-25T19:57:06.084019] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T19:57:06.096847] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-25T19:57:07.085755] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T19:57:07.095433] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-25T19:57:07.095587] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-25T19:57:07.478207] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-25T19:57:07.478319] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-25T19:57:07.479137] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-25T19:57:07.479217] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-25T19:57:07.480715] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54580 (keeping 200 days of data) [2025-10-25T19:57:07.792019] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-25T19:57:07.792173] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-25T19:57:07.792290] [INFO ] [MAIN ] Update Progress: 416/2366 symbols. CCL took 16.3s. Estimated remaining time: 4h 38m 7s [2025-10-25T19:57:07.957550] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:57:07.957726] [DEBUG] [LOCAL ] CCO: No existing data file found in primary storage. [2025-10-25T19:57:07.957798] [WARN ] [MAIN ] CCO: No existing data found, performing full refresh instead. [2025-10-25T19:57:07.957945] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-25T19:57:07.958020] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-25T19:57:07.958081] [DEBUG] [LOCAL ] CCO: No primary data file found to delete. [2025-10-25T19:57:07.958145] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-25T19:57:08.303363] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:57:08.303782] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-25T19:57:09.727365] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T19:57:09.735482] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-25T19:57:11.379381] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T19:57:11.387175] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-25T19:57:12.991485] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T19:57:13.000874] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-25T19:57:13.877261] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T19:57:13.887179] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-25T19:57:14.795187] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T19:57:14.805404] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-25T19:57:15.715522] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T19:57:15.726849] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-25T19:57:16.726771] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T19:57:16.737168] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-25T19:57:17.666113] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T19:57:17.676300] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-25T19:57:18.593734] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T19:57:18.603957] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-25T19:57:19.499743] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T19:57:19.508734] [INFO ] [REMOTE ] CCO: Full fetch complete (67425 records). [2025-10-25T19:57:19.508869] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-25T19:57:19.894100] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-25T19:57:19.894221] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-25T19:57:19.894966] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-25T19:57:19.895052] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-25T19:57:19.896512] [DEBUG] [LOCAL ] CCO: Trimmed 67425 records to 49282 (keeping 200 days of data) [2025-10-25T19:57:20.164498] [DEBUG] [LOCAL ] CCO: Primary data saved (49282 records). [2025-10-25T19:57:20.164716] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-25T19:57:20.164856] [INFO ] [MAIN ] Update Progress: 417/2366 symbols. CCO took 12.4s. Estimated remaining time: 4h 38m 16s [2025-10-25T19:57:20.342322] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:57:20.342546] [DEBUG] [LOCAL ] CCRD: No existing data file found in primary storage. [2025-10-25T19:57:20.342668] [WARN ] [MAIN ] CCRD: No existing data found, performing full refresh instead. [2025-10-25T19:57:20.342806] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-25T19:57:20.342895] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-25T19:57:20.342999] [DEBUG] [LOCAL ] CCRD: No primary data file found to delete. [2025-10-25T19:57:20.343085] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-25T19:57:20.709171] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:57:20.709499] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-25T19:57:21.546909] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-25T19:57:21.548860] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-25T19:57:22.302985] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T19:57:22.304599] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-25T19:57:22.930413] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T19:57:22.932141] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-25T19:57:23.674862] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T19:57:23.676591] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-25T19:57:24.465403] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T19:57:24.467407] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-25T19:57:25.402862] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T19:57:25.406137] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-25T19:57:26.313457] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T19:57:26.316639] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-25T19:57:27.374217] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T19:57:27.377666] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-25T19:57:28.243463] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T19:57:28.246059] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-25T19:57:29.171866] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T19:57:29.174051] [INFO ] [REMOTE ] CCRD: Full fetch complete (11748 records). [2025-10-25T19:57:29.174174] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-25T19:57:29.535031] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-25T19:57:29.535138] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-25T19:57:29.535440] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-25T19:57:29.535520] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-25T19:57:29.536071] [DEBUG] [LOCAL ] CCRD: Trimmed 11748 records to 9672 (keeping 200 days of data) [2025-10-25T19:57:29.590283] [DEBUG] [LOCAL ] CCRD: Primary data saved (9672 records). [2025-10-25T19:57:29.590437] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-25T19:57:29.590555] [INFO ] [MAIN ] Update Progress: 418/2366 symbols. CCRD took 9.4s. Estimated remaining time: 4h 38m 11s [2025-10-25T19:57:29.762365] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:57:29.762544] [DEBUG] [LOCAL ] CCS: No existing data file found in primary storage. [2025-10-25T19:57:29.762614] [WARN ] [MAIN ] CCS: No existing data found, performing full refresh instead. [2025-10-25T19:57:29.762769] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-25T19:57:29.762842] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-25T19:57:29.762921] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-10-25T19:57:29.762993] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-25T19:57:30.109946] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:57:30.110278] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-25T19:57:31.542535] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T19:57:31.549383] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-25T19:57:33.065201] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T19:57:33.072430] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-25T19:57:34.571248] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T19:57:34.578180] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-25T19:57:35.953064] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T19:57:35.961980] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-25T19:57:37.415078] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T19:57:37.422048] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-25T19:57:38.792370] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T19:57:38.798957] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-25T19:57:40.246215] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T19:57:40.253447] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-25T19:57:41.507004] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-25T19:57:41.513227] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-25T19:57:42.917284] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T19:57:42.924244] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-25T19:57:44.216930] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T19:57:44.222113] [INFO ] [REMOTE ] CCS: Full fetch complete (44740 records). [2025-10-25T19:57:44.222232] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-25T19:57:44.606076] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-25T19:57:44.606205] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-25T19:57:44.606896] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-25T19:57:44.607001] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-25T19:57:44.612061] [DEBUG] [LOCAL ] CCS: Trimmed 44740 records to 30380 (keeping 200 days of data) [2025-10-25T19:57:44.792230] [DEBUG] [LOCAL ] CCS: Primary data saved (30380 records). [2025-10-25T19:57:44.792393] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-25T19:57:44.792511] [INFO ] [MAIN ] Update Progress: 419/2366 symbols. CCS took 15.2s. Estimated remaining time: 4h 38m 34s [2025-10-25T19:57:44.961392] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:57:44.961581] [DEBUG] [LOCAL ] CCU: No existing data file found in primary storage. [2025-10-25T19:57:44.961685] [WARN ] [MAIN ] CCU: No existing data found, performing full refresh instead. [2025-10-25T19:57:44.961799] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-25T19:57:44.961870] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-25T19:57:44.961949] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-25T19:57:44.962014] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-25T19:57:45.319954] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:57:45.320314] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-25T19:57:46.477219] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T19:57:46.483401] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-25T19:57:47.580832] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T19:57:47.585484] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-25T19:57:48.869029] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-25T19:57:48.875585] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-25T19:57:50.176220] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T19:57:50.182780] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-25T19:57:51.412711] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T19:57:51.418197] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-25T19:57:52.504679] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T19:57:52.512270] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-25T19:57:53.791788] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T19:57:53.800632] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-25T19:57:54.956806] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T19:57:54.962100] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-25T19:57:56.088880] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T19:57:56.093712] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-25T19:57:57.132255] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-25T19:57:57.135756] [INFO ] [REMOTE ] CCU: Full fetch complete (32237 records). [2025-10-25T19:57:57.135856] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-25T19:57:57.511005] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-25T19:57:57.511134] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-25T19:57:57.511627] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-25T19:57:57.511729] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-25T19:57:57.512538] [DEBUG] [LOCAL ] CCU: Trimmed 32237 records to 21859 (keeping 200 days of data) [2025-10-25T19:57:57.637276] [DEBUG] [LOCAL ] CCU: Primary data saved (21859 records). [2025-10-25T19:57:57.637432] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-25T19:57:57.637527] [INFO ] [MAIN ] Update Progress: 420/2366 symbols. CCU took 12.8s. Estimated remaining time: 4h 38m 45s [2025-10-25T19:57:57.805351] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:57:57.805573] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-25T19:57:57.805669] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-25T19:57:57.805784] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-25T19:57:57.805856] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-25T19:57:57.805938] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-25T19:57:57.806009] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-25T19:57:58.150937] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:57:58.151298] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-25T19:57:58.485761] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-25T19:57:58.486759] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-25T19:57:58.817399] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-25T19:57:58.818601] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-25T19:57:59.125509] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-25T19:57:59.126461] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-25T19:57:59.541314] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-25T19:57:59.542193] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-25T19:57:59.846321] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-25T19:57:59.847245] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-25T19:58:00.204749] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T19:58:00.205111] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-25T19:58:00.205200] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T19:58:00.205304] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-25T19:58:00.205389] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T19:58:00.205510] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-25T19:58:00.205608] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-25T19:58:00.205703] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-25T19:58:00.205785] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-25T19:58:00.205880] [INFO ] [MAIN ] Update Progress: 421/2366 symbols. CCZ took 2.6s. Estimated remaining time: 4h 38m 8s [2025-10-25T19:58:00.373518] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:58:00.373758] [DEBUG] [LOCAL ] CDE: No existing data file found in primary storage. [2025-10-25T19:58:00.373817] [WARN ] [MAIN ] CDE: No existing data found, performing full refresh instead. [2025-10-25T19:58:00.373922] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-25T19:58:00.373996] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-25T19:58:00.374064] [DEBUG] [LOCAL ] CDE: No primary data file found to delete. [2025-10-25T19:58:00.374103] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-25T19:58:00.727842] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:58:00.729175] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-25T19:58:03.829596] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (3.10 seconds). [2025-10-25T19:58:03.840131] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-25T19:58:05.757198] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T19:58:05.767589] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-25T19:58:07.696467] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T19:58:07.708280] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-25T19:58:08.720977] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T19:58:08.732387] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-25T19:58:09.799588] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T19:58:09.811153] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-25T19:58:10.728266] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T19:58:10.739159] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-25T19:58:11.825775] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T19:58:11.837617] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-25T19:58:12.932848] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T19:58:12.944145] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-25T19:58:14.154190] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T19:58:14.166034] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-25T19:58:15.239549] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T19:58:15.249581] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-25T19:58:15.249823] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-25T19:58:15.668166] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-25T19:58:15.668304] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-25T19:58:15.669295] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-25T19:58:15.669396] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-25T19:58:15.671074] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 54424 (keeping 200 days of data) [2025-10-25T19:58:15.979511] [DEBUG] [LOCAL ] CDE: Primary data saved (54424 records). [2025-10-25T19:58:15.979697] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-25T19:58:15.979832] [INFO ] [MAIN ] Update Progress: 422/2366 symbols. CDE took 15.8s. Estimated remaining time: 4h 38m 33s [2025-10-25T19:58:16.148376] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:58:16.148576] [DEBUG] [LOCAL ] CDLR: No existing data file found in primary storage. [2025-10-25T19:58:16.148669] [WARN ] [MAIN ] CDLR: No existing data found, performing full refresh instead. [2025-10-25T19:58:16.148768] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-25T19:58:16.148859] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-25T19:58:16.148940] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-10-25T19:58:16.149005] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-25T19:58:16.499448] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:58:16.499804] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-25T19:58:17.174767] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-25T19:58:17.176603] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-25T19:58:17.745298] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T19:58:17.747083] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-25T19:58:18.784254] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T19:58:18.788057] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-25T19:58:19.675289] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T19:58:19.677897] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-25T19:58:20.616763] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T19:58:20.619636] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-25T19:58:21.616357] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T19:58:21.619570] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-25T19:58:22.358960] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T19:58:22.361757] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-25T19:58:23.258484] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T19:58:23.261014] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-25T19:58:24.299300] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T19:58:24.302361] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-25T19:58:25.329326] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T19:58:25.332409] [INFO ] [REMOTE ] CDLR: Full fetch complete (14294 records). [2025-10-25T19:58:25.332531] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-25T19:58:25.693985] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-25T19:58:25.694099] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-25T19:58:25.694410] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-25T19:58:25.694486] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-25T19:58:25.695091] [DEBUG] [LOCAL ] CDLR: Trimmed 14294 records to 10348 (keeping 200 days of data) [2025-10-25T19:58:25.756912] [DEBUG] [LOCAL ] CDLR: Primary data saved (10348 records). [2025-10-25T19:58:25.757089] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-25T19:58:25.757211] [INFO ] [MAIN ] Update Progress: 423/2366 symbols. CDLR took 9.8s. Estimated remaining time: 4h 38m 30s [2025-10-25T19:58:25.928847] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:58:25.929040] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-10-25T19:58:25.929111] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-10-25T19:58:25.929224] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-25T19:58:25.929293] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-25T19:58:25.929373] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-10-25T19:58:25.929441] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-25T19:58:26.293260] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:58:26.293679] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-25T19:58:27.765745] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T19:58:27.774755] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-25T19:58:29.451921] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T19:58:29.460410] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-25T19:58:31.164485] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T19:58:31.174226] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-25T19:58:32.838784] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T19:58:32.848640] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-25T19:58:34.412466] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T19:58:34.421800] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-25T19:58:35.855626] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T19:58:35.865016] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-25T19:58:37.550813] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-25T19:58:37.563575] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-25T19:58:39.208456] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T19:58:39.218194] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-25T19:58:40.852833] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T19:58:40.867926] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-25T19:58:42.414922] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T19:58:42.422909] [INFO ] [REMOTE ] CDP: Full fetch complete (62129 records). [2025-10-25T19:58:42.423114] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-25T19:58:42.806722] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-25T19:58:42.806838] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-25T19:58:42.807585] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-25T19:58:42.807709] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-25T19:58:42.809014] [DEBUG] [LOCAL ] CDP: Trimmed 62129 records to 42901 (keeping 200 days of data) [2025-10-25T19:58:43.059594] [DEBUG] [LOCAL ] CDP: Primary data saved (42901 records). [2025-10-25T19:58:43.059829] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-25T19:58:43.060006] [INFO ] [MAIN ] Update Progress: 424/2366 symbols. CDP took 17.3s. Estimated remaining time: 4h 39m 1s [2025-10-25T19:58:43.225761] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:58:43.225986] [DEBUG] [LOCAL ] CDRE: No existing data file found in primary storage. [2025-10-25T19:58:43.226093] [WARN ] [MAIN ] CDRE: No existing data found, performing full refresh instead. [2025-10-25T19:58:43.226252] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-25T19:58:43.226344] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-25T19:58:43.226450] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-10-25T19:58:43.226543] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-25T19:58:43.578122] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:58:43.578499] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-25T19:58:44.801503] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T19:58:44.807315] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-25T19:58:45.880890] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-25T19:58:45.884999] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-25T19:58:47.074377] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T19:58:47.080224] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-25T19:58:48.312048] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T19:58:48.318016] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-25T19:58:49.630191] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T19:58:49.636275] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-25T19:58:50.788066] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T19:58:50.794377] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-25T19:58:51.970778] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T19:58:51.976016] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-25T19:58:53.287851] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T19:58:53.293834] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-25T19:58:54.539920] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T19:58:54.545786] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-25T19:58:55.678830] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T19:58:55.683378] [INFO ] [REMOTE ] CDRE: Full fetch complete (35001 records). [2025-10-25T19:58:55.683506] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-25T19:58:56.050519] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-25T19:58:56.050671] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-25T19:58:56.051208] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-25T19:58:56.051307] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-25T19:58:56.052217] [DEBUG] [LOCAL ] CDRE: Trimmed 35001 records to 24976 (keeping 200 days of data) [2025-10-25T19:58:56.195091] [DEBUG] [LOCAL ] CDRE: Primary data saved (24976 records). [2025-10-25T19:58:56.195262] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-25T19:58:56.195401] [INFO ] [MAIN ] Update Progress: 425/2366 symbols. CDRE took 13.1s. Estimated remaining time: 4h 39m 13s [2025-10-25T19:58:56.362266] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:58:56.362525] [DEBUG] [LOCAL ] CE: No existing data file found in primary storage. [2025-10-25T19:58:56.362612] [WARN ] [MAIN ] CE: No existing data found, performing full refresh instead. [2025-10-25T19:58:56.362746] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-25T19:58:56.362817] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-25T19:58:56.362918] [DEBUG] [LOCAL ] CE: No primary data file found to delete. [2025-10-25T19:58:56.362988] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-25T19:58:56.746813] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:58:56.747162] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-25T19:58:58.569470] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T19:58:58.579550] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-25T19:59:00.441480] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T19:59:00.451826] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-25T19:59:02.629910] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-25T19:59:02.641074] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-25T19:59:03.800987] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T19:59:03.811988] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-25T19:59:04.790855] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T19:59:04.801989] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-25T19:59:05.937826] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T19:59:05.948522] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-25T19:59:06.855583] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T19:59:06.866903] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-25T19:59:07.852309] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T19:59:07.863250] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-25T19:59:09.076667] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T19:59:09.092230] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-25T19:59:09.926950] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T19:59:09.936044] [INFO ] [REMOTE ] CE: Full fetch complete (74750 records). [2025-10-25T19:59:09.936187] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-25T19:59:10.324945] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-25T19:59:10.325059] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-25T19:59:10.325971] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-25T19:59:10.326052] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-25T19:59:10.327442] [DEBUG] [LOCAL ] CE: Trimmed 74750 records to 51959 (keeping 200 days of data) [2025-10-25T19:59:10.624397] [DEBUG] [LOCAL ] CE: Primary data saved (51959 records). [2025-10-25T19:59:10.624539] [INFO ] [MAIN ] CE: Full history saved. [2025-10-25T19:59:10.624681] [INFO ] [MAIN ] Update Progress: 426/2366 symbols. CE took 14.4s. Estimated remaining time: 4h 39m 31s [2025-10-25T19:59:10.793162] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:59:10.793341] [DEBUG] [LOCAL ] CEE: No existing data file found in primary storage. [2025-10-25T19:59:10.793418] [WARN ] [MAIN ] CEE: No existing data found, performing full refresh instead. [2025-10-25T19:59:10.793510] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-25T19:59:10.793582] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-25T19:59:10.793692] [DEBUG] [LOCAL ] CEE: No primary data file found to delete. [2025-10-25T19:59:10.793759] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-25T19:59:11.150186] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:59:11.150617] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-25T19:59:11.879434] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T19:59:11.881772] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-25T19:59:12.777201] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T19:59:12.780697] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-25T19:59:13.620053] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-25T19:59:13.623901] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-25T19:59:14.365466] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T19:59:14.367684] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-25T19:59:15.142485] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T19:59:15.144513] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-25T19:59:15.882508] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T19:59:15.885374] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-25T19:59:16.678743] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-25T19:59:16.680513] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-25T19:59:17.487698] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-25T19:59:17.489917] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-25T19:59:18.146395] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T19:59:18.148051] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-25T19:59:18.754616] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-25T19:59:18.755893] [INFO ] [REMOTE ] CEE: Full fetch complete (10140 records). [2025-10-25T19:59:18.755984] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-25T19:59:19.109463] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-25T19:59:19.109599] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-25T19:59:19.109959] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-25T19:59:19.110053] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-25T19:59:19.110576] [DEBUG] [LOCAL ] CEE: Trimmed 10140 records to 5157 (keeping 200 days of data) [2025-10-25T19:59:19.139361] [DEBUG] [LOCAL ] CEE: Primary data saved (5157 records). [2025-10-25T19:59:19.139497] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-25T19:59:19.139675] [INFO ] [MAIN ] Update Progress: 427/2366 symbols. CEE took 8.5s. Estimated remaining time: 4h 39m 21s [2025-10-25T19:59:19.303565] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:59:19.303792] [DEBUG] [LOCAL ] CEPU: No existing data file found in primary storage. [2025-10-25T19:59:19.303901] [WARN ] [MAIN ] CEPU: No existing data found, performing full refresh instead. [2025-10-25T19:59:19.304046] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-25T19:59:19.304129] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-25T19:59:19.304237] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-25T19:59:19.304318] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-25T19:59:19.652955] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:59:19.653361] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-25T19:59:21.058465] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T19:59:21.066381] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-25T19:59:22.335456] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T19:59:22.341244] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-25T19:59:23.550512] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T19:59:23.556288] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-25T19:59:24.753929] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T19:59:24.759793] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-25T19:59:25.993372] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T19:59:26.000109] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-25T19:59:26.981059] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T19:59:26.986130] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-25T19:59:28.218079] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T19:59:28.224773] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-25T19:59:29.390574] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T19:59:29.396501] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-25T19:59:30.765482] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T19:59:30.772681] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-25T19:59:32.194412] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T19:59:32.201259] [INFO ] [REMOTE ] CEPU: Full fetch complete (39655 records). [2025-10-25T19:59:32.201413] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-25T19:59:32.592977] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-25T19:59:32.593160] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-25T19:59:32.593933] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-25T19:59:32.594029] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-25T19:59:32.595732] [DEBUG] [LOCAL ] CEPU: Trimmed 39655 records to 27514 (keeping 200 days of data) [2025-10-25T19:59:32.767299] [DEBUG] [LOCAL ] CEPU: Primary data saved (27514 records). [2025-10-25T19:59:32.767528] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-25T19:59:32.767704] [INFO ] [MAIN ] Update Progress: 428/2366 symbols. CEPU took 13.6s. Estimated remaining time: 4h 39m 35s [2025-10-25T19:59:32.940233] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:59:32.940483] [DEBUG] [LOCAL ] CF: No existing data file found in primary storage. [2025-10-25T19:59:32.940557] [WARN ] [MAIN ] CF: No existing data found, performing full refresh instead. [2025-10-25T19:59:32.940705] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-25T19:59:32.940794] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-25T19:59:32.940881] [DEBUG] [LOCAL ] CF: No primary data file found to delete. [2025-10-25T19:59:32.940952] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-25T19:59:33.293473] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:59:33.293886] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-25T19:59:35.027453] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T19:59:35.037504] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-25T19:59:36.895047] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T19:59:36.905059] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-25T19:59:38.791416] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-25T19:59:38.802250] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-25T19:59:39.685595] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T19:59:39.696480] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-25T19:59:40.668231] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T19:59:40.679156] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-25T19:59:41.607680] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T19:59:41.620799] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-25T19:59:42.641631] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T19:59:42.652993] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-25T19:59:43.522854] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T19:59:43.534037] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-25T19:59:44.404011] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T19:59:44.415934] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-25T19:59:45.283167] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T19:59:45.292421] [INFO ] [REMOTE ] CF: Full fetch complete (75564 records). [2025-10-25T19:59:45.292582] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-25T19:59:45.672997] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-25T19:59:45.673112] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-25T19:59:45.673875] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-25T19:59:45.673955] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-25T19:59:45.675348] [DEBUG] [LOCAL ] CF: Trimmed 75564 records to 52842 (keeping 200 days of data) [2025-10-25T19:59:45.982464] [DEBUG] [LOCAL ] CF: Primary data saved (52842 records). [2025-10-25T19:59:45.982629] [INFO ] [MAIN ] CF: Full history saved. [2025-10-25T19:59:45.982771] [INFO ] [MAIN ] Update Progress: 429/2366 symbols. CF took 13.2s. Estimated remaining time: 4h 39m 47s [2025-10-25T19:59:46.146033] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:59:46.146266] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-10-25T19:59:46.146341] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-10-25T19:59:46.146432] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-25T19:59:46.146500] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-25T19:59:46.146584] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-10-25T19:59:46.146677] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-25T19:59:46.491000] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T19:59:46.491362] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-25T19:59:48.272809] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T19:59:48.283099] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-25T19:59:49.942997] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T19:59:49.954035] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-25T19:59:51.723911] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T19:59:51.735221] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-25T19:59:52.772191] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T19:59:52.783848] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-25T19:59:54.010712] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T19:59:54.022134] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-25T19:59:55.079703] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T19:59:55.090615] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-25T19:59:56.286404] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T19:59:56.298228] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-25T19:59:57.238957] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T19:59:57.250576] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-25T19:59:58.159746] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T19:59:58.171453] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-25T19:59:59.050082] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T19:59:59.060239] [INFO ] [REMOTE ] CFG: Full fetch complete (77777 records). [2025-10-25T19:59:59.060489] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-25T19:59:59.465132] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-25T19:59:59.465264] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-25T19:59:59.466174] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-25T19:59:59.466271] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-25T19:59:59.467877] [DEBUG] [LOCAL ] CFG: Trimmed 77777 records to 54402 (keeping 200 days of data) [2025-10-25T19:59:59.785961] [DEBUG] [LOCAL ] CFG: Primary data saved (54402 records). [2025-10-25T19:59:59.786123] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-25T19:59:59.786242] [INFO ] [MAIN ] Update Progress: 430/2366 symbols. CFG took 13.8s. Estimated remaining time: 4h 40m 2s [2025-10-25T19:59:59.959285] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T19:59:59.959472] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-25T19:59:59.959559] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-25T19:59:59.959700] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-25T19:59:59.959776] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-25T19:59:59.959860] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-25T19:59:59.959928] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-25T20:00:00.334519] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:00:00.334878] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-25T20:00:00.690017] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:00:00.690428] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-25T20:00:00.690538] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:00:00.690626] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-25T20:00:00.690732] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:00:00.690820] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-25T20:00:00.690937] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-25T20:00:00.691030] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-25T20:00:00.691129] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-25T20:00:00.691294] [INFO ] [MAIN ] Update Progress: 431/2366 symbols. CFND took 0.9s. Estimated remaining time: 4h 39m 18s [2025-10-25T20:00:00.894861] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:00:00.895055] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-10-25T20:00:00.895129] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-10-25T20:00:00.895240] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-25T20:00:00.895312] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-25T20:00:00.895370] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-25T20:00:00.895434] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-25T20:00:01.365681] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:00:01.366195] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-25T20:00:03.624940] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-25T20:00:03.632922] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-25T20:00:06.784786] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (3.15 seconds). [2025-10-25T20:00:06.792276] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-25T20:00:08.448158] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T20:00:08.460315] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-25T20:00:09.964046] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T20:00:09.973549] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-25T20:00:11.574426] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T20:00:11.582289] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-25T20:00:13.104502] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T20:00:13.110691] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-25T20:00:14.803239] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-25T20:00:14.811203] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-25T20:00:16.461499] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-25T20:00:16.470233] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-25T20:00:18.035398] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T20:00:18.043626] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-25T20:00:19.409786] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T20:00:19.415468] [INFO ] [REMOTE ] CFR: Full fetch complete (48673 records). [2025-10-25T20:00:19.415583] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-25T20:00:19.785567] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-25T20:00:19.785702] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-25T20:00:19.786244] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-25T20:00:19.786315] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-25T20:00:19.787331] [DEBUG] [LOCAL ] CFR: Trimmed 48673 records to 32889 (keeping 200 days of data) [2025-10-25T20:00:19.982038] [DEBUG] [LOCAL ] CFR: Primary data saved (32889 records). [2025-10-25T20:00:19.982206] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-25T20:00:19.982330] [INFO ] [MAIN ] Update Progress: 432/2366 symbols. CFR took 19.3s. Estimated remaining time: 4h 39m 57s [2025-10-25T20:00:20.149102] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:00:20.149290] [DEBUG] [LOCAL ] CGAU: No existing data file found in primary storage. [2025-10-25T20:00:20.149382] [WARN ] [MAIN ] CGAU: No existing data found, performing full refresh instead. [2025-10-25T20:00:20.149495] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-25T20:00:20.149567] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-25T20:00:20.149631] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-25T20:00:20.149716] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-25T20:00:20.522097] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:00:20.522463] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-25T20:00:22.125323] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T20:00:22.133478] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-25T20:00:23.951055] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T20:00:23.959149] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-25T20:00:25.495265] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T20:00:25.504454] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-25T20:00:26.510319] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T20:00:26.519456] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-25T20:00:27.326385] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T20:00:27.335394] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-25T20:00:28.178749] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T20:00:28.187513] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-25T20:00:29.104536] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T20:00:29.113717] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-25T20:00:30.092217] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T20:00:30.101730] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-25T20:00:31.062174] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:00:31.072362] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-25T20:00:31.898142] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T20:00:31.907425] [INFO ] [REMOTE ] CGAU: Full fetch complete (62224 records). [2025-10-25T20:00:31.907589] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-25T20:00:32.291764] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-25T20:00:32.291900] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-25T20:00:32.292569] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-25T20:00:32.292677] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-25T20:00:32.294056] [DEBUG] [LOCAL ] CGAU: Trimmed 62224 records to 44606 (keeping 200 days of data) [2025-10-25T20:00:32.564168] [DEBUG] [LOCAL ] CGAU: Primary data saved (44606 records). [2025-10-25T20:00:32.564733] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-25T20:00:32.564864] [INFO ] [MAIN ] Update Progress: 433/2366 symbols. CGAU took 12.6s. Estimated remaining time: 4h 40m 6s [2025-10-25T20:00:32.736911] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:00:32.737170] [DEBUG] [LOCAL ] CGV: No existing data file found in primary storage. [2025-10-25T20:00:32.737243] [WARN ] [MAIN ] CGV: No existing data found, performing full refresh instead. [2025-10-25T20:00:32.737359] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-25T20:00:32.737463] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-25T20:00:32.737550] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-10-25T20:00:32.737619] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-25T20:00:33.106688] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:00:33.107045] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-25T20:00:33.726214] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T20:00:33.727426] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-25T20:00:34.307878] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T20:00:34.309213] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-25T20:00:34.975890] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T20:00:34.977065] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-25T20:00:35.612099] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-25T20:00:35.613394] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-25T20:00:36.131358] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-25T20:00:36.132380] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-25T20:00:36.756758] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T20:00:36.757903] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-25T20:00:37.233710] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-25T20:00:37.234813] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-25T20:00:37.793284] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-25T20:00:37.794474] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-25T20:00:38.289783] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-25T20:00:38.290891] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-25T20:00:38.826366] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T20:00:38.827276] [INFO ] [REMOTE ] CGV: Full fetch complete (2210 records). [2025-10-25T20:00:38.827368] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-25T20:00:39.183878] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-25T20:00:39.183987] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-25T20:00:39.184112] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-25T20:00:39.184202] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-25T20:00:39.184570] [DEBUG] [LOCAL ] CGV: Trimmed 2210 records to 1374 (keeping 200 days of data) [2025-10-25T20:00:39.193314] [DEBUG] [LOCAL ] CGV: Primary data saved (1374 records). [2025-10-25T20:00:39.193396] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-25T20:00:39.193501] [INFO ] [MAIN ] Update Progress: 434/2366 symbols. CGV took 6.6s. Estimated remaining time: 4h 39m 48s [2025-10-25T20:00:39.359948] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:00:39.360134] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-25T20:00:39.360206] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-25T20:00:39.360319] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-25T20:00:39.360398] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-25T20:00:39.360481] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-25T20:00:39.360550] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-25T20:00:39.711833] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:00:39.712172] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-25T20:00:40.985315] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T20:00:40.990735] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-25T20:00:42.118721] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T20:00:42.126238] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-25T20:00:43.358713] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-25T20:00:43.363825] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-25T20:00:44.686159] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T20:00:44.694993] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-25T20:00:45.513525] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T20:00:45.519979] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-25T20:00:46.627729] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T20:00:46.632833] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-25T20:00:48.010548] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T20:00:48.017042] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-25T20:00:49.231373] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T20:00:49.237117] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-25T20:00:50.535250] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T20:00:50.540489] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-25T20:00:51.954274] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T20:00:51.959092] [INFO ] [REMOTE ] CHCT: Full fetch complete (34695 records). [2025-10-25T20:00:51.959221] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-25T20:00:52.331709] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-25T20:00:52.331839] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-25T20:00:52.332318] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-25T20:00:52.332401] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-25T20:00:52.333421] [DEBUG] [LOCAL ] CHCT: Trimmed 34695 records to 24555 (keeping 200 days of data) [2025-10-25T20:00:52.477006] [DEBUG] [LOCAL ] CHCT: Primary data saved (24555 records). [2025-10-25T20:00:52.477183] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-25T20:00:52.477313] [INFO ] [MAIN ] Update Progress: 435/2366 symbols. CHCT took 13.3s. Estimated remaining time: 4h 39m 60s [2025-10-25T20:00:52.645212] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:00:52.645417] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-10-25T20:00:52.645497] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-10-25T20:00:52.645612] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-25T20:00:52.645714] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-25T20:00:52.645799] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-25T20:00:52.645870] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-25T20:00:52.998961] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:00:52.999269] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-25T20:00:55.019340] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-25T20:00:55.032949] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-25T20:00:56.865886] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T20:00:56.875860] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-25T20:00:58.682857] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T20:00:58.693562] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-25T20:00:59.655267] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T20:00:59.666514] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-25T20:01:00.960086] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T20:01:00.971422] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-25T20:01:02.851310] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-25T20:01:02.861973] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-25T20:01:04.014371] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T20:01:04.026194] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-25T20:01:04.862231] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T20:01:04.873451] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-25T20:01:05.898928] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T20:01:05.909944] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-25T20:01:06.963204] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T20:01:06.972715] [INFO ] [REMOTE ] CHD: Full fetch complete (75000 records). [2025-10-25T20:01:06.972890] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-25T20:01:07.371742] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-25T20:01:07.371856] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-25T20:01:07.372674] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-25T20:01:07.372756] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-25T20:01:07.374288] [DEBUG] [LOCAL ] CHD: Trimmed 75000 records to 53076 (keeping 200 days of data) [2025-10-25T20:01:07.684781] [DEBUG] [LOCAL ] CHD: Primary data saved (53076 records). [2025-10-25T20:01:07.684942] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-25T20:01:07.685057] [INFO ] [MAIN ] Update Progress: 436/2366 symbols. CHD took 15.2s. Estimated remaining time: 4h 40m 20s [2025-10-25T20:01:07.857073] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:01:07.857255] [DEBUG] [LOCAL ] CHE: No existing data file found in primary storage. [2025-10-25T20:01:07.857326] [WARN ] [MAIN ] CHE: No existing data found, performing full refresh instead. [2025-10-25T20:01:07.857451] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-25T20:01:07.857527] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-25T20:01:07.857587] [DEBUG] [LOCAL ] CHE: No primary data file found to delete. [2025-10-25T20:01:07.857671] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-25T20:01:08.226026] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:01:08.226406] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-25T20:01:09.221898] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T20:01:09.224955] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-25T20:01:10.201898] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T20:01:10.205713] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-25T20:01:11.189264] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T20:01:11.192392] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-25T20:01:12.345209] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:01:12.348800] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-25T20:01:13.533525] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T20:01:13.536982] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-25T20:01:14.548906] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T20:01:14.552300] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-25T20:01:15.768753] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T20:01:15.773051] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-25T20:01:16.938268] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T20:01:16.942060] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-25T20:01:18.219968] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T20:01:18.224404] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-25T20:01:19.393580] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T20:01:19.398440] [INFO ] [REMOTE ] CHE: Full fetch complete (20612 records). [2025-10-25T20:01:19.398554] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-25T20:01:19.762954] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-25T20:01:19.763063] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-25T20:01:19.763421] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-25T20:01:19.763497] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-25T20:01:19.764160] [DEBUG] [LOCAL ] CHE: Trimmed 20612 records to 15561 (keeping 200 days of data) [2025-10-25T20:01:19.856948] [DEBUG] [LOCAL ] CHE: Primary data saved (15561 records). [2025-10-25T20:01:19.857117] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-25T20:01:19.857236] [INFO ] [MAIN ] Update Progress: 437/2366 symbols. CHE took 12.2s. Estimated remaining time: 4h 40m 26s [2025-10-25T20:01:20.028842] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:01:20.029041] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-10-25T20:01:20.029113] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-10-25T20:01:20.029228] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-25T20:01:20.029303] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-25T20:01:20.029386] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-25T20:01:20.029458] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-25T20:01:20.397514] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:01:20.397977] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-25T20:01:22.200412] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T20:01:22.210780] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-25T20:01:24.055780] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T20:01:24.065468] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-25T20:01:25.899085] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T20:01:25.910036] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-25T20:01:26.912429] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T20:01:26.922379] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-25T20:01:27.836482] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T20:01:27.846501] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-25T20:01:29.020627] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T20:01:29.031017] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-25T20:01:30.175077] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T20:01:30.186228] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-25T20:01:31.158884] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:01:31.169876] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-25T20:01:32.171233] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:01:32.181950] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-25T20:01:33.126581] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:01:33.134897] [INFO ] [REMOTE ] CHGG: Full fetch complete (69799 records). [2025-10-25T20:01:33.135048] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-25T20:01:33.521262] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-25T20:01:33.521410] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-25T20:01:33.522229] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-25T20:01:33.522311] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-25T20:01:33.523785] [DEBUG] [LOCAL ] CHGG: Trimmed 69799 records to 48084 (keeping 200 days of data) [2025-10-25T20:01:33.780816] [DEBUG] [LOCAL ] CHGG: Primary data saved (48084 records). [2025-10-25T20:01:33.780971] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-25T20:01:33.781090] [INFO ] [MAIN ] Update Progress: 438/2366 symbols. CHGG took 13.9s. Estimated remaining time: 4h 40m 40s [2025-10-25T20:01:33.945673] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:01:33.945870] [DEBUG] [LOCAL ] CHH: No existing data file found in primary storage. [2025-10-25T20:01:33.945941] [WARN ] [MAIN ] CHH: No existing data found, performing full refresh instead. [2025-10-25T20:01:33.946029] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-25T20:01:33.946095] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-25T20:01:33.946172] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-10-25T20:01:33.946243] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-25T20:01:34.297746] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:01:34.298137] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-25T20:01:35.826716] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T20:01:35.833677] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-25T20:01:37.365345] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T20:01:37.372322] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-25T20:01:38.620624] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T20:01:38.628165] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-25T20:01:40.194876] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T20:01:40.202894] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-25T20:01:41.831211] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T20:01:41.839101] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-25T20:01:43.189714] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T20:01:43.196225] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-25T20:01:44.681837] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T20:01:44.691123] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-25T20:01:46.111059] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T20:01:46.118468] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-25T20:01:47.580733] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T20:01:47.587710] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-25T20:01:49.003026] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T20:01:49.012147] [INFO ] [REMOTE ] CHH: Full fetch complete (47610 records). [2025-10-25T20:01:49.012391] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-25T20:01:49.423388] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-25T20:01:49.423531] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-25T20:01:49.424193] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-25T20:01:49.424282] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-25T20:01:49.425518] [DEBUG] [LOCAL ] CHH: Trimmed 47610 records to 32762 (keeping 200 days of data) [2025-10-25T20:01:49.623054] [DEBUG] [LOCAL ] CHH: Primary data saved (32762 records). [2025-10-25T20:01:49.623215] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-25T20:01:49.623344] [INFO ] [MAIN ] Update Progress: 439/2366 symbols. CHH took 15.8s. Estimated remaining time: 4h 41m 3s [2025-10-25T20:01:49.791272] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:01:49.791449] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-25T20:01:49.791523] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-25T20:01:49.791662] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-25T20:01:49.791758] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-25T20:01:49.791844] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-25T20:01:49.791914] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-25T20:01:50.145180] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:01:50.145548] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-25T20:01:51.355623] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T20:01:51.362308] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-25T20:01:52.518588] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T20:01:52.523074] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-25T20:01:53.855896] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T20:01:53.861814] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-25T20:01:55.155101] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T20:01:55.161289] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-25T20:01:56.334519] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T20:01:56.341190] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-25T20:01:57.564032] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T20:01:57.569041] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-25T20:01:58.870196] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T20:01:58.874996] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-25T20:01:59.992063] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T20:01:59.996684] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-25T20:02:01.426775] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T20:02:01.432010] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-25T20:02:03.183198] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T20:02:03.189068] [INFO ] [REMOTE ] CHMI: Full fetch complete (31230 records). [2025-10-25T20:02:03.189298] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-25T20:02:03.581958] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-25T20:02:03.582099] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-25T20:02:03.582566] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-25T20:02:03.582679] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-25T20:02:03.583604] [DEBUG] [LOCAL ] CHMI: Trimmed 31230 records to 21387 (keeping 200 days of data) [2025-10-25T20:02:03.700147] [DEBUG] [LOCAL ] CHMI: Primary data saved (21387 records). [2025-10-25T20:02:03.700300] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-25T20:02:03.700414] [INFO ] [MAIN ] Update Progress: 440/2366 symbols. CHMI took 14.1s. Estimated remaining time: 4h 41m 17s [2025-10-25T20:02:03.864928] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:02:03.865132] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-25T20:02:03.865202] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-25T20:02:03.865316] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-25T20:02:03.865386] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-25T20:02:03.865443] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-25T20:02:03.865508] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-25T20:02:04.250661] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:02:04.251069] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-25T20:02:05.093532] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-25T20:02:05.095973] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-25T20:02:05.838251] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-25T20:02:05.840285] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-25T20:02:06.405438] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T20:02:06.407159] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-25T20:02:07.070617] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-25T20:02:07.072466] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-25T20:02:07.767213] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-25T20:02:07.769113] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-25T20:02:08.517633] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T20:02:08.519359] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-25T20:02:09.200390] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-25T20:02:09.201968] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-25T20:02:10.020809] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T20:02:10.022848] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-25T20:02:10.865738] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T20:02:10.867728] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-25T20:02:11.726124] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T20:02:11.727812] [INFO ] [REMOTE ] CHN: Full fetch complete (7583 records). [2025-10-25T20:02:11.727954] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-25T20:02:12.092825] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-25T20:02:12.092946] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-25T20:02:12.093251] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-25T20:02:12.093344] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-25T20:02:12.093898] [DEBUG] [LOCAL ] CHN: Trimmed 7583 records to 5088 (keeping 200 days of data) [2025-10-25T20:02:12.122906] [DEBUG] [LOCAL ] CHN: Primary data saved (5088 records). [2025-10-25T20:02:12.123043] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-25T20:02:12.123212] [INFO ] [MAIN ] Update Progress: 441/2366 symbols. CHN took 8.4s. Estimated remaining time: 4h 41m 7s [2025-10-25T20:02:12.298514] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:02:12.298770] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-25T20:02:12.298846] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-25T20:02:12.298967] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-25T20:02:12.299062] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-25T20:02:12.299149] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-25T20:02:12.299218] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-25T20:02:12.689734] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:02:12.690133] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-25T20:02:14.938710] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-25T20:02:14.950342] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-25T20:02:17.129083] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-25T20:02:17.139125] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-25T20:02:19.516686] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-25T20:02:19.528475] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-25T20:02:21.788746] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-25T20:02:21.800046] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-25T20:02:23.770361] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-25T20:02:23.782793] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-25T20:02:25.898943] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-25T20:02:25.910070] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-25T20:02:28.176304] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-25T20:02:28.187705] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-25T20:02:30.402865] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-25T20:02:30.411861] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-25T20:02:32.298030] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T20:02:32.306524] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-25T20:02:34.123758] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-25T20:02:34.130967] [INFO ] [REMOTE ] CHPT: Full fetch complete (70754 records). [2025-10-25T20:02:34.131113] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-25T20:02:34.526292] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-25T20:02:34.526419] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-25T20:02:34.527288] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-25T20:02:34.527374] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-25T20:02:34.528943] [DEBUG] [LOCAL ] CHPT: Trimmed 70754 records to 47410 (keeping 200 days of data) [2025-10-25T20:02:34.793533] [DEBUG] [LOCAL ] CHPT: Primary data saved (47410 records). [2025-10-25T20:02:34.793693] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-25T20:02:34.793827] [INFO ] [MAIN ] Update Progress: 442/2366 symbols. CHPT took 22.7s. Estimated remaining time: 4h 41m 59s [2025-10-25T20:02:34.968785] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:02:34.969077] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-25T20:02:34.969149] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-25T20:02:34.969304] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-25T20:02:34.969381] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-25T20:02:34.969462] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-25T20:02:34.969536] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-25T20:02:35.320060] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:02:35.320476] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-25T20:02:36.382146] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-25T20:02:36.386178] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-25T20:02:37.467468] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T20:02:37.471997] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-25T20:02:38.695623] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-25T20:02:38.700710] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-25T20:02:39.885295] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T20:02:39.891836] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-25T20:02:41.099699] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T20:02:41.104753] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-25T20:02:42.300362] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T20:02:42.304741] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-25T20:02:43.507681] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T20:02:43.512368] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-25T20:02:44.779340] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T20:02:44.784103] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-25T20:02:45.918991] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T20:02:45.925064] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-25T20:02:46.936289] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T20:02:46.939901] [INFO ] [REMOTE ] CHT: Full fetch complete (27615 records). [2025-10-25T20:02:46.940015] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-25T20:02:47.301890] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-25T20:02:47.302024] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-25T20:02:47.302514] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-25T20:02:47.302636] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-25T20:02:47.303354] [DEBUG] [LOCAL ] CHT: Trimmed 27615 records to 19441 (keeping 200 days of data) [2025-10-25T20:02:47.413196] [DEBUG] [LOCAL ] CHT: Primary data saved (19441 records). [2025-10-25T20:02:47.413375] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-25T20:02:47.413514] [INFO ] [MAIN ] Update Progress: 443/2366 symbols. CHT took 12.6s. Estimated remaining time: 4h 42m 7s [2025-10-25T20:02:47.579486] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:02:47.579727] [DEBUG] [LOCAL ] CHWY: No existing data file found in primary storage. [2025-10-25T20:02:47.579816] [WARN ] [MAIN ] CHWY: No existing data found, performing full refresh instead. [2025-10-25T20:02:47.579983] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-25T20:02:47.580077] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-25T20:02:47.580185] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-25T20:02:47.580276] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-25T20:02:47.934265] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:02:47.934630] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-25T20:02:49.871547] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T20:02:49.882330] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-25T20:02:51.819613] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T20:02:51.829927] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-25T20:02:53.742057] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T20:02:53.752997] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-25T20:02:54.732829] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T20:02:54.744173] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-25T20:02:55.767181] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T20:02:55.778601] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-25T20:02:56.551920] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T20:02:56.562797] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-25T20:02:57.633638] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T20:02:57.645342] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-25T20:02:58.615811] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:02:58.627200] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-25T20:02:59.718692] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T20:02:59.730188] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-25T20:03:00.781338] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T20:03:00.791278] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-25T20:03:00.791453] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-25T20:03:01.182000] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-25T20:03:01.182154] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-25T20:03:01.182967] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-25T20:03:01.183052] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-25T20:03:01.184549] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 54434 (keeping 200 days of data) [2025-10-25T20:03:01.498762] [DEBUG] [LOCAL ] CHWY: Primary data saved (54434 records). [2025-10-25T20:03:01.498956] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-25T20:03:01.499083] [INFO ] [MAIN ] Update Progress: 444/2366 symbols. CHWY took 14.1s. Estimated remaining time: 4h 42m 21s [2025-10-25T20:03:01.671958] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:03:01.672182] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-25T20:03:01.672253] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-25T20:03:01.672341] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-25T20:03:01.672409] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-25T20:03:01.672467] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-25T20:03:01.672506] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-25T20:03:02.035130] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:03:02.035485] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-25T20:03:03.851200] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T20:03:03.861228] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-25T20:03:05.670834] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T20:03:05.681067] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-25T20:03:07.564131] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T20:03:07.575628] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-25T20:03:08.612691] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T20:03:08.623315] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-25T20:03:09.521736] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T20:03:09.532487] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-25T20:03:10.571107] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T20:03:10.581381] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-25T20:03:11.790343] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T20:03:11.801762] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-25T20:03:12.689938] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T20:03:12.700867] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-25T20:03:13.420696] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T20:03:13.431299] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-25T20:03:14.349915] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:03:14.362492] [INFO ] [REMOTE ] CI: Full fetch complete (72022 records). [2025-10-25T20:03:14.362811] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-25T20:03:14.765806] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-25T20:03:14.765934] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-25T20:03:14.766747] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-25T20:03:14.766831] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-25T20:03:14.768397] [DEBUG] [LOCAL ] CI: Trimmed 72022 records to 50262 (keeping 200 days of data) [2025-10-25T20:03:15.069187] [DEBUG] [LOCAL ] CI: Primary data saved (50262 records). [2025-10-25T20:03:15.069355] [INFO ] [MAIN ] CI: Full history saved. [2025-10-25T20:03:15.069455] [INFO ] [MAIN ] Update Progress: 445/2366 symbols. CI took 13.6s. Estimated remaining time: 4h 42m 33s [2025-10-25T20:03:15.233439] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:03:15.233688] [DEBUG] [LOCAL ] CIA: No existing data file found in primary storage. [2025-10-25T20:03:15.233762] [WARN ] [MAIN ] CIA: No existing data found, performing full refresh instead. [2025-10-25T20:03:15.233873] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-25T20:03:15.233948] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-25T20:03:15.234028] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-25T20:03:15.234130] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-25T20:03:15.601752] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:03:15.602141] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-25T20:03:16.810891] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T20:03:16.814415] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-25T20:03:17.886834] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-25T20:03:17.890836] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-25T20:03:19.080698] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T20:03:19.084676] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-25T20:03:20.237391] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:03:20.241301] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-25T20:03:21.175542] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T20:03:21.179124] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-25T20:03:22.347285] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T20:03:22.352814] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-25T20:03:23.500401] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T20:03:23.505234] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-25T20:03:24.611998] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T20:03:24.616075] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-25T20:03:25.713566] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T20:03:25.717385] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-25T20:03:26.706293] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T20:03:26.710172] [INFO ] [REMOTE ] CIA: Full fetch complete (23153 records). [2025-10-25T20:03:26.710350] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-25T20:03:27.261851] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-25T20:03:27.262018] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-25T20:03:27.262712] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-25T20:03:27.262814] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-25T20:03:27.263989] [DEBUG] [LOCAL ] CIA: Trimmed 23153 records to 16617 (keeping 200 days of data) [2025-10-25T20:03:27.393474] [DEBUG] [LOCAL ] CIA: Primary data saved (16617 records). [2025-10-25T20:03:27.393736] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-25T20:03:27.393958] [INFO ] [MAIN ] Update Progress: 446/2366 symbols. CIA took 12.3s. Estimated remaining time: 4h 42m 39s [2025-10-25T20:03:27.606206] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:03:27.606460] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-25T20:03:27.606537] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-25T20:03:27.606690] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-25T20:03:27.606773] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-25T20:03:27.606857] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-25T20:03:27.606929] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-25T20:03:28.050110] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:03:28.050460] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-25T20:03:29.553320] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T20:03:29.560184] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-25T20:03:31.020523] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T20:03:31.027203] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-25T20:03:32.480617] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T20:03:32.487867] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-25T20:03:34.062307] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T20:03:34.070540] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-25T20:03:35.616912] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-25T20:03:35.623559] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-25T20:03:37.013698] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T20:03:37.023639] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-25T20:03:38.270434] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T20:03:38.276345] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-25T20:03:39.561240] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T20:03:39.567391] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-25T20:03:41.140799] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T20:03:41.147747] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-25T20:03:42.378667] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T20:03:42.384476] [INFO ] [REMOTE ] CIB: Full fetch complete (45482 records). [2025-10-25T20:03:42.384579] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-25T20:03:42.757115] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-25T20:03:42.757253] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-25T20:03:42.757820] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-25T20:03:42.757918] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-25T20:03:42.758946] [DEBUG] [LOCAL ] CIB: Trimmed 45482 records to 30705 (keeping 200 days of data) [2025-10-25T20:03:42.929367] [DEBUG] [LOCAL ] CIB: Primary data saved (30705 records). [2025-10-25T20:03:42.929545] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-25T20:03:42.929694] [INFO ] [MAIN ] Update Progress: 447/2366 symbols. CIB took 15.5s. Estimated remaining time: 4h 42m 59s [2025-10-25T20:03:43.096780] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:03:43.097010] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-25T20:03:43.097102] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-25T20:03:43.097216] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-25T20:03:43.097285] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-25T20:03:43.097365] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-25T20:03:43.097434] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-25T20:03:43.467145] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:03:43.467522] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-25T20:03:43.972946] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-25T20:03:43.974209] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-25T20:03:44.544728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T20:03:44.545903] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-25T20:03:45.048174] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-25T20:03:45.049251] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-25T20:03:45.607339] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-25T20:03:45.609128] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-25T20:03:46.089119] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T20:03:46.090507] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-25T20:03:46.621307] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-25T20:03:46.622516] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-25T20:03:47.191587] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T20:03:47.192724] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-25T20:03:47.693875] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-25T20:03:47.694941] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-25T20:03:48.123565] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-25T20:03:48.124577] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-25T20:03:48.608284] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T20:03:48.609127] [INFO ] [REMOTE ] CICB: Full fetch complete (1913 records). [2025-10-25T20:03:48.609228] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-25T20:03:48.785211] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-25T20:03:48.785409] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:03:48.785503] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:03:48.785597] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-25T20:03:48.785768] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-25T20:03:48.785855] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-25T20:03:48.785956] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-25T20:03:48.786092] [INFO ] [MAIN ] Update Progress: 448/2366 symbols. CICB took 5.9s. Estimated remaining time: 4h 42m 37s [2025-10-25T20:03:48.958592] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:03:48.959700] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-25T20:03:48.959774] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-25T20:03:48.960096] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-25T20:03:48.960175] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-25T20:03:48.960281] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-25T20:03:48.960364] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-25T20:03:49.312740] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:03:49.313250] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-25T20:03:51.038986] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T20:03:51.049303] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-25T20:03:53.044429] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T20:03:53.054388] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-25T20:03:54.960706] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T20:03:54.971891] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-25T20:03:55.830681] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T20:03:55.841844] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-25T20:03:56.734261] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:03:56.744868] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-25T20:03:58.523549] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-25T20:03:58.534205] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-25T20:03:59.511677] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T20:03:59.522741] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-25T20:04:00.372292] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T20:04:00.383680] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-25T20:04:01.718089] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T20:04:01.730101] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-25T20:04:02.711109] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T20:04:02.723614] [INFO ] [REMOTE ] CIEN: Full fetch complete (75836 records). [2025-10-25T20:04:02.723975] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-25T20:04:03.162882] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-25T20:04:03.163058] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-25T20:04:03.164317] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-25T20:04:03.164447] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-25T20:04:03.166822] [DEBUG] [LOCAL ] CIEN: Trimmed 75836 records to 52880 (keeping 200 days of data) [2025-10-25T20:04:03.495677] [DEBUG] [LOCAL ] CIEN: Primary data saved (52880 records). [2025-10-25T20:04:03.495910] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-25T20:04:03.496057] [INFO ] [MAIN ] Update Progress: 449/2366 symbols. CIEN took 14.7s. Estimated remaining time: 4h 42m 53s [2025-10-25T20:04:03.674541] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:04:03.674889] [DEBUG] [LOCAL ] CIF: No existing data file found in primary storage. [2025-10-25T20:04:03.674974] [WARN ] [MAIN ] CIF: No existing data found, performing full refresh instead. [2025-10-25T20:04:03.675117] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-25T20:04:03.675202] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-25T20:04:03.675329] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-25T20:04:03.675408] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-25T20:04:04.077629] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:04:04.078156] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-25T20:04:04.799319] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T20:04:04.801244] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-25T20:04:05.752588] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T20:04:05.754536] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-25T20:04:06.630111] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T20:04:06.632164] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-25T20:04:07.343949] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T20:04:07.346321] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-25T20:04:08.078305] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-25T20:04:08.080361] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-25T20:04:08.650007] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T20:04:08.651793] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-25T20:04:09.380082] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-25T20:04:09.381679] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-25T20:04:10.056145] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-25T20:04:10.057757] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-25T20:04:10.778744] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T20:04:10.780282] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-25T20:04:11.424625] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T20:04:11.425876] [INFO ] [REMOTE ] CIF: Full fetch complete (6556 records). [2025-10-25T20:04:11.425984] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-25T20:04:11.782750] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-25T20:04:11.782889] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-25T20:04:11.783113] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-25T20:04:11.783218] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-25T20:04:11.783751] [DEBUG] [LOCAL ] CIF: Trimmed 6556 records to 4015 (keeping 200 days of data) [2025-10-25T20:04:11.806464] [DEBUG] [LOCAL ] CIF: Primary data saved (4015 records). [2025-10-25T20:04:11.806602] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-25T20:04:11.806765] [INFO ] [MAIN ] Update Progress: 450/2366 symbols. CIF took 8.3s. Estimated remaining time: 4h 42m 42s [2025-10-25T20:04:11.973446] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:04:11.973635] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-25T20:04:11.973733] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-25T20:04:11.974046] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-25T20:04:11.974122] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-25T20:04:11.974208] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-25T20:04:11.974282] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-25T20:04:12.328522] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:04:12.328954] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-25T20:04:13.948584] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T20:04:13.956301] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-25T20:04:15.491987] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T20:04:15.503060] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-25T20:04:17.237633] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:04:17.248035] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-25T20:04:18.139392] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T20:04:18.148205] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-25T20:04:19.353143] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T20:04:19.362349] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-25T20:04:20.389513] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:04:20.399689] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-25T20:04:21.599782] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T20:04:21.611978] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-25T20:04:22.508226] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T20:04:22.518953] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-25T20:04:23.478734] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:04:23.490952] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-25T20:04:25.157832] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-25T20:04:25.171476] [INFO ] [REMOTE ] CIG: Full fetch complete (62759 records). [2025-10-25T20:04:25.171704] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-25T20:04:25.581047] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-25T20:04:25.581199] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-25T20:04:25.582186] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-25T20:04:25.582273] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-25T20:04:25.584187] [DEBUG] [LOCAL ] CIG: Trimmed 62759 records to 45103 (keeping 200 days of data) [2025-10-25T20:04:25.860490] [DEBUG] [LOCAL ] CIG: Primary data saved (45103 records). [2025-10-25T20:04:25.860752] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-25T20:04:25.860904] [INFO ] [MAIN ] Update Progress: 451/2366 symbols. CIG took 14.1s. Estimated remaining time: 4h 42m 55s [2025-10-25T20:04:26.039813] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:04:26.040121] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-25T20:04:26.040197] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-25T20:04:26.040330] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-25T20:04:26.040407] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-25T20:04:26.040490] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-25T20:04:26.040563] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-25T20:04:26.424067] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:04:26.424509] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-25T20:04:27.447412] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T20:04:27.451265] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-25T20:04:28.537998] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T20:04:28.541981] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-25T20:04:29.708251] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-25T20:04:29.713512] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-25T20:04:31.362761] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T20:04:31.367886] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-25T20:04:32.389366] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T20:04:32.392863] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-25T20:04:33.316484] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T20:04:33.319571] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-25T20:04:34.379832] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T20:04:34.385163] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-25T20:04:35.351900] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:04:35.356845] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-25T20:04:36.424790] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T20:04:36.428878] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-25T20:04:37.527366] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T20:04:37.531063] [INFO ] [REMOTE ] CII: Full fetch complete (22819 records). [2025-10-25T20:04:37.531217] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-25T20:04:37.897961] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-25T20:04:37.898095] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-25T20:04:37.898507] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-25T20:04:37.898585] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-25T20:04:37.899295] [DEBUG] [LOCAL ] CII: Trimmed 22819 records to 15310 (keeping 200 days of data) [2025-10-25T20:04:37.988884] [DEBUG] [LOCAL ] CII: Primary data saved (15310 records). [2025-10-25T20:04:37.989069] [INFO ] [MAIN ] CII: Full history saved. [2025-10-25T20:04:37.989195] [INFO ] [MAIN ] Update Progress: 452/2366 symbols. CII took 12.1s. Estimated remaining time: 4h 43m 0s [2025-10-25T20:04:38.153329] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:04:38.153509] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-25T20:04:38.153560] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-25T20:04:38.153690] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-25T20:04:38.153769] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-25T20:04:38.153856] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-25T20:04:38.153926] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-25T20:04:38.503170] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:04:38.503530] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-25T20:04:39.959033] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T20:04:39.966497] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-25T20:04:41.528162] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T20:04:41.536039] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-25T20:04:42.955755] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T20:04:42.965059] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-25T20:04:44.567452] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T20:04:44.576797] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-25T20:04:46.165727] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T20:04:46.173769] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-25T20:04:47.593180] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T20:04:47.601739] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-25T20:04:49.139254] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T20:04:49.147113] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-25T20:04:50.592299] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T20:04:50.599827] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-25T20:04:52.127946] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T20:04:52.136244] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-25T20:04:53.688139] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T20:04:53.695790] [INFO ] [REMOTE ] CIM: Full fetch complete (54805 records). [2025-10-25T20:04:53.696004] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-25T20:04:54.079075] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-25T20:04:54.079241] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-25T20:04:54.079952] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-25T20:04:54.080054] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-25T20:04:54.081373] [DEBUG] [LOCAL ] CIM: Trimmed 54805 records to 37903 (keeping 200 days of data) [2025-10-25T20:04:54.305059] [DEBUG] [LOCAL ] CIM: Primary data saved (37903 records). [2025-10-25T20:04:54.305279] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-25T20:04:54.305421] [INFO ] [MAIN ] Update Progress: 453/2366 symbols. CIM took 16.3s. Estimated remaining time: 4h 43m 23s [2025-10-25T20:04:54.478005] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:04:54.478259] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-25T20:04:54.478347] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-25T20:04:54.478485] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-25T20:04:54.478575] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-25T20:04:54.478710] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-25T20:04:54.478804] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-25T20:04:54.829960] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:04:54.830349] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-25T20:04:55.437343] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T20:04:55.438777] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-25T20:04:56.035169] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T20:04:56.036503] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-25T20:04:56.564962] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-25T20:04:56.566229] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-25T20:04:57.165434] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T20:04:57.166954] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-25T20:04:57.806153] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-25T20:04:57.807787] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-25T20:04:58.403709] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-25T20:04:58.405073] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-25T20:04:58.931070] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-25T20:04:58.932257] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-25T20:04:59.662057] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T20:04:59.663329] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-25T20:05:00.288538] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T20:05:00.289942] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-25T20:05:00.892835] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T20:05:00.894001] [INFO ] [REMOTE ] CIMN: Full fetch complete (3887 records). [2025-10-25T20:05:00.894099] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-25T20:05:01.265721] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-25T20:05:01.265847] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-25T20:05:01.266033] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-25T20:05:01.266130] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-25T20:05:01.266613] [DEBUG] [LOCAL ] CIMN: Trimmed 3887 records to 2724 (keeping 200 days of data) [2025-10-25T20:05:01.283028] [DEBUG] [LOCAL ] CIMN: Primary data saved (2724 records). [2025-10-25T20:05:01.283139] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-25T20:05:01.283280] [INFO ] [MAIN ] Update Progress: 454/2366 symbols. CIMN took 7.0s. Estimated remaining time: 4h 43m 6s [2025-10-25T20:05:01.455194] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:05:01.455398] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-25T20:05:01.455493] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-25T20:05:01.455663] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-25T20:05:01.455745] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-25T20:05:01.455847] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-25T20:05:01.455931] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-25T20:05:01.855250] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:05:01.855725] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-25T20:05:02.488589] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-25T20:05:02.489880] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-25T20:05:03.091232] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T20:05:03.092517] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-25T20:05:03.676785] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T20:05:03.678174] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-25T20:05:04.449754] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-25T20:05:04.451443] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-25T20:05:05.026059] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T20:05:05.027550] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-25T20:05:05.577842] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T20:05:05.579140] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-25T20:05:06.188421] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-25T20:05:06.189633] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-25T20:05:06.996092] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-25T20:05:06.997879] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-25T20:05:07.910889] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T20:05:07.913360] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-25T20:05:08.567790] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T20:05:08.569497] [INFO ] [REMOTE ] CIMO: Full fetch complete (4538 records). [2025-10-25T20:05:08.569618] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-25T20:05:08.761547] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T20:05:08.761773] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:05:08.761844] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:05:08.761919] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-25T20:05:08.762011] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-25T20:05:08.762082] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-25T20:05:08.762161] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-25T20:05:08.762263] [INFO ] [MAIN ] Update Progress: 455/2366 symbols. CIMO took 7.5s. Estimated remaining time: 4h 42m 51s [2025-10-25T20:05:08.931895] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:05:08.932106] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-25T20:05:08.932179] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-25T20:05:08.932288] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-25T20:05:08.932358] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-25T20:05:08.932438] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-25T20:05:08.932507] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-25T20:05:09.346988] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:05:09.347387] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-25T20:05:09.649445] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:05:09.649814] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-25T20:05:09.649900] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:05:09.649980] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-25T20:05:09.650046] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:05:09.650118] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-25T20:05:09.650211] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-25T20:05:09.650282] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-25T20:05:09.650364] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-25T20:05:09.650482] [INFO ] [MAIN ] Update Progress: 456/2366 symbols. CIMP took 0.9s. Estimated remaining time: 4h 42m 9s [2025-10-25T20:05:09.818626] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:05:09.818857] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-25T20:05:09.818931] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-25T20:05:09.819049] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-25T20:05:09.819122] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-25T20:05:09.819203] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-25T20:05:09.819274] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-25T20:05:10.204449] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:05:10.204926] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-25T20:05:11.246457] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-25T20:05:11.250223] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-25T20:05:12.410537] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T20:05:12.415292] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-25T20:05:13.543920] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-25T20:05:13.547828] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-25T20:05:14.654857] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T20:05:14.659014] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-25T20:05:15.788830] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T20:05:15.793382] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-25T20:05:16.948866] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T20:05:16.955407] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-25T20:05:17.962448] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T20:05:17.966784] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-25T20:05:19.137712] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T20:05:19.142634] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-25T20:05:20.675189] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T20:05:20.681498] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-25T20:05:22.054249] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T20:05:22.060011] [INFO ] [REMOTE ] CINT: Full fetch complete (28723 records). [2025-10-25T20:05:22.060116] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-25T20:05:22.438251] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-25T20:05:22.438381] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-25T20:05:22.438824] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-25T20:05:22.438906] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-25T20:05:22.439633] [DEBUG] [LOCAL ] CINT: Trimmed 28723 records to 20869 (keeping 200 days of data) [2025-10-25T20:05:22.552122] [DEBUG] [LOCAL ] CINT: Primary data saved (20869 records). [2025-10-25T20:05:22.552286] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-25T20:05:22.552393] [INFO ] [MAIN ] Update Progress: 457/2366 symbols. CINT took 12.9s. Estimated remaining time: 4h 42m 17s [2025-10-25T20:05:22.734798] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:05:22.735009] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-10-25T20:05:22.735082] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-10-25T20:05:22.735198] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-25T20:05:22.735270] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-25T20:05:22.735351] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-25T20:05:22.735425] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-25T20:05:23.086542] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:05:23.086922] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-25T20:05:24.213918] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T20:05:24.221374] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-25T20:05:25.235364] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T20:05:25.240640] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-25T20:05:26.417787] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T20:05:26.422316] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-25T20:05:27.567449] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:05:27.572307] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-25T20:05:28.649208] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T20:05:28.653358] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-25T20:05:29.719222] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T20:05:29.724702] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-25T20:05:31.171768] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T20:05:31.177595] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-25T20:05:32.412325] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T20:05:32.418001] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-25T20:05:33.701540] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T20:05:33.709080] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-25T20:05:34.966492] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T20:05:34.971950] [INFO ] [REMOTE ] CIO: Full fetch complete (29881 records). [2025-10-25T20:05:34.972058] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-25T20:05:35.337272] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-25T20:05:35.337385] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-25T20:05:35.337818] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-25T20:05:35.337897] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-25T20:05:35.338683] [DEBUG] [LOCAL ] CIO: Trimmed 29881 records to 21650 (keeping 200 days of data) [2025-10-25T20:05:35.455231] [DEBUG] [LOCAL ] CIO: Primary data saved (21650 records). [2025-10-25T20:05:35.455380] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-25T20:05:35.455498] [INFO ] [MAIN ] Update Progress: 458/2366 symbols. CIO took 12.9s. Estimated remaining time: 4h 42m 25s [2025-10-25T20:05:35.627298] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:05:35.627518] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-25T20:05:35.627592] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-25T20:05:35.627744] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-25T20:05:35.627837] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-25T20:05:35.627951] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-25T20:05:35.628021] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-25T20:05:35.985513] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:05:35.985881] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-25T20:05:37.191835] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T20:05:37.197139] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-25T20:05:38.345562] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T20:05:38.350817] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-25T20:05:39.970322] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T20:05:39.977369] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-25T20:05:41.465496] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T20:05:41.473943] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-25T20:05:42.899891] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T20:05:42.906046] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-25T20:05:44.280075] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T20:05:44.286505] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-25T20:05:45.498078] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T20:05:45.503730] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-25T20:05:46.798592] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T20:05:46.804823] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-25T20:05:47.995565] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T20:05:48.001478] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-25T20:05:49.189714] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T20:05:49.194845] [INFO ] [REMOTE ] CION: Full fetch complete (40552 records). [2025-10-25T20:05:49.194996] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-25T20:05:49.564716] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-25T20:05:49.564840] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-25T20:05:49.565344] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-25T20:05:49.565423] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-25T20:05:49.566426] [DEBUG] [LOCAL ] CION: Trimmed 40552 records to 28391 (keeping 200 days of data) [2025-10-25T20:05:49.723669] [DEBUG] [LOCAL ] CION: Primary data saved (28391 records). [2025-10-25T20:05:49.723830] [INFO ] [MAIN ] CION: Full history saved. [2025-10-25T20:05:49.723950] [INFO ] [MAIN ] Update Progress: 459/2366 symbols. CION took 14.3s. Estimated remaining time: 4h 42m 38s [2025-10-25T20:05:49.890284] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:05:49.890446] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-10-25T20:05:49.890519] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-10-25T20:05:49.890633] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-25T20:05:49.890729] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-25T20:05:49.890811] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-10-25T20:05:49.890882] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-25T20:05:50.237973] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:05:50.238329] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-25T20:05:51.854934] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T20:05:51.864683] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-25T20:05:53.583055] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T20:05:53.592999] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-25T20:05:55.406785] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T20:05:55.418088] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-25T20:05:57.277964] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-25T20:05:57.290693] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-25T20:05:58.192476] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T20:05:58.204140] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-25T20:05:59.204677] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T20:05:59.220797] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-25T20:06:00.380775] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T20:06:00.393082] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-25T20:06:01.736161] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T20:06:01.748727] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-25T20:06:02.961290] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T20:06:02.973167] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-25T20:06:03.917128] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:06:03.929634] [INFO ] [REMOTE ] CIVI: Full fetch complete (76085 records). [2025-10-25T20:06:03.929907] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-25T20:06:04.321798] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-25T20:06:04.321907] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-25T20:06:04.322673] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-25T20:06:04.322751] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-25T20:06:04.324128] [DEBUG] [LOCAL ] CIVI: Trimmed 76085 records to 53474 (keeping 200 days of data) [2025-10-25T20:06:04.630190] [DEBUG] [LOCAL ] CIVI: Primary data saved (53474 records). [2025-10-25T20:06:04.630347] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-25T20:06:04.630464] [INFO ] [MAIN ] Update Progress: 460/2366 symbols. CIVI took 14.9s. Estimated remaining time: 4h 42m 54s [2025-10-25T20:06:04.794588] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:06:04.794752] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-25T20:06:04.794819] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-25T20:06:04.794925] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-25T20:06:04.794996] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-25T20:06:04.795059] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-25T20:06:04.795123] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-25T20:06:05.140539] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:06:05.140902] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-25T20:06:07.051351] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T20:06:07.061701] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-25T20:06:08.938449] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T20:06:08.948997] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-25T20:06:10.828588] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T20:06:10.839557] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-25T20:06:11.824865] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T20:06:11.836185] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-25T20:06:12.855902] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T20:06:12.866962] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-25T20:06:13.741248] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T20:06:13.752203] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-25T20:06:14.793713] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:06:14.805203] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-25T20:06:15.762908] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T20:06:15.774547] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-25T20:06:16.782490] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T20:06:16.794199] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-25T20:06:17.827149] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T20:06:17.837138] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-25T20:06:17.837331] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-25T20:06:18.229210] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-25T20:06:18.229347] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-25T20:06:18.230163] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-25T20:06:18.230247] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-25T20:06:18.231773] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 54429 (keeping 200 days of data) [2025-10-25T20:06:18.568612] [DEBUG] [LOCAL ] CL: Primary data saved (54429 records). [2025-10-25T20:06:18.568818] [INFO ] [MAIN ] CL: Full history saved. [2025-10-25T20:06:18.568943] [INFO ] [MAIN ] Update Progress: 461/2366 symbols. CL took 13.9s. Estimated remaining time: 4h 43m 6s [2025-10-25T20:06:18.735816] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:06:18.736025] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-10-25T20:06:18.736098] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-10-25T20:06:18.736211] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-25T20:06:18.736283] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-25T20:06:18.736343] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-25T20:06:18.736408] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-25T20:06:19.094922] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:06:19.095369] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-25T20:06:20.392808] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T20:06:20.398909] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-25T20:06:21.768521] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T20:06:21.774909] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-25T20:06:23.180796] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T20:06:23.188061] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-25T20:06:25.134398] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-25T20:06:25.143271] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-25T20:06:26.474997] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T20:06:26.481856] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-25T20:06:27.863366] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T20:06:27.869899] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-25T20:06:29.615928] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T20:06:29.624042] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-25T20:06:31.006838] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T20:06:31.014364] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-25T20:06:32.621987] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T20:06:32.629831] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-25T20:06:34.004274] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T20:06:34.014159] [INFO ] [REMOTE ] CLB: Full fetch complete (47526 records). [2025-10-25T20:06:34.014309] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-25T20:06:34.425218] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-25T20:06:34.425340] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-25T20:06:34.425918] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-25T20:06:34.425996] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-25T20:06:34.427047] [DEBUG] [LOCAL ] CLB: Trimmed 47526 records to 34120 (keeping 200 days of data) [2025-10-25T20:06:34.622429] [DEBUG] [LOCAL ] CLB: Primary data saved (34120 records). [2025-10-25T20:06:34.622592] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-25T20:06:34.622739] [INFO ] [MAIN ] Update Progress: 462/2366 symbols. CLB took 16.1s. Estimated remaining time: 4h 43m 27s [2025-10-25T20:06:34.787742] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:06:34.787966] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-10-25T20:06:34.788053] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-10-25T20:06:34.788181] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-25T20:06:34.788251] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-25T20:06:34.788331] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-25T20:06:34.788402] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-25T20:06:35.138037] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:06:35.138367] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-25T20:06:36.240468] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T20:06:36.244996] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-25T20:06:37.326289] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T20:06:37.333418] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-25T20:06:38.484959] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T20:06:38.490355] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-25T20:06:39.569264] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T20:06:39.573779] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-25T20:06:40.574632] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T20:06:40.579325] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-25T20:06:41.607321] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:06:41.612295] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-25T20:06:42.440395] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T20:06:42.443299] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-25T20:06:43.242709] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T20:06:43.245375] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-25T20:06:44.198603] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:06:44.201899] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-25T20:06:45.383047] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T20:06:45.387313] [INFO ] [REMOTE ] CLCO: Full fetch complete (22769 records). [2025-10-25T20:06:45.387407] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-25T20:06:45.777786] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-25T20:06:45.778155] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-25T20:06:45.778567] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-25T20:06:45.778673] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-25T20:06:45.779294] [DEBUG] [LOCAL ] CLCO: Trimmed 22769 records to 13397 (keeping 200 days of data) [2025-10-25T20:06:45.849906] [DEBUG] [LOCAL ] CLCO: Primary data saved (13397 records). [2025-10-25T20:06:45.850061] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-25T20:06:45.850193] [INFO ] [MAIN ] Update Progress: 463/2366 symbols. CLCO took 11.2s. Estimated remaining time: 4h 43m 27s [2025-10-25T20:06:46.016315] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:06:46.016571] [DEBUG] [LOCAL ] CLDT: No existing data file found in primary storage. [2025-10-25T20:06:46.016677] [WARN ] [MAIN ] CLDT: No existing data found, performing full refresh instead. [2025-10-25T20:06:46.016798] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-25T20:06:46.016870] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-25T20:06:46.016953] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-25T20:06:46.017024] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-25T20:06:46.399013] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:06:46.399364] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-25T20:06:47.538765] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T20:06:47.543517] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-25T20:06:48.978155] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T20:06:48.983811] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-25T20:06:50.566186] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T20:06:50.572982] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-25T20:06:51.909353] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-25T20:06:51.917010] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-25T20:06:53.317261] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T20:06:53.323279] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-25T20:06:54.636084] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T20:06:54.641727] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-25T20:06:55.810324] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T20:06:55.815428] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-25T20:06:56.947542] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T20:06:56.952766] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-25T20:06:58.268594] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T20:06:58.274630] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-25T20:06:59.446808] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T20:06:59.452068] [INFO ] [REMOTE ] CLDT: Full fetch complete (37655 records). [2025-10-25T20:06:59.452205] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-25T20:06:59.825543] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-25T20:06:59.825701] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-25T20:06:59.826272] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-25T20:06:59.826355] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-25T20:06:59.827290] [DEBUG] [LOCAL ] CLDT: Trimmed 37655 records to 25525 (keeping 200 days of data) [2025-10-25T20:06:59.966325] [DEBUG] [LOCAL ] CLDT: Primary data saved (25525 records). [2025-10-25T20:06:59.966489] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-25T20:06:59.966613] [INFO ] [MAIN ] Update Progress: 464/2366 symbols. CLDT took 14.1s. Estimated remaining time: 4h 43m 39s [2025-10-25T20:07:00.131278] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:07:00.131440] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-10-25T20:07:00.131511] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-10-25T20:07:00.131664] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-25T20:07:00.131738] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-25T20:07:00.131795] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-25T20:07:00.131858] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-25T20:07:00.478610] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:07:00.478990] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-25T20:07:02.995933] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-25T20:07:03.007142] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-25T20:07:04.992803] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-25T20:07:05.003123] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-25T20:07:07.138577] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-25T20:07:07.150132] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-25T20:07:08.215173] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T20:07:08.226350] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-25T20:07:09.340092] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T20:07:09.351562] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-25T20:07:10.273639] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T20:07:10.284625] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-25T20:07:11.624780] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T20:07:11.636589] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-25T20:07:12.739435] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T20:07:12.751581] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-25T20:07:13.714679] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:07:13.726191] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-25T20:07:14.641900] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:07:14.652497] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-25T20:07:14.652775] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-25T20:07:15.071475] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-25T20:07:15.071612] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-25T20:07:15.072540] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-25T20:07:15.072624] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-25T20:07:15.074227] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54521 (keeping 200 days of data) [2025-10-25T20:07:15.383896] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-10-25T20:07:15.384071] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-25T20:07:15.384262] [INFO ] [MAIN ] Update Progress: 465/2366 symbols. CLF took 15.4s. Estimated remaining time: 4h 43m 57s [2025-10-25T20:07:15.552734] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:07:15.552954] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-10-25T20:07:15.553027] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-10-25T20:07:15.553162] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-25T20:07:15.553234] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-25T20:07:15.553316] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-25T20:07:15.553387] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-25T20:07:15.896969] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:07:15.897356] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-25T20:07:17.335143] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T20:07:17.341607] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-25T20:07:18.682698] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T20:07:18.689784] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-25T20:07:20.206532] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T20:07:20.213826] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-25T20:07:21.797286] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T20:07:21.805205] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-25T20:07:23.041175] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T20:07:23.047162] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-25T20:07:24.473567] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T20:07:24.479306] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-25T20:07:25.729253] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T20:07:25.735856] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-25T20:07:27.002794] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T20:07:27.008900] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-25T20:07:27.967323] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:07:27.974182] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-25T20:07:29.320008] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T20:07:29.325798] [INFO ] [REMOTE ] CLH: Full fetch complete (42253 records). [2025-10-25T20:07:29.325961] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-25T20:07:29.695321] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-25T20:07:29.695432] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-25T20:07:29.695960] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-25T20:07:29.696040] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-25T20:07:29.697005] [DEBUG] [LOCAL ] CLH: Trimmed 42253 records to 28008 (keeping 200 days of data) [2025-10-25T20:07:29.858887] [DEBUG] [LOCAL ] CLH: Primary data saved (28008 records). [2025-10-25T20:07:29.859080] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-25T20:07:29.859212] [INFO ] [MAIN ] Update Progress: 466/2366 symbols. CLH took 14.5s. Estimated remaining time: 4h 44m 10s [2025-10-25T20:07:30.026868] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:07:30.027072] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-25T20:07:30.027144] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-25T20:07:30.027252] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-25T20:07:30.027322] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-25T20:07:30.027407] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-25T20:07:30.027477] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-25T20:07:30.384506] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:07:30.384863] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-25T20:07:31.464590] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-25T20:07:31.467782] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-25T20:07:32.536804] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-25T20:07:32.543049] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-25T20:07:33.541453] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-25T20:07:33.545211] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-25T20:07:34.633865] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T20:07:34.637388] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-25T20:07:35.498914] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T20:07:35.501610] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-25T20:07:36.319933] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T20:07:36.322566] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-25T20:07:37.360190] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:07:37.363468] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-25T20:07:38.313987] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T20:07:38.317109] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-25T20:07:39.054310] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-25T20:07:39.056396] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-25T20:07:39.854213] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T20:07:39.856184] [INFO ] [REMOTE ] CLPR: Full fetch complete (15774 records). [2025-10-25T20:07:39.856290] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-25T20:07:40.222986] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-25T20:07:40.223103] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-25T20:07:40.223540] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-25T20:07:40.223631] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-25T20:07:40.224295] [DEBUG] [LOCAL ] CLPR: Trimmed 15774 records to 10085 (keeping 200 days of data) [2025-10-25T20:07:40.281742] [DEBUG] [LOCAL ] CLPR: Primary data saved (10085 records). [2025-10-25T20:07:40.281916] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-25T20:07:40.282086] [INFO ] [MAIN ] Update Progress: 467/2366 symbols. CLPR took 10.4s. Estimated remaining time: 4h 44m 7s [2025-10-25T20:07:40.460333] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:07:40.460540] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-25T20:07:40.460632] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-25T20:07:40.460794] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-25T20:07:40.460886] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-25T20:07:40.460996] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-25T20:07:40.461078] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-25T20:07:40.830436] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:07:40.830826] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-25T20:07:43.004035] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-25T20:07:43.014772] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-25T20:07:45.223861] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-25T20:07:45.234016] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-25T20:07:47.470317] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-25T20:07:47.481235] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-25T20:07:48.680139] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T20:07:48.691046] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-25T20:07:49.747797] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T20:07:49.758914] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-25T20:07:50.790387] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:07:50.802285] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-25T20:07:51.832500] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T20:07:51.844608] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-25T20:07:52.786369] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:07:52.798089] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-25T20:07:53.779037] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T20:07:53.791258] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-25T20:07:54.771174] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T20:07:54.780938] [INFO ] [REMOTE ] CLS: Full fetch complete (77702 records). [2025-10-25T20:07:54.781103] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-25T20:07:55.172933] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-25T20:07:55.173063] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-25T20:07:55.173867] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-25T20:07:55.173949] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-25T20:07:55.175426] [DEBUG] [LOCAL ] CLS: Trimmed 77702 records to 54326 (keeping 200 days of data) [2025-10-25T20:07:55.492791] [DEBUG] [LOCAL ] CLS: Primary data saved (54326 records). [2025-10-25T20:07:55.492972] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-25T20:07:55.493110] [INFO ] [MAIN ] Update Progress: 468/2366 symbols. CLS took 15.2s. Estimated remaining time: 4h 44m 24s [2025-10-25T20:07:55.661770] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:07:55.661956] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-10-25T20:07:55.662024] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-10-25T20:07:55.662138] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-25T20:07:55.662207] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-25T20:07:55.662288] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-25T20:07:55.662355] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-25T20:07:56.009637] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:07:56.010032] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-25T20:07:57.844755] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T20:07:57.855279] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-25T20:07:59.426985] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:07:59.436838] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-25T20:08:01.518890] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-25T20:08:01.529858] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-25T20:08:02.613050] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T20:08:02.624076] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-25T20:08:03.882876] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T20:08:03.894233] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-25T20:08:04.926025] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:08:04.936794] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-25T20:08:05.974890] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:08:05.988398] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-25T20:08:07.086790] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T20:08:07.097697] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-25T20:08:07.962815] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T20:08:07.973984] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-25T20:08:08.907165] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:08:08.916470] [INFO ] [REMOTE ] CLVT: Full fetch complete (75369 records). [2025-10-25T20:08:08.916664] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-25T20:08:09.310784] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-25T20:08:09.310942] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-25T20:08:09.311735] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-25T20:08:09.311816] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-25T20:08:09.313265] [DEBUG] [LOCAL ] CLVT: Trimmed 75369 records to 52626 (keeping 200 days of data) [2025-10-25T20:08:09.591582] [DEBUG] [LOCAL ] CLVT: Primary data saved (52626 records). [2025-10-25T20:08:09.591757] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-25T20:08:09.591873] [INFO ] [MAIN ] Update Progress: 469/2366 symbols. CLVT took 14.1s. Estimated remaining time: 4h 44m 35s [2025-10-25T20:08:09.757618] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:08:09.757839] [DEBUG] [LOCAL ] CLW: No existing data file found in primary storage. [2025-10-25T20:08:09.760823] [WARN ] [MAIN ] CLW: No existing data found, performing full refresh instead. [2025-10-25T20:08:09.761079] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-25T20:08:09.761168] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-25T20:08:09.761256] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-10-25T20:08:09.761329] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-25T20:08:10.110673] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:08:10.111020] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-25T20:08:11.456484] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T20:08:11.462687] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-25T20:08:12.674392] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T20:08:12.680557] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-25T20:08:13.887782] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T20:08:13.893598] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-25T20:08:15.106455] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T20:08:15.112333] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-25T20:08:16.405761] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T20:08:16.413788] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-25T20:08:17.515604] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T20:08:17.519961] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-25T20:08:18.664278] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T20:08:18.669161] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-25T20:08:19.846734] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-25T20:08:19.854438] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-25T20:08:20.980291] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T20:08:20.988049] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-25T20:08:22.019308] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T20:08:22.023345] [INFO ] [REMOTE ] CLW: Full fetch complete (33529 records). [2025-10-25T20:08:22.023447] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-25T20:08:22.393860] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-25T20:08:22.393963] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-25T20:08:22.394418] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-25T20:08:22.394496] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-25T20:08:22.395371] [DEBUG] [LOCAL ] CLW: Trimmed 33529 records to 21485 (keeping 200 days of data) [2025-10-25T20:08:22.513969] [DEBUG] [LOCAL ] CLW: Primary data saved (21485 records). [2025-10-25T20:08:22.514121] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-25T20:08:22.514217] [INFO ] [MAIN ] Update Progress: 470/2366 symbols. CLW took 12.9s. Estimated remaining time: 4h 44m 42s [2025-10-25T20:08:22.680305] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:08:22.680483] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-10-25T20:08:22.680552] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-10-25T20:08:22.680815] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-25T20:08:22.680890] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-25T20:08:22.680953] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-25T20:08:22.681014] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-25T20:08:23.030883] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:08:23.031239] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-25T20:08:24.659028] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T20:08:24.668486] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-25T20:08:26.461291] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T20:08:26.471014] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-25T20:08:28.193742] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T20:08:28.204136] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-25T20:08:29.266405] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:08:29.276599] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-25T20:08:30.309676] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:08:30.320531] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-25T20:08:31.456278] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T20:08:31.466892] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-25T20:08:32.280556] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-25T20:08:32.291961] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-25T20:08:33.408294] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T20:08:33.419465] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-25T20:08:34.763400] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T20:08:34.774701] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-25T20:08:35.746056] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T20:08:35.755749] [INFO ] [REMOTE ] CLX: Full fetch complete (73909 records). [2025-10-25T20:08:35.755917] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-25T20:08:36.167008] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-25T20:08:36.167122] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-25T20:08:36.168083] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-25T20:08:36.168166] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-25T20:08:36.169558] [DEBUG] [LOCAL ] CLX: Trimmed 73909 records to 52564 (keeping 200 days of data) [2025-10-25T20:08:36.488959] [DEBUG] [LOCAL ] CLX: Primary data saved (52564 records). [2025-10-25T20:08:36.489128] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-25T20:08:36.489267] [INFO ] [MAIN ] Update Progress: 471/2366 symbols. CLX took 14.0s. Estimated remaining time: 4h 44m 53s [2025-10-25T20:08:36.661205] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:08:36.661395] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-10-25T20:08:36.661467] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-10-25T20:08:36.661583] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-25T20:08:36.661679] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-25T20:08:36.661766] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-10-25T20:08:36.661837] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-25T20:08:37.017674] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:08:37.018038] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-25T20:08:38.854941] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T20:08:38.865374] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-25T20:08:40.440616] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T20:08:40.450284] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-25T20:08:42.291074] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-25T20:08:42.301323] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-25T20:08:44.254767] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-25T20:08:44.273061] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-25T20:08:45.927683] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T20:08:45.937507] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-25T20:08:47.540748] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T20:08:47.550390] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-25T20:08:49.250556] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-25T20:08:49.261478] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-25T20:08:50.876958] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T20:08:50.887567] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-25T20:08:52.518962] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T20:08:52.529480] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-25T20:08:54.159027] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T20:08:54.167633] [INFO ] [REMOTE ] CM: Full fetch complete (69753 records). [2025-10-25T20:08:54.167874] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-25T20:08:54.564806] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-25T20:08:54.564941] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-25T20:08:54.565677] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-25T20:08:54.565758] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-25T20:08:54.567075] [DEBUG] [LOCAL ] CM: Trimmed 69753 records to 48983 (keeping 200 days of data) [2025-10-25T20:08:54.853287] [DEBUG] [LOCAL ] CM: Primary data saved (48983 records). [2025-10-25T20:08:54.853449] [INFO ] [MAIN ] CM: Full history saved. [2025-10-25T20:08:54.853569] [INFO ] [MAIN ] Update Progress: 472/2366 symbols. CM took 18.4s. Estimated remaining time: 4h 45m 22s [2025-10-25T20:08:55.020744] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:08:55.020933] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-25T20:08:55.021024] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-25T20:08:55.021134] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-25T20:08:55.021204] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-25T20:08:55.021284] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-25T20:08:55.021349] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-25T20:08:55.373063] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:08:55.373427] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-25T20:08:57.154018] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T20:08:57.168283] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-25T20:08:58.832908] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T20:08:58.842824] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-25T20:09:00.571420] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:09:00.581896] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-25T20:09:02.241944] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T20:09:02.252848] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-25T20:09:03.749119] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T20:09:03.759588] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-25T20:09:04.729366] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:09:04.739222] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-25T20:09:05.798085] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T20:09:05.809621] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-25T20:09:06.969385] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T20:09:06.980275] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-25T20:09:08.188764] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T20:09:08.199430] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-25T20:09:09.030618] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T20:09:09.040467] [INFO ] [REMOTE ] CMA: Full fetch complete (73535 records). [2025-10-25T20:09:09.040706] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-25T20:09:09.444746] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-25T20:09:09.444893] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-25T20:09:09.445711] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-25T20:09:09.445808] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-25T20:09:09.447201] [DEBUG] [LOCAL ] CMA: Trimmed 73535 records to 50940 (keeping 200 days of data) [2025-10-25T20:09:09.743153] [DEBUG] [LOCAL ] CMA: Primary data saved (50940 records). [2025-10-25T20:09:09.743307] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-25T20:09:09.743426] [INFO ] [MAIN ] Update Progress: 473/2366 symbols. CMA took 14.9s. Estimated remaining time: 4h 45m 36s [2025-10-25T20:09:09.913957] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:09:09.914140] [DEBUG] [LOCAL ] CMBT: No existing data file found in primary storage. [2025-10-25T20:09:09.914210] [WARN ] [MAIN ] CMBT: No existing data found, performing full refresh instead. [2025-10-25T20:09:09.914325] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-25T20:09:09.914426] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-25T20:09:09.914510] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-10-25T20:09:09.914578] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-25T20:09:10.264666] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:09:10.265014] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-25T20:09:11.373911] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T20:09:11.377414] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-25T20:09:12.511032] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T20:09:12.515889] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-25T20:09:13.598615] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-25T20:09:13.602250] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-25T20:09:14.771948] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T20:09:14.775745] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-25T20:09:15.881351] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T20:09:15.885550] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-25T20:09:17.068937] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T20:09:17.072728] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-25T20:09:18.240630] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T20:09:18.244723] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-25T20:09:19.742684] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T20:09:19.749754] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-25T20:09:21.714307] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-25T20:09:21.725023] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-25T20:09:23.620305] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-25T20:09:23.630076] [INFO ] [REMOTE ] CMBT: Full fetch complete (34461 records). [2025-10-25T20:09:23.630198] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-25T20:09:24.014237] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-25T20:09:24.014364] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-25T20:09:24.014849] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-25T20:09:24.014930] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-25T20:09:24.015899] [DEBUG] [LOCAL ] CMBT: Trimmed 34461 records to 28286 (keeping 200 days of data) [2025-10-25T20:09:24.186854] [DEBUG] [LOCAL ] CMBT: Primary data saved (28286 records). [2025-10-25T20:09:24.187048] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-25T20:09:24.187195] [INFO ] [MAIN ] Update Progress: 474/2366 symbols. CMBT took 14.4s. Estimated remaining time: 4h 45m 48s [2025-10-25T20:09:24.372076] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:09:24.372273] [DEBUG] [LOCAL ] CMC: No existing data file found in primary storage. [2025-10-25T20:09:24.372348] [WARN ] [MAIN ] CMC: No existing data found, performing full refresh instead. [2025-10-25T20:09:24.372464] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-25T20:09:24.372537] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-25T20:09:24.372621] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-25T20:09:24.372714] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-25T20:09:24.721035] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:09:24.721406] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-25T20:09:26.438534] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T20:09:26.448550] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-25T20:09:28.086161] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T20:09:28.095167] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-25T20:09:29.872075] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T20:09:29.882154] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-25T20:09:31.626068] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T20:09:31.641149] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-25T20:09:33.490528] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-25T20:09:33.499936] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-25T20:09:35.103341] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T20:09:35.112701] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-25T20:09:36.724939] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T20:09:36.735017] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-25T20:09:38.339821] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T20:09:38.349150] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-25T20:09:40.058537] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T20:09:40.068299] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-25T20:09:41.802424] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-25T20:09:41.815188] [INFO ] [REMOTE ] CMC: Full fetch complete (67219 records). [2025-10-25T20:09:41.815414] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-25T20:09:42.228404] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-25T20:09:42.228538] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-25T20:09:42.229297] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-25T20:09:42.229380] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-25T20:09:42.230682] [DEBUG] [LOCAL ] CMC: Trimmed 67219 records to 46265 (keeping 200 days of data) [2025-10-25T20:09:42.499235] [DEBUG] [LOCAL ] CMC: Primary data saved (46265 records). [2025-10-25T20:09:42.499810] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-25T20:09:42.499941] [INFO ] [MAIN ] Update Progress: 475/2366 symbols. CMC took 18.3s. Estimated remaining time: 4h 46m 16s [2025-10-25T20:09:42.665722] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:09:42.665912] [DEBUG] [LOCAL ] CMCM: No existing data file found in primary storage. [2025-10-25T20:09:42.665982] [WARN ] [MAIN ] CMCM: No existing data found, performing full refresh instead. [2025-10-25T20:09:42.666094] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-25T20:09:42.666164] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-25T20:09:42.666245] [DEBUG] [LOCAL ] CMCM: No primary data file found to delete. [2025-10-25T20:09:42.666293] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-25T20:09:43.013873] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:09:43.014230] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-25T20:09:43.676262] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-25T20:09:43.677546] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-25T20:09:44.439423] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T20:09:44.441426] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-25T20:09:45.154385] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T20:09:45.156176] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-25T20:09:45.867086] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T20:09:45.869000] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-25T20:09:46.413413] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-25T20:09:46.414789] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-25T20:09:47.085701] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-25T20:09:47.087108] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-25T20:09:47.826291] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T20:09:47.831380] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-25T20:09:48.546251] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T20:09:48.548860] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-25T20:09:49.541534] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T20:09:49.544145] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-25T20:09:50.228756] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-25T20:09:50.230464] [INFO ] [REMOTE ] CMCM: Full fetch complete (7089 records). [2025-10-25T20:09:50.230557] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-25T20:09:50.652221] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-25T20:09:50.652340] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-25T20:09:50.652601] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-25T20:09:50.652722] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-25T20:09:50.653223] [DEBUG] [LOCAL ] CMCM: Trimmed 7089 records to 4882 (keeping 200 days of data) [2025-10-25T20:09:50.682488] [DEBUG] [LOCAL ] CMCM: Primary data saved (4882 records). [2025-10-25T20:09:50.682703] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-25T20:09:50.682852] [INFO ] [MAIN ] Update Progress: 476/2366 symbols. CMCM took 8.2s. Estimated remaining time: 4h 46m 4s [2025-10-25T20:09:50.896256] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:09:50.896480] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-25T20:09:50.896555] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-25T20:09:50.896696] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-25T20:09:50.896771] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-25T20:09:50.896873] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-25T20:09:50.896965] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-25T20:09:51.277457] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:09:51.277842] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-25T20:09:51.649828] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:09:51.650204] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-25T20:09:51.650329] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:09:51.650417] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-25T20:09:51.650502] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:09:51.650594] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-25T20:09:51.650737] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-25T20:09:51.650822] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-25T20:09:51.650926] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-25T20:09:51.651053] [INFO ] [MAIN ] Update Progress: 477/2366 symbols. CMDB took 1.0s. Estimated remaining time: 4h 45m 22s [2025-10-25T20:09:51.816350] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:09:51.816592] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-25T20:09:51.816706] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-25T20:09:51.816857] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-25T20:09:51.816946] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-25T20:09:51.817243] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-25T20:09:51.817328] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-25T20:09:52.185440] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:09:52.185903] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-25T20:09:54.470899] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-25T20:09:54.481435] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-25T20:09:56.681606] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-25T20:09:56.691898] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-25T20:09:58.795072] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T20:09:58.806331] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-25T20:10:00.248011] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T20:10:00.259349] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-25T20:10:01.363146] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T20:10:01.374366] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-25T20:10:02.782186] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T20:10:02.793137] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-25T20:10:04.029955] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T20:10:04.041843] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-25T20:10:04.999789] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T20:10:05.011405] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-25T20:10:06.183386] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T20:10:06.195479] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-25T20:10:07.124507] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:10:07.134767] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-25T20:10:07.134987] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-25T20:10:07.532807] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-25T20:10:07.532940] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-25T20:10:07.533789] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-25T20:10:07.533875] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-25T20:10:07.535380] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54502 (keeping 200 days of data) [2025-10-25T20:10:07.864293] [DEBUG] [LOCAL ] CMG: Primary data saved (54502 records). [2025-10-25T20:10:07.864463] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-25T20:10:07.864588] [INFO ] [MAIN ] Update Progress: 478/2366 symbols. CMG took 16.2s. Estimated remaining time: 4h 45m 42s [2025-10-25T20:10:08.033203] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:10:08.033401] [DEBUG] [LOCAL ] CMI: No existing data file found in primary storage. [2025-10-25T20:10:08.033473] [WARN ] [MAIN ] CMI: No existing data found, performing full refresh instead. [2025-10-25T20:10:08.033585] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-25T20:10:08.033683] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-25T20:10:08.033767] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-10-25T20:10:08.033838] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-25T20:10:08.411287] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:10:08.411677] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-25T20:10:10.230686] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T20:10:10.239045] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-25T20:10:11.813781] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:10:11.822259] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-25T20:10:13.588229] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T20:10:13.597838] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-25T20:10:15.467207] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-25T20:10:15.476956] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-25T20:10:17.408637] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-25T20:10:17.420852] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-25T20:10:18.933390] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T20:10:18.941626] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-25T20:10:20.587752] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T20:10:20.597299] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-25T20:10:22.365438] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T20:10:22.374947] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-25T20:10:23.899580] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T20:10:23.908937] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-25T20:10:25.539248] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T20:10:25.547263] [INFO ] [REMOTE ] CMI: Full fetch complete (61140 records). [2025-10-25T20:10:25.547449] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-25T20:10:25.927635] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-25T20:10:25.927760] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-25T20:10:25.928455] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-25T20:10:25.928541] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-25T20:10:25.929741] [DEBUG] [LOCAL ] CMI: Trimmed 61140 records to 42162 (keeping 200 days of data) [2025-10-25T20:10:26.181407] [DEBUG] [LOCAL ] CMI: Primary data saved (42162 records). [2025-10-25T20:10:26.181597] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-25T20:10:26.181743] [INFO ] [MAIN ] Update Progress: 479/2366 symbols. CMI took 18.3s. Estimated remaining time: 4h 46m 9s [2025-10-25T20:10:26.346963] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:10:26.347113] [DEBUG] [LOCAL ] CMP: No existing data file found in primary storage. [2025-10-25T20:10:26.347182] [WARN ] [MAIN ] CMP: No existing data found, performing full refresh instead. [2025-10-25T20:10:26.347296] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-25T20:10:26.347377] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-25T20:10:26.347461] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-10-25T20:10:26.347536] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-25T20:10:26.690570] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:10:26.690921] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-25T20:10:28.139886] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T20:10:28.146764] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-25T20:10:29.588157] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T20:10:29.595740] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-25T20:10:31.191820] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T20:10:31.199282] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-25T20:10:32.844585] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T20:10:32.852998] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-25T20:10:34.608834] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T20:10:34.617969] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-25T20:10:35.895403] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T20:10:35.903705] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-25T20:10:37.365843] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T20:10:37.374518] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-25T20:10:39.197726] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-25T20:10:39.204854] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-25T20:10:40.552993] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T20:10:40.562838] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-25T20:10:41.839122] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T20:10:41.844711] [INFO ] [REMOTE ] CMP: Full fetch complete (51450 records). [2025-10-25T20:10:41.844863] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-25T20:10:42.216419] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-25T20:10:42.216539] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-25T20:10:42.217209] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-25T20:10:42.217307] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-25T20:10:42.218437] [DEBUG] [LOCAL ] CMP: Trimmed 51450 records to 36035 (keeping 200 days of data) [2025-10-25T20:10:42.419852] [DEBUG] [LOCAL ] CMP: Primary data saved (36035 records). [2025-10-25T20:10:42.420033] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-25T20:10:42.420235] [INFO ] [MAIN ] Update Progress: 480/2366 symbols. CMP took 16.2s. Estimated remaining time: 4h 46m 28s [2025-10-25T20:10:42.593425] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:10:42.593674] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-10-25T20:10:42.593749] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-10-25T20:10:42.593870] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-25T20:10:42.593940] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-25T20:10:42.594021] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-25T20:10:42.594091] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-25T20:10:42.952549] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:10:42.952920] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-25T20:10:44.433639] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T20:10:44.442526] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-25T20:10:46.000549] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T20:10:46.009408] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-25T20:10:47.536851] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T20:10:47.546094] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-25T20:10:48.986803] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T20:10:48.995693] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-25T20:10:50.474601] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T20:10:50.484861] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-25T20:10:52.040900] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-25T20:10:52.048958] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-25T20:10:53.750426] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-25T20:10:53.758521] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-25T20:10:55.368039] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T20:10:55.377553] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-25T20:10:57.075618] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-25T20:10:57.084059] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-25T20:10:58.840951] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-25T20:10:58.847228] [INFO ] [REMOTE ] CMPO: Full fetch complete (57878 records). [2025-10-25T20:10:58.847387] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-25T20:10:59.228489] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-25T20:10:59.228614] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-25T20:10:59.229298] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-25T20:10:59.229391] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-25T20:10:59.230663] [DEBUG] [LOCAL ] CMPO: Trimmed 57878 records to 38765 (keeping 200 days of data) [2025-10-25T20:10:59.447786] [DEBUG] [LOCAL ] CMPO: Primary data saved (38765 records). [2025-10-25T20:10:59.447987] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-25T20:10:59.448096] [INFO ] [MAIN ] Update Progress: 481/2366 symbols. CMPO took 17.0s. Estimated remaining time: 4h 46m 50s [2025-10-25T20:10:59.615805] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:10:59.615981] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-25T20:10:59.616068] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-25T20:10:59.616178] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-25T20:10:59.616250] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-25T20:10:59.616332] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-25T20:10:59.616398] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-25T20:10:59.969885] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:10:59.970236] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-25T20:11:01.628683] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T20:11:01.635190] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-25T20:11:03.224290] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T20:11:03.235285] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-25T20:11:04.777862] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T20:11:04.785454] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-25T20:11:06.394108] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T20:11:06.403841] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-25T20:11:07.770217] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T20:11:07.777743] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-25T20:11:09.308229] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T20:11:09.315962] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-25T20:11:10.795814] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T20:11:10.803881] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-25T20:11:12.303756] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T20:11:12.313363] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-25T20:11:13.806830] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T20:11:13.814350] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-25T20:11:15.355697] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T20:11:15.362616] [INFO ] [REMOTE ] CMRE: Full fetch complete (51191 records). [2025-10-25T20:11:15.362826] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-25T20:11:15.732160] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-25T20:11:15.732278] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-25T20:11:15.732859] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-25T20:11:15.732939] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-25T20:11:15.733985] [DEBUG] [LOCAL ] CMRE: Trimmed 51191 records to 36133 (keeping 200 days of data) [2025-10-25T20:11:15.942860] [DEBUG] [LOCAL ] CMRE: Primary data saved (36133 records). [2025-10-25T20:11:15.943068] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-25T20:11:15.943196] [INFO ] [MAIN ] Update Progress: 482/2366 symbols. CMRE took 16.5s. Estimated remaining time: 4h 47m 9s [2025-10-25T20:11:16.109189] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:11:16.109397] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-25T20:11:16.109469] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-25T20:11:16.109580] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-25T20:11:16.109698] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-25T20:11:16.109781] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-25T20:11:16.109851] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-25T20:11:16.455024] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:11:16.455328] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-25T20:11:18.234301] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T20:11:18.244730] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-25T20:11:20.215610] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-25T20:11:20.225986] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-25T20:11:22.252791] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-25T20:11:22.263722] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-25T20:11:23.620748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-25T20:11:23.631718] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-25T20:11:24.760494] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T20:11:24.771679] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-25T20:11:25.704360] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T20:11:25.716333] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-25T20:11:26.181839] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-25T20:11:26.193248] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-25T20:11:27.171661] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T20:11:27.184061] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-25T20:11:28.104134] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T20:11:28.122522] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-25T20:11:28.927898] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T20:11:28.937499] [INFO ] [REMOTE ] CMS: Full fetch complete (76272 records). [2025-10-25T20:11:28.937732] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-25T20:11:29.329022] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-25T20:11:29.329140] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-25T20:11:29.330379] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-25T20:11:29.330466] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-25T20:11:29.331989] [DEBUG] [LOCAL ] CMS: Trimmed 76272 records to 53289 (keeping 200 days of data) [2025-10-25T20:11:29.644302] [DEBUG] [LOCAL ] CMS: Primary data saved (53289 records). [2025-10-25T20:11:29.644455] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-25T20:11:29.644583] [INFO ] [MAIN ] Update Progress: 483/2366 symbols. CMS took 13.7s. Estimated remaining time: 4h 47m 18s [2025-10-25T20:11:29.812286] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:11:29.812472] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-25T20:11:29.812540] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-25T20:11:29.812629] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-25T20:11:29.812718] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-25T20:11:29.812799] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-25T20:11:29.812866] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-25T20:11:30.157411] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:11:30.157820] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-25T20:11:30.832874] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-25T20:11:30.834396] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-25T20:11:31.447996] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T20:11:31.449218] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-25T20:11:32.108558] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-25T20:11:32.109860] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-25T20:11:32.790446] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-25T20:11:32.792064] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-25T20:11:33.532045] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T20:11:33.533588] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-25T20:11:34.189510] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T20:11:34.191204] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-25T20:11:34.907422] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T20:11:34.908985] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-25T20:11:35.581298] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-25T20:11:35.582726] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-25T20:11:36.339861] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T20:11:36.341424] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-25T20:11:36.987514] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T20:11:36.988832] [INFO ] [REMOTE ] CMSA: Full fetch complete (4808 records). [2025-10-25T20:11:36.988929] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-25T20:11:37.341896] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-25T20:11:37.342005] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-25T20:11:37.342174] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-25T20:11:37.342253] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-25T20:11:37.342637] [DEBUG] [LOCAL ] CMSA: Trimmed 4808 records to 3514 (keeping 200 days of data) [2025-10-25T20:11:37.362995] [DEBUG] [LOCAL ] CMSA: Primary data saved (3514 records). [2025-10-25T20:11:37.363083] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-25T20:11:37.363188] [INFO ] [MAIN ] Update Progress: 484/2366 symbols. CMSA took 7.7s. Estimated remaining time: 4h 47m 3s [2025-10-25T20:11:37.529128] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:11:37.529339] [DEBUG] [LOCAL ] CMSC: No existing data file found in primary storage. [2025-10-25T20:11:37.529413] [WARN ] [MAIN ] CMSC: No existing data found, performing full refresh instead. [2025-10-25T20:11:37.529533] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-25T20:11:37.529606] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-25T20:11:37.529708] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-25T20:11:37.529776] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-25T20:11:37.877783] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:11:37.878171] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-25T20:11:38.614139] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-25T20:11:38.615842] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-25T20:11:39.210195] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-25T20:11:39.211602] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-25T20:11:40.022464] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T20:11:40.024394] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-25T20:11:40.813175] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T20:11:40.815497] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-25T20:11:41.510960] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-25T20:11:41.513468] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-25T20:11:42.158974] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-25T20:11:42.160802] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-25T20:11:42.834704] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-25T20:11:42.836594] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-25T20:11:43.489877] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-25T20:11:43.491573] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-25T20:11:44.204618] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T20:11:44.206324] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-25T20:11:44.874684] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T20:11:44.876033] [INFO ] [REMOTE ] CMSC: Full fetch complete (6895 records). [2025-10-25T20:11:44.876149] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-25T20:11:45.272444] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-25T20:11:45.272591] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-25T20:11:45.273116] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-25T20:11:45.273212] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-25T20:11:45.273829] [DEBUG] [LOCAL ] CMSC: Trimmed 6895 records to 4846 (keeping 200 days of data) [2025-10-25T20:11:45.304538] [DEBUG] [LOCAL ] CMSC: Primary data saved (4846 records). [2025-10-25T20:11:45.304758] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-25T20:11:45.304897] [INFO ] [MAIN ] Update Progress: 485/2366 symbols. CMSC took 7.9s. Estimated remaining time: 4h 46m 49s [2025-10-25T20:11:45.493990] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:11:45.494195] [DEBUG] [LOCAL ] CMSD: No existing data file found in primary storage. [2025-10-25T20:11:45.494268] [WARN ] [MAIN ] CMSD: No existing data found, performing full refresh instead. [2025-10-25T20:11:45.494379] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-25T20:11:45.494449] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-25T20:11:45.494531] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-10-25T20:11:45.494600] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-25T20:11:45.857752] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:11:45.858111] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-25T20:11:46.746577] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-25T20:11:46.749349] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-25T20:11:47.497854] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T20:11:47.499822] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-25T20:11:48.304373] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T20:11:48.306964] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-25T20:11:49.221788] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T20:11:49.224557] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-25T20:11:50.094858] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T20:11:50.097267] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-25T20:11:50.928573] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T20:11:50.931016] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-25T20:11:51.750470] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T20:11:51.752918] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-25T20:11:52.597457] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T20:11:52.599590] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-25T20:11:53.292861] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T20:11:53.294974] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-25T20:11:54.116221] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T20:11:54.117974] [INFO ] [REMOTE ] CMSD: Full fetch complete (11419 records). [2025-10-25T20:11:54.118063] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-25T20:11:54.485743] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-25T20:11:54.485853] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-25T20:11:54.486167] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-25T20:11:54.486244] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-25T20:11:54.486774] [DEBUG] [LOCAL ] CMSD: Trimmed 11419 records to 7687 (keeping 200 days of data) [2025-10-25T20:11:54.532341] [DEBUG] [LOCAL ] CMSD: Primary data saved (7687 records). [2025-10-25T20:11:54.532497] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-25T20:11:54.532621] [INFO ] [MAIN ] Update Progress: 486/2366 symbols. CMSD took 9.2s. Estimated remaining time: 4h 46m 41s [2025-10-25T20:11:54.710239] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:11:54.710429] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-25T20:11:54.710501] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-25T20:11:54.710615] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-25T20:11:54.710707] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-25T20:11:54.710792] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-25T20:11:54.710862] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-25T20:11:55.109560] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:11:55.109939] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-25T20:11:56.606718] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T20:11:56.614520] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-25T20:11:58.180189] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:11:58.187671] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-25T20:11:59.702414] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-25T20:11:59.711612] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-25T20:12:01.695921] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-25T20:12:01.705083] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-25T20:12:03.301405] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T20:12:03.309884] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-25T20:12:04.775269] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T20:12:04.783254] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-25T20:12:06.319864] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T20:12:06.328014] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-25T20:12:07.720596] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T20:12:07.727429] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-25T20:12:09.281396] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-25T20:12:09.288632] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-25T20:12:10.573703] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T20:12:10.579031] [INFO ] [REMOTE ] CMTG: Full fetch complete (52676 records). [2025-10-25T20:12:10.579184] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-25T20:12:10.972543] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-25T20:12:10.972685] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-25T20:12:10.973328] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-25T20:12:10.973406] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-25T20:12:10.974527] [DEBUG] [LOCAL ] CMTG: Trimmed 52676 records to 35511 (keeping 200 days of data) [2025-10-25T20:12:11.164812] [DEBUG] [LOCAL ] CMTG: Primary data saved (35511 records). [2025-10-25T20:12:11.164989] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-25T20:12:11.165113] [INFO ] [MAIN ] Update Progress: 487/2366 symbols. CMTG took 16.6s. Estimated remaining time: 4h 47m 0s [2025-10-25T20:12:11.337557] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:12:11.337730] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-25T20:12:11.337803] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-25T20:12:11.337943] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-25T20:12:11.338020] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-25T20:12:11.338102] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-25T20:12:11.338170] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-25T20:12:11.700535] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:12:11.700929] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-25T20:12:12.475972] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T20:12:12.478437] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-25T20:12:13.212100] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T20:12:13.213949] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-25T20:12:14.076679] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T20:12:14.079498] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-25T20:12:14.989807] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T20:12:14.992899] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-25T20:12:15.744434] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-25T20:12:15.745944] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-25T20:12:16.566740] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T20:12:16.568433] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-25T20:12:17.431577] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T20:12:17.434353] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-25T20:12:18.178770] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-25T20:12:18.180743] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-25T20:12:18.890065] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T20:12:18.891920] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-25T20:12:19.498702] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-25T20:12:19.499923] [INFO ] [REMOTE ] CMU: Full fetch complete (9468 records). [2025-10-25T20:12:19.500011] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-25T20:12:19.880604] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-25T20:12:19.880742] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-25T20:12:19.881034] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-25T20:12:19.881115] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-25T20:12:19.881901] [DEBUG] [LOCAL ] CMU: Trimmed 9468 records to 6365 (keeping 200 days of data) [2025-10-25T20:12:19.921262] [DEBUG] [LOCAL ] CMU: Primary data saved (6365 records). [2025-10-25T20:12:19.921438] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-25T20:12:19.921596] [INFO ] [MAIN ] Update Progress: 488/2366 symbols. CMU took 8.8s. Estimated remaining time: 4h 46m 50s [2025-10-25T20:12:20.102980] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:12:20.103222] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-25T20:12:20.103308] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-25T20:12:20.103461] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-25T20:12:20.103545] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-25T20:12:20.103680] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-25T20:12:20.103762] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-25T20:12:20.608802] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:12:20.609293] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-25T20:12:21.863598] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T20:12:21.869088] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-25T20:12:23.308591] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T20:12:23.315303] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-25T20:12:24.788562] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T20:12:24.795522] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-25T20:12:26.247906] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-25T20:12:26.254610] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-25T20:12:27.482472] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T20:12:27.488319] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-25T20:12:28.954425] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T20:12:28.962455] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-25T20:12:30.580002] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T20:12:30.592111] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-25T20:12:32.190759] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T20:12:32.198340] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-25T20:12:33.698939] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T20:12:33.706000] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-25T20:12:34.900720] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T20:12:34.906498] [INFO ] [REMOTE ] CNA: Full fetch complete (46111 records). [2025-10-25T20:12:34.906697] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-25T20:12:35.298336] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-25T20:12:35.298453] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-25T20:12:35.299060] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-25T20:12:35.299144] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-25T20:12:35.300128] [DEBUG] [LOCAL ] CNA: Trimmed 46111 records to 32892 (keeping 200 days of data) [2025-10-25T20:12:35.488217] [DEBUG] [LOCAL ] CNA: Primary data saved (32892 records). [2025-10-25T20:12:35.488375] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-25T20:12:35.488499] [INFO ] [MAIN ] Update Progress: 489/2366 symbols. CNA took 15.6s. Estimated remaining time: 4h 47m 5s [2025-10-25T20:12:35.668868] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:12:35.669523] [DEBUG] [LOCAL ] CNC: No existing data file found in primary storage. [2025-10-25T20:12:35.669597] [WARN ] [MAIN ] CNC: No existing data found, performing full refresh instead. [2025-10-25T20:12:35.669787] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-25T20:12:35.669864] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-25T20:12:35.669949] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-10-25T20:12:35.670020] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-25T20:12:36.036351] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:12:36.036705] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-25T20:12:37.782695] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T20:12:37.793183] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-25T20:12:39.692955] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T20:12:39.703285] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-25T20:12:41.586887] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T20:12:41.597974] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-25T20:12:42.632958] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:12:42.644269] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-25T20:12:43.637486] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:12:43.648823] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-25T20:12:44.617769] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:12:44.632336] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-25T20:12:45.682307] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T20:12:45.694721] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-25T20:12:46.625016] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T20:12:46.636578] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-25T20:12:47.279283] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T20:12:47.290719] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-25T20:12:48.202235] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:12:48.212161] [INFO ] [REMOTE ] CNC: Full fetch complete (77864 records). [2025-10-25T20:12:48.212321] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-25T20:12:48.618995] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-25T20:12:48.619131] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-25T20:12:48.620018] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-25T20:12:48.620103] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-25T20:12:48.621664] [DEBUG] [LOCAL ] CNC: Trimmed 77864 records to 54559 (keeping 200 days of data) [2025-10-25T20:12:48.938399] [DEBUG] [LOCAL ] CNC: Primary data saved (54559 records). [2025-10-25T20:12:48.938567] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-25T20:12:48.938714] [INFO ] [MAIN ] Update Progress: 490/2366 symbols. CNC took 13.5s. Estimated remaining time: 4h 47m 12s [2025-10-25T20:12:49.111062] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:12:49.111256] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-25T20:12:49.111329] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-25T20:12:49.111449] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-25T20:12:49.111520] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-25T20:12:49.111601] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-25T20:12:49.111695] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-25T20:12:49.480234] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:12:49.480576] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-25T20:12:50.194782] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-25T20:12:50.196196] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-25T20:12:50.744898] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-25T20:12:50.746328] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-25T20:12:51.605186] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T20:12:51.608174] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-25T20:12:52.312281] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-25T20:12:52.314039] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-25T20:12:53.130008] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T20:12:53.132480] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-25T20:12:54.258802] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T20:12:54.262604] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-25T20:12:55.131794] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T20:12:55.134484] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-25T20:12:56.189278] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T20:12:56.193062] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-25T20:12:57.271745] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T20:12:57.275311] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-25T20:12:58.007842] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T20:12:58.010278] [INFO ] [REMOTE ] CNF: Full fetch complete (12987 records). [2025-10-25T20:12:58.010487] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-25T20:12:58.368865] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-25T20:12:58.368980] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-25T20:12:58.369305] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-25T20:12:58.369381] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-25T20:12:58.369916] [DEBUG] [LOCAL ] CNF: Trimmed 12987 records to 10649 (keeping 200 days of data) [2025-10-25T20:12:58.425637] [DEBUG] [LOCAL ] CNF: Primary data saved (10649 records). [2025-10-25T20:12:58.425828] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-25T20:12:58.425929] [INFO ] [MAIN ] Update Progress: 491/2366 symbols. CNF took 9.5s. Estimated remaining time: 4h 47m 4s [2025-10-25T20:12:58.596319] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:12:58.596547] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-25T20:12:58.596621] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-25T20:12:58.596756] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-25T20:12:58.596828] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-25T20:12:58.596911] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-25T20:12:58.596982] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-25T20:12:58.984002] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:12:58.984370] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-25T20:13:00.763738] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T20:13:00.774190] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-25T20:13:03.076540] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-25T20:13:03.086675] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-25T20:13:04.959119] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T20:13:04.971026] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-25T20:13:06.027758] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:13:06.039860] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-25T20:13:07.191305] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-25T20:13:07.202326] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-25T20:13:08.171133] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:13:08.185609] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-25T20:13:09.165289] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T20:13:09.177082] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-25T20:13:10.277338] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T20:13:10.292470] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-25T20:13:11.384037] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T20:13:11.395474] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-25T20:13:12.496901] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T20:13:12.506767] [INFO ] [REMOTE ] CNH: Full fetch complete (77703 records). [2025-10-25T20:13:12.506920] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-25T20:13:12.901365] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-25T20:13:12.901492] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-25T20:13:12.902399] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-25T20:13:12.902490] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-25T20:13:12.904051] [DEBUG] [LOCAL ] CNH: Trimmed 77703 records to 54321 (keeping 200 days of data) [2025-10-25T20:13:13.222967] [DEBUG] [LOCAL ] CNH: Primary data saved (54321 records). [2025-10-25T20:13:13.223184] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-25T20:13:13.223360] [INFO ] [MAIN ] Update Progress: 492/2366 symbols. CNH took 14.8s. Estimated remaining time: 4h 47m 16s [2025-10-25T20:13:13.394517] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:13:13.394746] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-25T20:13:13.394839] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-25T20:13:13.394990] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-25T20:13:13.395078] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-25T20:13:13.395169] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-25T20:13:13.395247] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-25T20:13:13.754084] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:13:13.754466] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-25T20:13:15.536556] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T20:13:15.546974] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-25T20:13:17.305033] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T20:13:17.314746] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-25T20:13:19.049178] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:13:19.059951] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-25T20:13:20.069059] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T20:13:20.080178] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-25T20:13:21.139414] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T20:13:21.150703] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-25T20:13:22.043078] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T20:13:22.053413] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-25T20:13:23.237568] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T20:13:23.249033] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-25T20:13:24.472223] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T20:13:24.483192] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-25T20:13:25.370591] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-25T20:13:25.381831] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-25T20:13:26.401087] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T20:13:26.410487] [INFO ] [REMOTE ] CNI: Full fetch complete (74826 records). [2025-10-25T20:13:26.410698] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-25T20:13:26.797122] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-25T20:13:26.797237] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-25T20:13:26.798045] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-25T20:13:26.798126] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-25T20:13:26.799473] [DEBUG] [LOCAL ] CNI: Trimmed 74826 records to 52378 (keeping 200 days of data) [2025-10-25T20:13:27.108969] [DEBUG] [LOCAL ] CNI: Primary data saved (52378 records). [2025-10-25T20:13:27.109151] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-25T20:13:27.109272] [INFO ] [MAIN ] Update Progress: 493/2366 symbols. CNI took 13.9s. Estimated remaining time: 4h 47m 25s [2025-10-25T20:13:27.275160] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:13:27.275353] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-25T20:13:27.275403] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-25T20:13:27.275509] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-25T20:13:27.275578] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-25T20:13:27.275634] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-25T20:13:27.275721] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-25T20:13:27.628097] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:13:27.628422] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-25T20:13:29.313425] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T20:13:29.323088] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-25T20:13:30.967793] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T20:13:30.977672] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-25T20:13:32.906897] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T20:13:32.917997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-25T20:13:34.012438] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T20:13:34.023880] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-25T20:13:35.068866] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T20:13:35.079665] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-25T20:13:36.085415] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T20:13:36.095841] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-25T20:13:37.179103] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T20:13:37.190533] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-25T20:13:38.120866] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T20:13:38.132098] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-25T20:13:39.050549] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T20:13:39.062222] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-25T20:13:40.058724] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T20:13:40.068424] [INFO ] [REMOTE ] CNK: Full fetch complete (76297 records). [2025-10-25T20:13:40.068586] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-25T20:13:40.464789] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-25T20:13:40.464908] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-25T20:13:40.465767] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-25T20:13:40.465848] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-25T20:13:40.467340] [DEBUG] [LOCAL ] CNK: Trimmed 76297 records to 53674 (keeping 200 days of data) [2025-10-25T20:13:40.776954] [DEBUG] [LOCAL ] CNK: Primary data saved (53674 records). [2025-10-25T20:13:40.777124] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-25T20:13:40.777228] [INFO ] [MAIN ] Update Progress: 494/2366 symbols. CNK took 13.7s. Estimated remaining time: 4h 47m 33s [2025-10-25T20:13:40.944685] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:13:40.944881] [DEBUG] [LOCAL ] CNM: No existing data file found in primary storage. [2025-10-25T20:13:40.944956] [WARN ] [MAIN ] CNM: No existing data found, performing full refresh instead. [2025-10-25T20:13:40.945046] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-25T20:13:40.945113] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-25T20:13:40.945195] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-25T20:13:40.945265] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-25T20:13:41.294639] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:13:41.295022] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-25T20:13:42.997740] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T20:13:43.008020] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-25T20:13:44.704952] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T20:13:44.714288] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-25T20:13:46.356820] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T20:13:46.367758] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-25T20:13:47.520130] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:13:47.531023] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-25T20:13:48.557033] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:13:48.567627] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-25T20:13:50.070626] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T20:13:50.081510] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-25T20:13:51.101178] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T20:13:51.112559] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-25T20:13:52.136566] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T20:13:52.147813] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-25T20:13:53.274744] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T20:13:53.286209] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-25T20:13:54.109953] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T20:13:54.122042] [INFO ] [REMOTE ] CNM: Full fetch complete (73752 records). [2025-10-25T20:13:54.122342] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-25T20:13:54.572514] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-25T20:13:54.572673] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-25T20:13:54.573536] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-25T20:13:54.573619] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-25T20:13:54.575183] [DEBUG] [LOCAL ] CNM: Trimmed 73752 records to 51731 (keeping 200 days of data) [2025-10-25T20:13:54.865680] [DEBUG] [LOCAL ] CNM: Primary data saved (51731 records). [2025-10-25T20:13:54.865846] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-25T20:13:54.865965] [INFO ] [MAIN ] Update Progress: 495/2366 symbols. CNM took 14.1s. Estimated remaining time: 4h 47m 42s [2025-10-25T20:13:55.038843] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:13:55.039047] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-25T20:13:55.039120] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-25T20:13:55.039232] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-25T20:13:55.039302] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-25T20:13:55.039382] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-25T20:13:55.039456] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-25T20:13:55.393835] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:13:55.394176] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-25T20:13:56.888793] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-25T20:13:56.895205] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-25T20:13:58.257952] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-25T20:13:58.265425] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-25T20:13:59.865496] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T20:13:59.876001] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-25T20:14:01.615231] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T20:14:01.623724] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-25T20:14:03.091443] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T20:14:03.097991] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-25T20:14:04.554223] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T20:14:04.560819] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-25T20:14:06.161431] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T20:14:06.169563] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-25T20:14:07.634309] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T20:14:07.641313] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-25T20:14:09.154013] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T20:14:09.160749] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-25T20:14:10.521497] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T20:14:10.527638] [INFO ] [REMOTE ] CNMD: Full fetch complete (47431 records). [2025-10-25T20:14:10.527853] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-25T20:14:10.917246] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-25T20:14:10.917358] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-25T20:14:10.917967] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-25T20:14:10.918047] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-25T20:14:10.919063] [DEBUG] [LOCAL ] CNMD: Trimmed 47431 records to 32565 (keeping 200 days of data) [2025-10-25T20:14:11.113172] [DEBUG] [LOCAL ] CNMD: Primary data saved (32565 records). [2025-10-25T20:14:11.113347] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-25T20:14:11.113476] [INFO ] [MAIN ] Update Progress: 496/2366 symbols. CNMD took 16.2s. Estimated remaining time: 4h 47m 59s [2025-10-25T20:14:11.296751] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:14:11.296958] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-25T20:14:11.297049] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-25T20:14:11.297167] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-25T20:14:11.297237] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-25T20:14:11.297318] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-25T20:14:11.297387] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-25T20:14:11.663425] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:14:11.663824] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-25T20:14:12.974086] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T20:14:12.979551] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-25T20:14:14.251418] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T20:14:14.257431] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-25T20:14:15.763986] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-25T20:14:15.772791] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-25T20:14:17.262694] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T20:14:17.275222] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-25T20:14:18.756085] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T20:14:18.765755] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-25T20:14:20.364684] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T20:14:20.372377] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-25T20:14:21.943047] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T20:14:21.953202] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-25T20:14:23.666254] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T20:14:23.678304] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-25T20:14:25.437702] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-25T20:14:25.446153] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-25T20:14:26.845812] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-25T20:14:26.852474] [INFO ] [REMOTE ] CNNE: Full fetch complete (50632 records). [2025-10-25T20:14:26.852690] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-25T20:14:27.259880] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-25T20:14:27.259993] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-25T20:14:27.260638] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-25T20:14:27.260737] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-25T20:14:27.261925] [DEBUG] [LOCAL ] CNNE: Trimmed 50632 records to 36187 (keeping 200 days of data) [2025-10-25T20:14:27.473697] [DEBUG] [LOCAL ] CNNE: Primary data saved (36187 records). [2025-10-25T20:14:27.473860] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-25T20:14:27.473981] [INFO ] [MAIN ] Update Progress: 497/2366 symbols. CNNE took 16.4s. Estimated remaining time: 4h 48m 17s [2025-10-25T20:14:27.652938] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:14:27.653172] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-10-25T20:14:27.653247] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-10-25T20:14:27.653379] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-25T20:14:27.653483] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-25T20:14:27.653571] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-25T20:14:27.653662] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-25T20:14:28.015576] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:14:28.015981] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-25T20:14:29.613602] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T20:14:29.622053] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-25T20:14:31.380003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T20:14:31.389104] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-25T20:14:33.114540] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:14:33.124446] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-25T20:14:34.671920] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T20:14:34.681092] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-25T20:14:36.271592] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T20:14:36.280233] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-25T20:14:37.797201] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T20:14:37.805152] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-25T20:14:39.426592] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T20:14:39.436482] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-25T20:14:41.099070] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T20:14:41.107560] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-25T20:14:42.766737] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-25T20:14:42.780061] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-25T20:14:44.287831] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-25T20:14:44.298597] [INFO ] [REMOTE ] CNO: Full fetch complete (60759 records). [2025-10-25T20:14:44.298801] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-25T20:14:44.688597] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-25T20:14:44.688750] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-25T20:14:44.689474] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-25T20:14:44.689553] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-25T20:14:44.690938] [DEBUG] [LOCAL ] CNO: Trimmed 60759 records to 40807 (keeping 200 days of data) [2025-10-25T20:14:44.924947] [DEBUG] [LOCAL ] CNO: Primary data saved (40807 records). [2025-10-25T20:14:44.925097] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-25T20:14:44.925213] [INFO ] [MAIN ] Update Progress: 498/2366 symbols. CNO took 17.5s. Estimated remaining time: 4h 48m 38s [2025-10-25T20:14:45.115779] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:14:45.115999] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-10-25T20:14:45.116088] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-10-25T20:14:45.116220] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-25T20:14:45.116305] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-25T20:14:45.116407] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-25T20:14:45.116492] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-25T20:14:45.498980] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:14:45.499277] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-25T20:14:47.239504] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T20:14:47.249761] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-25T20:14:49.123698] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-25T20:14:49.135211] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-25T20:14:51.092835] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-25T20:14:51.104466] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-25T20:14:51.944697] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-25T20:14:51.956276] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-25T20:14:52.993612] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T20:14:53.004865] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-25T20:14:53.918933] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T20:14:53.929573] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-25T20:14:55.150789] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T20:14:55.162386] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-25T20:14:56.212712] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T20:14:56.224395] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-25T20:14:57.239690] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T20:14:57.250857] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-25T20:14:58.084572] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T20:14:58.094630] [INFO ] [REMOTE ] CNP: Full fetch complete (77555 records). [2025-10-25T20:14:58.094865] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-25T20:14:58.503719] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-25T20:14:58.503852] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-25T20:14:58.504836] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-25T20:14:58.504922] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-25T20:14:58.506423] [DEBUG] [LOCAL ] CNP: Trimmed 77555 records to 54255 (keeping 200 days of data) [2025-10-25T20:14:58.829357] [DEBUG] [LOCAL ] CNP: Primary data saved (54255 records). [2025-10-25T20:14:58.829532] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-25T20:14:58.829674] [INFO ] [MAIN ] Update Progress: 499/2366 symbols. CNP took 13.9s. Estimated remaining time: 4h 48m 46s [2025-10-25T20:14:59.003005] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:14:59.003199] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-10-25T20:14:59.003249] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-10-25T20:14:59.003327] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-25T20:14:59.003395] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-25T20:14:59.003476] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-25T20:14:59.003546] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-25T20:14:59.368999] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:14:59.369344] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-25T20:15:01.184407] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T20:15:01.194940] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-25T20:15:03.421941] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-25T20:15:03.432282] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-25T20:15:05.542564] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-25T20:15:05.555465] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-25T20:15:06.686722] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T20:15:06.697977] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-25T20:15:07.866437] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T20:15:07.877883] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-25T20:15:08.752584] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T20:15:08.763445] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-25T20:15:09.845749] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T20:15:09.858330] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-25T20:15:10.930115] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T20:15:10.941383] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-25T20:15:12.035743] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T20:15:12.047315] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-25T20:15:12.963546] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:15:12.973388] [INFO ] [REMOTE ] CNQ: Full fetch complete (77742 records). [2025-10-25T20:15:12.973584] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-25T20:15:13.371537] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-25T20:15:13.371704] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-25T20:15:13.372532] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-25T20:15:13.372614] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-25T20:15:13.374181] [DEBUG] [LOCAL ] CNQ: Trimmed 77742 records to 54361 (keeping 200 days of data) [2025-10-25T20:15:13.697000] [DEBUG] [LOCAL ] CNQ: Primary data saved (54361 records). [2025-10-25T20:15:13.697170] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-25T20:15:13.697291] [INFO ] [MAIN ] Update Progress: 500/2366 symbols. CNQ took 14.9s. Estimated remaining time: 4h 48m 58s [2025-10-25T20:15:13.883680] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:15:13.883883] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-25T20:15:13.883955] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-25T20:15:13.884068] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-25T20:15:13.884139] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-25T20:15:13.884219] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-25T20:15:13.884289] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-25T20:15:14.256803] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:15:14.257149] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-25T20:15:15.673562] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T20:15:15.679613] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-25T20:15:17.487520] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T20:15:17.496993] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-25T20:15:19.122299] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T20:15:19.133040] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-25T20:15:21.038591] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-25T20:15:21.048110] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-25T20:15:22.714717] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T20:15:22.724343] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-25T20:15:24.281678] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-25T20:15:24.291043] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-25T20:15:26.156533] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-25T20:15:26.166308] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-25T20:15:27.718125] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T20:15:27.727168] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-25T20:15:29.454758] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T20:15:29.464543] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-25T20:15:31.143167] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T20:15:31.154543] [INFO ] [REMOTE ] CNR: Full fetch complete (63485 records). [2025-10-25T20:15:31.154787] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-25T20:15:31.374308] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-25T20:15:31.374962] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:15:31.375037] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:15:31.375114] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-25T20:15:31.375214] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-25T20:15:31.375290] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-25T20:15:31.375384] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-25T20:15:31.375487] [INFO ] [MAIN ] Update Progress: 501/2366 symbols. CNR took 17.7s. Estimated remaining time: 4h 49m 20s [2025-10-25T20:15:31.550795] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:15:31.551022] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-25T20:15:31.551099] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-25T20:15:31.551212] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-25T20:15:31.551281] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-25T20:15:31.551360] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-25T20:15:31.551430] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-25T20:15:31.900902] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:15:31.901294] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-25T20:15:33.812101] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T20:15:33.816902] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-25T20:15:34.912432] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T20:15:34.916857] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-25T20:15:36.109291] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T20:15:36.114824] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-25T20:15:37.383131] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T20:15:37.391828] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-25T20:15:38.521584] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T20:15:38.525988] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-25T20:15:39.687784] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T20:15:39.692014] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-25T20:15:40.886514] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-25T20:15:40.891809] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-25T20:15:42.044314] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T20:15:42.049110] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-25T20:15:43.122835] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T20:15:43.128701] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-25T20:15:44.296754] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T20:15:44.302237] [INFO ] [REMOTE ] CNS: Full fetch complete (31552 records). [2025-10-25T20:15:44.302430] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-25T20:15:44.672216] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-25T20:15:44.672335] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-25T20:15:44.672876] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-25T20:15:44.672993] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-25T20:15:44.673833] [DEBUG] [LOCAL ] CNS: Trimmed 31552 records to 21673 (keeping 200 days of data) [2025-10-25T20:15:44.798711] [DEBUG] [LOCAL ] CNS: Primary data saved (21673 records). [2025-10-25T20:15:44.798878] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-25T20:15:44.799005] [INFO ] [MAIN ] Update Progress: 502/2366 symbols. CNS took 13.4s. Estimated remaining time: 4h 49m 26s [2025-10-25T20:15:44.974953] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:15:44.975326] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-25T20:15:44.975397] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-25T20:15:44.975542] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-25T20:15:44.975620] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-25T20:15:44.975724] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-25T20:15:44.975793] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-25T20:15:45.323919] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:15:45.324249] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-25T20:15:46.954110] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T20:15:46.967318] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-25T20:15:48.926098] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-25T20:15:48.936192] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-25T20:15:50.896737] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-25T20:15:50.907964] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-25T20:15:52.071097] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T20:15:52.082334] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-25T20:15:53.075267] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:15:53.086947] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-25T20:15:54.093059] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T20:15:54.103844] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-25T20:15:55.118676] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T20:15:55.131625] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-25T20:15:56.091520] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T20:15:56.103858] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-25T20:15:57.073118] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T20:15:57.093031] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-25T20:15:58.015792] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:15:58.025791] [INFO ] [REMOTE ] CNX: Full fetch complete (74894 records). [2025-10-25T20:15:58.025981] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-25T20:15:58.439490] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-25T20:15:58.440636] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-25T20:15:58.441728] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-25T20:15:58.441818] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-25T20:15:58.443741] [DEBUG] [LOCAL ] CNX: Trimmed 74894 records to 52059 (keeping 200 days of data) [2025-10-25T20:15:58.760990] [DEBUG] [LOCAL ] CNX: Primary data saved (52059 records). [2025-10-25T20:15:58.761224] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-25T20:15:58.761378] [INFO ] [MAIN ] Update Progress: 503/2366 symbols. CNX took 14.0s. Estimated remaining time: 4h 49m 34s [2025-10-25T20:15:58.942621] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:15:58.942921] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-25T20:15:58.942997] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-25T20:15:58.943104] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-25T20:15:58.943174] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-25T20:15:58.943258] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-25T20:15:58.943330] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-25T20:15:59.342890] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:15:59.343314] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-25T20:16:00.556227] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T20:16:00.561522] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-25T20:16:01.850567] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T20:16:01.855751] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-25T20:16:03.373473] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T20:16:03.380562] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-25T20:16:04.840769] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T20:16:04.850852] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-25T20:16:06.681415] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-25T20:16:06.690695] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-25T20:16:08.646915] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-25T20:16:08.656539] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-25T20:16:10.557849] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-25T20:16:10.568064] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-25T20:16:12.463845] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-25T20:16:12.472776] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-25T20:16:14.114477] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T20:16:14.122715] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-25T20:16:15.987580] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-25T20:16:15.996214] [INFO ] [REMOTE ] CODI: Full fetch complete (54107 records). [2025-10-25T20:16:15.996407] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-25T20:16:16.419725] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-25T20:16:16.419854] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-25T20:16:16.420519] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-25T20:16:16.420598] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-25T20:16:16.421844] [DEBUG] [LOCAL ] CODI: Trimmed 54107 records to 42561 (keeping 200 days of data) [2025-10-25T20:16:16.648612] [DEBUG] [LOCAL ] CODI: Primary data saved (42561 records). [2025-10-25T20:16:16.648809] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-25T20:16:16.648936] [INFO ] [MAIN ] Update Progress: 504/2366 symbols. CODI took 17.9s. Estimated remaining time: 4h 49m 56s [2025-10-25T20:16:16.818572] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:16:16.818877] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-10-25T20:16:16.818954] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-10-25T20:16:16.819071] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-25T20:16:16.819146] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-25T20:16:16.819228] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-25T20:16:16.819296] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-25T20:16:17.188275] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:16:17.188683] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-25T20:16:19.256825] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-25T20:16:19.268234] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-25T20:16:21.269586] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T20:16:21.279862] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-25T20:16:23.506637] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-25T20:16:23.517858] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-25T20:16:24.753945] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T20:16:24.765355] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-25T20:16:26.136537] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T20:16:26.147754] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-25T20:16:27.262368] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T20:16:27.273435] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-25T20:16:27.966814] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-25T20:16:27.978682] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-25T20:16:28.994246] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T20:16:29.006451] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-25T20:16:30.069160] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T20:16:30.080812] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-25T20:16:30.821706] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T20:16:30.831719] [INFO ] [REMOTE ] COF: Full fetch complete (77714 records). [2025-10-25T20:16:30.831934] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-25T20:16:31.246790] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-25T20:16:31.246917] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-25T20:16:31.247794] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-25T20:16:31.247877] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-25T20:16:31.249402] [DEBUG] [LOCAL ] COF: Trimmed 77714 records to 54405 (keeping 200 days of data) [2025-10-25T20:16:31.570762] [DEBUG] [LOCAL ] COF: Primary data saved (54405 records). [2025-10-25T20:16:31.570927] [INFO ] [MAIN ] COF: Full history saved. [2025-10-25T20:16:31.571050] [INFO ] [MAIN ] Update Progress: 505/2366 symbols. COF took 14.9s. Estimated remaining time: 4h 50m 7s [2025-10-25T20:16:31.737956] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:16:31.738158] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-25T20:16:31.738229] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-25T20:16:31.738345] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-25T20:16:31.738417] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-25T20:16:31.738502] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-25T20:16:31.738571] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-25T20:16:32.092115] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:16:32.092533] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-25T20:16:34.293934] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-25T20:16:34.305740] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-25T20:16:36.250972] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-25T20:16:36.260914] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-25T20:16:38.533920] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-25T20:16:38.545106] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-25T20:16:39.603461] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:16:39.615417] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-25T20:16:40.622504] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T20:16:40.634023] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-25T20:16:41.900284] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T20:16:41.910972] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-25T20:16:42.927122] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T20:16:42.938812] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-25T20:16:44.007061] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T20:16:44.018723] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-25T20:16:45.112667] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T20:16:45.124526] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-25T20:16:45.846242] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T20:16:45.855851] [INFO ] [REMOTE ] COHR: Full fetch complete (77471 records). [2025-10-25T20:16:45.856006] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-25T20:16:46.250254] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-25T20:16:46.250374] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-25T20:16:46.251180] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-25T20:16:46.251260] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-25T20:16:46.252692] [DEBUG] [LOCAL ] COHR: Trimmed 77471 records to 54156 (keeping 200 days of data) [2025-10-25T20:16:46.590308] [DEBUG] [LOCAL ] COHR: Primary data saved (54156 records). [2025-10-25T20:16:46.590475] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-25T20:16:46.590595] [INFO ] [MAIN ] Update Progress: 506/2366 symbols. COHR took 15.0s. Estimated remaining time: 4h 50m 19s [2025-10-25T20:16:46.761381] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:16:46.761629] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-25T20:16:46.761722] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-25T20:16:46.761842] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-25T20:16:46.761916] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-25T20:16:46.761995] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-25T20:16:46.762064] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-25T20:16:47.109151] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:16:47.109489] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-25T20:16:48.835485] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T20:16:48.845106] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-25T20:16:50.486304] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T20:16:50.495791] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-25T20:16:52.296444] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T20:16:52.307278] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-25T20:16:53.177421] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T20:16:53.188478] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-25T20:16:54.231585] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T20:16:54.244009] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-25T20:16:55.214082] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:16:55.225315] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-25T20:16:56.212413] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T20:16:56.223927] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-25T20:16:57.207192] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T20:16:57.218452] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-25T20:16:58.359433] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T20:16:58.371137] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-25T20:16:59.198733] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T20:16:59.208361] [INFO ] [REMOTE ] COLD: Full fetch complete (74953 records). [2025-10-25T20:16:59.208521] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-25T20:16:59.589969] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-25T20:16:59.590094] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-25T20:16:59.590904] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-25T20:16:59.590988] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-25T20:16:59.592386] [DEBUG] [LOCAL ] COLD: Trimmed 74953 records to 53264 (keeping 200 days of data) [2025-10-25T20:16:59.910885] [DEBUG] [LOCAL ] COLD: Primary data saved (53264 records). [2025-10-25T20:16:59.911117] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-25T20:16:59.911245] [INFO ] [MAIN ] Update Progress: 507/2366 symbols. COLD took 13.3s. Estimated remaining time: 4h 50m 24s [2025-10-25T20:17:00.086910] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:17:00.087151] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-25T20:17:00.087224] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-25T20:17:00.087338] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-25T20:17:00.087409] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-25T20:17:00.087488] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-25T20:17:00.087556] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-25T20:17:00.439327] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:17:00.439749] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-25T20:17:02.523873] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-25T20:17:02.534635] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-25T20:17:04.377688] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T20:17:04.391495] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-25T20:17:06.295422] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T20:17:06.306560] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-25T20:17:07.225923] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T20:17:07.237156] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-25T20:17:08.327997] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T20:17:08.339092] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-25T20:17:09.206562] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T20:17:09.217389] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-25T20:17:10.187461] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T20:17:10.198983] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-25T20:17:11.264905] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T20:17:11.276462] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-25T20:17:12.287807] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T20:17:12.299319] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-25T20:17:13.584103] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T20:17:13.594180] [INFO ] [REMOTE ] COMP: Full fetch complete (77415 records). [2025-10-25T20:17:13.594386] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-25T20:17:13.995690] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-25T20:17:13.995845] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-25T20:17:13.996839] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-25T20:17:13.996929] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-25T20:17:13.998595] [DEBUG] [LOCAL ] COMP: Trimmed 77415 records to 54183 (keeping 200 days of data) [2025-10-25T20:17:14.298872] [DEBUG] [LOCAL ] COMP: Primary data saved (54183 records). [2025-10-25T20:17:14.299047] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-25T20:17:14.299174] [INFO ] [MAIN ] Update Progress: 508/2366 symbols. COMP took 14.4s. Estimated remaining time: 4h 50m 33s [2025-10-25T20:17:14.467753] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:17:14.467978] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-25T20:17:14.468053] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-25T20:17:14.468167] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-25T20:17:14.468239] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-25T20:17:14.468320] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-25T20:17:14.468391] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-25T20:17:14.835005] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:17:14.835390] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-25T20:17:16.469176] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T20:17:16.477615] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-25T20:17:17.887440] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-25T20:17:17.895166] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-25T20:17:19.506258] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T20:17:19.515050] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-25T20:17:21.178214] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T20:17:21.187203] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-25T20:17:22.663825] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T20:17:22.671285] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-25T20:17:24.172911] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T20:17:24.181194] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-25T20:17:25.723250] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T20:17:25.731447] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-25T20:17:27.222637] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-25T20:17:27.231914] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-25T20:17:28.801373] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T20:17:28.810849] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-25T20:17:30.229626] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T20:17:30.236944] [INFO ] [REMOTE ] CON: Full fetch complete (56693 records). [2025-10-25T20:17:30.237141] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-25T20:17:30.637396] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-25T20:17:30.637527] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-25T20:17:30.638258] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-25T20:17:30.638361] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-25T20:17:30.639631] [DEBUG] [LOCAL ] CON: Trimmed 56693 records to 39266 (keeping 200 days of data) [2025-10-25T20:17:30.867873] [DEBUG] [LOCAL ] CON: Primary data saved (39266 records). [2025-10-25T20:17:30.868093] [INFO ] [MAIN ] CON: Full history saved. [2025-10-25T20:17:30.868217] [INFO ] [MAIN ] Update Progress: 509/2366 symbols. CON took 16.6s. Estimated remaining time: 4h 50m 49s [2025-10-25T20:17:31.040596] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:17:31.040824] [DEBUG] [LOCAL ] COOK: No existing data file found in primary storage. [2025-10-25T20:17:31.040896] [WARN ] [MAIN ] COOK: No existing data found, performing full refresh instead. [2025-10-25T20:17:31.041007] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-25T20:17:31.041079] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-25T20:17:31.041163] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-25T20:17:31.041230] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-25T20:17:31.401599] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:17:31.402011] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-25T20:17:32.586587] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T20:17:32.590938] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-25T20:17:33.478986] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T20:17:33.482139] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-25T20:17:34.637754] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T20:17:34.642743] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-25T20:17:35.791379] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:17:35.796065] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-25T20:17:36.952879] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T20:17:36.958536] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-25T20:17:38.381747] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T20:17:38.388454] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-25T20:17:39.557775] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T20:17:39.563265] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-25T20:17:40.847817] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T20:17:40.853359] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-25T20:17:42.076570] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-25T20:17:42.082807] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-25T20:17:43.289226] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T20:17:43.296332] [INFO ] [REMOTE ] COOK: Full fetch complete (33098 records). [2025-10-25T20:17:43.296528] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-25T20:17:43.672370] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-25T20:17:43.672497] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-25T20:17:43.672988] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-25T20:17:43.673069] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-25T20:17:43.673928] [DEBUG] [LOCAL ] COOK: Trimmed 33098 records to 25105 (keeping 200 days of data) [2025-10-25T20:17:43.806235] [DEBUG] [LOCAL ] COOK: Primary data saved (25105 records). [2025-10-25T20:17:43.806400] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-25T20:17:43.806520] [INFO ] [MAIN ] Update Progress: 510/2366 symbols. COOK took 12.9s. Estimated remaining time: 4h 50m 53s [2025-10-25T20:17:43.970003] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:17:43.970229] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-25T20:17:43.970309] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-25T20:17:43.970456] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-25T20:17:43.970547] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-25T20:17:43.970680] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-25T20:17:43.970773] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-25T20:17:44.315475] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:17:44.315850] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-25T20:17:46.300036] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-25T20:17:46.310792] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-25T20:17:48.290630] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-25T20:17:48.301391] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-25T20:17:50.250975] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T20:17:50.263571] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-25T20:17:51.297830] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:17:51.309069] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-25T20:17:52.188183] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T20:17:52.199362] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-25T20:17:53.310724] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T20:17:53.321638] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-25T20:17:54.230423] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:17:54.242099] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-25T20:17:55.502893] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T20:17:55.514466] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-25T20:17:56.518663] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:17:56.531845] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-25T20:17:57.370950] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T20:17:57.381141] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-25T20:17:57.381386] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-25T20:17:57.792629] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-25T20:17:57.792814] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-25T20:17:57.793786] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-25T20:17:57.793890] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-25T20:17:57.795466] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54507 (keeping 200 days of data) [2025-10-25T20:17:58.121470] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-25T20:17:58.121676] [INFO ] [MAIN ] COP: Full history saved. [2025-10-25T20:17:58.121823] [INFO ] [MAIN ] Update Progress: 511/2366 symbols. COP took 14.3s. Estimated remaining time: 4h 51m 1s [2025-10-25T20:17:58.313679] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:17:58.313897] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-25T20:17:58.313979] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-25T20:17:58.314102] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-25T20:17:58.314197] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-25T20:17:58.314312] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-25T20:17:58.314389] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-25T20:17:58.669171] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:17:58.669521] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-25T20:18:00.417607] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T20:18:00.427209] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-25T20:18:02.542730] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-25T20:18:02.552280] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-25T20:18:04.449581] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T20:18:04.461029] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-25T20:18:05.435912] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T20:18:05.446872] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-25T20:18:06.386535] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T20:18:06.397053] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-25T20:18:07.248802] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T20:18:07.258313] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-25T20:18:08.098182] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T20:18:08.107805] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-25T20:18:09.072634] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T20:18:09.082430] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-25T20:18:10.028490] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:18:10.039097] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-25T20:18:11.095434] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T20:18:11.103453] [INFO ] [REMOTE ] COR: Full fetch complete (68315 records). [2025-10-25T20:18:11.103700] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-25T20:18:11.491074] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-25T20:18:11.491222] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-25T20:18:11.492085] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-25T20:18:11.492185] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-25T20:18:11.493693] [DEBUG] [LOCAL ] COR: Trimmed 68315 records to 46834 (keeping 200 days of data) [2025-10-25T20:18:11.780958] [DEBUG] [LOCAL ] COR: Primary data saved (46834 records). [2025-10-25T20:18:11.781150] [INFO ] [MAIN ] COR: Full history saved. [2025-10-25T20:18:11.781285] [INFO ] [MAIN ] Update Progress: 512/2366 symbols. COR took 13.7s. Estimated remaining time: 4h 51m 7s [2025-10-25T20:18:11.961422] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:18:11.961691] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-25T20:18:11.961766] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-25T20:18:11.961921] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-25T20:18:11.961994] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-25T20:18:11.962075] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-25T20:18:11.962143] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-25T20:18:12.322523] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:18:12.322925] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-25T20:18:14.094696] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T20:18:14.105128] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-25T20:18:15.835806] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T20:18:15.846341] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-25T20:18:17.534247] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T20:18:17.545802] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-25T20:18:18.525988] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T20:18:18.537132] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-25T20:18:19.430050] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:18:19.441763] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-25T20:18:20.437976] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T20:18:20.453299] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-25T20:18:21.778181] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-25T20:18:21.790072] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-25T20:18:22.946691] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T20:18:22.959036] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-25T20:18:23.897734] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T20:18:23.908991] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-25T20:18:24.780793] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T20:18:24.790602] [INFO ] [REMOTE ] COTY: Full fetch complete (77277 records). [2025-10-25T20:18:24.790832] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-25T20:18:25.193634] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-25T20:18:25.193783] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-25T20:18:25.194580] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-25T20:18:25.194681] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-25T20:18:25.196136] [DEBUG] [LOCAL ] COTY: Trimmed 77277 records to 54031 (keeping 200 days of data) [2025-10-25T20:18:25.487676] [DEBUG] [LOCAL ] COTY: Primary data saved (54031 records). [2025-10-25T20:18:25.487837] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-25T20:18:25.487989] [INFO ] [MAIN ] Update Progress: 513/2366 symbols. COTY took 13.7s. Estimated remaining time: 4h 51m 13s [2025-10-25T20:18:25.652383] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:18:25.652588] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-10-25T20:18:25.652689] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-10-25T20:18:25.652806] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-25T20:18:25.652877] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-25T20:18:25.652973] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-25T20:18:25.653041] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-25T20:18:26.000265] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:18:26.000608] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-25T20:18:27.661463] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T20:18:27.671466] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-25T20:18:29.290038] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T20:18:29.299314] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-25T20:18:30.924006] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T20:18:30.934388] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-25T20:18:31.974346] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T20:18:31.984763] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-25T20:18:32.971824] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:18:32.982805] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-25T20:18:34.023258] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T20:18:34.034212] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-25T20:18:35.007550] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T20:18:35.019359] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-25T20:18:35.960704] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:18:35.971710] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-25T20:18:37.196754] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T20:18:37.207320] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-25T20:18:38.229165] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T20:18:38.239049] [INFO ] [REMOTE ] COUR: Full fetch complete (71258 records). [2025-10-25T20:18:38.239260] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-25T20:18:38.635751] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-25T20:18:38.635877] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-25T20:18:38.636712] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-25T20:18:38.636795] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-25T20:18:38.638255] [DEBUG] [LOCAL ] COUR: Trimmed 71258 records to 50179 (keeping 200 days of data) [2025-10-25T20:18:38.919423] [DEBUG] [LOCAL ] COUR: Primary data saved (50179 records). [2025-10-25T20:18:38.919617] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-25T20:18:38.919767] [INFO ] [MAIN ] Update Progress: 514/2366 symbols. COUR took 13.4s. Estimated remaining time: 4h 51m 18s [2025-10-25T20:18:39.099766] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:18:39.100009] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-25T20:18:39.100086] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-25T20:18:39.100204] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-25T20:18:39.100279] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-25T20:18:39.100362] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-25T20:18:39.100435] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-25T20:18:39.501744] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:18:39.502198] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-25T20:18:41.373248] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T20:18:41.384333] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-25T20:18:43.134413] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-25T20:18:43.144755] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-25T20:18:45.086544] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T20:18:45.103110] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-25T20:18:46.135333] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:18:46.147630] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-25T20:18:47.405186] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T20:18:47.416420] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-25T20:18:48.403268] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T20:18:48.414574] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-25T20:18:49.359876] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T20:18:49.371308] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-25T20:18:50.439717] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T20:18:50.451410] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-25T20:18:51.431344] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T20:18:51.442687] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-25T20:18:52.258468] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T20:18:52.268035] [INFO ] [REMOTE ] CP: Full fetch complete (77289 records). [2025-10-25T20:18:52.268196] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-25T20:18:52.651324] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-25T20:18:52.651462] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-25T20:18:52.652280] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-25T20:18:52.652361] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-25T20:18:52.653839] [DEBUG] [LOCAL ] CP: Trimmed 77289 records to 53992 (keeping 200 days of data) [2025-10-25T20:18:52.974812] [DEBUG] [LOCAL ] CP: Primary data saved (53992 records). [2025-10-25T20:18:52.974987] [INFO ] [MAIN ] CP: Full history saved. [2025-10-25T20:18:52.975112] [INFO ] [MAIN ] Update Progress: 515/2366 symbols. CP took 14.1s. Estimated remaining time: 4h 51m 26s [2025-10-25T20:18:53.150477] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:18:53.150710] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-25T20:18:53.150789] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-25T20:18:53.150905] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-25T20:18:53.150976] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-25T20:18:53.151057] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-25T20:18:53.151128] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-25T20:18:53.518725] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:18:53.519109] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-25T20:18:54.861388] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T20:18:54.867196] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-25T20:18:57.878313] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (3.01 seconds). [2025-10-25T20:18:57.885716] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-25T20:18:59.367727] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-25T20:18:59.375023] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-25T20:19:00.760982] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T20:19:00.767609] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-25T20:19:02.481162] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-25T20:19:02.488056] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-25T20:19:03.921105] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T20:19:03.929408] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-25T20:19:05.185590] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T20:19:05.191893] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-25T20:19:06.585593] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T20:19:06.592537] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-25T20:19:07.831087] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T20:19:07.836987] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-25T20:19:09.044593] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T20:19:09.049183] [INFO ] [REMOTE ] CPA: Full fetch complete (40979 records). [2025-10-25T20:19:09.049335] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-25T20:19:09.429551] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-25T20:19:09.429804] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-25T20:19:09.430424] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-25T20:19:09.430504] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-25T20:19:09.431481] [DEBUG] [LOCAL ] CPA: Trimmed 40979 records to 28029 (keeping 200 days of data) [2025-10-25T20:19:09.598495] [DEBUG] [LOCAL ] CPA: Primary data saved (28029 records). [2025-10-25T20:19:09.598693] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-25T20:19:09.598821] [INFO ] [MAIN ] Update Progress: 516/2366 symbols. CPA took 16.6s. Estimated remaining time: 4h 51m 42s [2025-10-25T20:19:09.771538] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:19:09.771777] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-25T20:19:09.771852] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-25T20:19:09.771971] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-25T20:19:09.772045] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-25T20:19:09.772130] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-25T20:19:09.772203] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-25T20:19:10.120903] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:19:10.121304] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-25T20:19:10.636079] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-25T20:19:10.637104] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-25T20:19:11.133402] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-25T20:19:11.134604] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-25T20:19:11.647121] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-25T20:19:11.648226] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-25T20:19:12.214319] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-25T20:19:12.215686] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-25T20:19:12.755163] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-25T20:19:12.756306] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-25T20:19:13.227538] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T20:19:13.228598] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-25T20:19:14.087147] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T20:19:14.088330] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-25T20:19:14.568379] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-25T20:19:14.569420] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-25T20:19:15.143303] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T20:19:15.144449] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-25T20:19:15.763568] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T20:19:15.764623] [INFO ] [REMOTE ] CPAC: Full fetch complete (1792 records). [2025-10-25T20:19:15.764744] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-25T20:19:15.941555] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T20:19:15.941806] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:19:15.941883] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:19:15.941941] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-25T20:19:15.942005] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-25T20:19:15.942072] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-25T20:19:15.942130] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-25T20:19:15.942231] [INFO ] [MAIN ] Update Progress: 517/2366 symbols. CPAC took 6.3s. Estimated remaining time: 4h 51m 21s [2025-10-25T20:19:16.107071] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:19:16.107290] [DEBUG] [LOCAL ] CPAY: No existing data file found in primary storage. [2025-10-25T20:19:16.107363] [WARN ] [MAIN ] CPAY: No existing data found, performing full refresh instead. [2025-10-25T20:19:16.107455] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-25T20:19:16.107523] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-25T20:19:16.107604] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-10-25T20:19:16.107694] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-25T20:19:16.472482] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:19:16.472879] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-25T20:19:17.885405] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T20:19:17.895727] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-25T20:19:19.278818] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T20:19:19.285261] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-25T20:19:20.743311] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T20:19:20.750905] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-25T20:19:24.381173] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-10-25T20:19:24.388631] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-25T20:19:25.850847] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T20:19:25.858446] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-25T20:19:27.254820] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-25T20:19:27.262091] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-25T20:19:28.741556] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T20:19:28.748234] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-25T20:19:30.108484] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T20:19:30.115022] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-25T20:19:31.437078] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T20:19:31.443335] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-25T20:19:33.003844] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-25T20:19:33.009954] [INFO ] [REMOTE ] CPAY: Full fetch complete (44604 records). [2025-10-25T20:19:33.010227] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-25T20:19:33.415336] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-25T20:19:33.415522] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-25T20:19:33.416401] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-25T20:19:33.416501] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-25T20:19:33.417908] [DEBUG] [LOCAL ] CPAY: Trimmed 44604 records to 30364 (keeping 200 days of data) [2025-10-25T20:19:33.608309] [DEBUG] [LOCAL ] CPAY: Primary data saved (30364 records). [2025-10-25T20:19:33.608528] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-25T20:19:33.608714] [INFO ] [MAIN ] Update Progress: 518/2366 symbols. CPAY took 17.7s. Estimated remaining time: 4h 51m 41s [2025-10-25T20:19:33.788973] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:19:33.789225] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-25T20:19:33.789303] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-25T20:19:33.789427] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-25T20:19:33.789500] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-25T20:19:33.789583] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-25T20:19:33.789681] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-25T20:19:34.152607] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:19:34.153067] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-25T20:19:35.497516] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T20:19:35.506023] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-25T20:19:36.563003] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T20:19:36.567108] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-25T20:19:37.670240] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T20:19:37.676932] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-25T20:19:38.823000] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:19:38.827377] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-25T20:19:39.821759] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:19:39.825250] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-25T20:19:40.861378] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T20:19:40.865223] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-25T20:19:42.257971] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T20:19:42.261796] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-25T20:19:43.292492] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T20:19:43.296374] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-25T20:19:44.112771] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-25T20:19:44.116849] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-25T20:19:45.143497] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T20:19:45.146757] [INFO ] [REMOTE ] CPF: Full fetch complete (23166 records). [2025-10-25T20:19:45.146872] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-25T20:19:45.507469] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-25T20:19:45.507586] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-25T20:19:45.507994] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-25T20:19:45.508074] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-25T20:19:45.508697] [DEBUG] [LOCAL ] CPF: Trimmed 23166 records to 15344 (keeping 200 days of data) [2025-10-25T20:19:45.596026] [DEBUG] [LOCAL ] CPF: Primary data saved (15344 records). [2025-10-25T20:19:45.596184] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-25T20:19:45.596304] [INFO ] [MAIN ] Update Progress: 519/2366 symbols. CPF took 12.0s. Estimated remaining time: 4h 51m 41s [2025-10-25T20:19:45.771493] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:19:45.771715] [DEBUG] [LOCAL ] CPK: No existing data file found in primary storage. [2025-10-25T20:19:45.771786] [WARN ] [MAIN ] CPK: No existing data found, performing full refresh instead. [2025-10-25T20:19:45.771907] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-25T20:19:45.771987] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-25T20:19:45.772068] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-25T20:19:45.772134] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-25T20:19:46.119478] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:19:46.119842] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-25T20:19:47.002802] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T20:19:47.005168] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-25T20:19:48.004547] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-25T20:19:48.008475] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-25T20:19:49.085548] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-25T20:19:49.088705] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-25T20:19:50.274753] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-25T20:19:50.279188] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-25T20:19:51.253770] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T20:19:51.257055] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-25T20:19:52.345114] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T20:19:52.348770] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-25T20:19:53.353009] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T20:19:53.356560] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-25T20:19:54.329794] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:19:54.332694] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-25T20:19:55.282185] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:19:55.285679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-25T20:19:57.207352] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-25T20:19:57.211127] [INFO ] [REMOTE ] CPK: Full fetch complete (18852 records). [2025-10-25T20:19:57.211260] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-25T20:19:57.597814] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-25T20:19:57.597962] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-25T20:19:57.598334] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-25T20:19:57.598408] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-25T20:19:57.599140] [DEBUG] [LOCAL ] CPK: Trimmed 18852 records to 14093 (keeping 200 days of data) [2025-10-25T20:19:57.691665] [DEBUG] [LOCAL ] CPK: Primary data saved (14093 records). [2025-10-25T20:19:57.691859] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-25T20:19:57.691987] [INFO ] [MAIN ] Update Progress: 520/2366 symbols. CPK took 12.1s. Estimated remaining time: 4h 51m 40s [2025-10-25T20:19:57.857590] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:19:57.857820] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-10-25T20:19:57.857891] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-10-25T20:19:57.858010] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-25T20:19:57.858082] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-25T20:19:57.858141] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-25T20:19:57.858203] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-25T20:19:58.210778] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:19:58.211165] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-25T20:20:00.391869] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-25T20:20:00.405569] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-25T20:20:03.237199] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-25T20:20:03.247456] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-25T20:20:05.528760] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-25T20:20:05.540194] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-25T20:20:06.555183] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T20:20:06.566386] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-25T20:20:07.586759] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T20:20:07.598092] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-25T20:20:08.594064] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T20:20:08.606101] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-25T20:20:10.681256] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-25T20:20:10.693566] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-25T20:20:11.702894] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T20:20:11.715133] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-25T20:20:12.821089] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T20:20:12.833693] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-25T20:20:14.259748] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T20:20:14.272190] [INFO ] [REMOTE ] CPNG: Full fetch complete (77791 records). [2025-10-25T20:20:14.272402] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-25T20:20:14.670528] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-25T20:20:14.670722] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-25T20:20:14.671717] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-25T20:20:14.671811] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-25T20:20:14.673440] [DEBUG] [LOCAL ] CPNG: Trimmed 77791 records to 54459 (keeping 200 days of data) [2025-10-25T20:20:14.989674] [DEBUG] [LOCAL ] CPNG: Primary data saved (54459 records). [2025-10-25T20:20:14.989867] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-25T20:20:14.989992] [INFO ] [MAIN ] Update Progress: 521/2366 symbols. CPNG took 17.3s. Estimated remaining time: 4h 51m 59s [2025-10-25T20:20:15.159870] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:20:15.160085] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-10-25T20:20:15.160156] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-10-25T20:20:15.160270] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-25T20:20:15.160340] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-25T20:20:15.160420] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-25T20:20:15.160490] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-25T20:20:15.521056] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:20:15.521454] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-25T20:20:17.622259] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-25T20:20:17.632777] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-25T20:20:19.333698] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T20:20:19.343922] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-25T20:20:21.132589] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T20:20:21.143893] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-25T20:20:22.314074] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T20:20:22.325333] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-25T20:20:23.584741] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T20:20:23.597085] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-25T20:20:24.593089] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T20:20:24.609500] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-25T20:20:25.705590] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T20:20:25.717554] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-25T20:20:26.745555] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T20:20:26.757752] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-25T20:20:27.666696] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T20:20:27.678183] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-25T20:20:28.679204] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T20:20:28.688709] [INFO ] [REMOTE ] CPRI: Full fetch complete (76189 records). [2025-10-25T20:20:28.688912] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-25T20:20:29.084864] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-25T20:20:29.085001] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-25T20:20:29.085826] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-25T20:20:29.085909] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-25T20:20:29.087399] [DEBUG] [LOCAL ] CPRI: Trimmed 76189 records to 53146 (keeping 200 days of data) [2025-10-25T20:20:29.391451] [DEBUG] [LOCAL ] CPRI: Primary data saved (53146 records). [2025-10-25T20:20:29.391679] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-25T20:20:29.391846] [INFO ] [MAIN ] Update Progress: 522/2366 symbols. CPRI took 14.4s. Estimated remaining time: 4h 52m 6s [2025-10-25T20:20:29.578734] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:20:29.578970] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-10-25T20:20:29.579044] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-10-25T20:20:29.579160] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-25T20:20:29.579232] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-25T20:20:29.579315] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-25T20:20:29.579385] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-25T20:20:29.944190] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:20:29.944575] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-25T20:20:31.132256] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-25T20:20:31.137106] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-25T20:20:32.395031] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T20:20:32.400755] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-25T20:20:33.695038] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T20:20:33.701846] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-25T20:20:35.066113] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-25T20:20:35.078313] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-25T20:20:36.527507] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T20:20:36.534469] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-25T20:20:37.735112] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T20:20:37.740901] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-25T20:20:38.971424] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T20:20:38.977468] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-25T20:20:40.412515] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T20:20:40.418579] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-25T20:20:41.551508] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T20:20:41.557000] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-25T20:20:42.724586] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T20:20:42.729466] [INFO ] [REMOTE ] CPS: Full fetch complete (36546 records). [2025-10-25T20:20:42.729661] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-25T20:20:43.128940] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-25T20:20:43.129100] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-25T20:20:43.129717] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-25T20:20:43.129810] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-25T20:20:43.131004] [DEBUG] [LOCAL ] CPS: Trimmed 36546 records to 25186 (keeping 200 days of data) [2025-10-25T20:20:43.276190] [DEBUG] [LOCAL ] CPS: Primary data saved (25186 records). [2025-10-25T20:20:43.276400] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-25T20:20:43.276576] [INFO ] [MAIN ] Update Progress: 523/2366 symbols. CPS took 13.9s. Estimated remaining time: 4h 52m 12s [2025-10-25T20:20:43.447173] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:20:43.447400] [DEBUG] [LOCAL ] CPT: No existing data file found in primary storage. [2025-10-25T20:20:43.447471] [WARN ] [MAIN ] CPT: No existing data found, performing full refresh instead. [2025-10-25T20:20:43.447584] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-25T20:20:43.447675] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-25T20:20:43.447777] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-10-25T20:20:43.447846] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-25T20:20:43.803808] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:20:43.804164] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-25T20:20:45.429426] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T20:20:45.438809] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-25T20:20:46.985861] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T20:20:46.995011] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-25T20:20:48.728265] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:20:48.737879] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-25T20:20:49.995509] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T20:20:50.005555] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-25T20:20:50.608538] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T20:20:50.618056] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-25T20:20:51.373632] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T20:20:51.383202] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-25T20:20:52.316579] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T20:20:52.331773] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-25T20:20:53.228040] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T20:20:53.237463] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-25T20:20:54.580392] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T20:20:54.590876] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-25T20:20:55.536774] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T20:20:55.545061] [INFO ] [REMOTE ] CPT: Full fetch complete (64753 records). [2025-10-25T20:20:55.545230] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-25T20:20:55.974519] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-25T20:20:55.974730] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-25T20:20:55.975484] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-25T20:20:55.975567] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-25T20:20:55.976933] [DEBUG] [LOCAL ] CPT: Trimmed 64753 records to 45157 (keeping 200 days of data) [2025-10-25T20:20:56.250909] [DEBUG] [LOCAL ] CPT: Primary data saved (45157 records). [2025-10-25T20:20:56.251076] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-25T20:20:56.251198] [INFO ] [MAIN ] Update Progress: 524/2366 symbols. CPT took 13.0s. Estimated remaining time: 4h 52m 15s [2025-10-25T20:20:56.415939] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:20:56.416141] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-25T20:20:56.416212] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-25T20:20:56.416322] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-25T20:20:56.416392] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-25T20:20:56.416471] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-25T20:20:56.416539] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-25T20:20:56.767163] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:20:56.767525] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-25T20:20:58.108863] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T20:20:58.114806] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-25T20:20:59.381802] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T20:20:59.387210] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-25T20:21:00.454988] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T20:21:00.460482] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-25T20:21:01.855502] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T20:21:01.859781] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-25T20:21:03.079428] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T20:21:03.084598] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-25T20:21:04.493696] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T20:21:04.500139] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-25T20:21:05.772313] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T20:21:05.779262] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-25T20:21:06.800061] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T20:21:06.803628] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-25T20:21:07.799915] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:21:07.803328] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-25T20:21:08.743450] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:21:08.746638] [INFO ] [REMOTE ] CQP: Full fetch complete (29587 records). [2025-10-25T20:21:08.746798] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-25T20:21:09.133081] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-25T20:21:09.133222] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-25T20:21:09.133759] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-25T20:21:09.133842] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-25T20:21:09.134808] [DEBUG] [LOCAL ] CQP: Trimmed 29587 records to 18984 (keeping 200 days of data) [2025-10-25T20:21:09.253137] [DEBUG] [LOCAL ] CQP: Primary data saved (18984 records). [2025-10-25T20:21:09.253317] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-25T20:21:09.253442] [INFO ] [MAIN ] Update Progress: 525/2366 symbols. CQP took 13.0s. Estimated remaining time: 4h 52m 18s [2025-10-25T20:21:09.428969] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:21:09.429241] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-10-25T20:21:09.429315] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-10-25T20:21:09.429427] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-25T20:21:09.429499] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-25T20:21:09.429595] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-10-25T20:21:09.429717] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-25T20:21:09.806613] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:21:09.806993] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-25T20:21:11.122363] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T20:21:11.127516] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-25T20:21:12.419130] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T20:21:12.423832] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-25T20:21:13.913573] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T20:21:13.919402] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-25T20:21:15.258616] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-25T20:21:15.265116] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-25T20:21:16.483451] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T20:21:16.489070] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-25T20:21:17.627315] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T20:21:17.632766] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-25T20:21:18.917241] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T20:21:18.922832] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-25T20:21:20.105520] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-25T20:21:20.111088] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-25T20:21:21.325056] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T20:21:21.330839] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-25T20:21:22.421174] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-25T20:21:22.425721] [INFO ] [REMOTE ] CR: Full fetch complete (34779 records). [2025-10-25T20:21:22.425833] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-25T20:21:22.812704] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-25T20:21:22.812833] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-25T20:21:22.813327] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-25T20:21:22.813407] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-25T20:21:22.814345] [DEBUG] [LOCAL ] CR: Trimmed 34779 records to 24331 (keeping 200 days of data) [2025-10-25T20:21:22.965473] [DEBUG] [LOCAL ] CR: Primary data saved (24331 records). [2025-10-25T20:21:22.965628] [INFO ] [MAIN ] CR: Full history saved. [2025-10-25T20:21:22.965766] [INFO ] [MAIN ] Update Progress: 526/2366 symbols. CR took 13.7s. Estimated remaining time: 4h 52m 23s [2025-10-25T20:21:23.142133] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:21:23.142339] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-10-25T20:21:23.142412] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-10-25T20:21:23.142526] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-25T20:21:23.142599] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-25T20:21:23.142702] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-25T20:21:23.142773] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-25T20:21:23.490895] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:21:23.491217] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-25T20:21:24.394228] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T20:21:24.397507] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-25T20:21:25.254886] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T20:21:25.257155] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-25T20:21:26.032502] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-25T20:21:26.035138] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-25T20:21:26.927260] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T20:21:26.930030] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-25T20:21:27.702237] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T20:21:27.704635] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-25T20:21:28.614308] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T20:21:28.617583] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-25T20:21:29.458810] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T20:21:29.461551] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-25T20:21:30.308731] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T20:21:30.311463] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-25T20:21:31.106276] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T20:21:31.108733] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-25T20:21:31.836118] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T20:21:31.838031] [INFO ] [REMOTE ] CRBD: Full fetch complete (12871 records). [2025-10-25T20:21:31.838145] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-25T20:21:32.207078] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-25T20:21:32.207252] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-25T20:21:32.207916] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-25T20:21:32.208036] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-25T20:21:32.208914] [DEBUG] [LOCAL ] CRBD: Trimmed 12871 records to 8822 (keeping 200 days of data) [2025-10-25T20:21:32.267220] [DEBUG] [LOCAL ] CRBD: Primary data saved (8822 records). [2025-10-25T20:21:32.267468] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-25T20:21:32.267629] [INFO ] [MAIN ] Update Progress: 527/2366 symbols. CRBD took 9.3s. Estimated remaining time: 4h 52m 12s [2025-10-25T20:21:32.467203] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:21:32.467470] [DEBUG] [LOCAL ] CRBG: No existing data file found in primary storage. [2025-10-25T20:21:32.467573] [WARN ] [MAIN ] CRBG: No existing data found, performing full refresh instead. [2025-10-25T20:21:32.467729] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-25T20:21:32.467814] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-25T20:21:32.467879] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-10-25T20:21:32.467969] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-25T20:21:32.897847] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:21:32.898974] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-25T20:21:34.735558] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T20:21:34.747166] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-25T20:21:36.435559] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T20:21:36.446109] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-25T20:21:38.133928] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T20:21:38.145432] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-25T20:21:39.141922] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T20:21:39.153889] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-25T20:21:40.186796] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:21:40.198206] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-25T20:21:41.040304] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T20:21:41.050811] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-25T20:21:41.811496] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-25T20:21:41.823454] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-25T20:21:42.568934] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-25T20:21:42.580281] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-25T20:21:43.584914] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:21:43.596992] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-25T20:21:44.551441] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T20:21:44.561529] [INFO ] [REMOTE ] CRBG: Full fetch complete (76034 records). [2025-10-25T20:21:44.561803] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-25T20:21:44.967540] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-25T20:21:44.967695] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-25T20:21:44.968702] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-25T20:21:44.968800] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-25T20:21:44.970291] [DEBUG] [LOCAL ] CRBG: Trimmed 76034 records to 53347 (keeping 200 days of data) [2025-10-25T20:21:45.280981] [DEBUG] [LOCAL ] CRBG: Primary data saved (53347 records). [2025-10-25T20:21:45.281157] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-25T20:21:45.281311] [INFO ] [MAIN ] Update Progress: 528/2366 symbols. CRBG took 13.0s. Estimated remaining time: 4h 52m 15s [2025-10-25T20:21:45.447080] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:21:45.447280] [DEBUG] [LOCAL ] CRC: No existing data file found in primary storage. [2025-10-25T20:21:45.447349] [WARN ] [MAIN ] CRC: No existing data found, performing full refresh instead. [2025-10-25T20:21:45.447459] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-25T20:21:45.447569] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-25T20:21:45.447676] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-10-25T20:21:45.447744] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-25T20:21:45.793994] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:21:45.794343] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-25T20:21:47.264455] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T20:21:47.273138] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-25T20:21:48.817308] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T20:21:48.826724] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-25T20:21:50.555156] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:21:50.568808] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-25T20:21:52.215298] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T20:21:52.224625] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-25T20:21:53.894022] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T20:21:53.903813] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-25T20:21:55.565488] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T20:21:55.575529] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-25T20:21:57.381876] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-25T20:21:57.392306] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-25T20:21:59.214125] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-25T20:21:59.223457] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-25T20:22:01.002074] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T20:22:01.012436] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-25T20:22:02.959640] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-25T20:22:02.974515] [INFO ] [REMOTE ] CRC: Full fetch complete (62999 records). [2025-10-25T20:22:02.974872] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-25T20:22:03.437575] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-25T20:22:03.437724] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-25T20:22:03.438506] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-25T20:22:03.438586] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-25T20:22:03.439913] [DEBUG] [LOCAL ] CRC: Trimmed 62999 records to 44669 (keeping 200 days of data) [2025-10-25T20:22:03.699816] [DEBUG] [LOCAL ] CRC: Primary data saved (44669 records). [2025-10-25T20:22:03.699987] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-25T20:22:03.700111] [INFO ] [MAIN ] Update Progress: 529/2366 symbols. CRC took 18.4s. Estimated remaining time: 4h 52m 36s [2025-10-25T20:22:03.867595] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:22:03.867820] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-25T20:22:03.867894] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-25T20:22:03.868024] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-25T20:22:03.868095] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-25T20:22:03.868159] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-25T20:22:03.868199] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-25T20:22:04.242936] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:22:04.243377] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-25T20:22:04.608009] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:22:04.608404] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-25T20:22:04.608501] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:22:04.608579] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-25T20:22:04.608706] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:22:04.608809] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-25T20:22:04.608884] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-25T20:22:04.608963] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-25T20:22:04.609043] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-25T20:22:04.609142] [INFO ] [MAIN ] Update Progress: 530/2366 symbols. CRCL took 0.9s. Estimated remaining time: 4h 51m 57s [2025-10-25T20:22:04.781126] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:22:04.781366] [DEBUG] [LOCAL ] CRGY: No existing data file found in primary storage. [2025-10-25T20:22:04.781435] [WARN ] [MAIN ] CRGY: No existing data found, performing full refresh instead. [2025-10-25T20:22:04.781526] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-25T20:22:04.781591] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-25T20:22:04.781669] [DEBUG] [LOCAL ] CRGY: No primary data file found to delete. [2025-10-25T20:22:04.781741] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-25T20:22:05.163698] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:22:05.164065] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-25T20:22:06.969035] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T20:22:06.979505] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-25T20:22:08.678151] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T20:22:08.687961] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-25T20:22:10.468407] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T20:22:10.479383] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-25T20:22:11.501602] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T20:22:11.513443] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-25T20:22:12.437136] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T20:22:12.448219] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-25T20:22:13.509673] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T20:22:13.520533] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-25T20:22:14.452173] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T20:22:14.463528] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-25T20:22:15.499771] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T20:22:15.510828] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-25T20:22:16.641696] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T20:22:16.653277] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-25T20:22:17.592932] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:22:17.603051] [INFO ] [REMOTE ] CRGY: Full fetch complete (76165 records). [2025-10-25T20:22:17.603258] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-25T20:22:18.008579] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-25T20:22:18.009527] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-25T20:22:18.010393] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-25T20:22:18.010478] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-25T20:22:18.012075] [DEBUG] [LOCAL ] CRGY: Trimmed 76165 records to 53270 (keeping 200 days of data) [2025-10-25T20:22:18.319551] [DEBUG] [LOCAL ] CRGY: Primary data saved (53270 records). [2025-10-25T20:22:18.319765] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-25T20:22:18.319890] [INFO ] [MAIN ] Update Progress: 531/2366 symbols. CRGY took 13.7s. Estimated remaining time: 4h 52m 2s [2025-10-25T20:22:18.489248] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:22:18.489505] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-10-25T20:22:18.489580] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-10-25T20:22:18.489718] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-25T20:22:18.489792] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-25T20:22:18.489875] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-25T20:22:18.489946] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-25T20:22:18.849697] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:22:18.850063] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-25T20:22:20.881174] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-25T20:22:20.892568] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-25T20:22:22.758787] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-25T20:22:22.771292] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-25T20:22:24.990313] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-25T20:22:25.001967] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-25T20:22:26.133523] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T20:22:26.145717] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-25T20:22:27.389236] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T20:22:27.400376] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-25T20:22:28.369169] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:22:28.379875] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-25T20:22:29.512916] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T20:22:29.524812] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-25T20:22:30.577727] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T20:22:30.592348] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-25T20:22:31.639238] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T20:22:31.650539] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-25T20:22:32.510616] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T20:22:32.520844] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-10-25T20:22:32.521077] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-25T20:22:32.919519] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-25T20:22:32.919681] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-25T20:22:32.920582] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-25T20:22:32.920688] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-25T20:22:32.922178] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 54172 (keeping 200 days of data) [2025-10-25T20:22:33.261332] [DEBUG] [LOCAL ] CRH: Primary data saved (54172 records). [2025-10-25T20:22:33.261526] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-25T20:22:33.261696] [INFO ] [MAIN ] Update Progress: 532/2366 symbols. CRH took 14.9s. Estimated remaining time: 4h 52m 11s [2025-10-25T20:22:33.430124] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:22:33.430338] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-10-25T20:22:33.430408] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-10-25T20:22:33.430521] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-25T20:22:33.430597] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-25T20:22:33.430701] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-25T20:22:33.430770] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-25T20:22:33.783063] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:22:33.783462] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-25T20:22:35.436793] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T20:22:35.446192] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-25T20:22:37.116452] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T20:22:37.125956] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-25T20:22:38.783374] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T20:22:38.795547] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-25T20:22:39.834252] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T20:22:39.846189] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-25T20:22:40.954100] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T20:22:40.971040] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-25T20:22:42.018721] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T20:22:42.030005] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-25T20:22:43.207659] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T20:22:43.219680] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-25T20:22:44.429909] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T20:22:44.442792] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-25T20:22:45.528202] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T20:22:45.539542] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-25T20:22:46.556985] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T20:22:46.566422] [INFO ] [REMOTE ] CRI: Full fetch complete (71031 records). [2025-10-25T20:22:46.566680] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-25T20:22:46.964599] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-25T20:22:46.964827] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-25T20:22:46.966042] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-25T20:22:46.966133] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-25T20:22:46.968222] [DEBUG] [LOCAL ] CRI: Trimmed 71031 records to 50239 (keeping 200 days of data) [2025-10-25T20:22:47.292432] [DEBUG] [LOCAL ] CRI: Primary data saved (50239 records). [2025-10-25T20:22:47.292687] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-25T20:22:47.292855] [INFO ] [MAIN ] Update Progress: 533/2366 symbols. CRI took 14.0s. Estimated remaining time: 4h 52m 17s [2025-10-25T20:22:47.472332] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:22:47.472609] [DEBUG] [LOCAL ] CRK: No existing data file found in primary storage. [2025-10-25T20:22:47.472707] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-10-25T20:22:47.472840] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-25T20:22:47.472916] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-25T20:22:47.473001] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-25T20:22:47.473078] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-25T20:22:47.876455] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:22:47.876901] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-25T20:22:49.554013] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T20:22:49.564996] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-25T20:22:51.368552] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T20:22:51.378317] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-25T20:22:53.307895] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T20:22:53.318893] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-25T20:22:55.335254] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-25T20:22:55.346457] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-25T20:22:57.185287] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-25T20:22:57.196148] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-25T20:22:58.955381] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T20:22:58.966133] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-25T20:23:00.734767] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-25T20:23:00.746265] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-25T20:23:07.280610] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (6.53 seconds). [2025-10-25T20:23:07.291591] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-25T20:23:09.127104] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-25T20:23:09.138575] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-25T20:23:10.960397] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-25T20:23:10.970204] [INFO ] [REMOTE ] CRK: Full fetch complete (75798 records). [2025-10-25T20:23:10.970366] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-25T20:23:11.373989] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-25T20:23:11.374142] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-25T20:23:11.374983] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-25T20:23:11.375065] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-25T20:23:11.376494] [DEBUG] [LOCAL ] CRK: Trimmed 75798 records to 52984 (keeping 200 days of data) [2025-10-25T20:23:11.671970] [DEBUG] [LOCAL ] CRK: Primary data saved (52984 records). [2025-10-25T20:23:11.672134] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-25T20:23:11.672255] [INFO ] [MAIN ] Update Progress: 534/2366 symbols. CRK took 24.4s. Estimated remaining time: 4h 52m 58s [2025-10-25T20:23:11.846829] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:23:11.847039] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-10-25T20:23:11.847114] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-10-25T20:23:11.847229] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-25T20:23:11.847302] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-25T20:23:11.847384] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-10-25T20:23:11.847474] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-25T20:23:12.214251] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:23:12.214660] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-25T20:23:13.953429] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T20:23:13.962007] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-25T20:23:16.048338] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-25T20:23:16.063135] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-25T20:23:17.888135] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T20:23:17.898093] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-25T20:23:19.777414] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-25T20:23:19.787843] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-25T20:23:21.778117] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T20:23:21.787893] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-25T20:23:23.373700] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T20:23:23.381996] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-25T20:23:24.977251] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T20:23:24.986550] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-25T20:23:26.546666] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T20:23:26.555285] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-25T20:23:28.349859] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T20:23:28.358770] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-25T20:23:30.105944] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T20:23:30.113901] [INFO ] [REMOTE ] CRL: Full fetch complete (63668 records). [2025-10-25T20:23:30.114041] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-25T20:23:30.496563] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-25T20:23:30.496723] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-25T20:23:30.497424] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-25T20:23:30.497503] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-25T20:23:30.498778] [DEBUG] [LOCAL ] CRL: Trimmed 63668 records to 43277 (keeping 200 days of data) [2025-10-25T20:23:30.745659] [DEBUG] [LOCAL ] CRL: Primary data saved (43277 records). [2025-10-25T20:23:30.745826] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-25T20:23:30.745949] [INFO ] [MAIN ] Update Progress: 535/2366 symbols. CRL took 19.1s. Estimated remaining time: 4h 53m 21s [2025-10-25T20:23:30.912452] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:23:30.912636] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-10-25T20:23:30.912731] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-10-25T20:23:30.912842] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-25T20:23:30.912912] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-25T20:23:30.912994] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-25T20:23:30.913061] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-25T20:23:31.263087] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:23:31.263427] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-25T20:23:33.716312] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-25T20:23:33.726797] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-25T20:23:36.093289] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-25T20:23:36.103239] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-25T20:23:38.664249] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-25T20:23:38.675869] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-25T20:23:39.809217] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T20:23:39.821543] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-25T20:23:40.780227] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T20:23:40.791521] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-25T20:23:41.912447] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T20:23:41.923124] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-25T20:23:43.227890] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T20:23:43.239776] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-25T20:23:44.304563] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T20:23:44.319306] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-25T20:23:45.418376] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T20:23:45.429781] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-25T20:23:46.408594] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T20:23:46.418837] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-25T20:23:46.419043] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-25T20:23:46.809552] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-25T20:23:46.809710] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-25T20:23:46.810569] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-25T20:23:46.810680] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-25T20:23:46.812153] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 54550 (keeping 200 days of data) [2025-10-25T20:23:47.146581] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-25T20:23:47.146782] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-25T20:23:47.146887] [INFO ] [MAIN ] Update Progress: 536/2366 symbols. CRM took 16.4s. Estimated remaining time: 4h 53m 34s [2025-10-25T20:23:47.312088] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:23:47.312312] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-10-25T20:23:47.312425] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-10-25T20:23:47.312540] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-25T20:23:47.312610] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-25T20:23:47.312713] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-25T20:23:47.312783] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-25T20:23:47.657168] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:23:47.657512] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-25T20:23:49.535813] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T20:23:49.544253] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-25T20:23:51.167178] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T20:23:51.176098] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-25T20:23:52.805026] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T20:23:52.814149] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-25T20:23:54.517711] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T20:23:54.527578] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-25T20:23:56.262975] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T20:23:56.272602] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-25T20:23:57.925788] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T20:23:57.935509] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-25T20:23:59.749407] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-25T20:23:59.759280] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-25T20:24:01.588195] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-25T20:24:01.597286] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-25T20:24:03.353835] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-25T20:24:03.365476] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-25T20:24:04.251839] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T20:24:04.260545] [INFO ] [REMOTE ] CRS: Full fetch complete (62766 records). [2025-10-25T20:24:04.260784] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-25T20:24:04.652544] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-25T20:24:04.652706] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-25T20:24:04.653430] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-25T20:24:04.653503] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-25T20:24:04.654897] [DEBUG] [LOCAL ] CRS: Trimmed 62766 records to 43864 (keeping 200 days of data) [2025-10-25T20:24:04.922296] [DEBUG] [LOCAL ] CRS: Primary data saved (43864 records). [2025-10-25T20:24:04.922465] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-25T20:24:04.922588] [INFO ] [MAIN ] Update Progress: 537/2366 symbols. CRS took 17.8s. Estimated remaining time: 4h 53m 52s [2025-10-25T20:24:05.094859] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:24:05.095119] [DEBUG] [LOCAL ] CRT: No existing data file found in primary storage. [2025-10-25T20:24:05.095216] [WARN ] [MAIN ] CRT: No existing data found, performing full refresh instead. [2025-10-25T20:24:05.095367] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-25T20:24:05.095458] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-25T20:24:05.095566] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-25T20:24:05.095635] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-25T20:24:05.462441] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:24:05.462819] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-25T20:24:06.478185] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T20:24:06.479996] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-25T20:24:07.195286] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T20:24:07.197052] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-25T20:24:07.903197] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T20:24:07.905119] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-25T20:24:08.615769] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T20:24:08.617677] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-25T20:24:09.347281] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-25T20:24:09.349282] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-25T20:24:10.085516] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T20:24:10.087307] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-25T20:24:11.156108] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T20:24:11.158154] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-25T20:24:11.980804] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T20:24:11.982799] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-25T20:24:12.745434] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T20:24:12.748844] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-25T20:24:13.514890] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T20:24:13.516717] [INFO ] [REMOTE ] CRT: Full fetch complete (7389 records). [2025-10-25T20:24:13.516816] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-25T20:24:13.884055] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-25T20:24:13.884176] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-25T20:24:13.884435] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-25T20:24:13.884516] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-25T20:24:13.884994] [DEBUG] [LOCAL ] CRT: Trimmed 7389 records to 4898 (keeping 200 days of data) [2025-10-25T20:24:13.912923] [DEBUG] [LOCAL ] CRT: Primary data saved (4898 records). [2025-10-25T20:24:13.913013] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-25T20:24:13.913126] [INFO ] [MAIN ] Update Progress: 538/2366 symbols. CRT took 9.0s. Estimated remaining time: 4h 53m 40s [2025-10-25T20:24:14.077852] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:24:14.078096] [DEBUG] [LOCAL ] CSAN: No existing data file found in primary storage. [2025-10-25T20:24:14.078168] [WARN ] [MAIN ] CSAN: No existing data found, performing full refresh instead. [2025-10-25T20:24:14.078283] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-25T20:24:14.078354] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-25T20:24:14.078436] [DEBUG] [LOCAL ] CSAN: No primary data file found to delete. [2025-10-25T20:24:14.078505] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-25T20:24:14.421113] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:24:14.421485] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-25T20:24:16.170603] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T20:24:16.178766] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-25T20:24:17.763277] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T20:24:17.771072] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-25T20:24:19.327228] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T20:24:19.335552] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-25T20:24:21.118460] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T20:24:21.131943] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-25T20:24:22.778556] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T20:24:22.788623] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-25T20:24:24.522776] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-25T20:24:24.533101] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-25T20:24:26.160677] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T20:24:26.170339] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-25T20:24:27.767097] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T20:24:27.775902] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-25T20:24:29.430352] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T20:24:29.441420] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-25T20:24:30.987070] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T20:24:30.994471] [INFO ] [REMOTE ] CSAN: Full fetch complete (60259 records). [2025-10-25T20:24:30.994624] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-25T20:24:31.381498] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-25T20:24:31.381629] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-25T20:24:31.382337] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-25T20:24:31.382417] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-25T20:24:31.383634] [DEBUG] [LOCAL ] CSAN: Trimmed 60259 records to 42874 (keeping 200 days of data) [2025-10-25T20:24:31.610540] [DEBUG] [LOCAL ] CSAN: Primary data saved (42874 records). [2025-10-25T20:24:31.610725] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-25T20:24:31.610845] [INFO ] [MAIN ] Update Progress: 539/2366 symbols. CSAN took 17.7s. Estimated remaining time: 4h 53m 58s [2025-10-25T20:24:31.776890] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:24:31.777107] [DEBUG] [LOCAL ] CSL: No existing data file found in primary storage. [2025-10-25T20:24:31.777181] [WARN ] [MAIN ] CSL: No existing data found, performing full refresh instead. [2025-10-25T20:24:31.777296] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-25T20:24:31.777368] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-25T20:24:31.777452] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-10-25T20:24:31.777522] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-25T20:24:32.145361] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:24:32.145760] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-25T20:24:33.696978] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T20:24:33.702818] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-25T20:24:35.172401] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T20:24:35.181035] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-25T20:24:36.553974] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T20:24:36.561112] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-25T20:24:38.305889] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T20:24:38.313852] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-25T20:24:39.834672] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T20:24:39.840708] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-25T20:24:41.041462] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T20:24:41.047414] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-25T20:24:42.513456] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T20:24:42.520492] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-25T20:24:43.977621] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T20:24:43.985503] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-25T20:24:45.633697] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T20:24:45.643025] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-25T20:24:47.082520] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-25T20:24:47.088584] [INFO ] [REMOTE ] CSL: Full fetch complete (45717 records). [2025-10-25T20:24:47.088767] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-25T20:24:47.481103] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-25T20:24:47.481247] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-25T20:24:47.481885] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-25T20:24:47.481965] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-25T20:24:47.482961] [DEBUG] [LOCAL ] CSL: Trimmed 45717 records to 31561 (keeping 200 days of data) [2025-10-25T20:24:47.669368] [DEBUG] [LOCAL ] CSL: Primary data saved (31561 records). [2025-10-25T20:24:47.669541] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-25T20:24:47.669664] [INFO ] [MAIN ] Update Progress: 540/2366 symbols. CSL took 16.1s. Estimated remaining time: 4h 54m 10s [2025-10-25T20:24:47.840391] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:24:47.840681] [DEBUG] [LOCAL ] CSR: No existing data file found in primary storage. [2025-10-25T20:24:47.840758] [WARN ] [MAIN ] CSR: No existing data found, performing full refresh instead. [2025-10-25T20:24:47.840860] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-25T20:24:47.840931] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-25T20:24:47.841021] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-25T20:24:47.841072] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-25T20:24:48.193234] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:24:48.193575] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-25T20:24:49.168003] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T20:24:49.170975] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-25T20:24:50.192530] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T20:24:50.195279] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-25T20:24:51.210002] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T20:24:51.212555] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-25T20:24:52.515291] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T20:24:52.519175] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-25T20:24:53.503506] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T20:24:53.506616] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-25T20:24:54.423231] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T20:24:54.426524] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-25T20:24:55.479914] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T20:24:55.483167] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-25T20:24:56.575412] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T20:24:56.578807] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-25T20:24:57.255745] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-25T20:24:57.259167] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-25T20:24:58.196794] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:24:58.199971] [INFO ] [REMOTE ] CSR: Full fetch complete (17942 records). [2025-10-25T20:24:58.200075] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-25T20:24:58.557316] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-25T20:24:58.557443] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-25T20:24:58.557857] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-25T20:24:58.557956] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-25T20:24:58.558687] [DEBUG] [LOCAL ] CSR: Trimmed 17942 records to 13551 (keeping 200 days of data) [2025-10-25T20:24:58.638360] [DEBUG] [LOCAL ] CSR: Primary data saved (13551 records). [2025-10-25T20:24:58.638527] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-25T20:24:58.638676] [INFO ] [MAIN ] Update Progress: 541/2366 symbols. CSR took 11.0s. Estimated remaining time: 4h 54m 5s [2025-10-25T20:24:58.817133] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:24:58.817700] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-25T20:24:58.817908] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-25T20:24:58.818078] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-25T20:24:58.818154] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-25T20:24:58.818238] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-25T20:24:58.818310] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-25T20:24:59.182608] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:24:59.183002] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-25T20:25:01.025678] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T20:25:01.035377] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-25T20:25:03.205298] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-25T20:25:03.214473] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-25T20:25:05.025417] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T20:25:05.035804] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-25T20:25:07.018836] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-25T20:25:07.029627] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-25T20:25:08.134490] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T20:25:08.144325] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-25T20:25:09.003404] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T20:25:09.013274] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-25T20:25:09.939012] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T20:25:09.949668] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-25T20:25:10.948262] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T20:25:10.959283] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-25T20:25:11.827565] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T20:25:11.837858] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-25T20:25:12.643252] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T20:25:12.651891] [INFO ] [REMOTE ] CSTM: Full fetch complete (69552 records). [2025-10-25T20:25:12.652055] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-25T20:25:13.112858] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-25T20:25:13.113034] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-25T20:25:13.114260] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-25T20:25:13.114370] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-25T20:25:13.116302] [DEBUG] [LOCAL ] CSTM: Trimmed 69552 records to 48134 (keeping 200 days of data) [2025-10-25T20:25:13.531258] [DEBUG] [LOCAL ] CSTM: Primary data saved (48134 records). [2025-10-25T20:25:13.531496] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-25T20:25:13.531701] [INFO ] [MAIN ] Update Progress: 542/2366 symbols. CSTM took 14.9s. Estimated remaining time: 4h 54m 13s [2025-10-25T20:25:13.807101] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:13.807365] [DEBUG] [LOCAL ] CSV: No existing data file found in primary storage. [2025-10-25T20:25:13.807449] [WARN ] [MAIN ] CSV: No existing data found, performing full refresh instead. [2025-10-25T20:25:13.807591] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-25T20:25:13.807704] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-25T20:25:13.807803] [DEBUG] [LOCAL ] CSV: No primary data file found to delete. [2025-10-25T20:25:13.807887] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-25T20:25:14.191762] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:14.192145] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-25T20:25:15.291477] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T20:25:15.294935] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-25T20:25:16.364911] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-25T20:25:16.368237] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-25T20:25:17.489920] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T20:25:17.493461] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-25T20:25:18.557224] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:25:18.561182] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-25T20:25:19.706425] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-25T20:25:19.710166] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-25T20:25:20.672279] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:25:20.676803] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-25T20:25:21.584215] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:25:21.587098] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-25T20:25:22.601821] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T20:25:22.605407] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-25T20:25:23.627610] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T20:25:23.631107] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-25T20:25:24.562139] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:25:24.564454] [INFO ] [REMOTE ] CSV: Full fetch complete (18934 records). [2025-10-25T20:25:24.564565] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-25T20:25:24.930780] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-25T20:25:24.930964] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-25T20:25:24.931355] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-25T20:25:24.931432] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-25T20:25:24.932165] [DEBUG] [LOCAL ] CSV: Trimmed 18934 records to 12542 (keeping 200 days of data) [2025-10-25T20:25:25.005615] [DEBUG] [LOCAL ] CSV: Primary data saved (12542 records). [2025-10-25T20:25:25.005825] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-25T20:25:25.005931] [INFO ] [MAIN ] Update Progress: 543/2366 symbols. CSV took 11.5s. Estimated remaining time: 4h 54m 9s [2025-10-25T20:25:25.169952] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:25.170172] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-25T20:25:25.170243] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-25T20:25:25.170354] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-25T20:25:25.170430] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-25T20:25:25.170511] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-25T20:25:25.170580] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-25T20:25:25.513673] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:25.513958] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-25T20:25:25.845730] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:25:25.846130] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-25T20:25:25.846220] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:25:25.846319] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-25T20:25:25.846409] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:25:25.846504] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-25T20:25:25.846632] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-25T20:25:25.846742] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-25T20:25:25.846847] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-25T20:25:25.846986] [INFO ] [MAIN ] Update Progress: 544/2366 symbols. CSW took 0.8s. Estimated remaining time: 4h 53m 30s [2025-10-25T20:25:26.013638] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:26.013892] [DEBUG] [LOCAL ] CTBB: No existing data file found in primary storage. [2025-10-25T20:25:26.013981] [WARN ] [MAIN ] CTBB: No existing data found, performing full refresh instead. [2025-10-25T20:25:26.014115] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-25T20:25:26.014204] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-25T20:25:26.014315] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-25T20:25:26.014400] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-25T20:25:26.361375] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:26.361747] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-25T20:25:27.243834] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T20:25:27.245987] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-25T20:25:28.026737] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T20:25:28.028739] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-25T20:25:28.925975] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T20:25:28.929881] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-25T20:25:29.737154] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T20:25:29.740848] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-25T20:25:30.537536] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T20:25:30.539610] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-25T20:25:31.405431] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T20:25:31.407613] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-25T20:25:32.105248] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T20:25:32.107336] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-25T20:25:32.897551] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T20:25:32.899839] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-25T20:25:33.732217] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-25T20:25:33.734408] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-25T20:25:34.483304] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T20:25:34.484910] [INFO ] [REMOTE ] CTBB: Full fetch complete (10055 records). [2025-10-25T20:25:34.485008] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-25T20:25:34.840628] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-25T20:25:34.840769] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-25T20:25:34.841095] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-25T20:25:34.841178] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-25T20:25:34.841750] [DEBUG] [LOCAL ] CTBB: Trimmed 10055 records to 6473 (keeping 200 days of data) [2025-10-25T20:25:34.879428] [DEBUG] [LOCAL ] CTBB: Primary data saved (6473 records). [2025-10-25T20:25:34.879561] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-25T20:25:34.879702] [INFO ] [MAIN ] Update Progress: 545/2366 symbols. CTBB took 9.0s. Estimated remaining time: 4h 53m 18s [2025-10-25T20:25:35.045808] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:35.046203] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-10-25T20:25:35.046289] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-10-25T20:25:35.046448] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-25T20:25:35.046536] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-25T20:25:35.046665] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-25T20:25:35.046759] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-25T20:25:35.411299] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:35.411677] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-25T20:25:36.128589] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T20:25:36.130335] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-25T20:25:36.832160] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T20:25:36.833848] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-25T20:25:37.788849] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T20:25:37.791167] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-25T20:25:38.637571] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T20:25:38.641367] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-25T20:25:39.302737] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T20:25:39.304378] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-25T20:25:40.046453] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T20:25:40.048432] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-25T20:25:40.821433] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T20:25:40.823402] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-25T20:25:41.541546] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-25T20:25:41.543818] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-25T20:25:42.330958] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T20:25:42.333006] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-25T20:25:42.986971] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T20:25:42.988361] [INFO ] [REMOTE ] CTDD: Full fetch complete (7883 records). [2025-10-25T20:25:42.988484] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-25T20:25:43.354541] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-25T20:25:43.355039] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-25T20:25:43.355344] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-25T20:25:43.355437] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-25T20:25:43.355935] [DEBUG] [LOCAL ] CTDD: Trimmed 7883 records to 5184 (keeping 200 days of data) [2025-10-25T20:25:43.386824] [DEBUG] [LOCAL ] CTDD: Primary data saved (5184 records). [2025-10-25T20:25:43.386954] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-25T20:25:43.387092] [INFO ] [MAIN ] Update Progress: 546/2366 symbols. CTDD took 8.5s. Estimated remaining time: 4h 53m 5s [2025-10-25T20:25:43.555577] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:43.555809] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-25T20:25:43.555897] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-25T20:25:43.556037] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-25T20:25:43.556126] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-25T20:25:43.556252] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-25T20:25:43.556338] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-25T20:25:43.931691] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:43.932059] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-25T20:25:44.246737] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:25:44.247126] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-25T20:25:44.247231] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:25:44.247326] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-25T20:25:44.247414] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:25:44.247510] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-25T20:25:44.247630] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-25T20:25:44.247747] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-25T20:25:44.247852] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-25T20:25:44.248021] [INFO ] [MAIN ] Update Progress: 547/2366 symbols. CTEV took 0.9s. Estimated remaining time: 4h 52m 26s [2025-10-25T20:25:44.425059] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:44.425376] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-25T20:25:44.425452] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-25T20:25:44.425569] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-25T20:25:44.425660] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-25T20:25:44.425754] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-25T20:25:44.425826] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-25T20:25:44.787308] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:44.787674] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-25T20:25:45.971302] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T20:25:45.976548] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-25T20:25:47.237116] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T20:25:47.243032] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-25T20:25:48.728841] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T20:25:48.736795] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-25T20:25:50.165748] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T20:25:50.172831] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-25T20:25:51.360596] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T20:25:51.366216] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-25T20:25:52.641957] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T20:25:52.648140] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-25T20:25:54.065013] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T20:25:54.071821] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-25T20:25:55.361106] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T20:25:55.367035] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-25T20:25:56.731637] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-25T20:25:56.738298] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-25T20:25:58.168494] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T20:25:58.174321] [INFO ] [REMOTE ] CTO: Full fetch complete (41382 records). [2025-10-25T20:25:58.174435] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-25T20:25:58.549102] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-25T20:25:58.549238] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-25T20:25:58.549819] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-25T20:25:58.549899] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-25T20:25:58.551026] [DEBUG] [LOCAL ] CTO: Trimmed 41382 records to 27737 (keeping 200 days of data) [2025-10-25T20:25:58.709891] [DEBUG] [LOCAL ] CTO: Primary data saved (27737 records). [2025-10-25T20:25:58.710060] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-25T20:25:58.710182] [INFO ] [MAIN ] Update Progress: 548/2366 symbols. CTO took 14.5s. Estimated remaining time: 4h 52m 32s [2025-10-25T20:25:58.882293] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:25:58.882489] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-25T20:25:58.882561] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-25T20:25:58.882696] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-25T20:25:58.882769] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-25T20:25:58.882855] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-25T20:25:58.882925] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-25T20:25:59.245893] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:25:59.246266] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-25T20:26:00.780207] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T20:26:00.793069] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-25T20:26:02.137302] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T20:26:02.144201] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-25T20:26:03.845464] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T20:26:03.857143] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-25T20:26:05.666126] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T20:26:05.675788] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-25T20:26:07.279535] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T20:26:07.287830] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-25T20:26:08.649417] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T20:26:08.658377] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-25T20:26:10.191394] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T20:26:10.200278] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-25T20:26:11.621808] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T20:26:11.629742] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-25T20:26:12.933408] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T20:26:12.941329] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-25T20:26:14.398766] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T20:26:14.406237] [INFO ] [REMOTE ] CTOS: Full fetch complete (53978 records). [2025-10-25T20:26:14.406366] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-25T20:26:14.781821] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-25T20:26:14.781938] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-25T20:26:14.782587] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-25T20:26:14.782696] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-25T20:26:14.783798] [DEBUG] [LOCAL ] CTOS: Trimmed 53978 records to 37815 (keeping 200 days of data) [2025-10-25T20:26:14.987789] [DEBUG] [LOCAL ] CTOS: Primary data saved (37815 records). [2025-10-25T20:26:14.987996] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-25T20:26:14.988126] [INFO ] [MAIN ] Update Progress: 549/2366 symbols. CTOS took 16.3s. Estimated remaining time: 4h 52m 44s [2025-10-25T20:26:15.185385] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:26:15.185694] [DEBUG] [LOCAL ] CTRA: No existing data file found in primary storage. [2025-10-25T20:26:15.185777] [WARN ] [MAIN ] CTRA: No existing data found, performing full refresh instead. [2025-10-25T20:26:15.185903] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-25T20:26:15.185978] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-25T20:26:15.186064] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-25T20:26:15.186135] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-25T20:26:15.536741] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:26:15.537108] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-25T20:26:17.235485] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T20:26:17.246323] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-25T20:26:19.229110] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-25T20:26:19.239247] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-25T20:26:21.333113] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-25T20:26:21.344466] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-25T20:26:22.461171] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T20:26:22.473265] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-25T20:26:23.375807] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T20:26:23.387065] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-25T20:26:24.655716] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T20:26:24.666463] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-25T20:26:25.782851] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T20:26:25.794485] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-25T20:26:26.805495] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T20:26:26.817594] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-25T20:26:27.877761] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T20:26:27.889573] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-25T20:26:28.815541] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:26:28.825425] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-25T20:26:28.825612] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-25T20:26:29.223344] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-25T20:26:29.223490] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-25T20:26:29.224342] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-25T20:26:29.224423] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-25T20:26:29.225911] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 54427 (keeping 200 days of data) [2025-10-25T20:26:29.540239] [DEBUG] [LOCAL ] CTRA: Primary data saved (54427 records). [2025-10-25T20:26:29.540423] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-25T20:26:29.540549] [INFO ] [MAIN ] Update Progress: 550/2366 symbols. CTRA took 14.6s. Estimated remaining time: 4h 52m 51s [2025-10-25T20:26:29.706105] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:26:29.706305] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-25T20:26:29.706378] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-25T20:26:29.706488] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-25T20:26:29.706565] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-25T20:26:29.706670] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-25T20:26:29.706739] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-25T20:26:30.064207] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:26:30.064593] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-25T20:26:32.007779] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T20:26:32.017104] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-25T20:26:33.703631] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T20:26:33.713198] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-25T20:26:35.351821] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T20:26:35.362349] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-25T20:26:37.213885] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T20:26:37.224638] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-25T20:26:38.944559] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T20:26:38.955082] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-25T20:26:40.681485] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-25T20:26:40.691537] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-25T20:26:42.493539] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T20:26:42.504448] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-25T20:26:44.215095] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T20:26:44.226087] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-25T20:26:46.083318] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T20:26:46.095942] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-25T20:26:47.973248] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T20:26:47.982472] [INFO ] [REMOTE ] CTRE: Full fetch complete (71337 records). [2025-10-25T20:26:47.982615] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-25T20:26:48.370578] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-25T20:26:48.370742] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-25T20:26:48.371601] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-25T20:26:48.371705] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-25T20:26:48.373195] [DEBUG] [LOCAL ] CTRE: Trimmed 71337 records to 50162 (keeping 200 days of data) [2025-10-25T20:26:48.665378] [DEBUG] [LOCAL ] CTRE: Primary data saved (50162 records). [2025-10-25T20:26:48.665544] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-25T20:26:48.665690] [INFO ] [MAIN ] Update Progress: 551/2366 symbols. CTRE took 19.1s. Estimated remaining time: 4h 53m 12s [2025-10-25T20:26:48.836533] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:26:48.836770] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-25T20:26:48.836840] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-25T20:26:48.836949] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-25T20:26:48.837028] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-25T20:26:48.837113] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-25T20:26:48.837183] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-25T20:26:49.184259] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:26:49.184582] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-25T20:26:50.572405] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T20:26:50.578925] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-25T20:26:51.827045] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T20:26:51.833348] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-25T20:26:53.248129] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T20:26:53.254704] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-25T20:26:54.638866] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T20:26:54.646113] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-25T20:26:56.107735] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T20:26:56.115546] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-25T20:26:57.441905] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T20:26:57.451222] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-25T20:26:59.189399] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T20:26:59.197516] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-25T20:27:00.898909] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T20:27:00.908939] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-25T20:27:02.690358] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T20:27:02.700687] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-25T20:27:04.329473] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T20:27:04.338816] [INFO ] [REMOTE ] CTRI: Full fetch complete (54780 records). [2025-10-25T20:27:04.339028] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-25T20:27:04.755528] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-25T20:27:04.755697] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-25T20:27:04.756358] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-25T20:27:04.756441] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-25T20:27:04.757672] [DEBUG] [LOCAL ] CTRI: Trimmed 54780 records to 41493 (keeping 200 days of data) [2025-10-25T20:27:04.992812] [DEBUG] [LOCAL ] CTRI: Primary data saved (41493 records). [2025-10-25T20:27:04.992981] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-25T20:27:04.993103] [INFO ] [MAIN ] Update Progress: 552/2366 symbols. CTRI took 16.3s. Estimated remaining time: 4h 53m 24s [2025-10-25T20:27:05.163012] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:27:05.163229] [DEBUG] [LOCAL ] CTS: No existing data file found in primary storage. [2025-10-25T20:27:05.163303] [WARN ] [MAIN ] CTS: No existing data found, performing full refresh instead. [2025-10-25T20:27:05.163396] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-25T20:27:05.163463] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-25T20:27:05.163533] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-25T20:27:05.163598] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-25T20:27:05.528222] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:27:05.528664] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-25T20:27:06.579133] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T20:27:06.582762] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-25T20:27:07.825857] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T20:27:07.829692] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-25T20:27:09.044706] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-25T20:27:09.049505] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-25T20:27:10.264276] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T20:27:10.270023] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-25T20:27:11.406119] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T20:27:11.410729] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-25T20:27:12.530034] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T20:27:12.533999] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-25T20:27:13.771314] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T20:27:13.776395] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-25T20:27:14.949583] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T20:27:14.956355] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-25T20:27:16.122315] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T20:27:16.129124] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-25T20:27:17.365055] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T20:27:17.369346] [INFO ] [REMOTE ] CTS: Full fetch complete (27407 records). [2025-10-25T20:27:17.369493] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-25T20:27:17.747993] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-25T20:27:17.748128] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-25T20:27:17.748689] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-25T20:27:17.748779] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-25T20:27:17.749518] [DEBUG] [LOCAL ] CTS: Trimmed 27407 records to 19809 (keeping 200 days of data) [2025-10-25T20:27:17.863579] [DEBUG] [LOCAL ] CTS: Primary data saved (19809 records). [2025-10-25T20:27:17.863781] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-25T20:27:17.863953] [INFO ] [MAIN ] Update Progress: 553/2366 symbols. CTS took 12.9s. Estimated remaining time: 4h 53m 25s [2025-10-25T20:27:18.035561] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:27:18.035821] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-25T20:27:18.035896] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-25T20:27:18.036010] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-25T20:27:18.036085] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-25T20:27:18.036191] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-25T20:27:18.036270] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-25T20:27:18.402732] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:27:18.403103] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-25T20:27:20.372220] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T20:27:20.382695] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-25T20:27:22.214149] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T20:27:22.224330] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-25T20:27:24.289185] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T20:27:24.302282] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-25T20:27:25.351232] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T20:27:25.362100] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-25T20:27:26.279325] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T20:27:26.291169] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-25T20:27:27.194105] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T20:27:27.205028] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-25T20:27:28.184230] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T20:27:28.196234] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-25T20:27:29.368399] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T20:27:29.379549] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-25T20:27:30.420909] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T20:27:30.432758] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-25T20:27:31.452454] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T20:27:31.463203] [INFO ] [REMOTE ] CTVA: Full fetch complete (77234 records). [2025-10-25T20:27:31.463405] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-25T20:27:31.899159] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-25T20:27:31.899328] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-25T20:27:31.900568] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-25T20:27:31.900691] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-25T20:27:31.902917] [DEBUG] [LOCAL ] CTVA: Trimmed 77234 records to 54078 (keeping 200 days of data) [2025-10-25T20:27:32.253967] [DEBUG] [LOCAL ] CTVA: Primary data saved (54078 records). [2025-10-25T20:27:32.254184] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-25T20:27:32.254328] [INFO ] [MAIN ] Update Progress: 554/2366 symbols. CTVA took 14.4s. Estimated remaining time: 4h 53m 31s [2025-10-25T20:27:32.420131] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:27:32.420319] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-25T20:27:32.420412] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-25T20:27:32.420528] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-25T20:27:32.420601] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-25T20:27:32.420709] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-25T20:27:32.420781] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-25T20:27:32.765398] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:27:32.765766] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-25T20:27:33.274564] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-25T20:27:33.275439] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-25T20:27:33.784173] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-25T20:27:33.785111] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-25T20:27:34.247712] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T20:27:34.248814] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-25T20:27:34.692714] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-25T20:27:34.693702] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-25T20:27:35.197366] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-25T20:27:35.198365] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-25T20:27:35.561197] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-25T20:27:35.562229] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-25T20:27:36.004240] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-25T20:27:36.005202] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-25T20:27:36.438753] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-25T20:27:36.439778] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-25T20:27:36.952343] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-25T20:27:36.953309] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-25T20:27:37.374026] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-25T20:27:37.375077] [INFO ] [REMOTE ] CUBB: Full fetch complete (956 records). [2025-10-25T20:27:37.375181] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-25T20:27:37.571580] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-25T20:27:37.571817] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:27:37.571887] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:27:37.571961] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-25T20:27:37.572063] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-25T20:27:37.572136] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-25T20:27:37.572215] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-25T20:27:37.572323] [INFO ] [MAIN ] Update Progress: 555/2366 symbols. CUBB took 5.3s. Estimated remaining time: 4h 53m 6s [2025-10-25T20:27:37.739185] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:27:37.739348] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-10-25T20:27:37.739433] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-10-25T20:27:37.739566] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-25T20:27:37.739639] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-25T20:27:37.739746] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-25T20:27:37.739814] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-25T20:27:38.091794] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:27:38.092189] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-25T20:27:39.885627] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T20:27:39.895605] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-25T20:27:41.455120] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T20:27:41.464609] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-25T20:27:43.406201] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T20:27:43.417342] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-25T20:27:44.489077] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T20:27:44.505156] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-25T20:27:45.409215] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T20:27:45.420330] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-25T20:27:46.376758] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:27:46.387028] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-25T20:27:47.279085] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T20:27:47.290697] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-25T20:27:48.380527] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T20:27:48.391245] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-25T20:27:49.354863] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:27:49.365724] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-25T20:27:50.371243] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T20:27:50.380698] [INFO ] [REMOTE ] CUBE: Full fetch complete (73333 records). [2025-10-25T20:27:50.380900] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-25T20:27:50.773405] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-25T20:27:50.773547] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-25T20:27:50.774391] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-25T20:27:50.774474] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-25T20:27:50.775955] [DEBUG] [LOCAL ] CUBE: Trimmed 73333 records to 51622 (keeping 200 days of data) [2025-10-25T20:27:51.079059] [DEBUG] [LOCAL ] CUBE: Primary data saved (51622 records). [2025-10-25T20:27:51.079250] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-25T20:27:51.079379] [INFO ] [MAIN ] Update Progress: 556/2366 symbols. CUBE took 13.5s. Estimated remaining time: 4h 53m 9s [2025-10-25T20:27:51.246060] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:27:51.246293] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-10-25T20:27:51.246368] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-10-25T20:27:51.246482] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-25T20:27:51.246554] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-25T20:27:51.246684] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-25T20:27:51.246754] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-25T20:27:51.600154] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:27:51.600520] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-25T20:27:52.955104] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T20:27:52.961291] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-25T20:27:54.114377] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T20:27:54.119186] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-25T20:27:55.322510] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T20:27:55.328265] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-25T20:27:56.724273] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T20:27:56.731579] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-25T20:27:57.868583] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T20:27:57.873637] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-25T20:27:59.142847] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T20:27:59.148367] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-25T20:28:00.751890] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T20:28:00.759308] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-25T20:28:02.059282] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T20:28:02.067988] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-25T20:28:03.604477] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T20:28:03.611192] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-25T20:28:04.844337] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T20:28:04.850143] [INFO ] [REMOTE ] CUBI: Full fetch complete (39197 records). [2025-10-25T20:28:04.850296] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-25T20:28:05.256443] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-25T20:28:05.256587] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-25T20:28:05.257175] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-25T20:28:05.257258] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-25T20:28:05.258380] [DEBUG] [LOCAL ] CUBI: Trimmed 39197 records to 27498 (keeping 200 days of data) [2025-10-25T20:28:05.409148] [DEBUG] [LOCAL ] CUBI: Primary data saved (27498 records). [2025-10-25T20:28:05.409310] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-25T20:28:05.409438] [INFO ] [MAIN ] Update Progress: 557/2366 symbols. CUBI took 14.3s. Estimated remaining time: 4h 53m 14s [2025-10-25T20:28:05.576498] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:28:05.576806] [DEBUG] [LOCAL ] CUK: No existing data file found in primary storage. [2025-10-25T20:28:05.576882] [WARN ] [MAIN ] CUK: No existing data found, performing full refresh instead. [2025-10-25T20:28:05.577017] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-25T20:28:05.577108] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-25T20:28:05.577217] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-10-25T20:28:05.577322] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-25T20:28:05.926417] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:28:05.926800] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-25T20:28:07.901616] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-25T20:28:07.911917] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-25T20:28:09.589508] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T20:28:09.599627] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-25T20:28:11.547353] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T20:28:11.558177] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-25T20:28:12.629126] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T20:28:12.640427] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-25T20:28:13.595740] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T20:28:13.606193] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-25T20:28:14.496535] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T20:28:14.506915] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-25T20:28:15.846743] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T20:28:15.858340] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-25T20:28:17.157483] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T20:28:17.168119] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-25T20:28:18.036959] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T20:28:18.047895] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-25T20:28:18.939890] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T20:28:18.949410] [INFO ] [REMOTE ] CUK: Full fetch complete (74393 records). [2025-10-25T20:28:18.949581] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-25T20:28:19.340303] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-25T20:28:19.340487] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-25T20:28:19.341298] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-25T20:28:19.341379] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-25T20:28:19.342748] [DEBUG] [LOCAL ] CUK: Trimmed 74393 records to 51820 (keeping 200 days of data) [2025-10-25T20:28:19.635022] [DEBUG] [LOCAL ] CUK: Primary data saved (51820 records). [2025-10-25T20:28:19.635186] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-25T20:28:19.635311] [INFO ] [MAIN ] Update Progress: 558/2366 symbols. CUK took 14.2s. Estimated remaining time: 4h 53m 19s [2025-10-25T20:28:19.803598] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:28:19.803862] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-25T20:28:19.803934] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-25T20:28:19.804048] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-25T20:28:19.804119] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-25T20:28:19.804200] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-25T20:28:19.804270] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-25T20:28:20.159165] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:28:20.159504] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-25T20:28:20.928065] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-25T20:28:20.929539] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-25T20:28:21.640133] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T20:28:21.641390] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-25T20:28:22.383433] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-25T20:28:22.385171] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-25T20:28:23.180760] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-25T20:28:23.182401] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-25T20:28:23.820742] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-25T20:28:23.822132] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-25T20:28:24.477135] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-25T20:28:24.478620] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-25T20:28:25.134533] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-25T20:28:25.135951] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-25T20:28:25.693328] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-25T20:28:25.695113] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-25T20:28:26.396214] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T20:28:26.397866] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-25T20:28:26.961223] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T20:28:26.962283] [INFO ] [REMOTE ] CULP: Full fetch complete (4454 records). [2025-10-25T20:28:26.962390] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-25T20:28:27.314787] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-25T20:28:27.314921] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-25T20:28:27.315106] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-25T20:28:27.315179] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-25T20:28:27.315567] [DEBUG] [LOCAL ] CULP: Trimmed 4454 records to 2867 (keeping 200 days of data) [2025-10-25T20:28:27.331076] [DEBUG] [LOCAL ] CULP: Primary data saved (2867 records). [2025-10-25T20:28:27.331158] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-25T20:28:27.331268] [INFO ] [MAIN ] Update Progress: 559/2366 symbols. CULP took 7.7s. Estimated remaining time: 4h 53m 3s [2025-10-25T20:28:27.496449] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:28:27.496691] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-25T20:28:27.496752] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-25T20:28:27.496853] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-25T20:28:27.496923] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-25T20:28:27.496982] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-25T20:28:27.497042] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-25T20:28:27.845856] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:28:27.846172] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-25T20:28:29.286229] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T20:28:29.293231] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-25T20:28:30.752164] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T20:28:30.758221] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-25T20:28:32.397810] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T20:28:32.405263] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-25T20:28:34.063295] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T20:28:34.072333] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-25T20:28:35.530724] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T20:28:35.536740] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-25T20:28:37.011203] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T20:28:37.018125] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-25T20:28:38.475996] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T20:28:38.483519] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-25T20:28:39.915405] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T20:28:39.923039] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-25T20:28:41.388331] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T20:28:41.395392] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-25T20:28:43.057994] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-25T20:28:43.065275] [INFO ] [REMOTE ] CURB: Full fetch complete (47646 records). [2025-10-25T20:28:43.065415] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-25T20:28:43.472634] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-25T20:28:43.473147] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-25T20:28:43.474422] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-25T20:28:43.474512] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-25T20:28:43.476358] [DEBUG] [LOCAL ] CURB: Trimmed 47646 records to 33391 (keeping 200 days of data) [2025-10-25T20:28:43.698877] [DEBUG] [LOCAL ] CURB: Primary data saved (33391 records). [2025-10-25T20:28:43.699117] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-25T20:28:43.699282] [INFO ] [MAIN ] Update Progress: 560/2366 symbols. CURB took 16.4s. Estimated remaining time: 4h 53m 15s [2025-10-25T20:28:43.879172] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:28:43.879411] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-25T20:28:43.879486] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-25T20:28:43.879610] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-25T20:28:43.879709] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-25T20:28:43.879795] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-25T20:28:43.879871] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-25T20:28:44.262175] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:28:44.262611] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-25T20:28:45.438825] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T20:28:45.444611] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-25T20:28:46.671998] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T20:28:46.677283] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-25T20:28:47.881341] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T20:28:47.889471] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-25T20:28:48.949163] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:28:48.954233] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-25T20:28:49.989878] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T20:28:49.994226] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-25T20:28:51.150888] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T20:28:51.159027] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-25T20:28:52.725632] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T20:28:52.733860] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-25T20:28:54.128790] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T20:28:54.135470] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-25T20:28:55.553942] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T20:28:55.561587] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-25T20:28:57.039226] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-25T20:28:57.045409] [INFO ] [REMOTE ] CURV: Full fetch complete (38966 records). [2025-10-25T20:28:57.045556] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-25T20:28:57.415522] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-25T20:28:57.415672] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-25T20:28:57.416242] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-25T20:28:57.416321] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-25T20:28:57.417352] [DEBUG] [LOCAL ] CURV: Trimmed 38966 records to 27627 (keeping 200 days of data) [2025-10-25T20:28:57.564389] [DEBUG] [LOCAL ] CURV: Primary data saved (27627 records). [2025-10-25T20:28:57.564548] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-25T20:28:57.564690] [INFO ] [MAIN ] Update Progress: 561/2366 symbols. CURV took 13.9s. Estimated remaining time: 4h 53m 18s [2025-10-25T20:28:57.732213] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:28:57.732428] [DEBUG] [LOCAL ] CUZ: No existing data file found in primary storage. [2025-10-25T20:28:57.732498] [WARN ] [MAIN ] CUZ: No existing data found, performing full refresh instead. [2025-10-25T20:28:57.732611] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-25T20:28:57.732700] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-25T20:28:57.732783] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-10-25T20:28:57.732849] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-25T20:28:58.086276] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:28:58.086694] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-25T20:28:59.726683] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T20:28:59.735900] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-25T20:29:01.673196] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T20:29:01.682788] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-25T20:29:03.515682] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T20:29:03.525942] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-25T20:29:04.517343] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T20:29:04.527772] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-25T20:29:05.433709] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T20:29:05.444394] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-25T20:29:06.401162] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:29:06.411171] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-25T20:29:07.359602] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T20:29:07.370558] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-25T20:29:08.069969] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-25T20:29:08.080462] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-25T20:29:09.033835] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:29:09.044507] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-25T20:29:10.006907] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T20:29:10.016619] [INFO ] [REMOTE ] CUZ: Full fetch complete (70765 records). [2025-10-25T20:29:10.016836] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-25T20:29:10.479137] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-25T20:29:10.479286] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-25T20:29:10.480232] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-25T20:29:10.480325] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-25T20:29:10.481907] [DEBUG] [LOCAL ] CUZ: Trimmed 70765 records to 50093 (keeping 200 days of data) [2025-10-25T20:29:10.805558] [DEBUG] [LOCAL ] CUZ: Primary data saved (50093 records). [2025-10-25T20:29:10.805776] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-25T20:29:10.805949] [INFO ] [MAIN ] Update Progress: 562/2366 symbols. CUZ took 13.2s. Estimated remaining time: 4h 53m 20s [2025-10-25T20:29:10.986440] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:29:10.986679] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-25T20:29:10.986752] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-25T20:29:10.986865] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-25T20:29:10.986936] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-25T20:29:10.987017] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-25T20:29:10.987085] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-25T20:29:11.353755] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:29:11.354132] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-25T20:29:13.313023] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-25T20:29:13.324827] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-25T20:29:15.404614] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-25T20:29:15.414852] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-25T20:29:17.469614] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-25T20:29:17.483688] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-25T20:29:19.356748] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-25T20:29:19.368026] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-25T20:29:21.390570] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-25T20:29:21.402020] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-25T20:29:23.245180] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-25T20:29:23.255939] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-25T20:29:25.203952] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-25T20:29:25.215533] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-25T20:29:27.256134] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-25T20:29:27.267400] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-25T20:29:29.148020] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-25T20:29:29.159742] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-25T20:29:31.145127] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-25T20:29:31.154872] [INFO ] [REMOTE ] CVE: Full fetch complete (77718 records). [2025-10-25T20:29:31.155030] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-25T20:29:31.545110] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-25T20:29:31.545257] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-25T20:29:31.546167] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-25T20:29:31.546268] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-25T20:29:31.547774] [DEBUG] [LOCAL ] CVE: Trimmed 77718 records to 54346 (keeping 200 days of data) [2025-10-25T20:29:31.870814] [DEBUG] [LOCAL ] CVE: Primary data saved (54346 records). [2025-10-25T20:29:31.871006] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-25T20:29:31.871142] [INFO ] [MAIN ] Update Progress: 563/2366 symbols. CVE took 21.1s. Estimated remaining time: 4h 53m 46s [2025-10-25T20:29:32.039196] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:29:32.039423] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-25T20:29:32.039494] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-25T20:29:32.039607] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-25T20:29:32.039698] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-25T20:29:32.039780] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-25T20:29:32.039850] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-25T20:29:32.398158] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:29:32.398582] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-25T20:29:33.310617] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T20:29:33.312999] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-25T20:29:34.305397] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T20:29:34.308419] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-25T20:29:35.373235] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T20:29:35.377062] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-25T20:29:36.414638] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T20:29:36.418242] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-25T20:29:37.662839] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T20:29:37.667554] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-25T20:29:38.803950] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T20:29:38.809766] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-25T20:29:39.710555] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T20:29:39.714595] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-25T20:29:40.793688] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T20:29:40.797302] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-25T20:29:41.795812] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:29:41.799951] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-25T20:29:42.712557] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:29:42.715956] [INFO ] [REMOTE ] CVEO: Full fetch complete (20959 records). [2025-10-25T20:29:42.716074] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-25T20:29:43.080199] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-25T20:29:43.080335] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-25T20:29:43.080797] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-25T20:29:43.080915] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-25T20:29:43.081523] [DEBUG] [LOCAL ] CVEO: Trimmed 20959 records to 15335 (keeping 200 days of data) [2025-10-25T20:29:43.168634] [DEBUG] [LOCAL ] CVEO: Primary data saved (15335 records). [2025-10-25T20:29:43.168911] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-25T20:29:43.169059] [INFO ] [MAIN ] Update Progress: 564/2366 symbols. CVEO took 11.3s. Estimated remaining time: 4h 53m 41s [2025-10-25T20:29:43.334592] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:29:43.334813] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-25T20:29:43.334887] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-25T20:29:43.334995] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-25T20:29:43.335071] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-25T20:29:43.335151] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-25T20:29:43.335218] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-25T20:29:43.682951] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:29:43.683277] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-25T20:29:45.427471] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T20:29:45.436535] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-25T20:29:47.025129] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T20:29:47.033624] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-25T20:29:48.834840] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T20:29:48.844884] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-25T20:29:50.730694] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-25T20:29:50.744194] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-25T20:29:52.542069] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T20:29:52.551896] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-25T20:29:54.316697] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T20:29:54.326388] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-25T20:29:56.054357] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T20:29:56.064873] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-25T20:29:57.690892] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T20:29:57.701402] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-25T20:29:59.531821] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-25T20:29:59.542447] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-25T20:30:01.202783] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-25T20:30:01.212471] [INFO ] [REMOTE ] CVI: Full fetch complete (67214 records). [2025-10-25T20:30:01.212699] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-25T20:30:01.651858] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-25T20:30:01.652008] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-25T20:30:01.652878] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-25T20:30:01.652967] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-25T20:30:01.654423] [DEBUG] [LOCAL ] CVI: Trimmed 67214 records to 47376 (keeping 200 days of data) [2025-10-25T20:30:01.928503] [DEBUG] [LOCAL ] CVI: Primary data saved (47376 records). [2025-10-25T20:30:01.928736] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-25T20:30:01.928910] [INFO ] [MAIN ] Update Progress: 565/2366 symbols. CVI took 18.8s. Estimated remaining time: 4h 53m 60s [2025-10-25T20:30:02.117104] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:30:02.117356] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-25T20:30:02.117428] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-25T20:30:02.117540] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-25T20:30:02.117609] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-25T20:30:02.117722] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-25T20:30:02.117803] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-25T20:30:02.493779] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:30:02.494147] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-25T20:30:03.925165] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T20:30:03.928933] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-25T20:30:05.152393] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T20:30:05.155167] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-25T20:30:06.183530] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T20:30:06.186842] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-25T20:30:07.568846] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T20:30:07.574157] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-25T20:30:08.660157] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T20:30:08.664752] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-25T20:30:09.866533] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T20:30:09.870907] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-25T20:30:10.879188] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T20:30:10.883049] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-25T20:30:11.834700] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T20:30:11.838155] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-25T20:30:12.797549] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:30:12.801140] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-25T20:30:13.751221] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T20:30:13.754172] [INFO ] [REMOTE ] CVLG: Full fetch complete (21357 records). [2025-10-25T20:30:13.754282] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-25T20:30:14.135188] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-25T20:30:14.135320] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-25T20:30:14.135749] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-25T20:30:14.135827] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-25T20:30:14.136418] [DEBUG] [LOCAL ] CVLG: Trimmed 21357 records to 15515 (keeping 200 days of data) [2025-10-25T20:30:14.227427] [DEBUG] [LOCAL ] CVLG: Primary data saved (15515 records). [2025-10-25T20:30:14.227607] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-25T20:30:14.227757] [INFO ] [MAIN ] Update Progress: 566/2366 symbols. CVLG took 12.3s. Estimated remaining time: 4h 53m 58s [2025-10-25T20:30:14.403610] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:30:14.403839] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-25T20:30:14.403911] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-25T20:30:14.404024] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-25T20:30:14.404096] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-25T20:30:14.404178] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-25T20:30:14.404248] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-25T20:30:14.775210] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:30:14.775568] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-25T20:30:16.871340] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-25T20:30:16.884824] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-25T20:30:18.735159] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-25T20:30:18.745188] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-25T20:30:20.830425] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-25T20:30:20.842664] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-25T20:30:21.906103] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:30:21.917993] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-25T20:30:23.025977] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T20:30:23.037233] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-25T20:30:23.988043] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:30:23.998921] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-25T20:30:25.117598] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T20:30:25.129689] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-25T20:30:26.068162] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:30:26.079577] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-25T20:30:27.043423] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:30:27.054554] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-25T20:30:28.052583] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T20:30:28.062397] [INFO ] [REMOTE ] CVNA: Full fetch complete (76728 records). [2025-10-25T20:30:28.062607] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-25T20:30:28.473025] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-25T20:30:28.473209] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-25T20:30:28.474235] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-25T20:30:28.474335] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-25T20:30:28.475941] [DEBUG] [LOCAL ] CVNA: Trimmed 76728 records to 53603 (keeping 200 days of data) [2025-10-25T20:30:28.787577] [DEBUG] [LOCAL ] CVNA: Primary data saved (53603 records). [2025-10-25T20:30:28.787807] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-25T20:30:28.787952] [INFO ] [MAIN ] Update Progress: 567/2366 symbols. CVNA took 14.6s. Estimated remaining time: 4h 54m 3s [2025-10-25T20:30:28.954977] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:30:28.955194] [DEBUG] [LOCAL ] CVS: No existing data file found in primary storage. [2025-10-25T20:30:28.955266] [WARN ] [MAIN ] CVS: No existing data found, performing full refresh instead. [2025-10-25T20:30:28.955374] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-25T20:30:28.955446] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-25T20:30:28.955526] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-10-25T20:30:28.955600] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-25T20:30:29.312973] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:30:29.313331] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-25T20:30:31.635475] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-25T20:30:31.652800] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-25T20:30:35.052615] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-10-25T20:30:35.062809] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-25T20:30:37.108999] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-25T20:30:37.120212] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-25T20:30:38.239089] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T20:30:38.250543] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-25T20:30:39.170281] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T20:30:39.181367] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-25T20:30:40.173765] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T20:30:40.184992] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-25T20:30:41.220030] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:30:41.231872] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-25T20:30:42.331245] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T20:30:42.342779] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-25T20:30:43.487314] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T20:30:43.499379] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-25T20:30:44.378372] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T20:30:44.388522] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-25T20:30:44.388760] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-25T20:30:44.783115] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-25T20:30:44.783246] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-25T20:30:44.784200] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-25T20:30:44.784292] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-25T20:30:44.785852] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54474 (keeping 200 days of data) [2025-10-25T20:30:45.112875] [DEBUG] [LOCAL ] CVS: Primary data saved (54474 records). [2025-10-25T20:30:45.113076] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-25T20:30:45.113255] [INFO ] [MAIN ] Update Progress: 568/2366 symbols. CVS took 16.3s. Estimated remaining time: 4h 54m 14s [2025-10-25T20:30:45.279379] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:30:45.279690] [DEBUG] [LOCAL ] CVX: No existing data file found in primary storage. [2025-10-25T20:30:45.279793] [WARN ] [MAIN ] CVX: No existing data found, performing full refresh instead. [2025-10-25T20:30:45.279937] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-25T20:30:45.280020] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-25T20:30:45.280128] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-25T20:30:45.280207] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-25T20:30:45.626027] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:30:45.626465] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-25T20:30:47.970698] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-25T20:30:47.981222] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-25T20:30:50.239401] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-25T20:30:50.249303] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-25T20:30:52.727094] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-25T20:30:52.738151] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-25T20:30:53.938465] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T20:30:53.950025] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-25T20:30:54.835233] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:30:54.846299] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-25T20:30:55.786769] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T20:30:55.797485] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-25T20:30:56.837951] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:30:56.849886] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-25T20:30:57.916854] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T20:30:57.928685] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-25T20:30:59.066328] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T20:30:59.077708] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-25T20:30:59.997693] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:31:00.008534] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-25T20:31:00.008794] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-25T20:31:00.407309] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-25T20:31:00.407444] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-25T20:31:00.408323] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-25T20:31:00.408426] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-25T20:31:00.410019] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 54540 (keeping 200 days of data) [2025-10-25T20:31:00.740693] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-10-25T20:31:00.740868] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-25T20:31:00.741009] [INFO ] [MAIN ] Update Progress: 569/2366 symbols. CVX took 15.6s. Estimated remaining time: 4h 54m 23s [2025-10-25T20:31:00.916820] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:31:00.917045] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-10-25T20:31:00.917117] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-10-25T20:31:00.917234] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-25T20:31:00.917305] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-25T20:31:00.917367] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-25T20:31:00.917438] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-25T20:31:01.276558] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:31:01.276924] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-25T20:31:02.716963] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T20:31:02.724004] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-25T20:31:04.111380] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T20:31:04.117166] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-25T20:31:05.518145] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T20:31:05.524615] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-25T20:31:06.776909] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T20:31:06.784325] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-25T20:31:08.242167] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T20:31:08.248226] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-25T20:31:09.583958] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T20:31:09.589605] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-25T20:31:10.806527] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T20:31:10.811598] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-25T20:31:12.109407] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T20:31:12.115011] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-25T20:31:13.304055] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T20:31:13.309047] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-25T20:31:14.540631] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T20:31:14.545030] [INFO ] [REMOTE ] CW: Full fetch complete (32859 records). [2025-10-25T20:31:14.545158] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-25T20:31:14.938382] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-25T20:31:14.938548] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-25T20:31:14.939677] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-25T20:31:14.939770] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-25T20:31:14.941483] [DEBUG] [LOCAL ] CW: Trimmed 32859 records to 22175 (keeping 200 days of data) [2025-10-25T20:31:15.083890] [DEBUG] [LOCAL ] CW: Primary data saved (22175 records). [2025-10-25T20:31:15.084129] [INFO ] [MAIN ] CW: Full history saved. [2025-10-25T20:31:15.084276] [INFO ] [MAIN ] Update Progress: 570/2366 symbols. CW took 14.3s. Estimated remaining time: 4h 54m 27s [2025-10-25T20:31:15.255775] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:31:15.256015] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-10-25T20:31:15.256113] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-10-25T20:31:15.256245] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-25T20:31:15.256318] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-25T20:31:15.256401] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-25T20:31:15.256472] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-25T20:31:15.616322] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:31:15.616724] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-25T20:31:17.446121] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T20:31:17.456010] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-25T20:31:19.132925] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T20:31:19.151973] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-25T20:31:20.836795] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T20:31:20.847540] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-25T20:31:21.899321] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T20:31:21.910187] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-25T20:31:22.761187] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T20:31:22.772073] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-25T20:31:23.661515] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T20:31:23.672255] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-25T20:31:24.697341] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T20:31:24.709750] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-25T20:31:25.703237] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T20:31:25.719415] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-25T20:31:26.769916] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T20:31:26.781622] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-25T20:31:27.689148] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:31:27.698854] [INFO ] [REMOTE ] CWAN: Full fetch complete (75624 records). [2025-10-25T20:31:27.699008] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-25T20:31:28.086348] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-25T20:31:28.086500] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-25T20:31:28.087383] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-25T20:31:28.087469] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-25T20:31:28.089041] [DEBUG] [LOCAL ] CWAN: Trimmed 75624 records to 53447 (keeping 200 days of data) [2025-10-25T20:31:28.381587] [DEBUG] [LOCAL ] CWAN: Primary data saved (53447 records). [2025-10-25T20:31:28.381773] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-25T20:31:28.381901] [INFO ] [MAIN ] Update Progress: 571/2366 symbols. CWAN took 13.3s. Estimated remaining time: 4h 54m 28s [2025-10-25T20:31:28.548080] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:31:28.548288] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-25T20:31:28.548361] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-25T20:31:28.548472] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-25T20:31:28.548544] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-25T20:31:28.548667] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-25T20:31:28.548740] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-25T20:31:28.900977] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:31:28.901755] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-25T20:31:30.552241] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T20:31:30.560838] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-25T20:31:32.136785] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T20:31:32.149155] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-25T20:31:33.952126] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T20:31:33.962428] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-25T20:31:34.869073] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T20:31:34.878866] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-25T20:31:35.823455] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T20:31:35.832596] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-25T20:31:36.787287] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:31:36.800056] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-25T20:31:37.711098] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:31:37.721299] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-25T20:31:38.800048] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T20:31:38.809977] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-25T20:31:39.766576] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:31:39.776623] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-25T20:31:40.710456] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:31:40.719442] [INFO ] [REMOTE ] CWEN: Full fetch complete (65674 records). [2025-10-25T20:31:40.719665] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-25T20:31:41.101028] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-25T20:31:41.101148] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-25T20:31:41.101931] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-25T20:31:41.102030] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-25T20:31:41.103310] [DEBUG] [LOCAL ] CWEN: Trimmed 65674 records to 45920 (keeping 200 days of data) [2025-10-25T20:31:41.367310] [DEBUG] [LOCAL ] CWEN: Primary data saved (45920 records). [2025-10-25T20:31:41.367478] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-25T20:31:41.367599] [INFO ] [MAIN ] Update Progress: 572/2366 symbols. CWEN took 13.0s. Estimated remaining time: 4h 54m 28s [2025-10-25T20:31:41.533963] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:31:41.534173] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-25T20:31:41.534243] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-25T20:31:41.534355] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-25T20:31:41.534424] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-25T20:31:41.534503] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-25T20:31:41.534572] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-25T20:31:41.896093] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:31:41.896428] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-25T20:31:43.544487] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T20:31:43.553952] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-25T20:31:45.141412] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T20:31:45.150572] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-25T20:31:47.144016] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T20:31:47.157051] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-25T20:31:48.029398] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T20:31:48.041509] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-25T20:31:48.933794] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:31:48.944753] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-25T20:31:49.990375] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T20:31:50.000931] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-25T20:31:51.006933] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T20:31:51.018183] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-25T20:31:51.997545] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T20:31:52.008494] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-25T20:31:52.936542] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T20:31:52.947570] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-25T20:31:53.861548] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:31:53.870839] [INFO ] [REMOTE ] CWH: Full fetch complete (73237 records). [2025-10-25T20:31:53.871030] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-25T20:31:54.266557] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-25T20:31:54.266702] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-25T20:31:54.267499] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-25T20:31:54.267580] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-25T20:31:54.269252] [DEBUG] [LOCAL ] CWH: Trimmed 73237 records to 52001 (keeping 200 days of data) [2025-10-25T20:31:54.580440] [DEBUG] [LOCAL ] CWH: Primary data saved (52001 records). [2025-10-25T20:31:54.580607] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-25T20:31:54.580757] [INFO ] [MAIN ] Update Progress: 573/2366 symbols. CWH took 13.2s. Estimated remaining time: 4h 54m 29s [2025-10-25T20:31:54.753233] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:31:54.753459] [DEBUG] [LOCAL ] CWK: No existing data file found in primary storage. [2025-10-25T20:31:54.753533] [WARN ] [MAIN ] CWK: No existing data found, performing full refresh instead. [2025-10-25T20:31:54.753668] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-25T20:31:54.753744] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-25T20:31:54.753825] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-25T20:31:54.753896] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-25T20:31:55.108121] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:31:55.108476] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-25T20:31:56.829196] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T20:31:56.838504] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-25T20:31:58.384392] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T20:31:58.393718] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-25T20:31:59.961064] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T20:31:59.971584] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-25T20:32:00.850363] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T20:32:00.861206] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-25T20:32:01.827707] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T20:32:01.838447] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-25T20:32:02.836330] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T20:32:02.845892] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-25T20:32:03.738935] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T20:32:03.749784] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-25T20:32:04.791611] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T20:32:04.802566] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-25T20:32:05.714348] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T20:32:05.725015] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-25T20:32:07.018230] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T20:32:07.027445] [INFO ] [REMOTE ] CWK: Full fetch complete (71419 records). [2025-10-25T20:32:07.027680] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-25T20:32:07.421275] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-25T20:32:07.421425] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-25T20:32:07.422347] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-25T20:32:07.422449] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-25T20:32:07.424048] [DEBUG] [LOCAL ] CWK: Trimmed 71419 records to 50403 (keeping 200 days of data) [2025-10-25T20:32:07.710271] [DEBUG] [LOCAL ] CWK: Primary data saved (50403 records). [2025-10-25T20:32:07.710446] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-25T20:32:07.710615] [INFO ] [MAIN ] Update Progress: 574/2366 symbols. CWK took 13.1s. Estimated remaining time: 4h 54m 29s [2025-10-25T20:32:07.880635] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:32:07.880869] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-25T20:32:07.880957] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-25T20:32:07.881120] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-25T20:32:07.881204] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-25T20:32:07.881311] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-25T20:32:07.881390] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-25T20:32:08.259957] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:32:08.260336] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-25T20:32:09.649705] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T20:32:09.655850] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-25T20:32:11.067712] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-25T20:32:11.074171] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-25T20:32:12.533732] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T20:32:12.543479] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-25T20:32:14.036112] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T20:32:14.043348] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-25T20:32:15.383724] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T20:32:15.390330] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-25T20:32:16.768289] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T20:32:16.774810] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-25T20:32:18.004571] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T20:32:18.010817] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-25T20:32:19.304212] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T20:32:19.310279] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-25T20:32:20.633992] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T20:32:20.640074] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-25T20:32:21.945096] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-25T20:32:21.950604] [INFO ] [REMOTE ] CWT: Full fetch complete (41357 records). [2025-10-25T20:32:21.950738] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-25T20:32:22.315600] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-25T20:32:22.315737] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-25T20:32:22.316274] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-25T20:32:22.316354] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-25T20:32:22.317212] [DEBUG] [LOCAL ] CWT: Trimmed 41357 records to 28471 (keeping 200 days of data) [2025-10-25T20:32:22.482393] [DEBUG] [LOCAL ] CWT: Primary data saved (28471 records). [2025-10-25T20:32:22.482575] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-25T20:32:22.482732] [INFO ] [MAIN ] Update Progress: 575/2366 symbols. CWT took 14.8s. Estimated remaining time: 4h 54m 35s [2025-10-25T20:32:22.648341] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:32:22.648558] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-10-25T20:32:22.648630] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-10-25T20:32:22.648766] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-25T20:32:22.648835] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-25T20:32:22.648917] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-25T20:32:22.648988] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-25T20:32:23.004627] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:32:23.005034] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-25T20:32:24.872140] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T20:32:24.882577] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-25T20:32:26.541383] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T20:32:26.551839] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-25T20:32:28.351164] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T20:32:28.363879] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-25T20:32:29.432491] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T20:32:29.446062] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-25T20:32:30.430429] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T20:32:30.441750] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-25T20:32:31.426433] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T20:32:31.436870] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-25T20:32:32.401031] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T20:32:32.412496] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-25T20:32:33.357476] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:32:33.368907] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-25T20:32:34.361560] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T20:32:34.372960] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-25T20:32:35.225431] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T20:32:35.234924] [INFO ] [REMOTE ] CX: Full fetch complete (76573 records). [2025-10-25T20:32:35.235085] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-25T20:32:35.645382] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-25T20:32:35.645527] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-25T20:32:35.646435] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-25T20:32:35.646523] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-25T20:32:35.648638] [DEBUG] [LOCAL ] CX: Trimmed 76573 records to 53576 (keeping 200 days of data) [2025-10-25T20:32:35.978367] [DEBUG] [LOCAL ] CX: Primary data saved (53576 records). [2025-10-25T20:32:35.978546] [INFO ] [MAIN ] CX: Full history saved. [2025-10-25T20:32:35.978697] [INFO ] [MAIN ] Update Progress: 576/2366 symbols. CX took 13.5s. Estimated remaining time: 4h 54m 36s [2025-10-25T20:32:36.180238] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:32:36.180468] [DEBUG] [LOCAL ] CXE: No existing data file found in primary storage. [2025-10-25T20:32:36.180542] [WARN ] [MAIN ] CXE: No existing data found, performing full refresh instead. [2025-10-25T20:32:36.180685] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-25T20:32:36.180762] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-25T20:32:36.180843] [DEBUG] [LOCAL ] CXE: No primary data file found to delete. [2025-10-25T20:32:36.180915] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-25T20:32:36.563928] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:32:36.564310] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-25T20:32:37.592009] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T20:32:37.594849] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-25T20:32:38.459293] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T20:32:38.462263] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-25T20:32:39.373048] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-25T20:32:39.376490] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-25T20:32:40.102876] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T20:32:40.104877] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-25T20:32:40.927352] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T20:32:40.929676] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-25T20:32:41.657011] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T20:32:41.659586] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-25T20:32:42.396991] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T20:32:42.399107] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-25T20:32:43.081863] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-25T20:32:43.083750] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-25T20:32:43.971016] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-25T20:32:43.973449] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-25T20:32:44.668667] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T20:32:44.670471] [INFO ] [REMOTE ] CXE: Full fetch complete (11140 records). [2025-10-25T20:32:44.670576] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-25T20:32:45.030679] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-25T20:32:45.030799] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-25T20:32:45.031075] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-25T20:32:45.031149] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-25T20:32:45.031665] [DEBUG] [LOCAL ] CXE: Trimmed 11140 records to 6478 (keeping 200 days of data) [2025-10-25T20:32:45.067323] [DEBUG] [LOCAL ] CXE: Primary data saved (6478 records). [2025-10-25T20:32:45.067420] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-25T20:32:45.067522] [INFO ] [MAIN ] Update Progress: 577/2366 symbols. CXE took 9.1s. Estimated remaining time: 4h 54m 24s [2025-10-25T20:32:45.234800] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:32:45.235022] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-10-25T20:32:45.235093] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-10-25T20:32:45.235207] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-25T20:32:45.235276] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-25T20:32:45.235355] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-25T20:32:45.235425] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-25T20:32:45.601286] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:32:45.601819] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-25T20:32:46.187692] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-25T20:32:46.188890] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-25T20:32:46.765285] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T20:32:46.766476] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-25T20:32:47.325460] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-25T20:32:47.326610] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-25T20:32:47.953196] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-25T20:32:47.954693] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-25T20:32:48.603897] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-25T20:32:48.605445] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-25T20:32:49.370702] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T20:32:49.372199] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-25T20:32:50.244625] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T20:32:50.247208] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-25T20:32:50.932400] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-25T20:32:50.934393] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-25T20:32:51.682985] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T20:32:51.685149] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-25T20:32:52.204469] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-25T20:32:52.205413] [INFO ] [REMOTE ] CXH: Full fetch complete (5300 records). [2025-10-25T20:32:52.205506] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-25T20:32:52.555560] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-25T20:32:52.555705] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-25T20:32:52.555917] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-25T20:32:52.556001] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-25T20:32:52.556399] [DEBUG] [LOCAL ] CXH: Trimmed 5300 records to 4406 (keeping 200 days of data) [2025-10-25T20:32:52.582187] [DEBUG] [LOCAL ] CXH: Primary data saved (4406 records). [2025-10-25T20:32:52.582366] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-25T20:32:52.582494] [INFO ] [MAIN ] Update Progress: 578/2366 symbols. CXH took 7.5s. Estimated remaining time: 4h 54m 7s [2025-10-25T20:32:52.752687] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:32:52.752908] [DEBUG] [LOCAL ] CXM: No existing data file found in primary storage. [2025-10-25T20:32:52.753006] [WARN ] [MAIN ] CXM: No existing data found, performing full refresh instead. [2025-10-25T20:32:52.753151] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-25T20:32:52.753246] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-25T20:32:52.753358] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-10-25T20:32:52.753451] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-25T20:32:53.098941] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:32:53.099300] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-25T20:32:54.617804] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T20:32:54.626980] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-25T20:32:56.177897] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T20:32:56.186689] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-25T20:32:57.957518] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T20:32:57.967983] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-25T20:32:58.790052] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T20:32:58.805755] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-25T20:33:00.012835] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T20:33:00.022944] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-25T20:33:00.917814] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T20:33:00.927828] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-25T20:33:02.464317] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T20:33:02.475473] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-25T20:33:03.332773] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T20:33:03.342791] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-25T20:33:04.272184] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T20:33:04.282313] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-25T20:33:05.524084] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T20:33:05.532285] [INFO ] [REMOTE ] CXM: Full fetch complete (68440 records). [2025-10-25T20:33:05.532430] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-25T20:33:05.913737] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-25T20:33:05.913863] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-25T20:33:05.914629] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-25T20:33:05.914727] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-25T20:33:05.916047] [DEBUG] [LOCAL ] CXM: Trimmed 68440 records to 47965 (keeping 200 days of data) [2025-10-25T20:33:06.181829] [DEBUG] [LOCAL ] CXM: Primary data saved (47965 records). [2025-10-25T20:33:06.182082] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-25T20:33:06.182211] [INFO ] [MAIN ] Update Progress: 579/2366 symbols. CXM took 13.6s. Estimated remaining time: 4h 54m 8s [2025-10-25T20:33:06.350353] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:33:06.350551] [DEBUG] [LOCAL ] CXT: No existing data file found in primary storage. [2025-10-25T20:33:06.350621] [WARN ] [MAIN ] CXT: No existing data found, performing full refresh instead. [2025-10-25T20:33:06.350764] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-25T20:33:06.350834] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-25T20:33:06.350912] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-25T20:33:06.350978] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-25T20:33:06.705424] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:33:06.705792] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-25T20:33:08.074941] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T20:33:08.081755] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-25T20:33:09.515159] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T20:33:09.521930] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-25T20:33:11.013627] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T20:33:11.020958] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-25T20:33:12.445513] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T20:33:12.452863] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-25T20:33:13.648467] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T20:33:13.654686] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-25T20:33:15.061075] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T20:33:15.067968] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-25T20:33:16.604345] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T20:33:16.611016] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-25T20:33:17.995557] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T20:33:18.002879] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-25T20:33:19.422760] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T20:33:19.430403] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-25T20:33:20.821117] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-25T20:33:20.826858] [INFO ] [REMOTE ] CXT: Full fetch complete (45587 records). [2025-10-25T20:33:20.827017] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-25T20:33:21.212750] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-25T20:33:21.212887] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-25T20:33:21.213472] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-25T20:33:21.213549] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-25T20:33:21.214513] [DEBUG] [LOCAL ] CXT: Trimmed 45587 records to 31071 (keeping 200 days of data) [2025-10-25T20:33:21.405532] [DEBUG] [LOCAL ] CXT: Primary data saved (31071 records). [2025-10-25T20:33:21.405709] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-25T20:33:21.405830] [INFO ] [MAIN ] Update Progress: 580/2366 symbols. CXT took 15.2s. Estimated remaining time: 4h 54m 15s [2025-10-25T20:33:21.571379] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:33:21.571547] [DEBUG] [LOCAL ] CXW: No existing data file found in primary storage. [2025-10-25T20:33:21.571618] [WARN ] [MAIN ] CXW: No existing data found, performing full refresh instead. [2025-10-25T20:33:21.571744] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-25T20:33:21.571815] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-25T20:33:21.571879] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-10-25T20:33:21.571944] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-25T20:33:21.925109] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:33:21.925473] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-25T20:33:23.546591] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T20:33:23.555581] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-25T20:33:25.361013] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T20:33:25.370082] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-25T20:33:27.027613] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T20:33:27.037464] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-25T20:33:28.108111] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T20:33:28.117838] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-25T20:33:29.028228] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T20:33:29.037397] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-25T20:33:30.013296] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T20:33:30.021999] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-25T20:33:30.951534] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T20:33:30.961424] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-25T20:33:31.993197] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T20:33:32.002717] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-25T20:33:33.161962] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T20:33:33.170940] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-25T20:33:33.993175] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T20:33:34.000890] [INFO ] [REMOTE ] CXW: Full fetch complete (64738 records). [2025-10-25T20:33:34.001043] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-25T20:33:34.391530] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-25T20:33:34.391690] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-25T20:33:34.392449] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-25T20:33:34.392552] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-25T20:33:34.393842] [DEBUG] [LOCAL ] CXW: Trimmed 64738 records to 44181 (keeping 200 days of data) [2025-10-25T20:33:34.638453] [DEBUG] [LOCAL ] CXW: Primary data saved (44181 records). [2025-10-25T20:33:34.638626] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-25T20:33:34.638783] [INFO ] [MAIN ] Update Progress: 581/2366 symbols. CXW took 13.2s. Estimated remaining time: 4h 54m 15s [2025-10-25T20:33:34.814271] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:33:34.814524] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-25T20:33:34.814619] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-25T20:33:34.814790] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-25T20:33:34.814879] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-25T20:33:34.814972] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-25T20:33:34.815062] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-25T20:33:35.188974] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:33:35.189405] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-25T20:33:35.928002] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-25T20:33:35.929626] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-25T20:33:37.094138] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T20:33:37.098333] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-25T20:33:38.583398] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T20:33:38.592037] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-25T20:33:40.096793] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T20:33:40.103001] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-25T20:33:41.450571] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-25T20:33:41.455940] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-25T20:33:42.742140] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T20:33:42.748265] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-25T20:33:43.915965] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T20:33:43.924529] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-25T20:33:45.702374] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T20:33:45.708473] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-25T20:33:47.121180] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T20:33:47.128373] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-25T20:33:48.484129] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T20:33:48.490408] [INFO ] [REMOTE ] CYD: Full fetch complete (36377 records). [2025-10-25T20:33:48.490536] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-25T20:33:48.860377] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-25T20:33:48.860496] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-25T20:33:48.861024] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-25T20:33:48.861124] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-25T20:33:48.862013] [DEBUG] [LOCAL ] CYD: Trimmed 36377 records to 27715 (keeping 200 days of data) [2025-10-25T20:33:49.018475] [DEBUG] [LOCAL ] CYD: Primary data saved (27715 records). [2025-10-25T20:33:49.018669] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-25T20:33:49.018798] [INFO ] [MAIN ] Update Progress: 582/2366 symbols. CYD took 14.4s. Estimated remaining time: 4h 54m 19s [2025-10-25T20:33:49.186236] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:33:49.186458] [DEBUG] [LOCAL ] CYH: No existing data file found in primary storage. [2025-10-25T20:33:49.186529] [WARN ] [MAIN ] CYH: No existing data found, performing full refresh instead. [2025-10-25T20:33:49.186613] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-25T20:33:49.186702] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-25T20:33:49.186783] [DEBUG] [LOCAL ] CYH: No primary data file found to delete. [2025-10-25T20:33:49.186852] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-25T20:33:49.540085] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:33:49.540458] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-25T20:33:51.498772] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-25T20:33:51.508189] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-25T20:33:53.239068] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T20:33:53.249085] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-25T20:33:55.222524] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T20:33:55.232503] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-25T20:33:56.283874] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T20:33:56.294697] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-25T20:33:59.410981] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-10-25T20:33:59.421820] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-25T20:34:00.461208] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T20:34:00.470771] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-25T20:34:02.297569] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T20:34:02.308498] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-25T20:34:03.425838] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T20:34:03.436538] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-25T20:34:04.731352] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-25T20:34:04.741334] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-25T20:34:05.821946] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T20:34:05.830733] [INFO ] [REMOTE ] CYH: Full fetch complete (69820 records). [2025-10-25T20:34:05.830915] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-25T20:34:06.225326] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-25T20:34:06.225465] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-25T20:34:06.226345] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-25T20:34:06.226430] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-25T20:34:06.228050] [DEBUG] [LOCAL ] CYH: Trimmed 69820 records to 48377 (keeping 200 days of data) [2025-10-25T20:34:06.490188] [DEBUG] [LOCAL ] CYH: Primary data saved (48377 records). [2025-10-25T20:34:06.490385] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-25T20:34:06.490509] [INFO ] [MAIN ] Update Progress: 583/2366 symbols. CYH took 17.5s. Estimated remaining time: 4h 54m 32s [2025-10-25T20:34:06.662048] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:34:06.662277] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-25T20:34:06.662366] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-25T20:34:06.662515] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-25T20:34:06.662593] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-25T20:34:06.662725] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-25T20:34:06.662806] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-25T20:34:07.023741] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:34:07.024087] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-25T20:34:09.241618] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-25T20:34:09.254193] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-25T20:34:11.050957] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T20:34:11.062015] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-25T20:34:12.967578] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T20:34:12.978923] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-25T20:34:14.274717] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T20:34:14.285946] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-25T20:34:15.615706] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T20:34:15.628325] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-25T20:34:16.586426] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:34:16.597028] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-25T20:34:17.844845] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T20:34:17.856813] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-25T20:34:18.767851] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T20:34:18.779373] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-25T20:34:19.758766] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T20:34:19.770151] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-25T20:34:20.735230] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T20:34:20.744935] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-25T20:34:20.745120] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-25T20:34:21.139384] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-25T20:34:21.139500] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-25T20:34:21.140385] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-25T20:34:21.140464] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-25T20:34:21.141907] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 54429 (keeping 200 days of data) [2025-10-25T20:34:21.461329] [DEBUG] [LOCAL ] D: Primary data saved (54429 records). [2025-10-25T20:34:21.461493] [INFO ] [MAIN ] D: Full history saved. [2025-10-25T20:34:21.461616] [INFO ] [MAIN ] Update Progress: 584/2366 symbols. D took 15.0s. Estimated remaining time: 4h 54m 38s [2025-10-25T20:34:21.634270] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:34:21.634659] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-10-25T20:34:21.634778] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-10-25T20:34:21.634911] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-25T20:34:21.634985] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-25T20:34:21.635046] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-25T20:34:21.635120] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-25T20:34:22.010847] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:34:22.011268] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-25T20:34:23.260777] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T20:34:23.264523] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-25T20:34:24.391438] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T20:34:24.395231] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-25T20:34:25.369285] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T20:34:25.372811] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-25T20:34:26.605002] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T20:34:26.609000] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-25T20:34:27.573809] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T20:34:27.576985] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-25T20:34:28.621044] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T20:34:28.624718] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-25T20:34:29.521696] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T20:34:29.524987] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-25T20:34:30.440514] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T20:34:30.443835] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-25T20:34:31.384630] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T20:34:31.387576] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-25T20:34:32.039930] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T20:34:32.042504] [INFO ] [REMOTE ] DAC: Full fetch complete (19009 records). [2025-10-25T20:34:32.042632] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-25T20:34:32.406855] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-25T20:34:32.406980] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-25T20:34:32.407350] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-25T20:34:32.407421] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-25T20:34:32.408039] [DEBUG] [LOCAL ] DAC: Trimmed 19009 records to 12491 (keeping 200 days of data) [2025-10-25T20:34:32.482395] [DEBUG] [LOCAL ] DAC: Primary data saved (12491 records). [2025-10-25T20:34:32.482581] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-25T20:34:32.482735] [INFO ] [MAIN ] Update Progress: 585/2366 symbols. DAC took 11.0s. Estimated remaining time: 4h 54m 31s [2025-10-25T20:34:32.656544] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:34:32.656803] [DEBUG] [LOCAL ] DAL: No existing data file found in primary storage. [2025-10-25T20:34:32.656875] [WARN ] [MAIN ] DAL: No existing data found, performing full refresh instead. [2025-10-25T20:34:32.656993] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-25T20:34:32.657085] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-25T20:34:32.657168] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-25T20:34:32.657237] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-25T20:34:33.013753] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:34:33.014098] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-25T20:34:35.243585] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-25T20:34:35.254154] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-25T20:34:37.296181] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-25T20:34:37.306280] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-25T20:34:39.332333] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-25T20:34:39.343333] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-25T20:34:40.466834] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T20:34:40.478194] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-25T20:34:41.552132] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T20:34:41.564008] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-25T20:34:42.549114] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T20:34:42.559849] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-25T20:34:43.649090] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T20:34:43.660835] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-25T20:34:44.697402] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T20:34:44.708918] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-25T20:34:45.628275] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T20:34:45.642837] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-25T20:34:46.549332] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:34:46.559130] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-25T20:34:46.559345] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-25T20:34:46.971118] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-25T20:34:46.971243] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-25T20:34:46.972443] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-25T20:34:46.972533] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-25T20:34:46.974129] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54533 (keeping 200 days of data) [2025-10-25T20:34:47.328359] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-25T20:34:47.328552] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-25T20:34:47.328703] [INFO ] [MAIN ] Update Progress: 586/2366 symbols. DAL took 14.8s. Estimated remaining time: 4h 54m 36s [2025-10-25T20:34:47.520213] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:34:47.520420] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-25T20:34:47.520492] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-25T20:34:47.520607] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-25T20:34:47.520700] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-25T20:34:47.520785] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-25T20:34:47.520854] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-25T20:34:47.893603] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:34:47.894009] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-25T20:34:49.663294] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T20:34:49.673185] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-25T20:34:51.428544] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T20:34:51.440781] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-25T20:34:53.045871] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T20:34:53.056009] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-25T20:34:54.022207] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T20:34:54.032630] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-25T20:34:55.375195] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T20:34:55.389838] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-25T20:34:56.422370] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:34:56.432269] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-25T20:34:57.424442] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T20:34:57.435577] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-25T20:34:58.310287] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T20:34:58.320935] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-25T20:34:59.339637] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T20:34:59.350177] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-25T20:35:00.275227] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:35:00.284326] [INFO ] [REMOTE ] DAN: Full fetch complete (71393 records). [2025-10-25T20:35:00.284525] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-25T20:35:00.706546] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-25T20:35:00.706713] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-25T20:35:00.707568] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-25T20:35:00.707685] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-25T20:35:00.709284] [DEBUG] [LOCAL ] DAN: Trimmed 71393 records to 50100 (keeping 200 days of data) [2025-10-25T20:35:01.012985] [DEBUG] [LOCAL ] DAN: Primary data saved (50100 records). [2025-10-25T20:35:01.013162] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-25T20:35:01.013269] [INFO ] [MAIN ] Update Progress: 587/2366 symbols. DAN took 13.7s. Estimated remaining time: 4h 54m 38s [2025-10-25T20:35:01.189772] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:35:01.189984] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-25T20:35:01.190058] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-25T20:35:01.190178] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-25T20:35:01.190249] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-25T20:35:01.190333] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-25T20:35:01.190404] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-25T20:35:01.569480] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:35:01.569870] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-25T20:35:03.747122] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-25T20:35:03.751459] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-25T20:35:06.348697] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-25T20:35:06.355750] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-25T20:35:08.277230] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T20:35:08.288370] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-25T20:35:09.585215] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T20:35:09.594437] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-25T20:35:11.527191] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-25T20:35:11.532254] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-25T20:35:12.594925] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T20:35:12.598925] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-25T20:35:13.639229] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:35:13.643132] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-25T20:35:14.804839] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T20:35:14.810586] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-25T20:35:16.086342] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T20:35:16.091771] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-25T20:35:17.272266] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T20:35:17.276544] [INFO ] [REMOTE ] DAO: Full fetch complete (32635 records). [2025-10-25T20:35:17.276687] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-25T20:35:17.662512] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-25T20:35:17.662627] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-25T20:35:17.663119] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-25T20:35:17.663195] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-25T20:35:17.663960] [DEBUG] [LOCAL ] DAO: Trimmed 32635 records to 20203 (keeping 200 days of data) [2025-10-25T20:35:17.772718] [DEBUG] [LOCAL ] DAO: Primary data saved (20203 records). [2025-10-25T20:35:17.772877] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-25T20:35:17.773001] [INFO ] [MAIN ] Update Progress: 588/2366 symbols. DAO took 16.8s. Estimated remaining time: 4h 54m 49s [2025-10-25T20:35:17.947090] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:35:17.947307] [DEBUG] [LOCAL ] DAR: No existing data file found in primary storage. [2025-10-25T20:35:17.947379] [WARN ] [MAIN ] DAR: No existing data found, performing full refresh instead. [2025-10-25T20:35:17.947476] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-25T20:35:17.947546] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-25T20:35:17.947607] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-10-25T20:35:17.947695] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-25T20:35:18.314222] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:35:18.314584] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-25T20:35:20.024822] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T20:35:20.034499] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-25T20:35:21.855115] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T20:35:21.864881] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-25T20:35:23.511256] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T20:35:23.521952] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-25T20:35:24.611576] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T20:35:24.622677] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-25T20:35:25.628022] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T20:35:25.639506] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-25T20:35:26.571674] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T20:35:26.582484] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-25T20:35:27.620728] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T20:35:27.633542] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-25T20:35:28.522799] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T20:35:28.533696] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-25T20:35:29.714443] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T20:35:29.725802] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-25T20:35:30.634377] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:35:30.644279] [INFO ] [REMOTE ] DAR: Full fetch complete (75154 records). [2025-10-25T20:35:30.644497] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-25T20:35:31.035367] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-25T20:35:31.035498] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-25T20:35:31.036329] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-25T20:35:31.036412] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-25T20:35:31.037943] [DEBUG] [LOCAL ] DAR: Trimmed 75154 records to 52770 (keeping 200 days of data) [2025-10-25T20:35:31.336333] [DEBUG] [LOCAL ] DAR: Primary data saved (52770 records). [2025-10-25T20:35:31.336543] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-25T20:35:31.336678] [INFO ] [MAIN ] Update Progress: 589/2366 symbols. DAR took 13.6s. Estimated remaining time: 4h 54m 49s [2025-10-25T20:35:31.502677] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:35:31.502911] [DEBUG] [LOCAL ] DAVA: No existing data file found in primary storage. [2025-10-25T20:35:31.502983] [WARN ] [MAIN ] DAVA: No existing data found, performing full refresh instead. [2025-10-25T20:35:31.503100] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-25T20:35:31.503170] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-25T20:35:31.503250] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-25T20:35:31.503320] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-25T20:35:31.849614] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:35:31.849979] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-25T20:35:33.387438] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T20:35:33.393533] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-25T20:35:34.885003] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T20:35:34.891766] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-25T20:35:36.226868] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T20:35:36.236467] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-25T20:35:37.849230] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T20:35:37.857180] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-25T20:35:39.524270] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T20:35:39.533367] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-25T20:35:41.054495] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T20:35:41.062987] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-25T20:35:42.680600] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T20:35:42.689018] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-25T20:35:44.452122] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T20:35:44.461223] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-25T20:35:46.349378] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T20:35:46.361434] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-25T20:35:47.947481] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-25T20:35:47.957411] [INFO ] [REMOTE ] DAVA: Full fetch complete (57297 records). [2025-10-25T20:35:47.957595] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-25T20:35:48.335332] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-25T20:35:48.335467] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-25T20:35:48.336278] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-25T20:35:48.336360] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-25T20:35:48.337714] [DEBUG] [LOCAL ] DAVA: Trimmed 57297 records to 42531 (keeping 200 days of data) [2025-10-25T20:35:48.574832] [DEBUG] [LOCAL ] DAVA: Primary data saved (42531 records). [2025-10-25T20:35:48.575015] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-25T20:35:48.575152] [INFO ] [MAIN ] Update Progress: 590/2366 symbols. DAVA took 17.2s. Estimated remaining time: 4h 55m 1s [2025-10-25T20:35:48.740760] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:35:48.740972] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-25T20:35:48.741044] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-25T20:35:48.741157] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-25T20:35:48.741227] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-25T20:35:48.741309] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-25T20:35:48.741379] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-25T20:35:49.088883] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:35:49.089237] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-25T20:35:50.890766] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T20:35:50.902142] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-25T20:35:52.473080] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:35:52.482533] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-25T20:35:54.270847] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T20:35:54.281914] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-25T20:35:55.240773] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T20:35:55.251593] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-25T20:35:56.072817] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T20:35:56.083496] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-25T20:35:56.991020] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T20:35:57.001031] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-25T20:35:57.742068] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T20:35:57.752503] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-25T20:35:58.879107] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T20:35:58.890379] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-25T20:35:59.869505] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T20:35:59.879676] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-25T20:36:00.932981] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T20:36:00.941911] [INFO ] [REMOTE ] DAY: Full fetch complete (71901 records). [2025-10-25T20:36:00.942108] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-25T20:36:01.335812] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-25T20:36:01.335927] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-25T20:36:01.336769] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-25T20:36:01.336849] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-25T20:36:01.338233] [DEBUG] [LOCAL ] DAY: Trimmed 71901 records to 49840 (keeping 200 days of data) [2025-10-25T20:36:01.615861] [DEBUG] [LOCAL ] DAY: Primary data saved (49840 records). [2025-10-25T20:36:01.616029] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-25T20:36:01.616173] [INFO ] [MAIN ] Update Progress: 591/2366 symbols. DAY took 13.0s. Estimated remaining time: 4h 55m 1s [2025-10-25T20:36:01.789249] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:36:01.789505] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-10-25T20:36:01.789593] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-10-25T20:36:01.789767] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-25T20:36:01.789843] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-25T20:36:01.789924] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-25T20:36:01.789995] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-25T20:36:02.156724] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:36:02.157123] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-25T20:36:03.930751] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T20:36:03.940577] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-25T20:36:05.930667] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-25T20:36:05.941579] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-25T20:36:08.149894] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-25T20:36:08.161060] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-25T20:36:10.269866] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-25T20:36:10.281134] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-25T20:36:12.411441] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-25T20:36:12.422709] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-25T20:36:14.244452] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-25T20:36:14.255003] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-25T20:36:16.503473] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-25T20:36:16.514815] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-25T20:36:18.534195] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-25T20:36:18.545327] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-25T20:36:20.401919] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T20:36:20.413268] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-25T20:36:22.304191] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-25T20:36:22.313686] [INFO ] [REMOTE ] DB: Full fetch complete (75680 records). [2025-10-25T20:36:22.313879] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-25T20:36:22.715705] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-25T20:36:22.715845] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-25T20:36:22.716745] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-25T20:36:22.716825] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-25T20:36:22.718337] [DEBUG] [LOCAL ] DB: Trimmed 75680 records to 53198 (keeping 200 days of data) [2025-10-25T20:36:23.025525] [DEBUG] [LOCAL ] DB: Primary data saved (53198 records). [2025-10-25T20:36:23.025725] [INFO ] [MAIN ] DB: Full history saved. [2025-10-25T20:36:23.025850] [INFO ] [MAIN ] Update Progress: 592/2366 symbols. DB took 21.4s. Estimated remaining time: 4h 55m 25s [2025-10-25T20:36:23.197602] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:36:23.197848] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-25T20:36:23.197939] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-25T20:36:23.198073] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-25T20:36:23.198151] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-25T20:36:23.198232] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-25T20:36:23.198300] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-25T20:36:23.552297] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:36:23.552730] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-25T20:36:24.606961] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T20:36:24.610386] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-25T20:36:25.630470] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T20:36:25.634168] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-25T20:36:26.873372] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T20:36:26.878300] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-25T20:36:28.117144] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T20:36:28.122844] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-25T20:36:29.258132] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T20:36:29.263098] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-25T20:36:30.434191] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T20:36:30.440425] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-25T20:36:31.790473] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T20:36:31.796854] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-25T20:36:33.065785] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T20:36:33.071912] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-25T20:36:34.360907] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-25T20:36:34.366386] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-25T20:36:35.626290] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T20:36:35.631209] [INFO ] [REMOTE ] DBD: Full fetch complete (32229 records). [2025-10-25T20:36:35.631376] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-25T20:36:36.008531] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-10-25T20:36:36.008803] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-10-25T20:36:36.009327] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-10-25T20:36:36.009405] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-10-25T20:36:36.010358] [DEBUG] [LOCAL ] DBD: Trimmed 32229 records to 24906 (keeping 200 days of data) [2025-10-25T20:36:36.145945] [DEBUG] [LOCAL ] DBD: Primary data saved (24906 records). [2025-10-25T20:36:36.146103] [INFO ] [MAIN ] DBD: Full history saved. [2025-10-25T20:36:36.146238] [INFO ] [MAIN ] Update Progress: 593/2366 symbols. DBD took 13.1s. Estimated remaining time: 4h 55m 24s [2025-10-25T20:36:36.337419] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:36:36.337623] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-10-25T20:36:36.337715] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-10-25T20:36:36.337829] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-25T20:36:36.337901] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-25T20:36:36.338004] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-25T20:36:36.338073] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-25T20:36:36.690764] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:36:36.691192] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-25T20:36:38.490544] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T20:36:38.500008] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-25T20:36:40.235306] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T20:36:40.244403] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-25T20:36:42.163663] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T20:36:42.174252] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-25T20:36:43.114418] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T20:36:43.124820] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-25T20:36:44.040297] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T20:36:44.049990] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-25T20:36:45.009207] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:36:45.018961] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-25T20:36:45.957803] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T20:36:45.967698] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-25T20:36:46.874167] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T20:36:46.882751] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-25T20:36:47.835001] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:36:47.844551] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-25T20:36:48.914980] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T20:36:48.921861] [INFO ] [REMOTE ] DBI: Full fetch complete (64644 records). [2025-10-25T20:36:48.922032] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-25T20:36:49.317837] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-25T20:36:49.318013] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-25T20:36:49.318801] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-25T20:36:49.318888] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-25T20:36:49.320214] [DEBUG] [LOCAL ] DBI: Trimmed 64644 records to 43873 (keeping 200 days of data) [2025-10-25T20:36:49.568614] [DEBUG] [LOCAL ] DBI: Primary data saved (43873 records). [2025-10-25T20:36:49.568821] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-25T20:36:49.568953] [INFO ] [MAIN ] Update Progress: 594/2366 symbols. DBI took 13.4s. Estimated remaining time: 4h 55m 25s [2025-10-25T20:36:49.737538] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:36:49.737755] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-25T20:36:49.737825] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-25T20:36:49.737954] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-25T20:36:49.738025] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-25T20:36:49.738104] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-25T20:36:49.738178] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-25T20:36:50.090914] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:36:50.091305] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-25T20:36:51.057185] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T20:36:51.059424] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-25T20:36:51.919878] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T20:36:51.923269] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-25T20:36:52.670262] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T20:36:52.672240] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-25T20:36:53.546709] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T20:36:53.550024] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-25T20:36:54.391663] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T20:36:54.393963] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-25T20:36:55.220880] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T20:36:55.223454] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-25T20:36:56.204588] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T20:36:56.211364] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-25T20:36:57.027674] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T20:36:57.030542] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-25T20:36:57.904018] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T20:36:57.906865] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-25T20:36:58.810836] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T20:36:58.812952] [INFO ] [REMOTE ] DBL: Full fetch complete (12818 records). [2025-10-25T20:36:58.813043] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-25T20:36:59.196239] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-25T20:36:59.196356] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-25T20:36:59.196728] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-25T20:36:59.196812] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-25T20:36:59.197316] [DEBUG] [LOCAL ] DBL: Trimmed 12818 records to 9473 (keeping 200 days of data) [2025-10-25T20:36:59.252379] [DEBUG] [LOCAL ] DBL: Primary data saved (9473 records). [2025-10-25T20:36:59.252531] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-25T20:36:59.252713] [INFO ] [MAIN ] Update Progress: 595/2366 symbols. DBL took 9.7s. Estimated remaining time: 4h 55m 14s [2025-10-25T20:36:59.419332] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:36:59.419529] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-25T20:36:59.419603] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-25T20:36:59.419740] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-25T20:36:59.419814] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-25T20:36:59.419895] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-25T20:36:59.419963] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-25T20:36:59.773474] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:36:59.773883] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-25T20:37:01.820227] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-25T20:37:01.830359] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-25T20:37:03.512025] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T20:37:03.521614] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-25T20:37:05.398160] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T20:37:05.409844] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-25T20:37:06.323002] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T20:37:06.334142] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-25T20:37:07.407521] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T20:37:07.418376] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-25T20:37:08.387286] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:37:08.397455] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-25T20:37:09.374756] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T20:37:09.385625] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-25T20:37:10.360214] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:37:10.370767] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-25T20:37:11.433424] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T20:37:11.443997] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-25T20:37:12.325591] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T20:37:12.335744] [INFO ] [REMOTE ] DBRG: Full fetch complete (72600 records). [2025-10-25T20:37:12.335995] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-25T20:37:12.736362] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-25T20:37:12.736538] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-25T20:37:12.737373] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-25T20:37:12.737480] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-25T20:37:12.739007] [DEBUG] [LOCAL ] DBRG: Trimmed 72600 records to 50733 (keeping 200 days of data) [2025-10-25T20:37:13.033685] [DEBUG] [LOCAL ] DBRG: Primary data saved (50733 records). [2025-10-25T20:37:13.033857] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-25T20:37:13.033985] [INFO ] [MAIN ] Update Progress: 596/2366 symbols. DBRG took 13.8s. Estimated remaining time: 4h 55m 15s [2025-10-25T20:37:13.204966] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:37:13.205196] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-25T20:37:13.205268] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-25T20:37:13.205381] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-25T20:37:13.205451] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-25T20:37:13.205532] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-25T20:37:13.205601] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-25T20:37:13.612444] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:37:13.612837] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-25T20:37:14.984493] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T20:37:14.991870] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-25T20:37:16.538030] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T20:37:16.545114] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-25T20:37:18.132844] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T20:37:18.141292] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-25T20:37:19.754193] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T20:37:19.763472] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-25T20:37:21.307875] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T20:37:21.315996] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-25T20:37:22.847760] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T20:37:22.855787] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-25T20:37:24.313159] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T20:37:24.321740] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-25T20:37:25.924155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T20:37:25.936543] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-25T20:37:27.479758] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T20:37:27.488451] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-25T20:37:28.619589] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T20:37:28.626185] [INFO ] [REMOTE ] DCI: Full fetch complete (53741 records). [2025-10-25T20:37:28.626297] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-25T20:37:29.000564] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-25T20:37:29.000699] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-25T20:37:29.001313] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-25T20:37:29.001388] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-25T20:37:29.002479] [DEBUG] [LOCAL ] DCI: Trimmed 53741 records to 37402 (keeping 200 days of data) [2025-10-25T20:37:29.224028] [DEBUG] [LOCAL ] DCI: Primary data saved (37402 records). [2025-10-25T20:37:29.224258] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-25T20:37:29.224383] [INFO ] [MAIN ] Update Progress: 597/2366 symbols. DCI took 16.2s. Estimated remaining time: 4h 55m 23s [2025-10-25T20:37:29.391314] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:37:29.391489] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-25T20:37:29.391566] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-25T20:37:29.391700] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-25T20:37:29.391778] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-25T20:37:29.391839] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-25T20:37:29.391901] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-25T20:37:29.736101] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:37:29.736430] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-25T20:37:30.769389] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T20:37:30.772153] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-25T20:37:31.702338] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T20:37:31.705235] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-25T20:37:32.650475] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T20:37:32.653130] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-25T20:37:33.571085] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T20:37:33.573883] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-25T20:37:34.497156] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T20:37:34.499956] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-25T20:37:35.574078] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T20:37:35.578117] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-25T20:37:36.659986] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T20:37:36.664221] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-25T20:37:37.726891] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T20:37:37.730892] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-25T20:37:38.846031] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T20:37:38.849956] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-25T20:37:40.028345] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T20:37:40.032066] [INFO ] [REMOTE ] DCO: Full fetch complete (19826 records). [2025-10-25T20:37:40.032170] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-25T20:37:40.403846] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-25T20:37:40.403969] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-25T20:37:40.404421] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-25T20:37:40.404494] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-25T20:37:40.405157] [DEBUG] [LOCAL ] DCO: Trimmed 19826 records to 15231 (keeping 200 days of data) [2025-10-25T20:37:40.492700] [DEBUG] [LOCAL ] DCO: Primary data saved (15231 records). [2025-10-25T20:37:40.492867] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-25T20:37:40.492994] [INFO ] [MAIN ] Update Progress: 598/2366 symbols. DCO took 11.3s. Estimated remaining time: 4h 55m 17s [2025-10-25T20:37:40.674325] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:37:40.674566] [DEBUG] [LOCAL ] DD: No existing data file found in primary storage. [2025-10-25T20:37:40.674671] [WARN ] [MAIN ] DD: No existing data found, performing full refresh instead. [2025-10-25T20:37:40.674795] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-25T20:37:40.674868] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-25T20:37:40.674937] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-25T20:37:40.675001] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-25T20:37:41.027256] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:37:41.027580] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-25T20:37:42.967210] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T20:37:42.977765] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-25T20:37:44.724142] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-25T20:37:44.739422] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-25T20:37:46.639343] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T20:37:46.650900] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-25T20:37:47.724456] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T20:37:47.735583] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-25T20:37:48.764609] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:37:48.776166] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-25T20:37:49.707676] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T20:37:49.718181] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-25T20:37:50.917923] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T20:37:50.929468] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-25T20:37:52.023911] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T20:37:52.035027] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-25T20:37:53.041487] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T20:37:53.053212] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-25T20:37:54.168366] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-25T20:37:54.177942] [INFO ] [REMOTE ] DD: Full fetch complete (76612 records). [2025-10-25T20:37:54.178124] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-25T20:37:54.573696] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-25T20:37:54.573813] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-25T20:37:54.574630] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-25T20:37:54.574729] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-25T20:37:54.576194] [DEBUG] [LOCAL ] DD: Trimmed 76612 records to 53685 (keeping 200 days of data) [2025-10-25T20:37:54.890865] [DEBUG] [LOCAL ] DD: Primary data saved (53685 records). [2025-10-25T20:37:54.891025] [INFO ] [MAIN ] DD: Full history saved. [2025-10-25T20:37:54.891151] [INFO ] [MAIN ] Update Progress: 599/2366 symbols. DD took 14.4s. Estimated remaining time: 4h 55m 20s [2025-10-25T20:37:55.058572] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:37:55.058765] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-25T20:37:55.058835] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-25T20:37:55.058965] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-25T20:37:55.059036] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-25T20:37:55.059116] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-25T20:37:55.059190] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-25T20:37:55.410061] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:37:55.410392] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-25T20:37:57.269567] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-25T20:37:57.279542] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-25T20:37:58.905293] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T20:37:58.915348] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-25T20:38:00.829797] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T20:38:00.841046] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-25T20:38:02.339778] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T20:38:02.351554] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-25T20:38:03.295763] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T20:38:03.306545] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-25T20:38:04.222878] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T20:38:04.233419] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-25T20:38:05.097087] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T20:38:05.107793] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-25T20:38:06.045954] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:38:06.061616] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-25T20:38:07.142415] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T20:38:07.153829] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-25T20:38:08.263762] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T20:38:08.276560] [INFO ] [REMOTE ] DDD: Full fetch complete (73989 records). [2025-10-25T20:38:08.276839] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-25T20:38:08.673939] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-25T20:38:08.674082] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-25T20:38:08.674984] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-25T20:38:08.675077] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-25T20:38:08.676670] [DEBUG] [LOCAL ] DDD: Trimmed 73989 records to 51686 (keeping 200 days of data) [2025-10-25T20:38:08.952625] [DEBUG] [LOCAL ] DDD: Primary data saved (51686 records). [2025-10-25T20:38:08.952831] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-25T20:38:08.952972] [INFO ] [MAIN ] Update Progress: 600/2366 symbols. DDD took 14.1s. Estimated remaining time: 4h 55m 22s [2025-10-25T20:38:09.119051] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:38:09.119250] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-10-25T20:38:09.119322] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-10-25T20:38:09.119440] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-25T20:38:09.119511] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-25T20:38:09.119593] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-25T20:38:09.119707] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-25T20:38:09.518238] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:38:09.518602] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-25T20:38:11.049776] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T20:38:11.056712] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-25T20:38:12.538730] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T20:38:12.546300] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-25T20:38:14.168210] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T20:38:14.176478] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-25T20:38:15.156257] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T20:38:15.166409] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-25T20:38:16.135417] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T20:38:16.144577] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-25T20:38:17.043956] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T20:38:17.050296] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-25T20:38:18.019351] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T20:38:18.025832] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-25T20:38:18.894136] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T20:38:18.900753] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-25T20:38:19.740898] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T20:38:19.750094] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-25T20:38:20.663294] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:38:20.671110] [INFO ] [REMOTE ] DDL: Full fetch complete (53609 records). [2025-10-25T20:38:20.671302] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-25T20:38:21.078635] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-25T20:38:21.078781] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-25T20:38:21.079437] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-25T20:38:21.079517] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-25T20:38:21.080639] [DEBUG] [LOCAL ] DDL: Trimmed 53609 records to 37701 (keeping 200 days of data) [2025-10-25T20:38:21.278448] [DEBUG] [LOCAL ] DDL: Primary data saved (37701 records). [2025-10-25T20:38:21.278610] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-25T20:38:21.278756] [INFO ] [MAIN ] Update Progress: 601/2366 symbols. DDL took 12.3s. Estimated remaining time: 4h 55m 18s [2025-10-25T20:38:21.447132] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:38:21.447368] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-25T20:38:21.447444] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-25T20:38:21.447557] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-25T20:38:21.447629] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-25T20:38:21.447753] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-25T20:38:21.447838] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-25T20:38:21.832735] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:38:21.833159] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-25T20:38:23.163494] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-25T20:38:23.166421] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-25T20:38:24.108552] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-25T20:38:24.112944] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-25T20:38:25.310461] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T20:38:25.314188] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-25T20:38:26.535154] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T20:38:26.539491] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-25T20:38:27.587862] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T20:38:27.591572] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-25T20:38:28.504320] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T20:38:28.507411] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-25T20:38:29.574932] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T20:38:29.578334] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-25T20:38:30.695330] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T20:38:30.698776] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-25T20:38:31.738478] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T20:38:31.741520] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-25T20:38:32.581718] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T20:38:32.583826] [INFO ] [REMOTE ] DDS: Full fetch complete (18387 records). [2025-10-25T20:38:32.583921] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-25T20:38:33.063021] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-25T20:38:33.063190] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-25T20:38:33.063920] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-25T20:38:33.064028] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-25T20:38:33.065114] [DEBUG] [LOCAL ] DDS: Trimmed 18387 records to 12448 (keeping 200 days of data) [2025-10-25T20:38:33.187500] [DEBUG] [LOCAL ] DDS: Primary data saved (12448 records). [2025-10-25T20:38:33.187786] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-25T20:38:33.188008] [INFO ] [MAIN ] Update Progress: 602/2366 symbols. DDS took 11.9s. Estimated remaining time: 4h 55m 14s [2025-10-25T20:38:33.429768] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:38:33.430094] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-25T20:38:33.430866] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-25T20:38:33.431023] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-25T20:38:33.431116] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-25T20:38:33.431223] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-25T20:38:33.431311] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-25T20:38:33.868768] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:38:33.869163] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-25T20:38:34.802727] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T20:38:34.803863] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-25T20:38:35.333172] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-25T20:38:35.334295] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-25T20:38:35.871892] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-25T20:38:35.873086] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-25T20:38:36.539231] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-25T20:38:36.540852] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-25T20:38:37.108317] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T20:38:37.109397] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-25T20:38:37.679582] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T20:38:37.680751] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-25T20:38:38.313196] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-25T20:38:38.314494] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-25T20:38:38.920411] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T20:38:38.921501] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-25T20:38:39.435183] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-25T20:38:39.436310] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-25T20:38:40.004184] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T20:38:40.005135] [INFO ] [REMOTE ] DDT: Full fetch complete (2810 records). [2025-10-25T20:38:40.005230] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-25T20:38:40.372842] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-25T20:38:40.372981] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-25T20:38:40.373155] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-25T20:38:40.373263] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-25T20:38:40.373700] [DEBUG] [LOCAL ] DDT: Trimmed 2810 records to 1881 (keeping 200 days of data) [2025-10-25T20:38:40.385502] [DEBUG] [LOCAL ] DDT: Primary data saved (1881 records). [2025-10-25T20:38:40.385637] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-25T20:38:40.385786] [INFO ] [MAIN ] Update Progress: 603/2366 symbols. DDT took 7.2s. Estimated remaining time: 4h 54m 55s [2025-10-25T20:38:40.562723] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:38:40.562959] [DEBUG] [LOCAL ] DE: No existing data file found in primary storage. [2025-10-25T20:38:40.563034] [WARN ] [MAIN ] DE: No existing data found, performing full refresh instead. [2025-10-25T20:38:40.563152] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-25T20:38:40.563225] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-25T20:38:40.563307] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-10-25T20:38:40.563376] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-25T20:38:40.940979] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:38:40.941377] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-25T20:38:42.855901] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T20:38:42.865714] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-25T20:38:44.644275] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T20:38:44.653782] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-25T20:38:46.451557] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T20:38:46.462828] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-25T20:38:47.437086] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T20:38:47.447195] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-25T20:38:48.355249] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T20:38:48.365322] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-25T20:38:49.296491] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T20:38:49.306008] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-25T20:38:50.211977] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:38:50.222290] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-25T20:38:51.148225] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T20:38:51.158563] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-25T20:38:52.221184] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T20:38:52.231986] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-25T20:38:53.493766] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T20:38:53.502935] [INFO ] [REMOTE ] DE: Full fetch complete (69919 records). [2025-10-25T20:38:53.503136] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-25T20:38:53.899192] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-25T20:38:53.899321] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-25T20:38:53.900211] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-25T20:38:53.900299] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-25T20:38:53.901749] [DEBUG] [LOCAL ] DE: Trimmed 69919 records to 48206 (keeping 200 days of data) [2025-10-25T20:38:54.209317] [DEBUG] [LOCAL ] DE: Primary data saved (48206 records). [2025-10-25T20:38:54.209497] [INFO ] [MAIN ] DE: Full history saved. [2025-10-25T20:38:54.209625] [INFO ] [MAIN ] Update Progress: 604/2366 symbols. DE took 13.8s. Estimated remaining time: 4h 54m 56s [2025-10-25T20:38:54.389496] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:38:54.389722] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-25T20:38:54.389804] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-25T20:38:54.389914] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-25T20:38:54.389983] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-25T20:38:54.390062] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-25T20:38:54.390130] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-25T20:38:54.741331] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:38:54.741745] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-25T20:38:56.621296] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T20:38:56.630255] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-25T20:38:58.183507] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T20:38:58.193120] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-25T20:38:59.967553] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T20:38:59.977610] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-25T20:39:00.944470] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T20:39:00.954910] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-25T20:39:01.988431] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:39:01.997072] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-25T20:39:02.889075] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T20:39:02.897188] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-25T20:39:03.776006] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T20:39:03.784426] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-25T20:39:04.711357] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T20:39:04.719514] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-25T20:39:05.717221] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:39:05.725609] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-25T20:39:06.580485] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T20:39:06.591134] [INFO ] [REMOTE ] DEA: Full fetch complete (61483 records). [2025-10-25T20:39:06.591335] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-25T20:39:06.974408] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-25T20:39:06.974521] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-25T20:39:06.975238] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-25T20:39:06.975319] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-25T20:39:06.976456] [DEBUG] [LOCAL ] DEA: Trimmed 61483 records to 40577 (keeping 200 days of data) [2025-10-25T20:39:07.211484] [DEBUG] [LOCAL ] DEA: Primary data saved (40577 records). [2025-10-25T20:39:07.211661] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-25T20:39:07.211785] [INFO ] [MAIN ] Update Progress: 605/2366 symbols. DEA took 13.0s. Estimated remaining time: 4h 54m 55s [2025-10-25T20:39:07.381398] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:39:07.381588] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-25T20:39:07.381680] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-25T20:39:07.381780] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-25T20:39:07.381847] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-25T20:39:07.381907] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-25T20:39:07.381970] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-25T20:39:07.761446] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:39:07.761818] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-25T20:39:09.080635] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T20:39:09.087322] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-25T20:39:10.437920] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T20:39:10.444087] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-25T20:39:12.163378] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T20:39:12.171818] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-25T20:39:13.605057] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T20:39:13.612405] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-25T20:39:15.011350] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T20:39:15.018554] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-25T20:39:16.687952] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T20:39:16.695074] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-25T20:39:18.114337] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T20:39:18.121202] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-25T20:39:19.363938] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T20:39:19.369782] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-25T20:39:20.863094] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T20:39:20.869910] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-25T20:39:22.244600] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T20:39:22.250874] [INFO ] [REMOTE ] DEC: Full fetch complete (44536 records). [2025-10-25T20:39:22.251038] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-25T20:39:22.659573] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-25T20:39:22.659711] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-25T20:39:22.660360] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-25T20:39:22.660442] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-25T20:39:22.661429] [DEBUG] [LOCAL ] DEC: Trimmed 44536 records to 30623 (keeping 200 days of data) [2025-10-25T20:39:22.837791] [DEBUG] [LOCAL ] DEC: Primary data saved (30623 records). [2025-10-25T20:39:22.837958] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-25T20:39:22.838083] [INFO ] [MAIN ] Update Progress: 606/2366 symbols. DEC took 15.6s. Estimated remaining time: 4h 55m 1s [2025-10-25T20:39:23.006228] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:39:23.006438] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-25T20:39:23.006508] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-25T20:39:23.006592] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-25T20:39:23.006680] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-25T20:39:23.006763] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-25T20:39:23.006841] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-25T20:39:23.358987] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:39:23.359302] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-25T20:39:25.160225] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T20:39:25.170309] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-25T20:39:27.204158] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-25T20:39:27.214228] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-25T20:39:29.337715] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-25T20:39:29.348959] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-25T20:39:30.297621] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T20:39:30.308919] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-25T20:39:31.420363] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T20:39:31.432035] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-25T20:39:32.221727] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T20:39:32.232459] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-25T20:39:33.243606] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T20:39:33.255161] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-25T20:39:34.204229] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T20:39:34.215739] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-25T20:39:35.286533] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T20:39:35.297845] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-25T20:39:36.345788] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T20:39:36.355761] [INFO ] [REMOTE ] DECK: Full fetch complete (77204 records). [2025-10-25T20:39:36.355953] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-25T20:39:36.747268] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-25T20:39:36.747376] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-25T20:39:36.748229] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-25T20:39:36.748310] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-25T20:39:36.749742] [DEBUG] [LOCAL ] DECK: Trimmed 77204 records to 54081 (keeping 200 days of data) [2025-10-25T20:39:37.061281] [DEBUG] [LOCAL ] DECK: Primary data saved (54081 records). [2025-10-25T20:39:37.061459] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-25T20:39:37.061584] [INFO ] [MAIN ] Update Progress: 607/2366 symbols. DECK took 14.2s. Estimated remaining time: 4h 55m 3s [2025-10-25T20:39:37.229100] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:39:37.229295] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-25T20:39:37.229366] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-25T20:39:37.229483] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-25T20:39:37.229555] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-25T20:39:37.229637] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-25T20:39:37.229732] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-25T20:39:37.577197] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:39:37.577533] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-25T20:39:39.385696] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T20:39:39.395227] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-25T20:39:41.175824] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T20:39:41.184962] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-25T20:39:42.802979] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T20:39:42.813254] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-25T20:39:43.771437] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T20:39:43.782358] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-25T20:39:44.811741] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:39:44.821987] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-25T20:39:45.721499] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T20:39:45.731411] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-25T20:39:46.640352] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:39:46.651413] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-25T20:39:47.584505] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T20:39:47.594775] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-25T20:39:48.591596] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:39:48.601808] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-25T20:39:49.429360] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T20:39:49.438245] [INFO ] [REMOTE ] DEI: Full fetch complete (69940 records). [2025-10-25T20:39:49.438404] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-25T20:39:49.828016] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-25T20:39:49.828142] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-25T20:39:49.828950] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-25T20:39:49.829033] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-25T20:39:49.830449] [DEBUG] [LOCAL ] DEI: Trimmed 69940 records to 48983 (keeping 200 days of data) [2025-10-25T20:39:50.126739] [DEBUG] [LOCAL ] DEI: Primary data saved (48983 records). [2025-10-25T20:39:50.126925] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-25T20:39:50.127058] [INFO ] [MAIN ] Update Progress: 608/2366 symbols. DEI took 13.1s. Estimated remaining time: 4h 55m 2s [2025-10-25T20:39:50.305950] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:39:50.306150] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-25T20:39:50.306228] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-25T20:39:50.306347] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-25T20:39:50.306422] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-25T20:39:50.306507] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-25T20:39:50.306581] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-25T20:39:50.675418] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:39:50.675779] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-25T20:39:53.351142] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-25T20:39:53.361871] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-25T20:39:55.694556] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-25T20:39:55.704694] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-25T20:39:57.982458] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-25T20:39:57.994914] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-25T20:39:59.020673] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:39:59.031775] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-25T20:40:00.088225] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T20:40:00.099395] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-25T20:40:01.110070] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T20:40:01.120872] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-25T20:40:02.137054] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T20:40:02.149104] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-25T20:40:03.424805] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T20:40:03.436522] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-25T20:40:04.392521] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T20:40:04.404014] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-25T20:40:05.386162] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T20:40:05.396078] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-25T20:40:05.396241] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-25T20:40:05.791243] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-25T20:40:05.791362] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-25T20:40:05.792202] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-25T20:40:05.792285] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-25T20:40:05.793745] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 54516 (keeping 200 days of data) [2025-10-25T20:40:06.131045] [DEBUG] [LOCAL ] DELL: Primary data saved (54516 records). [2025-10-25T20:40:06.131211] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-25T20:40:06.131316] [INFO ] [MAIN ] Update Progress: 609/2366 symbols. DELL took 16.0s. Estimated remaining time: 4h 55m 9s [2025-10-25T20:40:06.299753] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:40:06.299934] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-25T20:40:06.300003] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-25T20:40:06.300114] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-25T20:40:06.300189] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-25T20:40:06.300268] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-25T20:40:06.300334] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-25T20:40:06.664450] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:40:06.664819] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-25T20:40:08.624716] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-25T20:40:08.634825] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-25T20:40:10.578847] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T20:40:10.588492] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-25T20:40:12.361890] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T20:40:12.373070] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-25T20:40:14.376443] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-25T20:40:14.387585] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-25T20:40:16.383009] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-25T20:40:16.392920] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-25T20:40:18.306345] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-25T20:40:18.316313] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-25T20:40:20.454263] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-25T20:40:20.465300] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-25T20:40:22.504567] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-25T20:40:22.515115] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-25T20:40:24.445703] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-25T20:40:24.456487] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-25T20:40:26.476880] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-25T20:40:26.486155] [INFO ] [REMOTE ] DEO: Full fetch complete (71713 records). [2025-10-25T20:40:26.486303] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-25T20:40:26.869010] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-25T20:40:26.869122] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-25T20:40:26.869931] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-25T20:40:26.870011] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-25T20:40:26.871314] [DEBUG] [LOCAL ] DEO: Trimmed 71713 records to 49926 (keeping 200 days of data) [2025-10-25T20:40:27.169638] [DEBUG] [LOCAL ] DEO: Primary data saved (49926 records). [2025-10-25T20:40:27.169818] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-25T20:40:27.169941] [INFO ] [MAIN ] Update Progress: 610/2366 symbols. DEO took 21.0s. Estimated remaining time: 4h 55m 30s [2025-10-25T20:40:27.335914] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:40:27.336086] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-25T20:40:27.336155] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-25T20:40:27.336263] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-25T20:40:27.336333] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-25T20:40:27.336411] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-25T20:40:27.336480] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-25T20:40:27.685139] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:40:27.685485] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-25T20:40:29.338561] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T20:40:29.350406] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-25T20:40:30.692500] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T20:40:30.699205] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-25T20:40:32.258983] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T20:40:32.266481] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-25T20:40:33.525747] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T20:40:33.533996] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-25T20:40:34.866558] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T20:40:34.873244] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-25T20:40:36.280005] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T20:40:36.287259] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-25T20:40:37.706852] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T20:40:37.714470] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-25T20:40:39.166332] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T20:40:39.173011] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-25T20:40:40.595059] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T20:40:40.601449] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-25T20:40:41.866532] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T20:40:41.872020] [INFO ] [REMOTE ] DFH: Full fetch complete (47234 records). [2025-10-25T20:40:41.872136] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-25T20:40:42.248296] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-25T20:40:42.248405] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-25T20:40:42.249017] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-25T20:40:42.249097] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-25T20:40:42.250086] [DEBUG] [LOCAL ] DFH: Trimmed 47234 records to 31992 (keeping 200 days of data) [2025-10-25T20:40:42.428990] [DEBUG] [LOCAL ] DFH: Primary data saved (31992 records). [2025-10-25T20:40:42.429191] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-25T20:40:42.429326] [INFO ] [MAIN ] Update Progress: 611/2366 symbols. DFH took 15.3s. Estimated remaining time: 4h 55m 35s [2025-10-25T20:40:42.596382] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:40:42.596582] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-10-25T20:40:42.596675] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-10-25T20:40:42.596790] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-25T20:40:42.596860] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-25T20:40:42.596920] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-25T20:40:42.596982] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-25T20:40:42.952510] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:40:42.952883] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-25T20:40:44.290122] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T20:40:44.294502] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-25T20:40:45.471586] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-25T20:40:45.476629] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-25T20:40:46.842380] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T20:40:46.849059] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-25T20:40:48.438887] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T20:40:48.446137] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-25T20:40:49.591144] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-25T20:40:49.596206] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-25T20:40:50.543750] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:40:50.548603] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-25T20:40:51.640125] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T20:40:51.645029] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-25T20:40:52.673211] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T20:40:52.678327] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-25T20:40:53.880529] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-25T20:40:53.885961] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-25T20:40:55.130990] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T20:40:55.135117] [INFO ] [REMOTE ] DFIN: Full fetch complete (33413 records). [2025-10-25T20:40:55.135224] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-25T20:40:55.494527] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-25T20:40:55.494663] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-25T20:40:55.495146] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-25T20:40:55.495219] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-25T20:40:55.496042] [DEBUG] [LOCAL ] DFIN: Trimmed 33413 records to 22669 (keeping 200 days of data) [2025-10-25T20:40:55.619566] [DEBUG] [LOCAL ] DFIN: Primary data saved (22669 records). [2025-10-25T20:40:55.619746] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-25T20:40:55.619870] [INFO ] [MAIN ] Update Progress: 612/2366 symbols. DFIN took 13.2s. Estimated remaining time: 4h 55m 34s [2025-10-25T20:40:55.787363] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:40:55.787565] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-10-25T20:40:55.787635] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-10-25T20:40:55.787773] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-25T20:40:55.787845] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-25T20:40:55.787949] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-25T20:40:55.788020] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-25T20:40:56.137636] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:40:56.138937] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-25T20:40:57.036061] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T20:40:57.038351] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-25T20:40:57.941383] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T20:40:57.943995] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-25T20:40:58.851402] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-25T20:40:58.854429] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-25T20:40:59.841991] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T20:40:59.845089] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-25T20:41:00.749466] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T20:41:00.752536] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-25T20:41:03.291988] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-25T20:41:03.294791] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-25T20:41:04.213368] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T20:41:04.217592] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-25T20:41:04.983125] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-25T20:41:04.986445] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-25T20:41:05.821183] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-25T20:41:05.824273] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-25T20:41:06.683400] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T20:41:06.685392] [INFO ] [REMOTE ] DFP: Full fetch complete (15793 records). [2025-10-25T20:41:06.685488] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-25T20:41:07.082805] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-25T20:41:07.082926] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-25T20:41:07.083337] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-25T20:41:07.083418] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-25T20:41:07.084212] [DEBUG] [LOCAL ] DFP: Trimmed 15793 records to 11137 (keeping 200 days of data) [2025-10-25T20:41:07.158955] [DEBUG] [LOCAL ] DFP: Primary data saved (11137 records). [2025-10-25T20:41:07.159156] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-25T20:41:07.159319] [INFO ] [MAIN ] Update Progress: 613/2366 symbols. DFP took 11.5s. Estimated remaining time: 4h 55m 28s [2025-10-25T20:41:07.353056] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:41:07.353276] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-25T20:41:07.353368] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-25T20:41:07.353482] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-25T20:41:07.353552] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-25T20:41:07.353635] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-25T20:41:07.353744] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-25T20:41:07.724899] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:41:07.725277] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-25T20:41:09.676072] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-25T20:41:09.686369] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-25T20:41:11.671614] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-25T20:41:11.683664] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-25T20:41:13.720983] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T20:41:13.732055] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-25T20:41:14.861066] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T20:41:14.872174] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-25T20:41:16.042452] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T20:41:16.053755] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-25T20:41:16.969896] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T20:41:16.980692] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-25T20:41:18.076379] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T20:41:18.087592] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-25T20:41:19.191468] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T20:41:19.202473] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-25T20:41:20.267293] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T20:41:20.279043] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-25T20:41:21.221733] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:41:21.231483] [INFO ] [REMOTE ] DG: Full fetch complete (77308 records). [2025-10-25T20:41:21.231727] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-25T20:41:21.630152] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-25T20:41:21.630294] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-25T20:41:21.631195] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-25T20:41:21.631296] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-25T20:41:21.633017] [DEBUG] [LOCAL ] DG: Trimmed 77308 records to 54007 (keeping 200 days of data) [2025-10-25T20:41:22.126571] [DEBUG] [LOCAL ] DG: Primary data saved (54007 records). [2025-10-25T20:41:22.126803] [INFO ] [MAIN ] DG: Full history saved. [2025-10-25T20:41:22.126968] [INFO ] [MAIN ] Update Progress: 614/2366 symbols. DG took 15.0s. Estimated remaining time: 4h 55m 31s [2025-10-25T20:41:22.346134] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:41:22.346423] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-25T20:41:22.346511] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-25T20:41:22.346689] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-25T20:41:22.346773] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-25T20:41:22.346896] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-25T20:41:22.346983] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-25T20:41:22.773210] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:41:22.773555] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-25T20:41:24.339041] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T20:41:24.348476] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-25T20:41:26.130065] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T20:41:26.138961] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-25T20:41:27.879204] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T20:41:27.888960] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-25T20:41:29.707383] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T20:41:29.717973] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-25T20:41:31.350367] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T20:41:31.360263] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-25T20:41:33.057613] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T20:41:33.066374] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-25T20:41:34.796793] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T20:41:34.806908] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-25T20:41:36.610958] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-25T20:41:36.620721] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-25T20:41:38.179189] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T20:41:38.187683] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-25T20:41:39.735632] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T20:41:39.744162] [INFO ] [REMOTE ] DGX: Full fetch complete (65702 records). [2025-10-25T20:41:39.744380] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-25T20:41:40.133623] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-25T20:41:40.133786] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-25T20:41:40.134613] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-25T20:41:40.134728] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-25T20:41:40.136087] [DEBUG] [LOCAL ] DGX: Trimmed 65702 records to 45266 (keeping 200 days of data) [2025-10-25T20:41:40.413048] [DEBUG] [LOCAL ] DGX: Primary data saved (45266 records). [2025-10-25T20:41:40.413246] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-25T20:41:40.413400] [INFO ] [MAIN ] Update Progress: 615/2366 symbols. DGX took 18.3s. Estimated remaining time: 4h 55m 45s [2025-10-25T20:41:40.584575] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:41:40.584819] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-25T20:41:40.584905] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-25T20:41:40.585057] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-25T20:41:40.585149] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-25T20:41:40.585256] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-25T20:41:40.585344] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-25T20:41:40.941548] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:41:40.941951] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-25T20:41:42.085579] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T20:41:42.090050] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-25T20:41:43.231809] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T20:41:43.236265] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-25T20:41:44.376051] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T20:41:44.380800] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-25T20:41:45.600920] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T20:41:45.606434] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-25T20:41:46.696480] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T20:41:46.700717] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-25T20:41:47.825118] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T20:41:47.830038] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-25T20:41:49.118751] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-25T20:41:49.124018] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-25T20:41:50.434157] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T20:41:50.440264] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-25T20:41:51.601785] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T20:41:51.606233] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-25T20:41:52.757769] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T20:41:52.761379] [INFO ] [REMOTE ] DHF: Full fetch complete (29917 records). [2025-10-25T20:41:52.761497] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-25T20:41:53.147590] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-25T20:41:53.147735] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-25T20:41:53.148279] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-25T20:41:53.148417] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-25T20:41:53.149263] [DEBUG] [LOCAL ] DHF: Trimmed 29917 records to 21021 (keeping 200 days of data) [2025-10-25T20:41:53.264910] [DEBUG] [LOCAL ] DHF: Primary data saved (21021 records). [2025-10-25T20:41:53.265062] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-25T20:41:53.265183] [INFO ] [MAIN ] Update Progress: 616/2366 symbols. DHF took 12.9s. Estimated remaining time: 4h 55m 42s [2025-10-25T20:41:53.443457] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:41:53.443693] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-25T20:41:53.443771] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-25T20:41:53.443862] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-25T20:41:53.443929] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-25T20:41:53.444048] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-25T20:41:53.444118] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-25T20:41:53.812715] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:41:53.813080] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-25T20:41:55.646958] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T20:41:55.657594] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-25T20:41:57.429790] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-25T20:41:57.439722] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-25T20:41:59.482778] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T20:41:59.493817] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-25T20:42:00.591214] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T20:42:00.602479] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-25T20:42:02.103086] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T20:42:02.114750] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-25T20:42:03.173776] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T20:42:03.184509] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-25T20:42:04.207209] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T20:42:04.218965] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-25T20:42:05.307178] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T20:42:05.318460] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-25T20:42:06.209577] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-25T20:42:06.220906] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-25T20:42:07.297242] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T20:42:07.306816] [INFO ] [REMOTE ] DHI: Full fetch complete (77404 records). [2025-10-25T20:42:07.306997] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-25T20:42:07.708192] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-25T20:42:07.708307] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-25T20:42:07.709200] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-25T20:42:07.709280] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-25T20:42:07.710738] [DEBUG] [LOCAL ] DHI: Trimmed 77404 records to 54132 (keeping 200 days of data) [2025-10-25T20:42:08.042629] [DEBUG] [LOCAL ] DHI: Primary data saved (54132 records). [2025-10-25T20:42:08.042828] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-25T20:42:08.042958] [INFO ] [MAIN ] Update Progress: 617/2366 symbols. DHI took 14.8s. Estimated remaining time: 4h 55m 45s [2025-10-25T20:42:08.233974] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:42:08.234187] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-10-25T20:42:08.234258] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-10-25T20:42:08.234371] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-25T20:42:08.234440] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-25T20:42:08.234519] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-25T20:42:08.234585] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-25T20:42:08.598273] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:42:08.598691] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-25T20:42:10.751838] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-25T20:42:10.763187] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-25T20:42:12.575588] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T20:42:12.585790] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-25T20:42:14.632626] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-25T20:42:14.643998] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-25T20:42:16.584569] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T20:42:16.595818] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-25T20:42:18.610141] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-25T20:42:18.621970] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-25T20:42:20.387087] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-25T20:42:20.399537] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-25T20:42:22.243567] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-25T20:42:22.255288] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-25T20:42:24.162924] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-25T20:42:24.174606] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-25T20:42:26.114209] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-25T20:42:26.125606] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-25T20:42:28.150216] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-25T20:42:28.160055] [INFO ] [REMOTE ] DHR: Full fetch complete (77441 records). [2025-10-25T20:42:28.160236] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-25T20:42:28.542742] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-25T20:42:28.542853] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-25T20:42:28.543798] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-25T20:42:28.543890] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-25T20:42:28.545469] [DEBUG] [LOCAL ] DHR: Trimmed 77441 records to 54150 (keeping 200 days of data) [2025-10-25T20:42:28.870025] [DEBUG] [LOCAL ] DHR: Primary data saved (54150 records). [2025-10-25T20:42:28.870188] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-25T20:42:28.870374] [INFO ] [MAIN ] Update Progress: 618/2366 symbols. DHR took 20.8s. Estimated remaining time: 4h 56m 5s [2025-10-25T20:42:29.042167] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:42:29.042391] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-25T20:42:29.042495] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-25T20:42:29.042674] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-25T20:42:29.042759] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-25T20:42:29.042862] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-25T20:42:29.042943] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-25T20:42:29.391439] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:42:29.391799] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-25T20:42:31.191458] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T20:42:31.201045] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-25T20:42:32.920094] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T20:42:32.929444] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-25T20:42:34.853237] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T20:42:34.863360] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-25T20:42:35.892925] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:42:35.903283] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-25T20:42:36.952190] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T20:42:36.962987] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-25T20:42:37.832796] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T20:42:37.842761] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-25T20:42:38.745167] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T20:42:38.755030] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-25T20:42:39.702999] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T20:42:39.714073] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-25T20:42:40.726860] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T20:42:40.737092] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-25T20:42:41.550040] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T20:42:41.561451] [INFO ] [REMOTE ] DHT: Full fetch complete (70331 records). [2025-10-25T20:42:41.561639] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-25T20:42:41.949804] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-25T20:42:41.949917] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-25T20:42:41.950749] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-25T20:42:41.950832] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-25T20:42:41.952137] [DEBUG] [LOCAL ] DHT: Trimmed 70331 records to 48572 (keeping 200 days of data) [2025-10-25T20:42:42.228097] [DEBUG] [LOCAL ] DHT: Primary data saved (48572 records). [2025-10-25T20:42:42.228260] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-25T20:42:42.228382] [INFO ] [MAIN ] Update Progress: 619/2366 symbols. DHT took 13.4s. Estimated remaining time: 4h 56m 4s [2025-10-25T20:42:42.397528] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:42:42.397799] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-10-25T20:42:42.397873] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-10-25T20:42:42.398004] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-25T20:42:42.398076] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-25T20:42:42.398159] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-25T20:42:42.398229] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-25T20:42:42.750224] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:42:42.750559] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-25T20:42:43.833336] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-25T20:42:43.837080] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-25T20:42:44.945221] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-25T20:42:44.950079] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-25T20:42:45.989606] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T20:42:45.993285] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-25T20:42:47.083475] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T20:42:47.087607] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-25T20:42:48.134564] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T20:42:48.138197] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-25T20:42:49.088465] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:42:49.091299] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-25T20:42:49.959179] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T20:42:49.962140] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-25T20:42:50.804732] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T20:42:50.807688] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-25T20:42:51.836127] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T20:42:51.839800] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-25T20:42:52.956462] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-25T20:42:52.960128] [INFO ] [REMOTE ] DHX: Full fetch complete (21607 records). [2025-10-25T20:42:52.960222] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-25T20:42:53.332610] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-25T20:42:53.332762] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-25T20:42:53.333174] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-25T20:42:53.333252] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-25T20:42:53.333915] [DEBUG] [LOCAL ] DHX: Trimmed 21607 records to 13435 (keeping 200 days of data) [2025-10-25T20:42:53.404494] [DEBUG] [LOCAL ] DHX: Primary data saved (13435 records). [2025-10-25T20:42:53.404683] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-25T20:42:53.404810] [INFO ] [MAIN ] Update Progress: 620/2366 symbols. DHX took 11.2s. Estimated remaining time: 4h 55m 57s [2025-10-25T20:42:53.573253] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:42:53.573437] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-25T20:42:53.573522] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-25T20:42:53.573638] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-25T20:42:53.573733] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-25T20:42:53.573812] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-25T20:42:53.573887] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-25T20:42:53.924471] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:42:53.924856] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-25T20:42:54.795629] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-25T20:42:54.801960] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-25T20:42:55.594921] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T20:42:55.597419] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-25T20:42:56.457274] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T20:42:56.460308] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-25T20:42:57.520989] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:42:57.525005] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-25T20:42:58.352206] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T20:42:58.354907] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-25T20:42:59.288128] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T20:42:59.291313] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-25T20:43:00.119905] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T20:43:00.123467] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-25T20:43:01.165053] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T20:43:01.168331] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-25T20:43:02.463515] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T20:43:02.467291] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-25T20:43:03.381768] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:43:03.385200] [INFO ] [REMOTE ] DIAX: Full fetch complete (17635 records). [2025-10-25T20:43:03.385318] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-25T20:43:03.806781] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-25T20:43:03.806925] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-25T20:43:03.807664] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-25T20:43:03.807749] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-25T20:43:03.808502] [DEBUG] [LOCAL ] DIAX: Trimmed 17635 records to 12871 (keeping 200 days of data) [2025-10-25T20:43:03.889054] [DEBUG] [LOCAL ] DIAX: Primary data saved (12871 records). [2025-10-25T20:43:03.889276] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-25T20:43:03.889486] [INFO ] [MAIN ] Update Progress: 621/2366 symbols. DIAX took 10.5s. Estimated remaining time: 4h 55m 47s [2025-10-25T20:43:04.081043] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:43:04.081331] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-10-25T20:43:04.081420] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-10-25T20:43:04.081583] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-25T20:43:04.081690] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-25T20:43:04.081775] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-25T20:43:04.081849] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-25T20:43:04.469741] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:43:04.470224] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-25T20:43:06.348985] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T20:43:06.357989] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-25T20:43:07.860842] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T20:43:07.869239] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-25T20:43:09.551099] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T20:43:09.560338] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-25T20:43:11.203873] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T20:43:11.212739] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-25T20:43:12.715893] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T20:43:12.723624] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-25T20:43:14.251557] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T20:43:14.258969] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-25T20:43:15.988692] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T20:43:15.996143] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-25T20:43:17.561552] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T20:43:17.573284] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-25T20:43:19.151973] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T20:43:19.160345] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-25T20:43:20.710096] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-25T20:43:20.716603] [INFO ] [REMOTE ] DIN: Full fetch complete (54607 records). [2025-10-25T20:43:20.716774] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-25T20:43:21.100004] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-25T20:43:21.100138] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-25T20:43:21.100899] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-25T20:43:21.100997] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-25T20:43:21.102195] [DEBUG] [LOCAL ] DIN: Trimmed 54607 records to 37212 (keeping 200 days of data) [2025-10-25T20:43:21.317350] [DEBUG] [LOCAL ] DIN: Primary data saved (37212 records). [2025-10-25T20:43:21.317529] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-25T20:43:21.317692] [INFO ] [MAIN ] Update Progress: 622/2366 symbols. DIN took 17.4s. Estimated remaining time: 4h 55m 58s [2025-10-25T20:43:21.488178] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:43:21.488436] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-25T20:43:21.488526] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-25T20:43:21.488707] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-25T20:43:21.488798] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-25T20:43:21.488904] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-25T20:43:21.488993] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-25T20:43:21.854807] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:43:21.855134] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-25T20:43:23.593592] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T20:43:23.603802] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-25T20:43:25.388822] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T20:43:25.398720] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-25T20:43:27.238441] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-25T20:43:27.249616] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-25T20:43:28.198103] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T20:43:28.209135] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-25T20:43:29.227271] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T20:43:29.238325] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-25T20:43:30.356286] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T20:43:30.366976] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-25T20:43:31.334925] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T20:43:31.346905] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-25T20:43:32.349969] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T20:43:32.361076] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-25T20:43:33.375155] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T20:43:33.386517] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-25T20:43:34.380550] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T20:43:34.390005] [INFO ] [REMOTE ] DINO: Full fetch complete (76709 records). [2025-10-25T20:43:34.390163] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-25T20:43:34.779077] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-25T20:43:34.779214] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-25T20:43:34.780065] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-25T20:43:34.780148] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-25T20:43:34.781587] [DEBUG] [LOCAL ] DINO: Trimmed 76709 records to 53591 (keeping 200 days of data) [2025-10-25T20:43:35.104390] [DEBUG] [LOCAL ] DINO: Primary data saved (53591 records). [2025-10-25T20:43:35.104565] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-25T20:43:35.104719] [INFO ] [MAIN ] Update Progress: 623/2366 symbols. DINO took 13.8s. Estimated remaining time: 4h 55m 58s [2025-10-25T20:43:35.283801] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:43:35.284017] [DEBUG] [LOCAL ] DIS: No existing data file found in primary storage. [2025-10-25T20:43:35.284089] [WARN ] [MAIN ] DIS: No existing data found, performing full refresh instead. [2025-10-25T20:43:35.284203] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-25T20:43:35.284274] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-25T20:43:35.284355] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-25T20:43:35.284424] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-25T20:43:35.651949] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:43:35.652298] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-25T20:43:36.534533] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T20:43:36.545163] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-25T20:43:37.470725] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T20:43:37.480801] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-25T20:43:38.464519] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T20:43:38.475546] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-25T20:43:39.288454] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T20:43:39.299495] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-25T20:43:40.355249] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T20:43:40.366792] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-25T20:43:41.332754] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T20:43:41.343718] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-25T20:43:42.303010] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T20:43:42.315043] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-25T20:43:43.410110] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T20:43:43.421506] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-25T20:43:44.370631] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:43:44.382220] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-25T20:43:45.329502] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T20:43:45.339286] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-25T20:43:45.339459] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-25T20:43:45.745733] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-25T20:43:45.745851] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-25T20:43:45.746727] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-25T20:43:45.746807] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-25T20:43:45.748358] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54568 (keeping 200 days of data) [2025-10-25T20:43:46.071318] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-25T20:43:46.071483] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-25T20:43:46.071606] [INFO ] [MAIN ] Update Progress: 624/2366 symbols. DIS took 11.0s. Estimated remaining time: 4h 55m 50s [2025-10-25T20:43:46.238815] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:43:46.239031] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-25T20:43:46.239104] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-25T20:43:46.239257] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-25T20:43:46.239328] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-25T20:43:46.239409] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-25T20:43:46.239480] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-25T20:43:46.589795] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:43:46.590120] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-25T20:43:47.274498] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-25T20:43:47.275581] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-25T20:43:47.753578] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-25T20:43:47.754629] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-25T20:43:48.302442] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-25T20:43:48.303705] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-25T20:43:48.812919] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-25T20:43:48.814088] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-25T20:43:49.257094] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-25T20:43:49.258139] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-25T20:43:49.720012] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-25T20:43:49.720970] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-25T20:43:50.151703] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-25T20:43:50.152804] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-25T20:43:50.636277] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-25T20:43:50.637312] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-25T20:43:51.138257] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-25T20:43:51.139307] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-25T20:43:51.627713] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T20:43:51.628518] [INFO ] [REMOTE ] DIVY: Full fetch complete (1671 records). [2025-10-25T20:43:51.628606] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-25T20:43:51.816168] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T20:43:51.816361] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:43:51.816452] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:43:51.816531] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-25T20:43:51.816626] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-25T20:43:51.816723] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-25T20:43:51.816806] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-25T20:43:51.816917] [INFO ] [MAIN ] Update Progress: 625/2366 symbols. DIVY took 5.7s. Estimated remaining time: 4h 55m 27s [2025-10-25T20:43:51.991940] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:43:51.992170] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-10-25T20:43:51.992246] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-10-25T20:43:51.992359] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-25T20:43:51.992431] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-25T20:43:51.992513] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-25T20:43:51.992581] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-25T20:43:52.354558] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:43:52.354949] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-25T20:43:53.884457] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T20:43:53.893486] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-25T20:43:55.499798] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T20:43:55.509124] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-25T20:43:57.231111] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T20:43:57.241376] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-25T20:43:58.094363] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T20:43:58.105272] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-25T20:43:58.951770] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T20:43:58.962613] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-25T20:44:00.237883] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T20:44:00.247634] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-25T20:44:01.578492] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T20:44:01.589591] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-25T20:44:02.871941] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T20:44:02.884472] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-25T20:44:03.981080] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T20:44:03.993340] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-25T20:44:04.914845] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:44:04.924244] [INFO ] [REMOTE ] DK: Full fetch complete (70799 records). [2025-10-25T20:44:04.924460] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-25T20:44:05.398329] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-25T20:44:05.398543] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-25T20:44:05.400154] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-25T20:44:05.400266] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-25T20:44:05.402536] [DEBUG] [LOCAL ] DK: Trimmed 70799 records to 49930 (keeping 200 days of data) [2025-10-25T20:44:05.799440] [DEBUG] [LOCAL ] DK: Primary data saved (49930 records). [2025-10-25T20:44:05.799743] [INFO ] [MAIN ] DK: Full history saved. [2025-10-25T20:44:05.799921] [INFO ] [MAIN ] Update Progress: 626/2366 symbols. DK took 14.0s. Estimated remaining time: 4h 55m 27s [2025-10-25T20:44:06.023126] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:44:06.023358] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-25T20:44:06.023433] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-25T20:44:06.023566] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-25T20:44:06.023661] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-25T20:44:06.023749] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-25T20:44:06.023817] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-25T20:44:06.443559] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:44:06.444033] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-25T20:44:07.591726] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T20:44:07.597991] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-25T20:44:08.831401] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T20:44:08.836896] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-25T20:44:10.191951] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T20:44:10.197553] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-25T20:44:11.780109] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T20:44:11.786883] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-25T20:44:12.976166] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T20:44:12.981226] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-25T20:44:14.012890] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:44:14.017027] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-25T20:44:14.945616] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T20:44:14.949865] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-25T20:44:16.237545] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T20:44:16.241286] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-25T20:44:17.246338] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T20:44:17.249846] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-25T20:44:18.143483] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T20:44:18.146021] [INFO ] [REMOTE ] DKL: Full fetch complete (27472 records). [2025-10-25T20:44:18.146127] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-25T20:44:18.504149] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-25T20:44:18.504270] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-25T20:44:18.504781] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-25T20:44:18.504903] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-25T20:44:18.505694] [DEBUG] [LOCAL ] DKL: Trimmed 27472 records to 16962 (keeping 200 days of data) [2025-10-25T20:44:18.604793] [DEBUG] [LOCAL ] DKL: Primary data saved (16962 records). [2025-10-25T20:44:18.604985] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-25T20:44:18.605150] [INFO ] [MAIN ] Update Progress: 627/2366 symbols. DKL took 12.8s. Estimated remaining time: 4h 55m 24s [2025-10-25T20:44:18.779045] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:44:18.780289] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-10-25T20:44:18.780375] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-10-25T20:44:18.780578] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-25T20:44:18.780693] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-25T20:44:18.780797] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-10-25T20:44:18.780883] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-25T20:44:19.149760] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:44:19.150127] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-25T20:44:21.032452] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T20:44:21.041970] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-25T20:44:22.870878] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T20:44:22.880106] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-25T20:44:24.820204] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T20:44:24.830747] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-25T20:44:26.719601] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-25T20:44:26.729631] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-25T20:44:28.760973] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-25T20:44:28.771586] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-25T20:44:30.686149] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-25T20:44:30.701517] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-25T20:44:32.440901] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T20:44:32.451537] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-25T20:44:34.310931] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-25T20:44:34.321252] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-25T20:44:36.030594] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T20:44:36.041364] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-25T20:44:37.825208] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-25T20:44:37.833595] [INFO ] [REMOTE ] DKS: Full fetch complete (71402 records). [2025-10-25T20:44:37.833768] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-25T20:44:38.209676] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-25T20:44:38.209797] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-25T20:44:38.210585] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-25T20:44:38.210688] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-25T20:44:38.212078] [DEBUG] [LOCAL ] DKS: Trimmed 71402 records to 49852 (keeping 200 days of data) [2025-10-25T20:44:38.512322] [DEBUG] [LOCAL ] DKS: Primary data saved (49852 records). [2025-10-25T20:44:38.512494] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-25T20:44:38.512621] [INFO ] [MAIN ] Update Progress: 628/2366 symbols. DKS took 19.9s. Estimated remaining time: 4h 55m 41s [2025-10-25T20:44:38.677005] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:44:38.677193] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-25T20:44:38.677283] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-25T20:44:38.677391] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-25T20:44:38.677457] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-25T20:44:38.677516] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-25T20:44:38.677577] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-25T20:44:39.020813] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:44:39.021142] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-25T20:44:40.590758] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T20:44:40.597855] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-25T20:44:42.119883] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T20:44:42.126680] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-25T20:44:43.748499] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T20:44:43.755528] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-25T20:44:45.373843] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T20:44:45.381089] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-25T20:44:46.914991] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T20:44:46.923411] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-25T20:44:48.298785] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T20:44:48.305054] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-25T20:44:49.685536] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T20:44:49.691966] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-25T20:44:51.130348] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T20:44:51.138367] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-25T20:44:52.634709] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T20:44:52.642125] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-25T20:44:54.104281] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T20:44:54.111635] [INFO ] [REMOTE ] DLB: Full fetch complete (47513 records). [2025-10-25T20:44:54.111824] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-25T20:44:54.499451] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-25T20:44:54.499573] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-25T20:44:54.500290] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-25T20:44:54.500371] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-25T20:44:54.501496] [DEBUG] [LOCAL ] DLB: Trimmed 47513 records to 32686 (keeping 200 days of data) [2025-10-25T20:44:54.693404] [DEBUG] [LOCAL ] DLB: Primary data saved (32686 records). [2025-10-25T20:44:54.693583] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-25T20:44:54.693713] [INFO ] [MAIN ] Update Progress: 629/2366 symbols. DLB took 16.2s. Estimated remaining time: 4h 55m 47s [2025-10-25T20:44:54.861485] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:44:54.861741] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-10-25T20:44:54.861838] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-10-25T20:44:54.861958] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-25T20:44:54.862028] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-25T20:44:54.862129] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-25T20:44:54.862198] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-25T20:44:55.237222] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:44:55.237603] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-25T20:44:56.144955] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T20:44:56.149058] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-25T20:44:57.140031] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T20:44:57.142953] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-25T20:44:58.027627] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T20:44:58.029792] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-25T20:44:58.904197] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-25T20:44:58.908224] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-25T20:44:59.816258] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T20:44:59.819266] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-25T20:45:00.584694] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T20:45:00.586402] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-25T20:45:01.340166] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T20:45:01.342120] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-25T20:45:02.652398] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T20:45:02.654095] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-25T20:45:03.459346] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-25T20:45:03.461278] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-25T20:45:04.070022] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-25T20:45:04.071683] [INFO ] [REMOTE ] DLNG: Full fetch complete (11072 records). [2025-10-25T20:45:04.071783] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-25T20:45:04.423973] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-25T20:45:04.424090] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-25T20:45:04.424387] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-25T20:45:04.424682] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-25T20:45:04.425128] [DEBUG] [LOCAL ] DLNG: Trimmed 11072 records to 6143 (keeping 200 days of data) [2025-10-25T20:45:04.459856] [DEBUG] [LOCAL ] DLNG: Primary data saved (6143 records). [2025-10-25T20:45:04.459967] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-25T20:45:04.460103] [INFO ] [MAIN ] Update Progress: 630/2366 symbols. DLNG took 9.8s. Estimated remaining time: 4h 55m 36s [2025-10-25T20:45:04.626703] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:45:04.626875] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-10-25T20:45:04.626948] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-10-25T20:45:04.627058] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-25T20:45:04.627131] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-25T20:45:04.627213] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-10-25T20:45:04.627283] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-25T20:45:04.972192] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:45:04.972493] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-25T20:45:06.847544] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T20:45:06.857612] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-25T20:45:08.469307] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T20:45:08.479249] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-25T20:45:10.448154] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-25T20:45:10.459111] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-25T20:45:11.517898] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T20:45:11.529371] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-25T20:45:12.338571] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T20:45:12.349102] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-25T20:45:13.648401] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T20:45:13.658609] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-25T20:45:14.940036] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T20:45:14.951295] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-25T20:45:16.030105] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T20:45:16.040412] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-25T20:45:16.886699] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T20:45:16.901092] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-25T20:45:17.836690] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:45:17.846215] [INFO ] [REMOTE ] DLR: Full fetch complete (74186 records). [2025-10-25T20:45:17.846422] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-25T20:45:18.245681] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-25T20:45:18.245803] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-25T20:45:18.246623] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-25T20:45:18.246720] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-25T20:45:18.248084] [DEBUG] [LOCAL ] DLR: Trimmed 74186 records to 51364 (keeping 200 days of data) [2025-10-25T20:45:18.563738] [DEBUG] [LOCAL ] DLR: Primary data saved (51364 records). [2025-10-25T20:45:18.563918] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-25T20:45:18.564051] [INFO ] [MAIN ] Update Progress: 631/2366 symbols. DLR took 14.1s. Estimated remaining time: 4h 55m 36s [2025-10-25T20:45:18.743045] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:45:18.743283] [DEBUG] [LOCAL ] DLX: No existing data file found in primary storage. [2025-10-25T20:45:18.743357] [WARN ] [MAIN ] DLX: No existing data found, performing full refresh instead. [2025-10-25T20:45:18.743484] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-25T20:45:18.743566] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-25T20:45:18.743628] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-25T20:45:18.743720] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-25T20:45:19.099748] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:45:19.100112] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-25T20:45:20.306866] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T20:45:20.312011] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-25T20:45:21.885632] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:45:21.892555] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-25T20:45:23.298816] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T20:45:23.305181] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-25T20:45:24.754726] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-25T20:45:24.765181] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-25T20:45:26.386791] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T20:45:26.393346] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-25T20:45:27.766127] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T20:45:27.772570] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-25T20:45:29.046326] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T20:45:29.054617] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-25T20:45:30.670166] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T20:45:30.676621] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-25T20:45:31.952243] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T20:45:31.958176] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-25T20:45:33.122105] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T20:45:33.126719] [INFO ] [REMOTE ] DLX: Full fetch complete (41377 records). [2025-10-25T20:45:33.126849] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-25T20:45:33.532584] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-25T20:45:33.532722] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-25T20:45:33.533316] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-25T20:45:33.533394] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-25T20:45:33.534347] [DEBUG] [LOCAL ] DLX: Trimmed 41377 records to 28400 (keeping 200 days of data) [2025-10-25T20:45:33.697218] [DEBUG] [LOCAL ] DLX: Primary data saved (28400 records). [2025-10-25T20:45:33.697382] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-25T20:45:33.697511] [INFO ] [MAIN ] Update Progress: 632/2366 symbols. DLX took 15.1s. Estimated remaining time: 4h 55m 40s [2025-10-25T20:45:33.860734] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:45:33.860953] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-10-25T20:45:33.861029] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-10-25T20:45:33.861144] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-25T20:45:33.861217] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-25T20:45:33.861303] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-25T20:45:33.861375] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-25T20:45:34.209943] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:45:34.210321] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-25T20:45:35.331802] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T20:45:35.335866] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-25T20:45:36.411839] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T20:45:36.415476] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-25T20:45:37.516944] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T20:45:37.521279] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-25T20:45:38.866924] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T20:45:38.871904] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-25T20:45:39.858573] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:45:39.864050] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-25T20:45:41.172944] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T20:45:41.177002] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-25T20:45:42.382485] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T20:45:42.387805] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-25T20:45:43.500424] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T20:45:43.504835] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-25T20:45:44.676698] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T20:45:44.682238] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-25T20:45:46.012462] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T20:45:46.019048] [INFO ] [REMOTE ] DLY: Full fetch complete (28779 records). [2025-10-25T20:45:46.019308] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-25T20:45:46.597665] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-25T20:45:46.597821] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-25T20:45:46.598703] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-25T20:45:46.598806] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-25T20:45:46.600057] [DEBUG] [LOCAL ] DLY: Trimmed 28779 records to 21112 (keeping 200 days of data) [2025-10-25T20:45:46.736074] [DEBUG] [LOCAL ] DLY: Primary data saved (21112 records). [2025-10-25T20:45:46.736241] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-25T20:45:46.736369] [INFO ] [MAIN ] Update Progress: 633/2366 symbols. DLY took 13.0s. Estimated remaining time: 4h 55m 37s [2025-10-25T20:45:46.911813] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:45:46.912011] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-10-25T20:45:46.912085] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-10-25T20:45:46.912200] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-25T20:45:46.912272] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-25T20:45:46.912355] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-25T20:45:46.912425] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-25T20:45:47.281299] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:45:47.281741] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-25T20:45:47.958823] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-25T20:45:47.960343] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-25T20:45:48.680323] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T20:45:48.682026] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-25T20:45:49.440243] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T20:45:49.441838] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-25T20:45:50.084263] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-25T20:45:50.085719] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-25T20:45:50.851688] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T20:45:50.853872] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-25T20:45:51.467952] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T20:45:51.469395] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-25T20:45:52.173179] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T20:45:52.174843] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-25T20:45:52.875868] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-25T20:45:52.877831] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-25T20:45:53.627269] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T20:45:53.629287] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-25T20:45:54.510947] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T20:45:54.512423] [INFO ] [REMOTE ] DMA: Full fetch complete (6572 records). [2025-10-25T20:45:54.512513] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-25T20:45:54.869633] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-25T20:45:54.869763] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-25T20:45:54.869954] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-25T20:45:54.870029] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-25T20:45:54.870442] [DEBUG] [LOCAL ] DMA: Trimmed 6572 records to 4751 (keeping 200 days of data) [2025-10-25T20:45:54.897634] [DEBUG] [LOCAL ] DMA: Primary data saved (4751 records). [2025-10-25T20:45:54.897750] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-25T20:45:54.897881] [INFO ] [MAIN ] Update Progress: 634/2366 symbols. DMA took 8.2s. Estimated remaining time: 4h 55m 21s [2025-10-25T20:45:55.064183] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:45:55.064367] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-25T20:45:55.064437] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-25T20:45:55.064546] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-25T20:45:55.064620] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-25T20:45:55.064774] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-25T20:45:55.064863] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-25T20:45:55.420448] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:45:55.420849] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-25T20:45:56.392848] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T20:45:56.396088] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-25T20:45:57.181686] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T20:45:57.184038] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-25T20:45:58.058291] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-25T20:45:58.060411] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-25T20:45:58.976410] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T20:45:58.979554] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-25T20:45:59.818308] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T20:45:59.820938] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-25T20:46:00.748301] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T20:46:00.751072] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-25T20:46:01.785373] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T20:46:01.788196] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-25T20:46:03.468672] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T20:46:03.471593] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-25T20:46:04.570761] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T20:46:04.573771] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-25T20:46:05.555484] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T20:46:05.557942] [INFO ] [REMOTE ] DMB: Full fetch complete (14586 records). [2025-10-25T20:46:05.558062] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-25T20:46:05.928020] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-25T20:46:05.928157] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-25T20:46:05.928577] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-25T20:46:05.928849] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-25T20:46:05.929452] [DEBUG] [LOCAL ] DMB: Trimmed 14586 records to 10587 (keeping 200 days of data) [2025-10-25T20:46:05.991603] [DEBUG] [LOCAL ] DMB: Primary data saved (10587 records). [2025-10-25T20:46:05.991808] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-25T20:46:05.991958] [INFO ] [MAIN ] Update Progress: 635/2366 symbols. DMB took 11.1s. Estimated remaining time: 4h 55m 13s [2025-10-25T20:46:06.164281] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:46:06.164493] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-10-25T20:46:06.164583] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-10-25T20:46:06.164743] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-25T20:46:06.164830] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-25T20:46:06.164914] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-25T20:46:06.164996] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-25T20:46:06.519794] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:46:06.520153] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-25T20:46:07.464858] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T20:46:07.467990] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-25T20:46:08.366155] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T20:46:08.368634] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-25T20:46:09.290406] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-25T20:46:09.294078] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-25T20:46:10.323684] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:46:10.326755] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-25T20:46:11.288934] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T20:46:11.292637] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-25T20:46:12.095919] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T20:46:12.098406] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-25T20:46:13.045342] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T20:46:13.048360] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-25T20:46:13.913509] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T20:46:13.916445] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-25T20:46:14.798791] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-25T20:46:14.801431] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-25T20:46:15.730117] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:46:15.732237] [INFO ] [REMOTE ] DMO: Full fetch complete (14333 records). [2025-10-25T20:46:15.732332] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-25T20:46:16.096900] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-25T20:46:16.097009] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-25T20:46:16.097344] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-25T20:46:16.097420] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-25T20:46:16.097995] [DEBUG] [LOCAL ] DMO: Trimmed 14333 records to 9879 (keeping 200 days of data) [2025-10-25T20:46:16.155403] [DEBUG] [LOCAL ] DMO: Primary data saved (9879 records). [2025-10-25T20:46:16.155552] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-25T20:46:16.155694] [INFO ] [MAIN ] Update Progress: 636/2366 symbols. DMO took 10.2s. Estimated remaining time: 4h 55m 3s [2025-10-25T20:46:16.323691] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:46:16.323887] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-10-25T20:46:16.323964] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-10-25T20:46:16.324050] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-25T20:46:16.324116] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-25T20:46:16.324199] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-25T20:46:16.324267] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-25T20:46:16.675309] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:46:16.675631] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-25T20:46:18.570878] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T20:46:18.580783] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-25T20:46:20.779419] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-25T20:46:20.789127] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-25T20:46:22.608303] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T20:46:22.618482] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-25T20:46:24.384091] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T20:46:24.398225] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-25T20:46:26.214803] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T20:46:26.224884] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-25T20:46:27.757283] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T20:46:27.766907] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-25T20:46:29.699453] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-25T20:46:29.710381] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-25T20:46:31.769546] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-25T20:46:31.779726] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-25T20:46:33.783718] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-25T20:46:33.793957] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-25T20:46:35.967092] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-25T20:46:35.976295] [INFO ] [REMOTE ] DNA: Full fetch complete (71196 records). [2025-10-25T20:46:35.976470] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-25T20:46:36.357808] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-25T20:46:36.357974] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-25T20:46:36.359120] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-25T20:46:36.359214] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-25T20:46:36.360746] [DEBUG] [LOCAL ] DNA: Trimmed 71196 records to 49222 (keeping 200 days of data) [2025-10-25T20:46:36.634990] [DEBUG] [LOCAL ] DNA: Primary data saved (49222 records). [2025-10-25T20:46:36.635213] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-25T20:46:36.635346] [INFO ] [MAIN ] Update Progress: 637/2366 symbols. DNA took 20.5s. Estimated remaining time: 4h 55m 21s [2025-10-25T20:46:36.801485] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:46:36.801728] [DEBUG] [LOCAL ] DNOW: No existing data file found in primary storage. [2025-10-25T20:46:36.801809] [WARN ] [MAIN ] DNOW: No existing data found, performing full refresh instead. [2025-10-25T20:46:36.801931] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-25T20:46:36.802003] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-25T20:46:36.802089] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-25T20:46:36.802161] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-25T20:46:37.145326] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:46:37.145694] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-25T20:46:38.819167] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T20:46:38.827375] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-25T20:46:40.360131] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T20:46:40.368710] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-25T20:46:41.946414] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T20:46:41.955480] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-25T20:46:43.573046] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T20:46:43.584193] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-25T20:46:45.389499] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T20:46:45.399195] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-25T20:46:46.880628] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T20:46:46.891605] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-25T20:46:48.653091] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-25T20:46:48.663292] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-25T20:46:50.207382] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T20:46:50.216856] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-25T20:46:51.855057] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T20:46:51.864507] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-25T20:46:53.548911] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T20:46:53.557266] [INFO ] [REMOTE ] DNOW: Full fetch complete (63747 records). [2025-10-25T20:46:53.557438] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-25T20:46:53.938885] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-25T20:46:53.939017] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-25T20:46:53.940353] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-25T20:46:53.940433] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-25T20:46:53.941720] [DEBUG] [LOCAL ] DNOW: Trimmed 63747 records to 44389 (keeping 200 days of data) [2025-10-25T20:46:54.196325] [DEBUG] [LOCAL ] DNOW: Primary data saved (44389 records). [2025-10-25T20:46:54.196514] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-25T20:46:54.196672] [INFO ] [MAIN ] Update Progress: 638/2366 symbols. DNOW took 17.6s. Estimated remaining time: 4h 55m 30s [2025-10-25T20:46:54.398117] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:46:54.398371] [DEBUG] [LOCAL ] DNP: No existing data file found in primary storage. [2025-10-25T20:46:54.398461] [WARN ] [MAIN ] DNP: No existing data found, performing full refresh instead. [2025-10-25T20:46:54.398608] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-25T20:46:54.398725] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-25T20:46:54.398827] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-25T20:46:54.398909] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-25T20:46:54.932026] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:46:54.932585] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-25T20:46:56.444125] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T20:46:56.451638] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-25T20:46:57.785460] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T20:46:57.792116] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-25T20:46:59.255180] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T20:46:59.262289] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-25T20:47:00.939750] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-25T20:47:00.948134] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-25T20:47:02.693884] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-25T20:47:02.702152] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-25T20:47:04.028107] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T20:47:04.034783] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-25T20:47:05.508476] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T20:47:05.515671] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-25T20:47:07.081732] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T20:47:07.089015] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-25T20:47:08.688196] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T20:47:08.695233] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-25T20:47:10.091394] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-25T20:47:10.097566] [INFO ] [REMOTE ] DNP: Full fetch complete (48443 records). [2025-10-25T20:47:10.097747] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-25T20:47:10.492980] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-25T20:47:10.493142] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-25T20:47:10.493838] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-25T20:47:10.493921] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-25T20:47:10.495097] [DEBUG] [LOCAL ] DNP: Trimmed 48443 records to 33548 (keeping 200 days of data) [2025-10-25T20:47:10.682605] [DEBUG] [LOCAL ] DNP: Primary data saved (33548 records). [2025-10-25T20:47:10.682786] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-25T20:47:10.682965] [INFO ] [MAIN ] Update Progress: 639/2366 symbols. DNP took 16.5s. Estimated remaining time: 4h 55m 37s [2025-10-25T20:47:10.855140] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:47:10.855348] [DEBUG] [LOCAL ] DOC: No existing data file found in primary storage. [2025-10-25T20:47:10.855420] [WARN ] [MAIN ] DOC: No existing data found, performing full refresh instead. [2025-10-25T20:47:10.855536] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-25T20:47:10.855606] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-25T20:47:10.855711] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-10-25T20:47:10.855782] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-25T20:47:11.207351] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:47:11.207786] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-25T20:47:12.928995] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T20:47:12.941002] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-25T20:47:14.834002] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-25T20:47:14.844183] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-25T20:47:16.928885] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-25T20:47:16.940339] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-25T20:47:17.856556] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T20:47:17.868141] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-25T20:47:18.856023] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:47:18.867258] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-25T20:47:19.825538] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:47:19.836189] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-25T20:47:20.967571] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T20:47:20.979530] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-25T20:47:21.949639] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:47:21.960940] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-25T20:47:22.959369] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T20:47:22.970593] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-25T20:47:23.554908] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T20:47:23.565435] [INFO ] [REMOTE ] DOC: Full fetch complete (77597 records). [2025-10-25T20:47:23.565735] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-25T20:47:23.975730] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-25T20:47:23.975928] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-25T20:47:23.977297] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-25T20:47:23.977430] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-25T20:47:23.979839] [DEBUG] [LOCAL ] DOC: Trimmed 77597 records to 54334 (keeping 200 days of data) [2025-10-25T20:47:24.304221] [DEBUG] [LOCAL ] DOC: Primary data saved (54334 records). [2025-10-25T20:47:24.304404] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-25T20:47:24.304534] [INFO ] [MAIN ] Update Progress: 640/2366 symbols. DOC took 13.6s. Estimated remaining time: 4h 55m 35s [2025-10-25T20:47:24.474449] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:47:24.474669] [DEBUG] [LOCAL ] DOCN: No existing data file found in primary storage. [2025-10-25T20:47:24.474743] [WARN ] [MAIN ] DOCN: No existing data found, performing full refresh instead. [2025-10-25T20:47:24.474857] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-25T20:47:24.474929] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-25T20:47:24.475011] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-25T20:47:24.475082] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-25T20:47:24.847846] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:47:24.848278] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-25T20:47:26.461279] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-25T20:47:26.470617] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-25T20:47:28.357947] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-25T20:47:28.367594] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-25T20:47:30.186753] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T20:47:30.197883] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-25T20:47:31.153447] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T20:47:31.164356] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-25T20:47:31.753078] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T20:47:31.764965] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-25T20:47:33.127464] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T20:47:33.137780] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-25T20:47:34.202151] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T20:47:34.213113] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-25T20:47:35.174169] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T20:47:35.185085] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-25T20:47:36.298253] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T20:47:36.309272] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-25T20:47:37.209076] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T20:47:37.218566] [INFO ] [REMOTE ] DOCN: Full fetch complete (73061 records). [2025-10-25T20:47:37.218739] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-25T20:47:37.604274] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-25T20:47:37.604386] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-25T20:47:37.605220] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-25T20:47:37.605302] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-25T20:47:37.606682] [DEBUG] [LOCAL ] DOCN: Trimmed 73061 records to 51866 (keeping 200 days of data) [2025-10-25T20:47:37.926248] [DEBUG] [LOCAL ] DOCN: Primary data saved (51866 records). [2025-10-25T20:47:37.926503] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-25T20:47:37.926630] [INFO ] [MAIN ] Update Progress: 641/2366 symbols. DOCN took 13.6s. Estimated remaining time: 4h 55m 34s [2025-10-25T20:47:38.093675] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:47:38.093864] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-25T20:47:38.093935] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-25T20:47:38.094045] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-25T20:47:38.094115] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-25T20:47:38.094196] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-25T20:47:38.094266] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-25T20:47:38.443114] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:47:38.443474] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-25T20:47:40.072764] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T20:47:40.087234] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-25T20:47:41.931214] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T20:47:41.941537] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-25T20:47:43.726844] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T20:47:43.738268] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-25T20:47:44.844851] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T20:47:44.856193] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-25T20:47:45.748668] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:47:45.760170] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-25T20:47:46.765234] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T20:47:46.775794] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-25T20:47:48.195900] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T20:47:48.206883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-25T20:47:49.126172] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T20:47:49.136714] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-25T20:47:49.988091] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T20:47:49.998549] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-25T20:47:50.837632] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T20:47:50.846072] [INFO ] [REMOTE ] DOCS: Full fetch complete (73619 records). [2025-10-25T20:47:50.846213] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-25T20:47:51.238877] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-25T20:47:51.239055] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-25T20:47:51.239954] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-25T20:47:51.240041] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-25T20:47:51.241462] [DEBUG] [LOCAL ] DOCS: Trimmed 73619 records to 50950 (keeping 200 days of data) [2025-10-25T20:47:51.528476] [DEBUG] [LOCAL ] DOCS: Primary data saved (50950 records). [2025-10-25T20:47:51.528669] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-25T20:47:51.528798] [INFO ] [MAIN ] Update Progress: 642/2366 symbols. DOCS took 13.6s. Estimated remaining time: 4h 55m 33s [2025-10-25T20:47:51.694260] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:47:51.694450] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-10-25T20:47:51.694526] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-10-25T20:47:51.694691] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-25T20:47:51.694779] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-25T20:47:51.694873] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-25T20:47:51.694952] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-25T20:47:52.102075] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:47:52.102469] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-25T20:47:53.612969] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T20:47:53.620932] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-25T20:47:54.969091] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T20:47:54.975697] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-25T20:47:56.534763] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T20:47:56.542679] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-25T20:47:58.067921] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T20:47:58.076050] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-25T20:47:59.608719] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T20:47:59.617170] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-25T20:48:01.327470] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T20:48:01.335410] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-25T20:48:02.792370] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T20:48:02.801853] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-25T20:48:04.247592] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T20:48:04.256798] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-25T20:48:06.027975] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T20:48:06.037858] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-25T20:48:07.645269] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T20:48:07.652966] [INFO ] [REMOTE ] DOLE: Full fetch complete (54630 records). [2025-10-25T20:48:07.653113] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-25T20:48:08.025030] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-25T20:48:08.025142] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-25T20:48:08.025998] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-25T20:48:08.026078] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-25T20:48:08.027255] [DEBUG] [LOCAL ] DOLE: Trimmed 54630 records to 39659 (keeping 200 days of data) [2025-10-25T20:48:08.254613] [DEBUG] [LOCAL ] DOLE: Primary data saved (39659 records). [2025-10-25T20:48:08.254802] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-25T20:48:08.254967] [INFO ] [MAIN ] Update Progress: 643/2366 symbols. DOLE took 16.7s. Estimated remaining time: 4h 55m 40s [2025-10-25T20:48:08.425545] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:48:08.425728] [DEBUG] [LOCAL ] DOUG: No existing data file found in primary storage. [2025-10-25T20:48:08.425830] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-10-25T20:48:08.425951] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-25T20:48:08.426031] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-25T20:48:08.426109] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-10-25T20:48:08.426175] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-25T20:48:08.775421] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:48:08.775782] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-25T20:48:10.258338] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T20:48:10.265637] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-25T20:48:11.612488] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T20:48:11.620045] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-25T20:48:12.996341] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T20:48:13.004353] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-25T20:48:14.439307] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T20:48:14.446577] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-25T20:48:16.011288] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T20:48:16.019766] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-25T20:48:17.527392] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T20:48:17.534984] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-25T20:48:18.944996] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-25T20:48:18.952471] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-25T20:48:20.578821] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T20:48:20.586146] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-25T20:48:21.940378] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T20:48:21.948847] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-25T20:48:23.295436] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T20:48:23.300769] [INFO ] [REMOTE ] DOUG: Full fetch complete (49727 records). [2025-10-25T20:48:23.300903] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-25T20:48:23.725481] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-25T20:48:23.725608] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-25T20:48:23.726282] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-25T20:48:23.726362] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-25T20:48:23.727521] [DEBUG] [LOCAL ] DOUG: Trimmed 49727 records to 34109 (keeping 200 days of data) [2025-10-25T20:48:23.911511] [DEBUG] [LOCAL ] DOUG: Primary data saved (34109 records). [2025-10-25T20:48:23.911713] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-25T20:48:23.911850] [INFO ] [MAIN ] Update Progress: 644/2366 symbols. DOUG took 15.7s. Estimated remaining time: 4h 55m 44s [2025-10-25T20:48:24.086082] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:48:24.086311] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-10-25T20:48:24.086402] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-10-25T20:48:24.086539] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-25T20:48:24.086671] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-25T20:48:24.086776] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-25T20:48:24.086860] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-25T20:48:24.450672] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:48:24.451084] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-25T20:48:26.059896] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-25T20:48:26.073112] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-25T20:48:27.736339] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T20:48:27.744750] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-25T20:48:29.559685] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T20:48:29.570349] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-25T20:48:31.584823] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-25T20:48:31.595616] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-25T20:48:33.371910] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-25T20:48:33.382597] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-25T20:48:35.027413] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T20:48:35.038708] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-25T20:48:36.948687] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-25T20:48:36.958760] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-25T20:48:38.551185] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T20:48:38.561002] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-25T20:48:40.396144] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-25T20:48:40.405732] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-25T20:48:42.473070] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-25T20:48:42.481928] [INFO ] [REMOTE ] DOV: Full fetch complete (66285 records). [2025-10-25T20:48:42.482087] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-25T20:48:42.867579] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-25T20:48:42.867712] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-25T20:48:42.868477] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-25T20:48:42.868554] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-25T20:48:42.869810] [DEBUG] [LOCAL ] DOV: Trimmed 66285 records to 46328 (keeping 200 days of data) [2025-10-25T20:48:43.146666] [DEBUG] [LOCAL ] DOV: Primary data saved (46328 records). [2025-10-25T20:48:43.146852] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-25T20:48:43.146993] [INFO ] [MAIN ] Update Progress: 645/2366 symbols. DOV took 19.2s. Estimated remaining time: 4h 55m 57s [2025-10-25T20:48:43.314425] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:48:43.314625] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-10-25T20:48:43.314714] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-10-25T20:48:43.314823] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-25T20:48:43.314893] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-25T20:48:43.314956] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-25T20:48:43.315018] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-25T20:48:43.659112] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:48:43.659484] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-25T20:48:45.797985] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-25T20:48:45.808328] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-25T20:48:47.910981] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-25T20:48:47.921111] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-25T20:48:49.882678] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-25T20:48:49.894928] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-25T20:48:51.087426] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-25T20:48:51.098871] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-25T20:48:52.282750] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T20:48:52.293891] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-25T20:48:53.295488] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T20:48:53.306473] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-25T20:48:54.400707] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T20:48:54.412444] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-25T20:48:55.551428] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T20:48:55.562721] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-25T20:48:56.797837] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T20:48:56.809233] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-25T20:48:57.720470] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:48:57.730334] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-25T20:48:57.730514] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-25T20:48:58.134248] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-25T20:48:58.134385] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-25T20:48:58.135405] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-25T20:48:58.135506] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-25T20:48:58.137140] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54513 (keeping 200 days of data) [2025-10-25T20:48:58.469266] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-10-25T20:48:58.469469] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-25T20:48:58.469607] [INFO ] [MAIN ] Update Progress: 646/2366 symbols. DOW took 15.3s. Estimated remaining time: 4h 56m 0s [2025-10-25T20:48:58.635269] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:48:58.635499] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-10-25T20:48:58.635571] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-10-25T20:48:58.635715] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-25T20:48:58.635785] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-25T20:48:58.635864] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-25T20:48:58.635933] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-25T20:48:58.988873] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:48:58.989246] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-25T20:48:59.994883] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T20:48:59.998087] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-25T20:49:00.895927] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T20:49:00.898696] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-25T20:49:02.623444] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T20:49:02.627190] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-25T20:49:03.715941] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T20:49:03.719724] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-25T20:49:04.754104] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:49:04.757534] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-25T20:49:05.748221] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T20:49:05.751405] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-25T20:49:06.800560] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T20:49:06.804231] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-25T20:49:07.849408] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T20:49:07.853171] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-25T20:49:08.899696] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T20:49:08.904037] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-25T20:49:09.846932] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T20:49:09.850043] [INFO ] [REMOTE ] DPG: Full fetch complete (19008 records). [2025-10-25T20:49:09.850187] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-25T20:49:10.237213] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-25T20:49:10.237361] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-25T20:49:10.237888] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-25T20:49:10.238275] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-25T20:49:10.239395] [DEBUG] [LOCAL ] DPG: Trimmed 19008 records to 13476 (keeping 200 days of data) [2025-10-25T20:49:10.318491] [DEBUG] [LOCAL ] DPG: Primary data saved (13476 records). [2025-10-25T20:49:10.318739] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-25T20:49:10.318884] [INFO ] [MAIN ] Update Progress: 647/2366 symbols. DPG took 11.8s. Estimated remaining time: 4h 55m 54s [2025-10-25T20:49:10.507194] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:49:10.507426] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-25T20:49:10.507500] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-25T20:49:10.507615] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-25T20:49:10.507711] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-25T20:49:10.507796] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-25T20:49:10.507867] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-25T20:49:10.865118] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:49:10.865456] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-25T20:49:12.365787] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T20:49:12.374505] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-25T20:49:14.050902] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T20:49:14.060145] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-25T20:49:15.669723] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T20:49:15.679328] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-25T20:49:17.004168] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T20:49:17.014676] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-25T20:49:17.813816] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T20:49:17.821705] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-25T20:49:18.662060] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T20:49:18.670332] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-25T20:49:19.418367] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T20:49:19.429969] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-25T20:49:19.885429] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T20:49:19.895797] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-25T20:49:20.452253] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-25T20:49:20.462519] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-25T20:49:21.444271] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T20:49:21.453117] [INFO ] [REMOTE ] DQ: Full fetch complete (63621 records). [2025-10-25T20:49:21.453313] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-25T20:49:21.865049] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-25T20:49:21.865181] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-25T20:49:21.866028] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-25T20:49:21.866119] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-25T20:49:21.867506] [DEBUG] [LOCAL ] DQ: Trimmed 63621 records to 44422 (keeping 200 days of data) [2025-10-25T20:49:22.129192] [DEBUG] [LOCAL ] DQ: Primary data saved (44422 records). [2025-10-25T20:49:22.129568] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-25T20:49:22.129724] [INFO ] [MAIN ] Update Progress: 648/2366 symbols. DQ took 11.8s. Estimated remaining time: 4h 55m 48s [2025-10-25T20:49:22.334080] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:49:22.334305] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-10-25T20:49:22.334400] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-10-25T20:49:22.334562] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-25T20:49:22.334670] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-25T20:49:22.334747] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-25T20:49:22.334815] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-25T20:49:22.790703] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:49:22.791236] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-25T20:49:24.218244] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T20:49:24.224023] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-25T20:49:25.681701] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T20:49:25.690513] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-25T20:49:27.195005] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T20:49:27.202958] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-25T20:49:28.786160] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T20:49:28.794210] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-25T20:49:30.241980] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T20:49:30.248563] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-25T20:49:31.781828] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T20:49:31.789733] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-25T20:49:33.181184] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T20:49:33.188693] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-25T20:49:34.856369] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T20:49:34.864132] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-25T20:49:36.693379] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-25T20:49:36.703232] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-25T20:49:38.380255] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T20:49:38.388464] [INFO ] [REMOTE ] DRD: Full fetch complete (52405 records). [2025-10-25T20:49:38.388614] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-25T20:49:38.759986] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-25T20:49:38.760096] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-25T20:49:38.760802] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-25T20:49:38.760893] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-25T20:49:38.762029] [DEBUG] [LOCAL ] DRD: Trimmed 52405 records to 38484 (keeping 200 days of data) [2025-10-25T20:49:38.984023] [DEBUG] [LOCAL ] DRD: Primary data saved (38484 records). [2025-10-25T20:49:38.984240] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-25T20:49:38.984441] [INFO ] [MAIN ] Update Progress: 649/2366 symbols. DRD took 16.9s. Estimated remaining time: 4h 55m 55s [2025-10-25T20:49:39.167839] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:49:39.168110] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-25T20:49:39.168191] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-25T20:49:39.168287] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-25T20:49:39.168358] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-25T20:49:39.168439] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-25T20:49:39.168510] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-25T20:49:39.548335] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:49:39.548721] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-25T20:49:41.200451] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T20:49:41.209696] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-25T20:49:42.723969] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T20:49:42.732767] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-25T20:49:44.316943] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T20:49:44.328182] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-25T20:49:45.578070] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T20:49:45.589108] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-25T20:49:46.568689] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T20:49:46.579342] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-25T20:49:47.528611] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:49:47.539073] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-25T20:49:48.733372] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-25T20:49:48.743942] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-25T20:49:49.709140] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:49:49.719914] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-25T20:49:50.326265] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T20:49:50.337623] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-25T20:49:51.256523] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:49:51.265784] [INFO ] [REMOTE ] DRH: Full fetch complete (71926 records). [2025-10-25T20:49:51.266003] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-25T20:49:51.695793] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-25T20:49:51.695914] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-25T20:49:51.696870] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-25T20:49:51.696979] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-25T20:49:51.698416] [DEBUG] [LOCAL ] DRH: Trimmed 71926 records to 50932 (keeping 200 days of data) [2025-10-25T20:49:51.999130] [DEBUG] [LOCAL ] DRH: Primary data saved (50932 records). [2025-10-25T20:49:51.999292] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-25T20:49:51.999418] [INFO ] [MAIN ] Update Progress: 650/2366 symbols. DRH took 13.0s. Estimated remaining time: 4h 55m 51s [2025-10-25T20:49:52.166424] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:49:52.166605] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-25T20:49:52.166703] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-25T20:49:52.166820] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-25T20:49:52.166894] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-25T20:49:52.166972] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-25T20:49:52.167041] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-25T20:49:52.514955] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:49:52.515314] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-25T20:49:54.355707] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T20:49:54.365184] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-25T20:49:56.187526] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T20:49:56.196903] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-25T20:49:58.050935] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T20:49:58.061309] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-25T20:49:59.353675] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T20:49:59.363893] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-25T20:50:00.251755] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:50:00.262364] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-25T20:50:01.392235] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T20:50:01.402620] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-25T20:50:02.363316] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T20:50:02.373536] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-25T20:50:03.291420] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T20:50:03.300899] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-25T20:50:04.673020] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T20:50:04.685151] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-25T20:50:05.673179] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T20:50:05.683336] [INFO ] [REMOTE ] DRI: Full fetch complete (69425 records). [2025-10-25T20:50:05.683519] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-25T20:50:06.091786] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-25T20:50:06.091936] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-25T20:50:06.092792] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-25T20:50:06.092876] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-25T20:50:06.094297] [DEBUG] [LOCAL ] DRI: Trimmed 69425 records to 48148 (keeping 200 days of data) [2025-10-25T20:50:06.381305] [DEBUG] [LOCAL ] DRI: Primary data saved (48148 records). [2025-10-25T20:50:06.381466] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-25T20:50:06.381590] [INFO ] [MAIN ] Update Progress: 651/2366 symbols. DRI took 14.4s. Estimated remaining time: 4h 55m 52s [2025-10-25T20:50:06.545873] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:50:06.546053] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-25T20:50:06.546124] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-25T20:50:06.546290] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-25T20:50:06.546359] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-25T20:50:06.546439] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-25T20:50:06.546508] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-25T20:50:06.895272] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:50:06.895613] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-25T20:50:07.948513] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T20:50:07.951379] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-25T20:50:08.870000] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-25T20:50:08.872933] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-25T20:50:09.994323] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T20:50:09.997983] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-25T20:50:10.903615] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T20:50:10.908466] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-25T20:50:11.855256] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T20:50:11.857871] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-25T20:50:12.736280] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T20:50:12.739105] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-25T20:50:13.701061] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T20:50:13.703538] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-25T20:50:14.616040] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T20:50:14.618640] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-25T20:50:15.484997] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T20:50:15.487521] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-25T20:50:16.318365] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T20:50:16.320205] [INFO ] [REMOTE ] DRLL: Full fetch complete (14447 records). [2025-10-25T20:50:16.320299] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-25T20:50:16.674381] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-25T20:50:16.674514] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-25T20:50:16.674957] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-25T20:50:16.675052] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-25T20:50:16.675638] [DEBUG] [LOCAL ] DRLL: Trimmed 14447 records to 8701 (keeping 200 days of data) [2025-10-25T20:50:16.726006] [DEBUG] [LOCAL ] DRLL: Primary data saved (8701 records). [2025-10-25T20:50:16.726186] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-25T20:50:16.726343] [INFO ] [MAIN ] Update Progress: 652/2366 symbols. DRLL took 10.3s. Estimated remaining time: 4h 55m 41s [2025-10-25T20:50:16.891413] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:50:16.891618] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-25T20:50:16.891725] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-25T20:50:16.891880] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-25T20:50:16.891973] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-25T20:50:16.892085] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-25T20:50:16.892172] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-25T20:50:17.238230] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:50:17.238611] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-25T20:50:18.457306] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T20:50:18.463226] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-25T20:50:19.892140] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T20:50:19.898268] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-25T20:50:21.387594] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T20:50:21.393913] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-25T20:50:23.330267] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T20:50:23.337558] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-25T20:50:24.534032] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T20:50:24.539494] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-25T20:50:25.700868] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T20:50:25.706608] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-25T20:50:27.305431] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T20:50:27.312979] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-25T20:50:28.864307] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T20:50:28.870602] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-25T20:50:30.194609] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T20:50:30.201228] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-25T20:50:31.735022] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-25T20:50:31.745157] [INFO ] [REMOTE ] DSL: Full fetch complete (41843 records). [2025-10-25T20:50:31.745405] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-25T20:50:32.241098] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-25T20:50:32.241244] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-25T20:50:32.241971] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-25T20:50:32.242070] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-25T20:50:32.243214] [DEBUG] [LOCAL ] DSL: Trimmed 41843 records to 29390 (keeping 200 days of data) [2025-10-25T20:50:32.416137] [DEBUG] [LOCAL ] DSL: Primary data saved (29390 records). [2025-10-25T20:50:32.416310] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-25T20:50:32.416472] [INFO ] [MAIN ] Update Progress: 653/2366 symbols. DSL took 15.7s. Estimated remaining time: 4h 55m 45s [2025-10-25T20:50:32.586232] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:50:32.586439] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-25T20:50:32.586509] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-25T20:50:32.586678] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-25T20:50:32.586752] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-25T20:50:32.586831] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-25T20:50:32.586899] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-25T20:50:32.945772] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:50:32.946075] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-25T20:50:34.041504] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T20:50:34.047668] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-25T20:50:35.313179] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T20:50:35.318634] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-25T20:50:36.722674] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T20:50:36.727819] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-25T20:50:37.967773] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T20:50:37.974077] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-25T20:50:38.982118] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T20:50:38.986982] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-25T20:50:40.035823] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T20:50:40.040039] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-25T20:50:40.925093] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T20:50:40.928197] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-25T20:50:41.830966] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T20:50:41.834264] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-25T20:50:42.820144] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T20:50:42.823844] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-25T20:50:43.731909] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:50:43.734795] [INFO ] [REMOTE ] DSM: Full fetch complete (23903 records). [2025-10-25T20:50:43.734985] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-25T20:50:44.103086] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-25T20:50:44.103198] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-25T20:50:44.103674] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-25T20:50:44.103754] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-25T20:50:44.104443] [DEBUG] [LOCAL ] DSM: Trimmed 23903 records to 14316 (keeping 200 days of data) [2025-10-25T20:50:44.182340] [DEBUG] [LOCAL ] DSM: Primary data saved (14316 records). [2025-10-25T20:50:44.182494] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-25T20:50:44.182615] [INFO ] [MAIN ] Update Progress: 654/2366 symbols. DSM took 11.8s. Estimated remaining time: 4h 55m 38s [2025-10-25T20:50:44.349150] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:50:44.349336] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-25T20:50:44.349407] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-25T20:50:44.349494] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-25T20:50:44.349559] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-25T20:50:44.349686] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-25T20:50:44.349764] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-25T20:50:44.701924] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:50:44.702243] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-25T20:50:45.401791] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T20:50:45.402839] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-25T20:50:45.924052] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-25T20:50:45.925414] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-25T20:50:46.636106] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T20:50:46.637514] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-25T20:50:47.379161] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T20:50:47.380924] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-25T20:50:47.930056] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-25T20:50:47.931288] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-25T20:50:48.395752] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-25T20:50:48.396854] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-25T20:50:48.902952] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-25T20:50:48.904137] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-25T20:50:49.472439] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T20:50:49.473615] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-25T20:50:49.998299] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-25T20:50:49.999824] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-25T20:50:50.529502] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-25T20:50:50.530447] [INFO ] [REMOTE ] DSMC: Full fetch complete (2880 records). [2025-10-25T20:50:50.530537] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-25T20:50:50.874104] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-25T20:50:50.874213] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-25T20:50:50.874346] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-25T20:50:50.874437] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-25T20:50:50.874860] [DEBUG] [LOCAL ] DSMC: Trimmed 2880 records to 1800 (keeping 200 days of data) [2025-10-25T20:50:50.885791] [DEBUG] [LOCAL ] DSMC: Primary data saved (1800 records). [2025-10-25T20:50:50.885871] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-25T20:50:50.885981] [INFO ] [MAIN ] Update Progress: 655/2366 symbols. DSMC took 6.7s. Estimated remaining time: 4h 55m 18s [2025-10-25T20:50:51.050658] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:50:51.050866] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-25T20:50:51.050936] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-25T20:50:51.051068] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-25T20:50:51.051142] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-25T20:50:51.051220] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-25T20:50:51.051288] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-25T20:50:51.404428] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:50:51.404859] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-25T20:50:52.628297] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T20:50:52.633613] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-25T20:50:53.774909] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T20:50:53.779560] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-25T20:50:55.107319] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T20:50:55.111963] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-25T20:50:56.343973] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T20:50:56.349591] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-25T20:50:57.548383] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T20:50:57.554352] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-25T20:50:58.664237] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T20:50:58.669032] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-25T20:50:59.859094] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-25T20:50:59.864915] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-25T20:51:01.260221] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T20:51:01.264968] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-25T20:51:02.651971] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T20:51:02.658434] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-25T20:51:03.882676] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T20:51:03.887560] [INFO ] [REMOTE ] DSU: Full fetch complete (33031 records). [2025-10-25T20:51:03.887786] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-25T20:51:04.279151] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-25T20:51:04.279296] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-25T20:51:04.279855] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-25T20:51:04.279952] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-25T20:51:04.280825] [DEBUG] [LOCAL ] DSU: Trimmed 33031 records to 23142 (keeping 200 days of data) [2025-10-25T20:51:04.414179] [DEBUG] [LOCAL ] DSU: Primary data saved (23142 records). [2025-10-25T20:51:04.414404] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-25T20:51:04.414555] [INFO ] [MAIN ] Update Progress: 656/2366 symbols. DSU took 13.5s. Estimated remaining time: 4h 55m 16s [2025-10-25T20:51:04.579925] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:51:04.580112] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-25T20:51:04.580182] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-25T20:51:04.580297] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-25T20:51:04.580366] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-25T20:51:04.580446] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-25T20:51:04.580512] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-25T20:51:04.928462] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:51:04.928841] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-25T20:51:06.238998] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T20:51:06.244355] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-25T20:51:07.571327] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T20:51:07.576828] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-25T20:51:08.955770] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T20:51:08.962826] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-25T20:51:10.249315] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T20:51:10.255263] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-25T20:51:11.421726] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T20:51:11.427151] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-25T20:51:12.703248] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T20:51:12.709401] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-25T20:51:13.869969] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T20:51:13.875607] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-25T20:51:15.113916] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T20:51:15.119446] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-25T20:51:16.300601] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T20:51:16.306012] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-25T20:51:17.697636] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-25T20:51:17.702144] [INFO ] [REMOTE ] DSX: Full fetch complete (35320 records). [2025-10-25T20:51:17.702269] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-25T20:51:18.089334] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-25T20:51:18.089464] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-25T20:51:18.090130] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-25T20:51:18.090212] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-25T20:51:18.091252] [DEBUG] [LOCAL ] DSX: Trimmed 35320 records to 23770 (keeping 200 days of data) [2025-10-25T20:51:18.228739] [DEBUG] [LOCAL ] DSX: Primary data saved (23770 records). [2025-10-25T20:51:18.228901] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-25T20:51:18.229041] [INFO ] [MAIN ] Update Progress: 657/2366 symbols. DSX took 13.8s. Estimated remaining time: 4h 55m 15s [2025-10-25T20:51:18.413878] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:51:18.414304] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-25T20:51:18.414381] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-25T20:51:18.414537] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-25T20:51:18.414614] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-25T20:51:18.414716] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-25T20:51:18.414787] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-25T20:51:18.947284] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:51:18.947834] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-25T20:51:20.851606] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T20:51:20.862098] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-25T20:51:22.741548] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T20:51:22.751812] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-25T20:51:24.608021] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T20:51:24.619091] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-25T20:51:26.206576] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T20:51:26.217596] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-25T20:51:27.055229] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T20:51:27.066523] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-25T20:51:27.902327] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T20:51:27.913003] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-25T20:51:28.924840] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T20:51:28.936110] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-25T20:51:29.853500] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T20:51:29.865373] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-25T20:51:31.251557] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T20:51:31.262705] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-25T20:51:32.414192] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T20:51:32.423710] [INFO ] [REMOTE ] DT: Full fetch complete (76891 records). [2025-10-25T20:51:32.423852] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-25T20:51:32.815489] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-25T20:51:32.815605] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-25T20:51:32.816475] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-25T20:51:32.816556] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-25T20:51:32.818019] [DEBUG] [LOCAL ] DT: Trimmed 76891 records to 53703 (keeping 200 days of data) [2025-10-25T20:51:33.111604] [DEBUG] [LOCAL ] DT: Primary data saved (53703 records). [2025-10-25T20:51:33.111800] [INFO ] [MAIN ] DT: Full history saved. [2025-10-25T20:51:33.111926] [INFO ] [MAIN ] Update Progress: 658/2366 symbols. DT took 14.9s. Estimated remaining time: 4h 55m 16s [2025-10-25T20:51:33.278780] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:51:33.278947] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-25T20:51:33.279031] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-25T20:51:33.279162] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-25T20:51:33.279231] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-25T20:51:33.279309] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-25T20:51:33.279375] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-25T20:51:33.647389] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:51:33.647788] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-25T20:51:34.386805] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-25T20:51:34.388352] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-25T20:51:35.027102] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-25T20:51:35.028489] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-25T20:51:35.678809] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-25T20:51:35.680299] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-25T20:51:36.313784] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-25T20:51:36.315407] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-25T20:51:37.065371] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-25T20:51:37.066949] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-25T20:51:37.736550] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-25T20:51:37.738432] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-25T20:51:38.476124] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T20:51:38.478397] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-25T20:51:39.200078] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-25T20:51:39.202037] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-25T20:51:39.751561] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-25T20:51:39.753712] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-25T20:51:40.389966] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T20:51:40.391186] [INFO ] [REMOTE ] DTB: Full fetch complete (6504 records). [2025-10-25T20:51:40.391278] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-25T20:51:40.746029] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-25T20:51:40.746153] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-25T20:51:40.746391] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-25T20:51:40.746470] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-25T20:51:40.746944] [DEBUG] [LOCAL ] DTB: Trimmed 6504 records to 4934 (keeping 200 days of data) [2025-10-25T20:51:40.775462] [DEBUG] [LOCAL ] DTB: Primary data saved (4934 records). [2025-10-25T20:51:40.775561] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-25T20:51:40.775679] [INFO ] [MAIN ] Update Progress: 659/2366 symbols. DTB took 7.7s. Estimated remaining time: 4h 54m 59s [2025-10-25T20:51:40.939957] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:51:40.940129] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-25T20:51:40.940199] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-25T20:51:40.940305] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-25T20:51:40.940402] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-25T20:51:40.940480] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-25T20:51:40.940567] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-25T20:51:41.287695] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:51:41.288072] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-25T20:51:42.930379] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T20:51:42.940240] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-25T20:51:44.606187] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T20:51:44.615367] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-25T20:51:46.360462] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T20:51:46.370786] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-25T20:51:47.654446] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T20:51:47.664891] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-25T20:51:48.847309] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T20:51:48.857410] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-25T20:51:49.813529] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T20:51:49.823115] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-25T20:51:50.714913] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T20:51:50.726000] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-25T20:51:51.842298] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T20:51:51.852486] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-25T20:51:52.948321] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T20:51:52.958138] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-25T20:51:54.023446] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T20:51:54.031824] [INFO ] [REMOTE ] DTE: Full fetch complete (68850 records). [2025-10-25T20:51:54.032001] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-25T20:51:54.438923] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-25T20:51:54.439048] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-25T20:51:54.439937] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-25T20:51:54.440022] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-25T20:51:54.441341] [DEBUG] [LOCAL ] DTE: Trimmed 68850 records to 47740 (keeping 200 days of data) [2025-10-25T20:51:54.742636] [DEBUG] [LOCAL ] DTE: Primary data saved (47740 records). [2025-10-25T20:51:54.742912] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-25T20:51:54.743094] [INFO ] [MAIN ] Update Progress: 660/2366 symbols. DTE took 14.0s. Estimated remaining time: 4h 54m 58s [2025-10-25T20:51:54.920454] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:51:54.920695] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-25T20:51:54.920772] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-25T20:51:54.920884] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-25T20:51:54.920955] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-25T20:51:54.921036] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-25T20:51:54.921103] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-25T20:51:55.268054] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:51:55.268407] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-25T20:51:55.790606] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-25T20:51:55.791675] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-25T20:51:56.300446] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-25T20:51:56.301421] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-25T20:51:56.824435] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-25T20:51:56.825933] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-25T20:51:57.421543] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T20:51:57.422803] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-25T20:51:57.948690] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-25T20:51:57.949751] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-25T20:51:58.383406] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-25T20:51:58.384390] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-25T20:51:58.843268] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-25T20:51:58.844298] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-25T20:51:59.341516] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-25T20:51:59.342567] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-25T20:51:59.890625] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-25T20:51:59.891691] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-25T20:52:00.404437] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-25T20:52:00.405253] [INFO ] [REMOTE ] DTF: Full fetch complete (1733 records). [2025-10-25T20:52:00.405343] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-25T20:52:00.582896] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-25T20:52:00.583086] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:52:00.583157] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:52:00.583233] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-25T20:52:00.583325] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-25T20:52:00.583399] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-25T20:52:00.583481] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-25T20:52:00.583593] [INFO ] [MAIN ] Update Progress: 661/2366 symbols. DTF took 5.8s. Estimated remaining time: 4h 54m 36s [2025-10-25T20:52:00.750227] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:52:00.750386] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-25T20:52:00.750457] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-25T20:52:00.750567] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-25T20:52:00.750637] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-25T20:52:00.750749] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-25T20:52:00.750819] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-25T20:52:01.099750] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:52:01.100095] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-25T20:52:02.275911] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T20:52:02.277869] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-25T20:52:03.012132] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T20:52:03.014111] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-25T20:52:03.894865] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T20:52:03.902249] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-25T20:52:04.657003] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T20:52:04.658929] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-25T20:52:05.409685] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-25T20:52:05.411599] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-25T20:52:06.130186] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T20:52:06.132368] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-25T20:52:06.835797] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T20:52:06.837699] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-25T20:52:07.587457] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-25T20:52:07.590040] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-25T20:52:08.319465] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-25T20:52:08.321836] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-25T20:52:09.166728] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T20:52:09.169460] [INFO ] [REMOTE ] DTG: Full fetch complete (8516 records). [2025-10-25T20:52:09.169578] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-25T20:52:09.553307] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-25T20:52:09.553471] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-25T20:52:09.553895] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-25T20:52:09.553981] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-25T20:52:09.554747] [DEBUG] [LOCAL ] DTG: Trimmed 8516 records to 5731 (keeping 200 days of data) [2025-10-25T20:52:09.591979] [DEBUG] [LOCAL ] DTG: Primary data saved (5731 records). [2025-10-25T20:52:09.592209] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-25T20:52:09.592370] [INFO ] [MAIN ] Update Progress: 662/2366 symbols. DTG took 9.0s. Estimated remaining time: 4h 54m 22s [2025-10-25T20:52:09.765157] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:52:09.765436] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-25T20:52:09.765514] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-25T20:52:09.765668] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-25T20:52:09.765749] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-25T20:52:09.765835] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-25T20:52:09.765908] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-25T20:52:10.134566] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:52:10.135038] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-25T20:52:10.498168] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T20:52:10.498535] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-25T20:52:10.498622] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T20:52:10.498740] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-25T20:52:10.498809] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T20:52:10.498882] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-25T20:52:10.498983] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-25T20:52:10.499053] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-25T20:52:10.499135] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-25T20:52:10.499241] [INFO ] [MAIN ] Update Progress: 663/2366 symbols. DTK took 0.9s. Estimated remaining time: 4h 53m 47s [2025-10-25T20:52:10.675862] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:52:10.676055] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-25T20:52:10.676128] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-25T20:52:10.676244] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-25T20:52:10.676317] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-25T20:52:10.676399] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-25T20:52:10.676451] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-25T20:52:11.061675] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:52:11.062150] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-25T20:52:12.892993] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T20:52:12.902089] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-25T20:52:14.468588] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:52:14.477548] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-25T20:52:16.429742] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T20:52:16.440209] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-25T20:52:18.251364] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T20:52:18.261506] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-25T20:52:19.955732] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T20:52:19.965605] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-25T20:52:21.569934] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T20:52:21.579049] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-25T20:52:23.410061] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T20:52:23.419555] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-25T20:52:25.109102] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T20:52:25.118383] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-25T20:52:26.652303] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T20:52:26.661885] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-25T20:52:28.315429] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T20:52:28.324230] [INFO ] [REMOTE ] DTM: Full fetch complete (65288 records). [2025-10-25T20:52:28.324411] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-25T20:52:28.757586] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-25T20:52:28.757725] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-25T20:52:28.758670] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-25T20:52:28.758773] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-25T20:52:28.760119] [DEBUG] [LOCAL ] DTM: Trimmed 65288 records to 44410 (keeping 200 days of data) [2025-10-25T20:52:29.031725] [DEBUG] [LOCAL ] DTM: Primary data saved (44410 records). [2025-10-25T20:52:29.031882] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-25T20:52:29.032010] [INFO ] [MAIN ] Update Progress: 664/2366 symbols. DTM took 18.5s. Estimated remaining time: 4h 53m 58s [2025-10-25T20:52:29.202960] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:52:29.203167] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-25T20:52:29.203240] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-25T20:52:29.203356] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-25T20:52:29.203491] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-25T20:52:29.203582] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-25T20:52:29.203676] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-25T20:52:29.554189] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:52:29.554547] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-25T20:52:30.448350] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-25T20:52:30.450395] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-25T20:52:31.081354] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-25T20:52:31.083143] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-25T20:52:31.796049] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T20:52:31.798231] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-25T20:52:32.549882] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T20:52:32.551784] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-25T20:52:33.226338] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-25T20:52:33.228118] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-25T20:52:33.787231] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T20:52:33.789095] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-25T20:52:34.506259] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T20:52:34.508372] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-25T20:52:35.268826] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T20:52:35.270426] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-25T20:52:35.982591] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T20:52:35.984342] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-25T20:52:36.706633] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T20:52:36.708047] [INFO ] [REMOTE ] DTW: Full fetch complete (6920 records). [2025-10-25T20:52:36.708135] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-25T20:52:37.066004] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-25T20:52:37.066128] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-25T20:52:37.066344] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-25T20:52:37.066419] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-25T20:52:37.066980] [DEBUG] [LOCAL ] DTW: Trimmed 6920 records to 4751 (keeping 200 days of data) [2025-10-25T20:52:37.094880] [DEBUG] [LOCAL ] DTW: Primary data saved (4751 records). [2025-10-25T20:52:37.095000] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-25T20:52:37.095135] [INFO ] [MAIN ] Update Progress: 665/2366 symbols. DTW took 8.1s. Estimated remaining time: 4h 53m 42s [2025-10-25T20:52:37.262728] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:52:37.262917] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-25T20:52:37.262990] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-25T20:52:37.263116] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-25T20:52:37.263188] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-25T20:52:37.263247] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-25T20:52:37.263313] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-25T20:52:37.614296] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:52:37.614612] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-25T20:52:39.394221] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T20:52:39.404541] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-25T20:52:41.144858] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T20:52:41.155119] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-25T20:52:43.063603] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T20:52:43.076879] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-25T20:52:44.072492] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T20:52:44.083589] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-25T20:52:45.335571] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T20:52:45.346895] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-25T20:52:46.373799] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T20:52:46.384560] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-25T20:52:47.348175] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T20:52:47.360819] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-25T20:52:48.438432] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T20:52:48.449893] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-25T20:52:49.441214] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T20:52:49.452562] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-25T20:52:50.383480] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:52:50.393222] [INFO ] [REMOTE ] DUK: Full fetch complete (77560 records). [2025-10-25T20:52:50.393388] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-25T20:52:50.824381] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-25T20:52:50.824546] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-25T20:52:50.825908] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-25T20:52:50.826007] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-25T20:52:50.827861] [DEBUG] [LOCAL ] DUK: Trimmed 77560 records to 54202 (keeping 200 days of data) [2025-10-25T20:52:51.151116] [DEBUG] [LOCAL ] DUK: Primary data saved (54202 records). [2025-10-25T20:52:51.151293] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-25T20:52:51.151425] [INFO ] [MAIN ] Update Progress: 666/2366 symbols. DUK took 14.1s. Estimated remaining time: 4h 53m 41s [2025-10-25T20:52:51.325633] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:52:51.325884] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-25T20:52:51.325959] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-25T20:52:51.326051] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-25T20:52:51.326120] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-25T20:52:51.326202] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-25T20:52:51.326272] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-25T20:52:51.692261] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:52:51.692745] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-25T20:52:52.598475] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T20:52:52.600714] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-25T20:52:53.321564] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T20:52:53.323405] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-25T20:52:54.014736] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-25T20:52:54.016690] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-25T20:52:54.852927] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-25T20:52:54.855211] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-25T20:52:55.688869] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T20:52:55.691137] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-25T20:52:56.528110] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T20:52:56.530707] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-25T20:52:57.329345] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-25T20:52:57.331421] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-25T20:52:57.998952] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-25T20:52:58.000625] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-25T20:52:58.843973] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T20:52:58.846193] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-25T20:52:59.545211] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T20:52:59.547006] [INFO ] [REMOTE ] DUKB: Full fetch complete (8953 records). [2025-10-25T20:52:59.547114] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-25T20:52:59.904108] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-25T20:52:59.904240] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-25T20:52:59.904512] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-25T20:52:59.904592] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-25T20:52:59.905080] [DEBUG] [LOCAL ] DUKB: Trimmed 8953 records to 6185 (keeping 200 days of data) [2025-10-25T20:52:59.940923] [DEBUG] [LOCAL ] DUKB: Primary data saved (6185 records). [2025-10-25T20:52:59.941026] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-25T20:52:59.941126] [INFO ] [MAIN ] Update Progress: 667/2366 symbols. DUKB took 8.8s. Estimated remaining time: 4h 53m 26s [2025-10-25T20:53:00.107937] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:53:00.108134] [DEBUG] [LOCAL ] DV: No existing data file found in primary storage. [2025-10-25T20:53:00.108206] [WARN ] [MAIN ] DV: No existing data found, performing full refresh instead. [2025-10-25T20:53:00.108361] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-25T20:53:00.108432] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-25T20:53:00.108511] [DEBUG] [LOCAL ] DV: No primary data file found to delete. [2025-10-25T20:53:00.108582] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-25T20:53:00.459145] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:53:00.459542] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-25T20:53:02.111414] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T20:53:02.121478] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-25T20:53:04.215068] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-25T20:53:04.224360] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-25T20:53:06.105829] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T20:53:06.116965] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-25T20:53:07.148770] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T20:53:07.159870] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-25T20:53:08.143695] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T20:53:08.154372] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-25T20:53:09.063596] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T20:53:09.073940] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-25T20:53:09.988601] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:53:09.999616] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-25T20:53:11.191239] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-25T20:53:11.202017] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-25T20:53:12.057350] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T20:53:12.068824] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-25T20:53:12.941270] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T20:53:12.950629] [INFO ] [REMOTE ] DV: Full fetch complete (73904 records). [2025-10-25T20:53:12.950796] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-25T20:53:13.334559] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-25T20:53:13.334692] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-25T20:53:13.335610] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-25T20:53:13.335725] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-25T20:53:13.337195] [DEBUG] [LOCAL ] DV: Trimmed 73904 records to 52001 (keeping 200 days of data) [2025-10-25T20:53:13.625547] [DEBUG] [LOCAL ] DV: Primary data saved (52001 records). [2025-10-25T20:53:13.625736] [INFO ] [MAIN ] DV: Full history saved. [2025-10-25T20:53:13.625913] [INFO ] [MAIN ] Update Progress: 668/2366 symbols. DV took 13.7s. Estimated remaining time: 4h 53m 24s [2025-10-25T20:53:13.793228] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:53:13.793411] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-10-25T20:53:13.793497] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-10-25T20:53:13.793705] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-25T20:53:13.793791] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-25T20:53:13.793898] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-25T20:53:13.794019] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-25T20:53:14.141583] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:53:14.142026] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-25T20:53:15.607552] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T20:53:15.615255] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-25T20:53:17.214672] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T20:53:17.223123] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-25T20:53:18.960813] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T20:53:18.969777] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-25T20:53:19.964550] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T20:53:19.977556] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-25T20:53:20.972249] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T20:53:20.981347] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-25T20:53:21.829117] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T20:53:21.837579] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-25T20:53:22.942294] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T20:53:22.951524] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-25T20:53:23.823963] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T20:53:23.832897] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-25T20:53:24.759863] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T20:53:24.768565] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-25T20:53:26.050729] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T20:53:26.058016] [INFO ] [REMOTE ] DVA: Full fetch complete (59599 records). [2025-10-25T20:53:26.058197] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-25T20:53:26.438045] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-25T20:53:26.438170] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-25T20:53:26.438897] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-25T20:53:26.438979] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-25T20:53:26.440217] [DEBUG] [LOCAL ] DVA: Trimmed 59599 records to 41227 (keeping 200 days of data) [2025-10-25T20:53:26.677550] [DEBUG] [LOCAL ] DVA: Primary data saved (41227 records). [2025-10-25T20:53:26.677727] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-25T20:53:26.677850] [INFO ] [MAIN ] Update Progress: 669/2366 symbols. DVA took 13.1s. Estimated remaining time: 4h 53m 21s [2025-10-25T20:53:26.844963] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:53:26.845173] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-25T20:53:26.845243] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-25T20:53:26.845355] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-25T20:53:26.845426] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-25T20:53:26.845507] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-25T20:53:26.845575] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-25T20:53:27.193194] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:53:27.193516] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-25T20:53:29.389331] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-25T20:53:29.399730] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-25T20:53:31.342685] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T20:53:31.354398] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-25T20:53:33.427776] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T20:53:33.438715] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-25T20:53:34.167544] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T20:53:34.178704] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-25T20:53:35.073544] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T20:53:35.084689] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-25T20:53:35.965356] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T20:53:35.980145] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-25T20:53:37.203184] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T20:53:37.214999] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-25T20:53:38.323443] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T20:53:38.334855] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-25T20:53:39.285319] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:53:39.298124] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-25T20:53:40.214634] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T20:53:40.224489] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-25T20:53:40.224675] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-25T20:53:40.613085] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-25T20:53:40.613244] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-25T20:53:40.614475] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-25T20:53:40.614576] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-25T20:53:40.616217] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 54479 (keeping 200 days of data) [2025-10-25T20:53:40.952191] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-10-25T20:53:40.952419] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-25T20:53:40.952594] [INFO ] [MAIN ] Update Progress: 670/2366 symbols. DVN took 14.3s. Estimated remaining time: 4h 53m 20s [2025-10-25T20:53:41.146772] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:53:41.147003] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-25T20:53:41.147076] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-25T20:53:41.147195] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-25T20:53:41.147304] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-25T20:53:41.147392] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-25T20:53:41.147463] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-25T20:53:41.502115] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:53:41.502604] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-25T20:53:43.328535] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T20:53:43.338505] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-25T20:53:45.111540] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-25T20:53:45.121470] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-25T20:53:46.911388] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T20:53:46.922471] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-25T20:53:48.045564] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T20:53:48.056893] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-25T20:53:49.060440] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T20:53:49.071802] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-25T20:53:50.145913] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T20:53:50.157739] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-25T20:53:51.115561] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T20:53:51.126846] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-25T20:53:52.062968] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:53:52.074061] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-25T20:53:53.104849] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T20:53:53.115973] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-25T20:53:54.179177] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T20:53:54.189329] [INFO ] [REMOTE ] DX: Full fetch complete (75917 records). [2025-10-25T20:53:54.189500] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-25T20:53:54.600205] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-25T20:53:54.600322] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-25T20:53:54.601253] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-25T20:53:54.601335] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-25T20:53:54.602849] [DEBUG] [LOCAL ] DX: Trimmed 75917 records to 53303 (keeping 200 days of data) [2025-10-25T20:53:54.917283] [DEBUG] [LOCAL ] DX: Primary data saved (53303 records). [2025-10-25T20:53:54.917451] [INFO ] [MAIN ] DX: Full history saved. [2025-10-25T20:53:54.917578] [INFO ] [MAIN ] Update Progress: 671/2366 symbols. DX took 14.0s. Estimated remaining time: 4h 53m 19s [2025-10-25T20:53:55.086541] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:53:55.086750] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-25T20:53:55.086820] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-25T20:53:55.086992] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-25T20:53:55.087062] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-25T20:53:55.087143] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-25T20:53:55.087212] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-25T20:53:55.447186] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:53:55.447534] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-25T20:53:57.020105] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T20:53:57.028339] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-25T20:53:58.482184] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T20:53:58.490959] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-25T20:54:00.058487] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T20:54:00.068518] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-25T20:54:01.217794] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T20:54:01.228473] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-25T20:54:02.242064] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T20:54:02.252393] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-25T20:54:03.113167] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T20:54:03.123451] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-25T20:54:04.155294] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T20:54:04.166919] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-25T20:54:05.127694] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T20:54:05.138273] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-25T20:54:06.053939] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T20:54:06.065387] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-25T20:54:06.956922] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T20:54:06.966146] [INFO ] [REMOTE ] DXC: Full fetch complete (70407 records). [2025-10-25T20:54:06.966314] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-25T20:54:07.347813] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-25T20:54:07.347951] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-25T20:54:07.349173] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-25T20:54:07.349255] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-25T20:54:07.350633] [DEBUG] [LOCAL ] DXC: Trimmed 70407 records to 50620 (keeping 200 days of data) [2025-10-25T20:54:07.638858] [DEBUG] [LOCAL ] DXC: Primary data saved (50620 records). [2025-10-25T20:54:07.639061] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-25T20:54:07.639203] [INFO ] [MAIN ] Update Progress: 672/2366 symbols. DXC took 12.7s. Estimated remaining time: 4h 53m 14s [2025-10-25T20:54:07.804228] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:54:07.804428] [DEBUG] [LOCAL ] DXYZ: No existing data file found in primary storage. [2025-10-25T20:54:07.804500] [WARN ] [MAIN ] DXYZ: No existing data found, performing full refresh instead. [2025-10-25T20:54:07.804616] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-25T20:54:07.804707] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-25T20:54:07.804770] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-10-25T20:54:07.804835] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-25T20:54:08.150917] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:54:08.151274] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-25T20:54:10.622279] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-25T20:54:10.632065] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-25T20:54:12.813878] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-25T20:54:12.823030] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-25T20:54:14.943296] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-25T20:54:14.951793] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-25T20:54:16.835528] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-25T20:54:16.844009] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-25T20:54:18.794223] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-25T20:54:18.802453] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-25T20:54:20.711782] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-25T20:54:20.719266] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-25T20:54:22.866131] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-25T20:54:22.874615] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-25T20:54:24.644934] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T20:54:24.652589] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-25T20:54:26.608177] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-25T20:54:26.616228] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-25T20:54:28.696007] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-25T20:54:28.703480] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56498 records). [2025-10-25T20:54:28.703611] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-25T20:54:29.097770] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-25T20:54:29.097927] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-25T20:54:29.098774] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-25T20:54:29.098860] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-25T20:54:29.100131] [DEBUG] [LOCAL ] DXYZ: Trimmed 56498 records to 37529 (keeping 200 days of data) [2025-10-25T20:54:29.313590] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37529 records). [2025-10-25T20:54:29.313789] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-25T20:54:29.313934] [INFO ] [MAIN ] Update Progress: 673/2366 symbols. DXYZ took 21.7s. Estimated remaining time: 4h 53m 32s [2025-10-25T20:54:29.487446] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:54:29.487664] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-10-25T20:54:29.487729] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-10-25T20:54:29.487840] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-25T20:54:29.487941] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-25T20:54:29.488024] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-25T20:54:29.488104] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-25T20:54:29.847806] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:54:29.848160] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-25T20:54:31.315758] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T20:54:31.322355] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-25T20:54:32.884609] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T20:54:32.891459] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-25T20:54:34.428710] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T20:54:34.437975] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-25T20:54:35.922266] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T20:54:35.929454] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-25T20:54:37.286999] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T20:54:37.294092] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-25T20:54:38.534412] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-25T20:54:38.540387] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-25T20:54:39.819370] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T20:54:39.825553] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-25T20:54:41.303466] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T20:54:41.310350] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-25T20:54:42.708036] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T20:54:42.714818] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-25T20:54:43.853434] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T20:54:43.857851] [INFO ] [REMOTE ] DY: Full fetch complete (43146 records). [2025-10-25T20:54:43.858033] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-25T20:54:44.237124] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-25T20:54:44.237246] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-25T20:54:44.237859] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-25T20:54:44.237955] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-25T20:54:44.238874] [DEBUG] [LOCAL ] DY: Trimmed 43146 records to 28284 (keeping 200 days of data) [2025-10-25T20:54:44.403041] [DEBUG] [LOCAL ] DY: Primary data saved (28284 records). [2025-10-25T20:54:44.403210] [INFO ] [MAIN ] DY: Full history saved. [2025-10-25T20:54:44.403338] [INFO ] [MAIN ] Update Progress: 674/2366 symbols. DY took 15.1s. Estimated remaining time: 4h 53m 34s [2025-10-25T20:54:44.577234] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:54:44.577437] [DEBUG] [LOCAL ] E: No existing data file found in primary storage. [2025-10-25T20:54:44.577510] [WARN ] [MAIN ] E: No existing data found, performing full refresh instead. [2025-10-25T20:54:44.577616] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-25T20:54:44.577712] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-25T20:54:44.577802] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-25T20:54:44.577873] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-25T20:54:44.927114] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:54:44.927459] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-25T20:54:46.387246] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T20:54:46.393973] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-25T20:54:47.651432] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T20:54:47.657499] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-25T20:54:49.148220] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T20:54:49.155371] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-25T20:54:50.771935] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T20:54:50.780800] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-25T20:54:52.264124] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T20:54:52.271331] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-25T20:54:53.951214] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-25T20:54:53.959112] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-25T20:54:55.703057] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T20:54:55.710922] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-25T20:54:57.107785] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T20:54:57.115819] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-25T20:54:58.612786] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T20:54:58.619452] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-25T20:55:00.034872] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T20:55:00.040784] [INFO ] [REMOTE ] E: Full fetch complete (47623 records). [2025-10-25T20:55:00.040937] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-25T20:55:00.427604] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-25T20:55:00.427755] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-25T20:55:00.429039] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-25T20:55:00.429126] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-25T20:55:00.430326] [DEBUG] [LOCAL ] E: Trimmed 47623 records to 33700 (keeping 200 days of data) [2025-10-25T20:55:00.630092] [DEBUG] [LOCAL ] E: Primary data saved (33700 records). [2025-10-25T20:55:00.630286] [INFO ] [MAIN ] E: Full history saved. [2025-10-25T20:55:00.630393] [INFO ] [MAIN ] Update Progress: 675/2366 symbols. E took 16.2s. Estimated remaining time: 4h 53m 38s [2025-10-25T20:55:00.801875] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:55:00.802092] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-25T20:55:00.802164] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-25T20:55:00.802285] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-25T20:55:00.802359] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-25T20:55:00.802440] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-25T20:55:00.802509] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-25T20:55:01.151562] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:55:01.151934] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-25T20:55:03.105406] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-25T20:55:03.114725] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-25T20:55:04.740677] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T20:55:04.749808] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-25T20:55:06.481756] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T20:55:06.491787] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-25T20:55:07.423390] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T20:55:07.433077] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-25T20:55:08.398256] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T20:55:08.408411] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-25T20:55:09.511287] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T20:55:09.520943] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-25T20:55:10.601459] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T20:55:10.612250] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-25T20:55:11.392284] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T20:55:11.401048] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-25T20:55:12.260699] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T20:55:12.270287] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-25T20:55:13.042294] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T20:55:13.048231] [INFO ] [REMOTE ] EAF: Full fetch complete (61708 records). [2025-10-25T20:55:13.048391] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-25T20:55:13.429556] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-25T20:55:13.429689] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-25T20:55:13.430479] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-25T20:55:13.430557] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-25T20:55:13.431829] [DEBUG] [LOCAL ] EAF: Trimmed 61708 records to 41299 (keeping 200 days of data) [2025-10-25T20:55:13.654386] [DEBUG] [LOCAL ] EAF: Primary data saved (41299 records). [2025-10-25T20:55:13.654536] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-25T20:55:13.654679] [INFO ] [MAIN ] Update Progress: 676/2366 symbols. EAF took 13.0s. Estimated remaining time: 4h 53m 34s [2025-10-25T20:55:13.823806] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:55:13.823990] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-25T20:55:13.824059] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-25T20:55:13.824168] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-25T20:55:13.824237] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-25T20:55:13.824315] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-25T20:55:13.824381] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-25T20:55:14.168804] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:55:14.169129] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-25T20:55:14.841262] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-25T20:55:14.843183] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-25T20:55:15.580530] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-25T20:55:15.582116] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-25T20:55:16.270470] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-25T20:55:16.272335] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-25T20:55:16.935255] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-25T20:55:16.937107] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-25T20:55:17.640519] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-25T20:55:17.642173] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-25T20:55:18.300844] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T20:55:18.302462] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-25T20:55:18.943078] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T20:55:18.944748] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-25T20:55:19.551373] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T20:55:19.552852] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-25T20:55:20.218031] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-25T20:55:20.219616] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-25T20:55:20.862143] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T20:55:20.863493] [INFO ] [REMOTE ] EAI: Full fetch complete (5812 records). [2025-10-25T20:55:20.863589] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-25T20:55:21.225760] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-25T20:55:21.225874] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-25T20:55:21.226093] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-25T20:55:21.226178] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-25T20:55:21.226690] [DEBUG] [LOCAL ] EAI: Trimmed 5812 records to 3971 (keeping 200 days of data) [2025-10-25T20:55:21.249902] [DEBUG] [LOCAL ] EAI: Primary data saved (3971 records). [2025-10-25T20:55:21.250024] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-25T20:55:21.250199] [INFO ] [MAIN ] Update Progress: 677/2366 symbols. EAI took 7.6s. Estimated remaining time: 4h 53m 17s [2025-10-25T20:55:21.420010] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:55:21.420191] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-25T20:55:21.420288] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-25T20:55:21.420426] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-25T20:55:21.420516] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-25T20:55:21.420629] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-25T20:55:21.420743] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-25T20:55:21.774833] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:55:21.775197] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-25T20:55:23.269106] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-25T20:55:23.276325] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-25T20:55:24.713338] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T20:55:24.724927] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-25T20:55:26.367137] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T20:55:26.376461] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-25T20:55:28.025943] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T20:55:28.034968] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-25T20:55:29.465883] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T20:55:29.472872] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-25T20:55:30.778631] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T20:55:30.784139] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-25T20:55:32.119461] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T20:55:32.125392] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-25T20:55:33.403743] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T20:55:33.409746] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-25T20:55:34.468768] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T20:55:34.473915] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-25T20:55:35.682028] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T20:55:35.687355] [INFO ] [REMOTE ] EARN: Full fetch complete (45076 records). [2025-10-25T20:55:35.687467] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-25T20:55:36.087851] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-25T20:55:36.088028] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-25T20:55:36.088909] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-25T20:55:36.089033] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-25T20:55:36.090172] [DEBUG] [LOCAL ] EARN: Trimmed 45076 records to 28066 (keeping 200 days of data) [2025-10-25T20:55:36.250619] [DEBUG] [LOCAL ] EARN: Primary data saved (28066 records). [2025-10-25T20:55:36.250875] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-25T20:55:36.251010] [INFO ] [MAIN ] Update Progress: 678/2366 symbols. EARN took 15.0s. Estimated remaining time: 4h 53m 18s [2025-10-25T20:55:36.423270] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:55:36.423479] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-10-25T20:55:36.423554] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-10-25T20:55:36.423693] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-25T20:55:36.423767] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-25T20:55:36.423853] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-25T20:55:36.423936] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-25T20:55:36.781062] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:55:36.781401] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-25T20:55:38.771325] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T20:55:38.780798] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-25T20:55:40.613083] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T20:55:40.622988] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-25T20:55:42.491428] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T20:55:42.501935] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-25T20:55:44.287361] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T20:55:44.301683] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-25T20:55:46.229879] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-25T20:55:46.240990] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-25T20:55:47.932763] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-25T20:55:47.943492] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-25T20:55:49.870073] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-25T20:55:49.881046] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-25T20:55:51.645143] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T20:55:51.658956] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-25T20:55:53.504162] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-25T20:55:53.514878] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-25T20:55:55.302150] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-25T20:55:55.311214] [INFO ] [REMOTE ] EAT: Full fetch complete (72430 records). [2025-10-25T20:55:55.311380] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-25T20:55:55.701177] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-25T20:55:55.701297] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-25T20:55:55.702190] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-25T20:55:55.702276] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-25T20:55:55.703724] [DEBUG] [LOCAL ] EAT: Trimmed 72430 records to 50437 (keeping 200 days of data) [2025-10-25T20:55:56.002708] [DEBUG] [LOCAL ] EAT: Primary data saved (50437 records). [2025-10-25T20:55:56.002920] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-25T20:55:56.003078] [INFO ] [MAIN ] Update Progress: 679/2366 symbols. EAT took 19.8s. Estimated remaining time: 4h 53m 30s [2025-10-25T20:55:56.179278] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:55:56.179507] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-25T20:55:56.179590] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-25T20:55:56.179732] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-25T20:55:56.179807] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-25T20:55:56.179891] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-25T20:55:56.179963] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-25T20:55:56.530091] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:55:56.530416] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-25T20:55:57.996315] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T20:55:58.005133] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-25T20:55:59.487210] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T20:55:59.495062] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-25T20:56:01.352728] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T20:56:01.361929] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-25T20:56:02.907581] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T20:56:02.916437] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-25T20:56:04.618866] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T20:56:04.627078] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-25T20:56:06.225778] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T20:56:06.233173] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-25T20:56:07.711114] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T20:56:07.720470] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-25T20:56:09.297310] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T20:56:09.305446] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-25T20:56:10.352218] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T20:56:10.359492] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-25T20:56:11.714990] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T20:56:11.721710] [INFO ] [REMOTE ] EB: Full fetch complete (54715 records). [2025-10-25T20:56:11.721857] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-25T20:56:12.110959] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-25T20:56:12.111070] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-25T20:56:12.111779] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-25T20:56:12.111863] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-25T20:56:12.112953] [DEBUG] [LOCAL ] EB: Trimmed 54715 records to 36579 (keeping 200 days of data) [2025-10-25T20:56:12.306806] [DEBUG] [LOCAL ] EB: Primary data saved (36579 records). [2025-10-25T20:56:12.306992] [INFO ] [MAIN ] EB: Full history saved. [2025-10-25T20:56:12.307121] [INFO ] [MAIN ] Update Progress: 680/2366 symbols. EB took 16.3s. Estimated remaining time: 4h 53m 34s [2025-10-25T20:56:12.476780] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:56:12.476971] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-25T20:56:12.477042] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-25T20:56:12.477156] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-25T20:56:12.477225] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-25T20:56:12.477304] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-25T20:56:12.477370] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-25T20:56:12.835279] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:56:12.835678] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-25T20:56:13.923156] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T20:56:13.927119] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-25T20:56:15.061829] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T20:56:15.066155] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-25T20:56:16.308202] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T20:56:16.313561] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-25T20:56:17.555584] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T20:56:17.560606] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-25T20:56:18.646016] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T20:56:18.651015] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-25T20:56:19.756840] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T20:56:19.761393] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-25T20:56:20.714895] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T20:56:20.719898] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-25T20:56:21.854460] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T20:56:21.859477] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-25T20:56:22.948085] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T20:56:22.952169] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-25T20:56:24.135168] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T20:56:24.142107] [INFO ] [REMOTE ] EBF: Full fetch complete (28407 records). [2025-10-25T20:56:24.142250] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-25T20:56:24.513722] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-25T20:56:24.513832] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-25T20:56:24.514322] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-25T20:56:24.514397] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-25T20:56:24.515096] [DEBUG] [LOCAL ] EBF: Trimmed 28407 records to 19579 (keeping 200 days of data) [2025-10-25T20:56:24.627999] [DEBUG] [LOCAL ] EBF: Primary data saved (19579 records). [2025-10-25T20:56:24.628186] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-25T20:56:24.628320] [INFO ] [MAIN ] Update Progress: 681/2366 symbols. EBF took 12.3s. Estimated remaining time: 4h 53m 29s [2025-10-25T20:56:24.799440] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:56:24.799696] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-10-25T20:56:24.799769] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-10-25T20:56:24.799882] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-25T20:56:24.799985] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-25T20:56:24.800068] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-10-25T20:56:24.800134] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-25T20:56:25.157633] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:56:25.158003] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-25T20:56:26.666581] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T20:56:26.675436] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-25T20:56:28.244721] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:56:28.252204] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-25T20:56:29.972035] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T20:56:29.981369] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-25T20:56:31.027123] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T20:56:31.037092] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-25T20:56:31.971135] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T20:56:31.980457] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-25T20:56:33.043983] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T20:56:33.052412] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-25T20:56:33.963105] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T20:56:33.972703] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-25T20:56:34.881830] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T20:56:34.891249] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-25T20:56:35.684334] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T20:56:35.694103] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-25T20:56:36.222417] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-25T20:56:36.230915] [INFO ] [REMOTE ] EBR: Full fetch complete (62440 records). [2025-10-25T20:56:36.231082] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-25T20:56:36.621241] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-25T20:56:36.621369] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-25T20:56:36.622468] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-25T20:56:36.622548] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-25T20:56:36.623870] [DEBUG] [LOCAL ] EBR: Trimmed 62440 records to 43984 (keeping 200 days of data) [2025-10-25T20:56:36.874813] [DEBUG] [LOCAL ] EBR: Primary data saved (43984 records). [2025-10-25T20:56:36.874980] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-25T20:56:36.875105] [INFO ] [MAIN ] Update Progress: 682/2366 symbols. EBR took 12.2s. Estimated remaining time: 4h 53m 23s [2025-10-25T20:56:37.043934] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:56:37.044125] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-25T20:56:37.044197] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-25T20:56:37.044316] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-25T20:56:37.044401] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-25T20:56:37.044500] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-25T20:56:37.044572] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-25T20:56:37.402151] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:56:37.402486] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-25T20:56:39.177613] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T20:56:39.187935] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-25T20:56:40.683909] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T20:56:40.692695] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-25T20:56:42.355929] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T20:56:42.369636] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-25T20:56:43.326511] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T20:56:43.337252] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-25T20:56:44.368731] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T20:56:44.379101] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-25T20:56:45.330864] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:56:45.340620] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-25T20:56:46.385921] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T20:56:46.396312] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-25T20:56:47.244893] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T20:56:47.255399] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-25T20:56:48.209639] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T20:56:48.219978] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-25T20:56:49.445516] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T20:56:49.454157] [INFO ] [REMOTE ] EBS: Full fetch complete (67398 records). [2025-10-25T20:56:49.454308] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-25T20:56:49.858184] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-25T20:56:49.858294] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-25T20:56:49.859085] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-25T20:56:49.859165] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-25T20:56:49.860409] [DEBUG] [LOCAL ] EBS: Trimmed 67398 records to 47237 (keeping 200 days of data) [2025-10-25T20:56:50.112954] [DEBUG] [LOCAL ] EBS: Primary data saved (47237 records). [2025-10-25T20:56:50.113113] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-25T20:56:50.113242] [INFO ] [MAIN ] Update Progress: 683/2366 symbols. EBS took 13.2s. Estimated remaining time: 4h 53m 19s [2025-10-25T20:56:50.279517] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:56:50.279765] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-25T20:56:50.279838] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-25T20:56:50.279925] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-25T20:56:50.279988] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-25T20:56:50.280044] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-25T20:56:50.280083] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-25T20:56:50.630305] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:56:50.630687] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-25T20:56:52.481632] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-25T20:56:52.491582] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-25T20:56:54.200426] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T20:56:54.210249] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-25T20:56:56.008441] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T20:56:56.019313] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-25T20:56:58.023983] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-25T20:56:58.034749] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-25T20:56:59.626151] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T20:56:59.636602] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-25T20:57:01.789113] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-25T20:57:01.799600] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-25T20:57:04.564706] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-25T20:57:04.575382] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-25T20:57:06.261688] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T20:57:06.272865] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-25T20:57:07.898105] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T20:57:07.908683] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-25T20:57:09.706067] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-25T20:57:09.715000] [INFO ] [REMOTE ] EC: Full fetch complete (71886 records). [2025-10-25T20:57:09.715209] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-25T20:57:10.110603] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-25T20:57:10.110747] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-25T20:57:10.111538] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-25T20:57:10.111612] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-25T20:57:10.113111] [DEBUG] [LOCAL ] EC: Trimmed 71886 records to 49596 (keeping 200 days of data) [2025-10-25T20:57:10.388564] [DEBUG] [LOCAL ] EC: Primary data saved (49596 records). [2025-10-25T20:57:10.388752] [INFO ] [MAIN ] EC: Full history saved. [2025-10-25T20:57:10.388860] [INFO ] [MAIN ] Update Progress: 684/2366 symbols. EC took 20.3s. Estimated remaining time: 4h 53m 33s [2025-10-25T20:57:10.553436] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:57:10.553671] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-25T20:57:10.553747] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-25T20:57:10.553858] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-25T20:57:10.553929] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-25T20:57:10.554011] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-25T20:57:10.554081] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-25T20:57:10.915011] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:57:10.915524] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-25T20:57:12.254382] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T20:57:12.260308] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-25T20:57:13.692118] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T20:57:13.698520] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-25T20:57:15.165579] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T20:57:15.172436] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-25T20:57:16.627569] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T20:57:16.633625] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-25T20:57:17.844996] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T20:57:17.850982] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-25T20:57:19.196414] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T20:57:19.202834] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-25T20:57:20.584984] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T20:57:20.592391] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-25T20:57:22.057962] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T20:57:22.065134] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-25T20:57:23.478728] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T20:57:23.485985] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-25T20:57:24.769404] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T20:57:24.774664] [INFO ] [REMOTE ] ECAT: Full fetch complete (42877 records). [2025-10-25T20:57:24.774813] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-25T20:57:25.161563] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-25T20:57:25.161736] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-25T20:57:25.162486] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-25T20:57:25.162570] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-25T20:57:25.163745] [DEBUG] [LOCAL ] ECAT: Trimmed 42877 records to 29468 (keeping 200 days of data) [2025-10-25T20:57:25.336158] [DEBUG] [LOCAL ] ECAT: Primary data saved (29468 records). [2025-10-25T20:57:25.336319] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-25T20:57:25.336445] [INFO ] [MAIN ] Update Progress: 685/2366 symbols. ECAT took 14.9s. Estimated remaining time: 4h 53m 33s [2025-10-25T20:57:25.502614] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:57:25.502826] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-10-25T20:57:25.502895] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-10-25T20:57:25.503004] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-25T20:57:25.503105] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-25T20:57:25.503187] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-25T20:57:25.503255] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-25T20:57:25.857220] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:57:25.857628] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-25T20:57:27.525428] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T20:57:27.537933] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-25T20:57:29.207853] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T20:57:29.215184] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-25T20:57:31.022533] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T20:57:31.031931] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-25T20:57:33.035390] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-25T20:57:33.044923] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-25T20:57:34.788506] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T20:57:34.797615] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-25T20:57:36.550483] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T20:57:36.558928] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-25T20:57:38.226400] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-25T20:57:38.236870] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-25T20:57:39.892852] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T20:57:39.902334] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-25T20:57:41.673111] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T20:57:41.682550] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-25T20:57:43.380343] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-25T20:57:43.388500] [INFO ] [REMOTE ] ECC: Full fetch complete (61625 records). [2025-10-25T20:57:43.388630] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-25T20:57:43.769763] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-25T20:57:43.769874] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-25T20:57:43.770629] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-25T20:57:43.770725] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-25T20:57:43.771949] [DEBUG] [LOCAL ] ECC: Trimmed 61625 records to 43956 (keeping 200 days of data) [2025-10-25T20:57:44.016890] [DEBUG] [LOCAL ] ECC: Primary data saved (43956 records). [2025-10-25T20:57:44.017046] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-25T20:57:44.017231] [INFO ] [MAIN ] Update Progress: 686/2366 symbols. ECC took 18.7s. Estimated remaining time: 4h 53m 43s [2025-10-25T20:57:44.189360] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:57:44.189543] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-25T20:57:44.189615] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-25T20:57:44.189749] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-25T20:57:44.189897] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-25T20:57:44.189984] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-25T20:57:44.190054] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-25T20:57:44.560213] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:57:44.560589] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-25T20:57:45.031398] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-25T20:57:45.032363] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-25T20:57:45.535935] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-25T20:57:45.536918] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-25T20:57:45.975113] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-25T20:57:45.976084] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-25T20:57:46.450693] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-25T20:57:46.451623] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-25T20:57:47.041591] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T20:57:47.042735] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-25T20:57:47.531348] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-25T20:57:47.532850] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-25T20:57:48.065899] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-25T20:57:48.067311] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-25T20:57:48.535988] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-25T20:57:48.537259] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-25T20:57:49.005139] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-25T20:57:49.006120] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-25T20:57:49.499426] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T20:57:49.500350] [INFO ] [REMOTE ] ECCC: Full fetch complete (1308 records). [2025-10-25T20:57:49.500451] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-25T20:57:49.677075] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-25T20:57:49.677313] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:57:49.677399] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:57:49.677493] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-25T20:57:49.677613] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-25T20:57:49.677719] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-25T20:57:49.677823] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-25T20:57:49.677992] [INFO ] [MAIN ] Update Progress: 687/2366 symbols. ECCC took 5.7s. Estimated remaining time: 4h 53m 21s [2025-10-25T20:57:49.844622] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:57:49.844845] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-25T20:57:49.844934] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-25T20:57:49.845071] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-25T20:57:49.845160] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-25T20:57:49.845265] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-25T20:57:49.845356] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-25T20:57:50.221634] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:57:50.222006] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-25T20:57:50.992254] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-25T20:57:50.993945] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-25T20:57:51.693090] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T20:57:51.694623] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-25T20:57:52.470185] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-25T20:57:52.472047] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-25T20:57:53.166966] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-25T20:57:53.169474] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-25T20:57:53.729509] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-25T20:57:53.730929] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-25T20:57:54.262809] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-25T20:57:54.264016] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-25T20:57:54.882961] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-25T20:57:54.884183] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-25T20:57:55.468948] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-25T20:57:55.470442] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-25T20:57:56.018568] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-25T20:57:56.019858] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-25T20:57:56.441622] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-25T20:57:56.442537] [INFO ] [REMOTE ] ECCU: Full fetch complete (4076 records). [2025-10-25T20:57:56.442631] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-25T20:57:56.799117] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-25T20:57:56.799238] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-25T20:57:56.799421] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-25T20:57:56.799495] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-25T20:57:56.799914] [DEBUG] [LOCAL ] ECCU: Trimmed 4076 records to 2170 (keeping 200 days of data) [2025-10-25T20:57:56.812962] [DEBUG] [LOCAL ] ECCU: Primary data saved (2170 records). [2025-10-25T20:57:56.813048] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-25T20:57:56.813167] [INFO ] [MAIN ] Update Progress: 688/2366 symbols. ECCU took 7.1s. Estimated remaining time: 4h 53m 2s [2025-10-25T20:57:56.985806] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:57:56.986065] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-25T20:57:56.986142] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-25T20:57:56.986259] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-25T20:57:56.986333] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-25T20:57:56.986415] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-25T20:57:56.986489] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-25T20:57:57.346188] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:57:57.346542] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-25T20:57:57.761435] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-25T20:57:57.762297] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-25T20:57:58.239258] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-25T20:57:58.240294] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-25T20:57:58.728200] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-25T20:57:58.729239] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-25T20:57:59.196496] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-25T20:57:59.197743] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-25T20:57:59.708171] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-25T20:57:59.709407] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-25T20:58:00.191729] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-25T20:58:00.192723] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-25T20:58:00.854181] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-25T20:58:00.855219] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-25T20:58:02.264414] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T20:58:02.265698] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-25T20:58:02.806593] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-25T20:58:02.807635] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-25T20:58:03.294501] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T20:58:03.295473] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-25T20:58:03.295568] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-25T20:58:03.484917] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-25T20:58:03.485234] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:58:03.485316] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:58:03.485402] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-25T20:58:03.485511] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-25T20:58:03.485591] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-25T20:58:03.485704] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-25T20:58:03.485851] [INFO ] [MAIN ] Update Progress: 689/2366 symbols. ECCW took 6.7s. Estimated remaining time: 4h 52m 42s [2025-10-25T20:58:03.662699] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:58:03.662974] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-25T20:58:03.663052] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-25T20:58:03.663190] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-25T20:58:03.663268] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-25T20:58:03.663391] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-25T20:58:03.663466] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-25T20:58:04.025566] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:58:04.026058] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-25T20:58:04.544544] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-25T20:58:04.545534] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-25T20:58:04.958616] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-25T20:58:04.959627] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-25T20:58:05.508847] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-25T20:58:05.510028] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-25T20:58:06.070998] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-25T20:58:06.072077] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-25T20:58:06.644392] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T20:58:06.645745] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-25T20:58:07.098688] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-25T20:58:07.099598] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-25T20:58:07.669617] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T20:58:07.670739] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-25T20:58:08.178170] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-25T20:58:08.179233] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-25T20:58:08.670631] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-25T20:58:08.671951] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-25T20:58:09.125926] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-25T20:58:09.126824] [INFO ] [REMOTE ] ECCX: Full fetch complete (1456 records). [2025-10-25T20:58:09.126911] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-25T20:58:09.324042] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-25T20:58:09.324236] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-25T20:58:09.324309] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-25T20:58:09.324386] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-25T20:58:09.324479] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-25T20:58:09.324553] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-25T20:58:09.324635] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-25T20:58:09.324772] [INFO ] [MAIN ] Update Progress: 690/2366 symbols. ECCX took 5.8s. Estimated remaining time: 4h 52m 20s [2025-10-25T20:58:09.500866] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:58:09.501057] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-10-25T20:58:09.501130] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-10-25T20:58:09.501245] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-25T20:58:09.501317] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-25T20:58:09.501398] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-25T20:58:09.501468] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-25T20:58:09.879628] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:58:09.879981] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-25T20:58:11.561055] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T20:58:11.568394] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-25T20:58:13.140021] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T20:58:13.148478] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-25T20:58:14.783046] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T20:58:14.791570] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-25T20:58:15.645323] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T20:58:15.653676] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-25T20:58:16.797638] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T20:58:16.806031] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-25T20:58:17.550250] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T20:58:17.556426] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-25T20:58:18.482793] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T20:58:18.490112] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-25T20:58:19.425969] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T20:58:19.433561] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-25T20:58:20.370556] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T20:58:20.377129] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-25T20:58:21.160973] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T20:58:21.167023] [INFO ] [REMOTE ] ECG: Full fetch complete (50806 records). [2025-10-25T20:58:21.167223] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-25T20:58:21.549105] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-25T20:58:21.549236] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-25T20:58:21.549919] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-25T20:58:21.550002] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-25T20:58:21.551209] [DEBUG] [LOCAL ] ECG: Trimmed 50806 records to 33239 (keeping 200 days of data) [2025-10-25T20:58:21.742159] [DEBUG] [LOCAL ] ECG: Primary data saved (33239 records). [2025-10-25T20:58:21.742374] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-25T20:58:21.742505] [INFO ] [MAIN ] Update Progress: 691/2366 symbols. ECG took 12.4s. Estimated remaining time: 4h 52m 15s [2025-10-25T20:58:21.921361] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:58:21.921583] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-10-25T20:58:21.921678] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-10-25T20:58:21.921792] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-25T20:58:21.921863] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-25T20:58:21.921943] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-10-25T20:58:21.922013] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-25T20:58:22.279142] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:58:22.279471] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-25T20:58:24.155580] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T20:58:24.165846] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-25T20:58:26.027018] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T20:58:26.036380] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-25T20:58:27.969355] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T20:58:27.979721] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-25T20:58:30.009574] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-25T20:58:30.020373] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-25T20:58:31.781255] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T20:58:31.791328] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-25T20:58:33.448614] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T20:58:33.458115] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-25T20:58:35.237802] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T20:58:35.248082] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-25T20:58:36.914047] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T20:58:36.923557] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-25T20:58:38.634262] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T20:58:38.644851] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-25T20:58:40.511037] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-25T20:58:40.519686] [INFO ] [REMOTE ] ECL: Full fetch complete (68416 records). [2025-10-25T20:58:40.519819] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-25T20:58:40.905495] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-25T20:58:40.905610] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-25T20:58:40.906432] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-25T20:58:40.906508] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-25T20:58:40.907786] [DEBUG] [LOCAL ] ECL: Trimmed 68416 records to 47402 (keeping 200 days of data) [2025-10-25T20:58:41.194725] [DEBUG] [LOCAL ] ECL: Primary data saved (47402 records). [2025-10-25T20:58:41.194882] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-25T20:58:41.195013] [INFO ] [MAIN ] Update Progress: 692/2366 symbols. ECL took 19.5s. Estimated remaining time: 4h 52m 26s [2025-10-25T20:58:41.363002] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:58:41.363184] [DEBUG] [LOCAL ] ECO: No existing data file found in primary storage. [2025-10-25T20:58:41.363266] [WARN ] [MAIN ] ECO: No existing data found, performing full refresh instead. [2025-10-25T20:58:41.363381] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-25T20:58:41.363454] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-25T20:58:41.363526] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-10-25T20:58:41.363597] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-25T20:58:41.725568] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:58:41.725954] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-25T20:58:43.032537] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T20:58:43.037979] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-25T20:58:44.346274] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T20:58:44.350994] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-25T20:58:45.442805] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-25T20:58:45.447585] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-25T20:58:46.673394] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T20:58:46.677809] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-25T20:58:47.723161] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T20:58:47.727203] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-25T20:58:48.918332] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T20:58:48.923515] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-25T20:58:50.157756] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T20:58:50.161798] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-25T20:58:51.336495] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T20:58:51.340882] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-25T20:58:52.467779] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T20:58:52.472246] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-25T20:58:53.606479] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T20:58:53.610370] [INFO ] [REMOTE ] ECO: Full fetch complete (28334 records). [2025-10-25T20:58:53.610510] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-25T20:58:53.974971] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-25T20:58:53.975085] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-25T20:58:53.975575] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-25T20:58:53.975671] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-25T20:58:53.976370] [DEBUG] [LOCAL ] ECO: Trimmed 28334 records to 18336 (keeping 200 days of data) [2025-10-25T20:58:54.083696] [DEBUG] [LOCAL ] ECO: Primary data saved (18336 records). [2025-10-25T20:58:54.083943] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-25T20:58:54.084085] [INFO ] [MAIN ] Update Progress: 693/2366 symbols. ECO took 12.9s. Estimated remaining time: 4h 52m 21s [2025-10-25T20:58:54.251192] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:58:54.251383] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-25T20:58:54.251453] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-25T20:58:54.251564] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-25T20:58:54.251635] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-25T20:58:54.251739] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-25T20:58:54.251808] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-25T20:58:54.601621] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:58:54.601979] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-25T20:58:55.990636] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T20:58:55.998138] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-25T20:58:57.331424] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T20:58:57.338921] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-25T20:58:58.919752] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T20:58:58.928605] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-25T20:58:59.849030] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T20:58:59.858404] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-25T20:59:00.821252] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T20:59:00.834037] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-25T20:59:01.821749] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T20:59:01.834079] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-25T20:59:02.971260] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T20:59:02.981451] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-25T20:59:03.950541] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T20:59:03.959816] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-25T20:59:04.667184] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T20:59:04.676795] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-25T20:59:05.543032] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T20:59:05.550525] [INFO ] [REMOTE ] ECVT: Full fetch complete (60344 records). [2025-10-25T20:59:05.550715] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-25T20:59:05.946604] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-25T20:59:05.946752] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-25T20:59:05.947497] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-25T20:59:05.947620] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-25T20:59:05.948963] [DEBUG] [LOCAL ] ECVT: Trimmed 60344 records to 43610 (keeping 200 days of data) [2025-10-25T20:59:06.191205] [DEBUG] [LOCAL ] ECVT: Primary data saved (43610 records). [2025-10-25T20:59:06.191416] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-25T20:59:06.191571] [INFO ] [MAIN ] Update Progress: 694/2366 symbols. ECVT took 12.1s. Estimated remaining time: 4h 52m 15s [2025-10-25T20:59:06.360516] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:59:06.360759] [DEBUG] [LOCAL ] ED: No existing data file found in primary storage. [2025-10-25T20:59:06.360834] [WARN ] [MAIN ] ED: No existing data found, performing full refresh instead. [2025-10-25T20:59:06.360946] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-25T20:59:06.361017] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-25T20:59:06.361098] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-10-25T20:59:06.361165] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-25T20:59:06.730326] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:59:06.730706] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-25T20:59:08.643184] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T20:59:08.653717] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-25T20:59:10.515731] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T20:59:10.525528] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-25T20:59:12.382765] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T20:59:12.394021] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-25T20:59:13.110330] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T20:59:13.121145] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-25T20:59:14.241850] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T20:59:14.259195] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-25T20:59:15.455895] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T20:59:15.466522] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-25T20:59:16.729012] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T20:59:16.742148] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-25T20:59:17.746503] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T20:59:17.758047] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-25T20:59:18.781182] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T20:59:18.792395] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-25T20:59:19.717577] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T20:59:19.727108] [INFO ] [REMOTE ] ED: Full fetch complete (76319 records). [2025-10-25T20:59:19.727277] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-25T20:59:20.107517] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-25T20:59:20.107636] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-25T20:59:20.108509] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-25T20:59:20.108592] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-25T20:59:20.110047] [DEBUG] [LOCAL ] ED: Trimmed 76319 records to 53298 (keeping 200 days of data) [2025-10-25T20:59:20.425951] [DEBUG] [LOCAL ] ED: Primary data saved (53298 records). [2025-10-25T20:59:20.426142] [INFO ] [MAIN ] ED: Full history saved. [2025-10-25T20:59:20.426272] [INFO ] [MAIN ] Update Progress: 695/2366 symbols. ED took 14.2s. Estimated remaining time: 4h 52m 13s [2025-10-25T20:59:20.590211] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:59:20.590404] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-10-25T20:59:20.590476] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-10-25T20:59:20.590589] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-25T20:59:20.590692] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-25T20:59:20.590780] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-25T20:59:20.590850] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-25T20:59:20.932980] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:59:20.933303] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-25T20:59:22.170482] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T20:59:22.175355] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-25T20:59:23.322906] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T20:59:23.328596] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-25T20:59:24.703380] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T20:59:24.709890] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-25T20:59:25.999131] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T20:59:26.004780] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-25T20:59:27.193519] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T20:59:27.199270] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-25T20:59:28.448800] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T20:59:28.455010] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-25T20:59:29.950086] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T20:59:29.957625] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-25T20:59:31.109772] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T20:59:31.115443] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-25T20:59:32.566324] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-25T20:59:32.573346] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-25T20:59:33.835581] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T20:59:33.840992] [INFO ] [REMOTE ] EDD: Full fetch complete (39118 records). [2025-10-25T20:59:33.841153] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-25T20:59:34.217806] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-25T20:59:34.217946] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-25T20:59:34.218547] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-25T20:59:34.218661] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-25T20:59:34.219661] [DEBUG] [LOCAL ] EDD: Trimmed 39118 records to 27595 (keeping 200 days of data) [2025-10-25T20:59:34.370418] [DEBUG] [LOCAL ] EDD: Primary data saved (27595 records). [2025-10-25T20:59:34.370576] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-25T20:59:34.370723] [INFO ] [MAIN ] Update Progress: 696/2366 symbols. EDD took 13.9s. Estimated remaining time: 4h 52m 11s [2025-10-25T20:59:34.542249] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:59:34.542468] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-25T20:59:34.542548] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-25T20:59:34.542661] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-25T20:59:34.542727] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-25T20:59:34.542780] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-25T20:59:34.542847] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-25T20:59:34.898869] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:59:34.899229] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-25T20:59:35.929870] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T20:59:35.933796] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-25T20:59:36.945915] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T20:59:36.949791] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-25T20:59:37.909000] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T20:59:37.912424] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-25T20:59:38.957958] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T20:59:38.961963] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-25T20:59:40.041126] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T20:59:40.045916] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-25T20:59:40.995605] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T20:59:40.998784] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-25T20:59:41.838711] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T20:59:41.843966] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-25T20:59:42.519847] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-25T20:59:42.524242] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-25T20:59:43.378757] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T20:59:43.382072] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-25T20:59:44.291249] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T20:59:44.294017] [INFO ] [REMOTE ] EDF: Full fetch complete (19922 records). [2025-10-25T20:59:44.294118] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-25T20:59:44.685879] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-25T20:59:44.686099] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-25T20:59:44.687091] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-25T20:59:44.687204] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-25T20:59:44.688321] [DEBUG] [LOCAL ] EDF: Trimmed 19922 records to 12935 (keeping 200 days of data) [2025-10-25T20:59:44.770558] [DEBUG] [LOCAL ] EDF: Primary data saved (12935 records). [2025-10-25T20:59:44.770841] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-25T20:59:44.771010] [INFO ] [MAIN ] Update Progress: 697/2366 symbols. EDF took 10.4s. Estimated remaining time: 4h 52m 0s [2025-10-25T20:59:44.951482] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:59:44.951845] [DEBUG] [LOCAL ] EDN: No existing data file found in primary storage. [2025-10-25T20:59:44.951980] [WARN ] [MAIN ] EDN: No existing data found, performing full refresh instead. [2025-10-25T20:59:44.952170] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-25T20:59:44.952247] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-25T20:59:44.952312] [DEBUG] [LOCAL ] EDN: No primary data file found to delete. [2025-10-25T20:59:44.952380] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-25T20:59:45.333061] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:59:45.333506] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-25T20:59:46.790796] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T20:59:46.798071] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-25T20:59:47.948324] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T20:59:47.953238] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-25T20:59:49.074395] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T20:59:49.078609] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-25T20:59:50.045420] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T20:59:50.049959] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-25T20:59:51.246396] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T20:59:51.251222] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-25T20:59:52.259957] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T20:59:52.264234] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-25T20:59:53.467493] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T20:59:53.472718] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-25T20:59:54.548997] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T20:59:54.553514] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-25T20:59:55.896413] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T20:59:55.902235] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-25T20:59:57.263811] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T20:59:57.268637] [INFO ] [REMOTE ] EDN: Full fetch complete (29646 records). [2025-10-25T20:59:57.268771] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-25T20:59:57.659969] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-25T20:59:57.660086] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-25T20:59:57.660600] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-25T20:59:57.660697] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-25T20:59:57.661379] [DEBUG] [LOCAL ] EDN: Trimmed 29646 records to 19648 (keeping 200 days of data) [2025-10-25T20:59:57.772302] [DEBUG] [LOCAL ] EDN: Primary data saved (19648 records). [2025-10-25T20:59:57.772460] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-25T20:59:57.772587] [INFO ] [MAIN ] Update Progress: 698/2366 symbols. EDN took 13.0s. Estimated remaining time: 4h 51m 56s [2025-10-25T20:59:57.940543] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T20:59:57.940742] [DEBUG] [LOCAL ] EDU: No existing data file found in primary storage. [2025-10-25T20:59:57.940816] [WARN ] [MAIN ] EDU: No existing data found, performing full refresh instead. [2025-10-25T20:59:57.940928] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-25T20:59:57.941000] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-25T20:59:57.941087] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-10-25T20:59:57.941176] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-25T20:59:58.294798] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T20:59:58.295133] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-25T20:59:59.937721] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T20:59:59.947507] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-25T21:00:02.527686] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-25T21:00:02.542137] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-25T21:00:05.759108] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (3.22 seconds). [2025-10-25T21:00:05.769121] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-25T21:00:07.182127] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T21:00:07.192268] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-25T21:00:08.162090] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T21:00:08.170960] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-25T21:00:09.088573] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T21:00:09.098442] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-25T21:00:09.992001] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T21:00:10.002522] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-25T21:00:11.016002] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T21:00:11.024941] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-25T21:00:12.290522] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T21:00:12.300511] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-25T21:00:13.216722] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T21:00:13.225356] [INFO ] [REMOTE ] EDU: Full fetch complete (67142 records). [2025-10-25T21:00:13.225517] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-25T21:00:13.618411] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-25T21:00:13.618522] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-25T21:00:13.619314] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-25T21:00:13.619396] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-25T21:00:13.620772] [DEBUG] [LOCAL ] EDU: Trimmed 67142 records to 45389 (keeping 200 days of data) [2025-10-25T21:00:13.876373] [DEBUG] [LOCAL ] EDU: Primary data saved (45389 records). [2025-10-25T21:00:13.876556] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-25T21:00:13.876713] [INFO ] [MAIN ] Update Progress: 699/2366 symbols. EDU took 16.1s. Estimated remaining time: 4h 51m 59s [2025-10-25T21:00:14.055683] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:00:14.055935] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-25T21:00:14.056027] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-25T21:00:14.056174] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-25T21:00:14.056259] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-25T21:00:14.056360] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-25T21:00:14.056441] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-25T21:00:14.412846] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:00:14.413164] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-25T21:00:15.786795] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T21:00:15.794560] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-25T21:00:17.285365] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T21:00:17.290052] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-25T21:00:18.812745] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T21:00:18.819233] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-25T21:00:20.469848] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T21:00:20.477765] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-25T21:00:21.791881] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T21:00:21.798517] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-25T21:00:23.235750] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T21:00:23.242979] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-25T21:00:24.637884] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T21:00:24.645620] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-25T21:00:25.767209] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T21:00:25.775669] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-25T21:00:27.133296] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-25T21:00:27.140196] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-25T21:00:28.202545] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T21:00:28.209061] [INFO ] [REMOTE ] EE: Full fetch complete (44571 records). [2025-10-25T21:00:28.209189] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-25T21:00:28.579606] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-25T21:00:28.579728] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-25T21:00:28.580340] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-25T21:00:28.580417] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-25T21:00:28.581354] [DEBUG] [LOCAL ] EE: Trimmed 44571 records to 32959 (keeping 200 days of data) [2025-10-25T21:00:28.768057] [DEBUG] [LOCAL ] EE: Primary data saved (32959 records). [2025-10-25T21:00:28.768218] [INFO ] [MAIN ] EE: Full history saved. [2025-10-25T21:00:28.768343] [INFO ] [MAIN ] Update Progress: 700/2366 symbols. EE took 14.9s. Estimated remaining time: 4h 51m 59s [2025-10-25T21:00:28.937132] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:00:28.937332] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-25T21:00:28.937427] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-25T21:00:28.937579] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-25T21:00:28.937687] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-25T21:00:28.937795] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-25T21:00:28.937888] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-25T21:00:29.287476] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:00:29.287824] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-25T21:00:29.981539] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-25T21:00:29.982811] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-25T21:00:30.734500] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T21:00:30.735724] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-25T21:00:31.494170] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T21:00:31.495684] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-25T21:00:32.204922] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T21:00:32.206460] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-25T21:00:32.860774] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-25T21:00:32.862109] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-25T21:00:33.522344] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T21:00:33.523694] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-25T21:00:34.282000] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-25T21:00:34.283520] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-25T21:00:34.871599] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T21:00:34.872921] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-25T21:00:35.491228] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T21:00:35.492428] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-25T21:00:35.989252] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-25T21:00:35.990236] [INFO ] [REMOTE ] EEA: Full fetch complete (3692 records). [2025-10-25T21:00:35.990338] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-25T21:00:36.184303] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T21:00:36.184541] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:00:36.184618] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:00:36.184726] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-25T21:00:36.184823] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-25T21:00:36.184899] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-25T21:00:36.184986] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-25T21:00:36.185107] [INFO ] [MAIN ] Update Progress: 701/2366 symbols. EEA took 7.4s. Estimated remaining time: 4h 51m 41s [2025-10-25T21:00:36.353081] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:00:36.353276] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-25T21:00:36.353352] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-25T21:00:36.353472] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-25T21:00:36.353549] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-25T21:00:36.353636] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-25T21:00:36.353732] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-25T21:00:36.703945] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:00:36.704314] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-25T21:00:37.662500] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-25T21:00:37.666563] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-25T21:00:38.815180] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T21:00:38.819524] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-25T21:00:39.980391] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T21:00:39.985376] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-25T21:00:41.159584] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T21:00:41.163580] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-25T21:00:42.156265] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T21:00:42.159469] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-25T21:00:43.115760] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T21:00:43.119086] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-25T21:00:44.011230] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T21:00:44.014278] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-25T21:00:44.923365] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T21:00:44.925608] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-25T21:00:45.735416] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-25T21:00:45.737967] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-25T21:00:46.515885] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T21:00:46.518034] [INFO ] [REMOTE ] EEX: Full fetch complete (18226 records). [2025-10-25T21:00:46.518187] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-25T21:00:46.920024] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-25T21:00:46.920149] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-25T21:00:46.920636] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-25T21:00:46.920740] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-25T21:00:46.921427] [DEBUG] [LOCAL ] EEX: Trimmed 18226 records to 9933 (keeping 200 days of data) [2025-10-25T21:00:46.982282] [DEBUG] [LOCAL ] EEX: Primary data saved (9933 records). [2025-10-25T21:00:46.982464] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-25T21:00:46.982598] [INFO ] [MAIN ] Update Progress: 702/2366 symbols. EEX took 10.8s. Estimated remaining time: 4h 51m 31s [2025-10-25T21:00:47.156252] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:00:47.156446] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-25T21:00:47.156516] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-25T21:00:47.156626] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-25T21:00:47.156717] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-25T21:00:47.156778] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-25T21:00:47.156841] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-25T21:00:47.510781] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:00:47.511128] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-25T21:00:49.171548] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T21:00:49.180183] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-25T21:00:50.838943] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T21:00:50.851937] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-25T21:00:52.490622] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T21:00:52.501045] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-25T21:00:54.354176] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T21:00:54.364379] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-25T21:00:56.101306] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T21:00:56.111989] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-25T21:00:57.732959] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T21:00:57.741678] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-25T21:00:59.508523] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-25T21:00:59.518414] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-25T21:01:01.357788] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-25T21:01:01.367781] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-25T21:01:03.669678] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-25T21:01:03.680092] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-25T21:01:05.501235] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-25T21:01:05.509924] [INFO ] [REMOTE ] EFC: Full fetch complete (66728 records). [2025-10-25T21:01:05.510055] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-25T21:01:05.889865] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-25T21:01:05.889981] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-25T21:01:05.890789] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-25T21:01:05.890869] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-25T21:01:05.892142] [DEBUG] [LOCAL ] EFC: Trimmed 66728 records to 46971 (keeping 200 days of data) [2025-10-25T21:01:06.181694] [DEBUG] [LOCAL ] EFC: Primary data saved (46971 records). [2025-10-25T21:01:06.181871] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-25T21:01:06.182001] [INFO ] [MAIN ] Update Progress: 703/2366 symbols. EFC took 19.2s. Estimated remaining time: 4h 51m 41s [2025-10-25T21:01:06.354266] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:01:06.354512] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-10-25T21:01:06.354587] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-10-25T21:01:06.354727] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-25T21:01:06.354801] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-25T21:01:06.354861] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-25T21:01:06.354926] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-25T21:01:06.707975] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:01:06.708310] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-25T21:01:07.608595] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T21:01:07.611253] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-25T21:01:08.585320] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-25T21:01:08.587778] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-25T21:01:09.509873] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-25T21:01:09.512557] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-25T21:01:10.659825] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T21:01:10.664236] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-25T21:01:11.548142] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T21:01:11.551303] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-25T21:01:12.465948] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T21:01:12.471228] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-25T21:01:13.584786] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T21:01:13.589246] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-25T21:01:14.753633] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T21:01:14.758174] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-25T21:01:15.682090] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T21:01:15.685971] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-25T21:01:16.790775] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T21:01:16.794329] [INFO ] [REMOTE ] EFR: Full fetch complete (19762 records). [2025-10-25T21:01:16.794439] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-25T21:01:17.168492] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-25T21:01:17.168629] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-25T21:01:17.169223] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-25T21:01:17.169305] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-25T21:01:17.170037] [DEBUG] [LOCAL ] EFR: Trimmed 19762 records to 15254 (keeping 200 days of data) [2025-10-25T21:01:17.261284] [DEBUG] [LOCAL ] EFR: Primary data saved (15254 records). [2025-10-25T21:01:17.261446] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-25T21:01:17.261574] [INFO ] [MAIN ] Update Progress: 704/2366 symbols. EFR took 11.1s. Estimated remaining time: 4h 51m 32s [2025-10-25T21:01:17.434147] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:01:17.434332] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-10-25T21:01:17.434405] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-10-25T21:01:17.434518] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-25T21:01:17.434590] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-25T21:01:17.434700] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-25T21:01:17.434776] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-25T21:01:17.793283] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:01:17.793611] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-25T21:01:18.698913] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T21:01:18.702090] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-25T21:01:19.571747] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-25T21:01:19.574126] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-25T21:01:20.641512] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T21:01:20.644337] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-25T21:01:21.720889] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T21:01:21.724722] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-25T21:01:22.802814] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T21:01:22.806227] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-25T21:01:23.888056] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T21:01:23.891949] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-25T21:01:24.763397] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T21:01:24.768314] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-25T21:01:25.637857] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T21:01:25.642340] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-25T21:01:26.642378] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T21:01:26.645786] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-25T21:01:27.665179] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T21:01:27.668318] [INFO ] [REMOTE ] EFT: Full fetch complete (17718 records). [2025-10-25T21:01:27.668419] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-25T21:01:28.033543] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-25T21:01:28.033683] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-25T21:01:28.034085] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-25T21:01:28.034159] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-25T21:01:28.034737] [DEBUG] [LOCAL ] EFT: Trimmed 17718 records to 13039 (keeping 200 days of data) [2025-10-25T21:01:28.110317] [DEBUG] [LOCAL ] EFT: Primary data saved (13039 records). [2025-10-25T21:01:28.110479] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-25T21:01:28.110601] [INFO ] [MAIN ] Update Progress: 705/2366 symbols. EFT took 10.8s. Estimated remaining time: 4h 51m 22s [2025-10-25T21:01:28.278781] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:01:28.278991] [DEBUG] [LOCAL ] EFX: No existing data file found in primary storage. [2025-10-25T21:01:28.279063] [WARN ] [MAIN ] EFX: No existing data found, performing full refresh instead. [2025-10-25T21:01:28.279151] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-25T21:01:28.279219] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-25T21:01:28.279279] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-25T21:01:28.279346] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-25T21:01:28.635471] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:01:28.635824] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-25T21:01:30.285525] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T21:01:30.294438] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-25T21:01:32.001501] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T21:01:32.010726] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-25T21:01:34.008093] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T21:01:34.017872] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-25T21:01:35.824308] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T21:01:35.835137] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-25T21:01:37.415424] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T21:01:37.424583] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-25T21:01:39.166619] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-25T21:01:39.175822] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-25T21:01:40.981492] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-25T21:01:40.991057] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-25T21:01:42.699483] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T21:01:42.708909] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-25T21:01:44.532043] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T21:01:44.541790] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-25T21:01:46.343301] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-25T21:01:46.351925] [INFO ] [REMOTE ] EFX: Full fetch complete (65091 records). [2025-10-25T21:01:46.352076] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-25T21:01:46.743925] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-25T21:01:46.744062] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-25T21:01:46.744964] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-25T21:01:46.745074] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-25T21:01:46.746415] [DEBUG] [LOCAL ] EFX: Trimmed 65091 records to 45341 (keeping 200 days of data) [2025-10-25T21:01:47.022832] [DEBUG] [LOCAL ] EFX: Primary data saved (45341 records). [2025-10-25T21:01:47.023013] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-25T21:01:47.023161] [INFO ] [MAIN ] Update Progress: 706/2366 symbols. EFX took 18.9s. Estimated remaining time: 4h 51m 31s [2025-10-25T21:01:47.199975] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:01:47.200198] [DEBUG] [LOCAL ] EFXT: No existing data file found in primary storage. [2025-10-25T21:01:47.200284] [WARN ] [MAIN ] EFXT: No existing data found, performing full refresh instead. [2025-10-25T21:01:47.200427] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-25T21:01:47.200516] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-25T21:01:47.200627] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-25T21:01:47.200760] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-25T21:01:47.573368] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:01:47.573767] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-25T21:01:49.142113] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T21:01:49.149352] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-25T21:01:50.521419] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T21:01:50.527329] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-25T21:01:51.930285] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T21:01:51.937176] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-25T21:01:53.446500] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T21:01:53.454337] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-25T21:01:54.742471] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T21:01:54.752143] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-25T21:01:56.046407] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T21:01:56.052550] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-25T21:01:57.275367] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T21:01:57.281568] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-25T21:01:58.746260] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T21:01:58.753406] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-25T21:01:59.922243] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T21:01:59.929346] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-25T21:02:01.118160] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T21:02:01.124550] [INFO ] [REMOTE ] EFXT: Full fetch complete (44311 records). [2025-10-25T21:02:01.124727] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-25T21:02:01.511515] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-25T21:02:01.511674] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-25T21:02:01.512433] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-25T21:02:01.512531] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-25T21:02:01.513600] [DEBUG] [LOCAL ] EFXT: Trimmed 44311 records to 30013 (keeping 200 days of data) [2025-10-25T21:02:01.693157] [DEBUG] [LOCAL ] EFXT: Primary data saved (30013 records). [2025-10-25T21:02:01.693320] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-25T21:02:01.693450] [INFO ] [MAIN ] Update Progress: 707/2366 symbols. EFXT took 14.7s. Estimated remaining time: 4h 51m 30s [2025-10-25T21:02:01.878896] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:02:01.879118] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-10-25T21:02:01.879191] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-10-25T21:02:01.879307] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-25T21:02:01.879378] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-25T21:02:01.879459] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-25T21:02:01.879531] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-25T21:02:02.265570] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:02:02.265975] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-25T21:02:04.653974] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-25T21:02:04.661566] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-25T21:02:06.184372] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T21:02:06.191434] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-25T21:02:07.695563] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T21:02:07.702984] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-25T21:02:09.259536] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T21:02:09.266280] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-25T21:02:10.795356] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T21:02:10.802746] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-25T21:02:12.320132] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T21:02:12.329714] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-25T21:02:13.832227] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T21:02:13.838870] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-25T21:02:15.147423] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T21:02:15.153223] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-25T21:02:16.397178] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T21:02:16.404297] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-25T21:02:17.610940] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T21:02:17.615501] [INFO ] [REMOTE ] EG: Full fetch complete (42615 records). [2025-10-25T21:02:17.615701] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-25T21:02:18.014821] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-25T21:02:18.014966] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-25T21:02:18.015628] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-25T21:02:18.015730] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-25T21:02:18.016720] [DEBUG] [LOCAL ] EG: Trimmed 42615 records to 27743 (keeping 200 days of data) [2025-10-25T21:02:18.187136] [DEBUG] [LOCAL ] EG: Primary data saved (27743 records). [2025-10-25T21:02:18.187321] [INFO ] [MAIN ] EG: Full history saved. [2025-10-25T21:02:18.187476] [INFO ] [MAIN ] Update Progress: 708/2366 symbols. EG took 16.5s. Estimated remaining time: 4h 51m 34s [2025-10-25T21:02:18.363403] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:02:18.363607] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-25T21:02:18.363708] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-25T21:02:18.363822] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-25T21:02:18.363895] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-25T21:02:18.363957] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-25T21:02:18.364023] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-25T21:02:18.743436] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:02:18.743834] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-25T21:02:20.387036] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T21:02:20.396671] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-25T21:02:22.011371] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T21:02:22.021163] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-25T21:02:23.639892] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T21:02:23.654365] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-25T21:02:24.777795] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T21:02:24.789178] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-25T21:02:25.804493] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T21:02:25.815150] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-25T21:02:26.719330] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T21:02:26.730164] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-25T21:02:27.567491] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T21:02:27.578875] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-25T21:02:28.549021] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T21:02:28.559674] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-25T21:02:29.605569] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T21:02:29.617428] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-25T21:02:30.425817] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T21:02:30.435683] [INFO ] [REMOTE ] EGO: Full fetch complete (74675 records). [2025-10-25T21:02:30.435877] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-25T21:02:30.819353] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-25T21:02:30.819465] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-25T21:02:30.820325] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-25T21:02:30.820404] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-25T21:02:30.821813] [DEBUG] [LOCAL ] EGO: Trimmed 74675 records to 52493 (keeping 200 days of data) [2025-10-25T21:02:31.113968] [DEBUG] [LOCAL ] EGO: Primary data saved (52493 records). [2025-10-25T21:02:31.114134] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-25T21:02:31.114275] [INFO ] [MAIN ] Update Progress: 709/2366 symbols. EGO took 12.9s. Estimated remaining time: 4h 51m 29s [2025-10-25T21:02:31.279554] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:02:31.279765] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-25T21:02:31.279836] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-25T21:02:31.279948] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-25T21:02:31.280018] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-25T21:02:31.280098] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-25T21:02:31.280166] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-25T21:02:31.628397] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:02:31.628798] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-25T21:02:33.374123] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T21:02:33.380609] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-25T21:02:34.758773] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T21:02:34.765881] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-25T21:02:36.180070] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T21:02:36.187613] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-25T21:02:37.724905] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T21:02:37.733273] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-25T21:02:39.081165] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-25T21:02:39.087621] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-25T21:02:40.511334] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T21:02:40.520333] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-25T21:02:42.010330] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T21:02:42.019160] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-25T21:02:43.449051] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T21:02:43.455786] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-25T21:02:44.867752] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T21:02:44.874906] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-25T21:02:46.156437] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T21:02:46.162203] [INFO ] [REMOTE ] EGP: Full fetch complete (45614 records). [2025-10-25T21:02:46.162357] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-25T21:02:46.537601] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-25T21:02:46.537739] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-25T21:02:46.538411] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-25T21:02:46.538490] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-25T21:02:46.539555] [DEBUG] [LOCAL ] EGP: Trimmed 45614 records to 30745 (keeping 200 days of data) [2025-10-25T21:02:46.725101] [DEBUG] [LOCAL ] EGP: Primary data saved (30745 records). [2025-10-25T21:02:46.725278] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-25T21:02:46.725420] [INFO ] [MAIN ] Update Progress: 710/2366 symbols. EGP took 15.6s. Estimated remaining time: 4h 51m 30s [2025-10-25T21:02:46.897086] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:02:46.897324] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-10-25T21:02:46.897399] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-10-25T21:02:46.897510] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-25T21:02:46.897580] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-25T21:02:46.897682] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-25T21:02:46.897761] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-25T21:02:47.249140] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:02:47.249472] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-25T21:02:48.973385] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T21:02:48.981796] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-25T21:02:50.675754] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T21:02:50.684385] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-25T21:02:52.495929] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T21:02:52.505445] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-25T21:02:54.257746] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T21:02:54.266879] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-25T21:02:56.105800] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-25T21:02:56.115592] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-25T21:02:57.838015] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-25T21:02:57.846771] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-25T21:02:59.151859] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-25T21:02:59.160501] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-25T21:03:01.479788] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-25T21:03:01.493286] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-25T21:03:03.363740] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-25T21:03:03.372589] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-25T21:03:05.259380] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-25T21:03:05.268009] [INFO ] [REMOTE ] EGY: Full fetch complete (60658 records). [2025-10-25T21:03:05.268262] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-25T21:03:05.769275] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-25T21:03:05.769451] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-25T21:03:05.770792] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-25T21:03:05.770914] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-25T21:03:05.772767] [DEBUG] [LOCAL ] EGY: Trimmed 60658 records to 41776 (keeping 200 days of data) [2025-10-25T21:03:06.100796] [DEBUG] [LOCAL ] EGY: Primary data saved (41776 records). [2025-10-25T21:03:06.100978] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-25T21:03:06.101115] [INFO ] [MAIN ] Update Progress: 711/2366 symbols. EGY took 19.4s. Estimated remaining time: 4h 51m 40s [2025-10-25T21:03:06.380357] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:03:06.380632] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-25T21:03:06.380782] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-25T21:03:06.380932] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-25T21:03:06.381024] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-25T21:03:06.381130] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-25T21:03:06.381220] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-25T21:03:06.813421] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:03:06.813890] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-25T21:03:07.919441] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T21:03:07.925322] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-25T21:03:09.178259] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T21:03:09.184165] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-25T21:03:10.540139] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T21:03:10.546622] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-25T21:03:12.158278] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T21:03:12.165033] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-25T21:03:13.519219] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-25T21:03:13.525772] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-25T21:03:14.846918] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T21:03:14.853214] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-25T21:03:16.441433] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T21:03:16.450066] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-25T21:03:17.849484] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T21:03:17.856600] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-25T21:03:18.976740] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T21:03:18.982296] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-25T21:03:20.113322] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T21:03:20.118277] [INFO ] [REMOTE ] EHAB: Full fetch complete (41150 records). [2025-10-25T21:03:20.118392] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-25T21:03:20.490013] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-25T21:03:20.490150] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-25T21:03:20.490834] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-25T21:03:20.490932] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-25T21:03:20.492012] [DEBUG] [LOCAL ] EHAB: Trimmed 41150 records to 29631 (keeping 200 days of data) [2025-10-25T21:03:20.650146] [DEBUG] [LOCAL ] EHAB: Primary data saved (29631 records). [2025-10-25T21:03:20.650350] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-25T21:03:20.650502] [INFO ] [MAIN ] Update Progress: 712/2366 symbols. EHAB took 14.5s. Estimated remaining time: 4h 51m 39s [2025-10-25T21:03:20.819136] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:03:20.819317] [DEBUG] [LOCAL ] EHC: No existing data file found in primary storage. [2025-10-25T21:03:20.819388] [WARN ] [MAIN ] EHC: No existing data found, performing full refresh instead. [2025-10-25T21:03:20.819503] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-25T21:03:20.819592] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-25T21:03:20.819694] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-25T21:03:20.819764] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-25T21:03:21.169661] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:03:21.169998] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-25T21:03:22.809512] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T21:03:22.817381] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-25T21:03:24.428328] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T21:03:24.436240] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-25T21:03:26.055547] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T21:03:26.064409] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-25T21:03:28.011532] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-25T21:03:28.021780] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-25T21:03:29.790833] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-25T21:03:29.799702] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-25T21:03:31.340271] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T21:03:31.349182] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-25T21:03:33.231238] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-25T21:03:33.240953] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-25T21:03:34.928036] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T21:03:34.939066] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-25T21:03:36.612686] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T21:03:36.621091] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-25T21:03:38.122400] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T21:03:38.130698] [INFO ] [REMOTE ] EHC: Full fetch complete (58727 records). [2025-10-25T21:03:38.130949] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-25T21:03:38.539096] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-25T21:03:38.539254] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-25T21:03:38.540475] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-25T21:03:38.540563] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-25T21:03:38.542468] [DEBUG] [LOCAL ] EHC: Trimmed 58727 records to 41478 (keeping 200 days of data) [2025-10-25T21:03:38.820527] [DEBUG] [LOCAL ] EHC: Primary data saved (41478 records). [2025-10-25T21:03:38.820799] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-25T21:03:38.820971] [INFO ] [MAIN ] Update Progress: 713/2366 symbols. EHC took 18.2s. Estimated remaining time: 4h 51m 46s [2025-10-25T21:03:39.024413] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:03:39.024666] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-10-25T21:03:39.024735] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-10-25T21:03:39.024853] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-25T21:03:39.024928] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-25T21:03:39.025013] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-25T21:03:39.025085] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-25T21:03:39.390829] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:03:39.391193] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-25T21:03:40.341357] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T21:03:40.344714] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-25T21:03:41.332190] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T21:03:41.337673] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-25T21:03:42.075449] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-25T21:03:42.078691] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-25T21:03:42.969745] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T21:03:42.972767] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-25T21:03:43.924416] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T21:03:43.927459] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-25T21:03:44.769491] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T21:03:44.772673] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-25T21:03:45.674078] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T21:03:45.677167] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-25T21:03:46.572977] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T21:03:46.575725] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-25T21:03:47.472712] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T21:03:47.475786] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-25T21:03:48.348077] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T21:03:48.350543] [INFO ] [REMOTE ] EHI: Full fetch complete (15720 records). [2025-10-25T21:03:48.350675] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-25T21:03:48.723249] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-25T21:03:48.723384] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-25T21:03:48.723835] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-25T21:03:48.723925] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-25T21:03:48.724593] [DEBUG] [LOCAL ] EHI: Trimmed 15720 records to 10648 (keeping 200 days of data) [2025-10-25T21:03:48.784178] [DEBUG] [LOCAL ] EHI: Primary data saved (10648 records). [2025-10-25T21:03:48.784361] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-25T21:03:48.784540] [INFO ] [MAIN ] Update Progress: 714/2366 symbols. EHI took 10.0s. Estimated remaining time: 4h 51m 33s [2025-10-25T21:03:48.954992] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:03:48.955210] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-10-25T21:03:48.955310] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-10-25T21:03:48.955461] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-25T21:03:48.955548] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-25T21:03:48.955693] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-25T21:03:48.955785] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-25T21:03:49.308498] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:03:49.309121] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-25T21:03:50.572089] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T21:03:50.577174] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-25T21:03:51.799126] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T21:03:51.804451] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-25T21:03:53.528686] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T21:03:53.539198] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-25T21:03:54.860208] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T21:03:54.865926] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-25T21:03:56.199562] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T21:03:56.207621] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-25T21:03:57.529497] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T21:03:57.535255] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-25T21:03:58.864214] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T21:03:58.870332] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-25T21:04:00.163823] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T21:04:00.169132] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-25T21:04:01.476636] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T21:04:01.480772] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-25T21:04:02.940231] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T21:04:02.943809] [INFO ] [REMOTE ] EIC: Full fetch complete (33997 records). [2025-10-25T21:04:02.943910] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-25T21:04:03.308064] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-25T21:04:03.308174] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-25T21:04:03.308708] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-25T21:04:03.308787] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-25T21:04:03.309513] [DEBUG] [LOCAL ] EIC: Trimmed 33997 records to 22653 (keeping 200 days of data) [2025-10-25T21:04:03.439261] [DEBUG] [LOCAL ] EIC: Primary data saved (22653 records). [2025-10-25T21:04:03.439408] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-25T21:04:03.439532] [INFO ] [MAIN ] Update Progress: 715/2366 symbols. EIC took 14.7s. Estimated remaining time: 4h 51m 32s [2025-10-25T21:04:03.604897] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:04:03.605060] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-25T21:04:03.605130] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-25T21:04:03.605242] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-25T21:04:03.605325] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-25T21:04:03.605382] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-25T21:04:03.605443] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-25T21:04:03.954900] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:04:03.955210] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-25T21:04:04.570883] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T21:04:04.571919] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-25T21:04:05.088467] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-25T21:04:05.089485] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-25T21:04:05.587163] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-25T21:04:05.588206] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-25T21:04:06.058089] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-25T21:04:06.059115] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-25T21:04:06.564861] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-25T21:04:06.565817] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-25T21:04:06.988721] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-25T21:04:06.989600] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-25T21:04:07.401737] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-25T21:04:07.402754] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-25T21:04:07.894796] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-25T21:04:07.895753] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-25T21:04:08.345490] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-25T21:04:08.346425] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-25T21:04:08.790674] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-25T21:04:08.791410] [INFO ] [REMOTE ] EICA: Full fetch complete (1194 records). [2025-10-25T21:04:08.791498] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-25T21:04:08.972791] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-25T21:04:08.972982] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:04:08.973237] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:04:08.973336] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-25T21:04:08.973457] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-25T21:04:08.973550] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-25T21:04:08.973686] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-25T21:04:08.973850] [INFO ] [MAIN ] Update Progress: 716/2366 symbols. EICA took 5.5s. Estimated remaining time: 4h 51m 10s [2025-10-25T21:04:09.146313] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:04:09.146516] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-25T21:04:09.146605] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-25T21:04:09.146759] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-25T21:04:09.146848] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-25T21:04:09.146954] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-25T21:04:09.147041] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-25T21:04:09.508234] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:04:09.508564] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-25T21:04:10.217423] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-25T21:04:10.218569] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-25T21:04:10.742160] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-25T21:04:10.743314] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-25T21:04:11.343224] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T21:04:11.344390] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-25T21:04:11.966986] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-25T21:04:11.968174] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-25T21:04:12.481375] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-25T21:04:12.482559] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-25T21:04:12.979176] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-25T21:04:12.980326] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-25T21:04:13.536276] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-25T21:04:13.537700] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-25T21:04:14.048619] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-25T21:04:14.049934] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-25T21:04:14.609668] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-25T21:04:14.610985] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-25T21:04:15.185489] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T21:04:15.186415] [INFO ] [REMOTE ] EICB: Full fetch complete (2631 records). [2025-10-25T21:04:15.186505] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-25T21:04:15.364226] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-25T21:04:15.364385] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:04:15.364482] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:04:15.364575] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-25T21:04:15.364725] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-25T21:04:15.364821] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-25T21:04:15.364923] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-25T21:04:15.365076] [INFO ] [MAIN ] Update Progress: 717/2366 symbols. EICB took 6.4s. Estimated remaining time: 4h 50m 50s [2025-10-25T21:04:15.535875] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:04:15.536102] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-25T21:04:15.536192] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-25T21:04:15.536337] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-25T21:04:15.536422] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-25T21:04:15.536523] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-25T21:04:15.536608] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-25T21:04:15.921968] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:04:15.922356] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-25T21:04:16.740392] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T21:04:16.741959] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-25T21:04:17.397281] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-25T21:04:17.399728] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-25T21:04:18.043272] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-25T21:04:18.045267] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-25T21:04:18.780990] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T21:04:18.783112] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-25T21:04:19.497807] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T21:04:19.499686] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-25T21:04:20.225863] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T21:04:20.227681] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-25T21:04:21.045800] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T21:04:21.047874] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-25T21:04:21.636793] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T21:04:21.638839] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-25T21:04:22.552596] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T21:04:22.554932] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-25T21:04:23.313781] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T21:04:23.315459] [INFO ] [REMOTE ] EICC: Full fetch complete (8451 records). [2025-10-25T21:04:23.315550] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-25T21:04:23.673231] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-10-25T21:04:23.673348] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-10-25T21:04:23.673590] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-10-25T21:04:23.673686] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-10-25T21:04:23.674121] [DEBUG] [LOCAL ] EICC: Trimmed 8451 records to 6243 (keeping 200 days of data) [2025-10-25T21:04:23.710782] [DEBUG] [LOCAL ] EICC: Primary data saved (6243 records). [2025-10-25T21:04:23.710929] [INFO ] [MAIN ] EICC: Full history saved. [2025-10-25T21:04:23.711100] [INFO ] [MAIN ] Update Progress: 718/2366 symbols. EICC took 8.3s. Estimated remaining time: 4h 50m 34s [2025-10-25T21:04:23.881190] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:04:23.881418] [DEBUG] [LOCAL ] EIG: No existing data file found in primary storage. [2025-10-25T21:04:23.881490] [WARN ] [MAIN ] EIG: No existing data found, performing full refresh instead. [2025-10-25T21:04:23.881576] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-25T21:04:23.881664] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-25T21:04:23.881741] [DEBUG] [LOCAL ] EIG: No primary data file found to delete. [2025-10-25T21:04:23.881804] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-25T21:04:24.243305] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:04:24.243699] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-25T21:04:25.329034] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T21:04:25.332514] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-25T21:04:26.513279] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-25T21:04:26.517065] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-25T21:04:27.715138] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T21:04:27.719917] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-25T21:04:28.927773] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T21:04:28.932497] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-25T21:04:30.059166] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T21:04:30.064173] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-25T21:04:31.008631] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T21:04:31.012914] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-25T21:04:32.223586] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T21:04:32.228527] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-25T21:04:33.412502] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-25T21:04:33.418300] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-25T21:04:34.493405] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T21:04:34.498513] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-25T21:04:35.632429] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T21:04:35.636105] [INFO ] [REMOTE ] EIG: Full fetch complete (27321 records). [2025-10-25T21:04:35.636238] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-25T21:04:36.024326] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-25T21:04:36.024443] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-25T21:04:36.025081] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-25T21:04:36.025165] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-25T21:04:36.026016] [DEBUG] [LOCAL ] EIG: Trimmed 27321 records to 20281 (keeping 200 days of data) [2025-10-25T21:04:36.142845] [DEBUG] [LOCAL ] EIG: Primary data saved (20281 records). [2025-10-25T21:04:36.142998] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-25T21:04:36.143126] [INFO ] [MAIN ] Update Progress: 719/2366 symbols. EIG took 12.4s. Estimated remaining time: 4h 50m 28s [2025-10-25T21:04:36.310122] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:04:36.310323] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-25T21:04:36.310392] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-25T21:04:36.310503] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-25T21:04:36.310572] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-25T21:04:36.310671] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-25T21:04:36.310739] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-25T21:04:36.671775] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:04:36.672104] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-25T21:04:38.763511] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-25T21:04:38.773841] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-25T21:04:40.549863] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T21:04:40.561381] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-25T21:04:42.508396] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T21:04:42.520178] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-25T21:04:43.503613] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T21:04:43.514848] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-25T21:04:44.195995] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-25T21:04:44.207091] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-25T21:04:45.239471] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T21:04:45.250514] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-25T21:04:46.056862] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-25T21:04:46.068308] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-25T21:04:46.987025] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T21:04:46.998996] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-25T21:04:47.989223] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T21:04:48.001538] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-25T21:04:48.839040] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T21:04:48.849107] [INFO ] [REMOTE ] EIX: Full fetch complete (77450 records). [2025-10-25T21:04:48.849262] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-25T21:04:49.249860] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-25T21:04:49.249979] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-25T21:04:49.250865] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-25T21:04:49.250946] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-25T21:04:49.252332] [DEBUG] [LOCAL ] EIX: Trimmed 77450 records to 54119 (keeping 200 days of data) [2025-10-25T21:04:49.572911] [DEBUG] [LOCAL ] EIX: Primary data saved (54119 records). [2025-10-25T21:04:49.573094] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-25T21:04:49.573250] [INFO ] [MAIN ] Update Progress: 720/2366 symbols. EIX took 13.4s. Estimated remaining time: 4h 50m 24s [2025-10-25T21:04:49.741063] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:04:49.741256] [DEBUG] [LOCAL ] EL: No existing data file found in primary storage. [2025-10-25T21:04:49.741328] [WARN ] [MAIN ] EL: No existing data found, performing full refresh instead. [2025-10-25T21:04:49.741441] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-25T21:04:49.741512] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-25T21:04:49.741594] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-25T21:04:49.741688] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-25T21:04:50.094196] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:04:50.094543] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-25T21:04:52.292216] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-25T21:04:52.302804] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-25T21:04:54.325447] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-25T21:04:54.335507] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-25T21:04:56.376430] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T21:04:56.387997] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-25T21:04:57.333834] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T21:04:57.344935] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-25T21:04:58.221069] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T21:04:58.232056] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-25T21:04:59.297156] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T21:04:59.308017] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-25T21:05:00.275495] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T21:05:00.287241] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-25T21:05:02.258030] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-25T21:05:02.270827] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-25T21:05:03.311078] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T21:05:03.328241] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-25T21:05:04.253814] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T21:05:04.263456] [INFO ] [REMOTE ] EL: Full fetch complete (77429 records). [2025-10-25T21:05:04.263633] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-25T21:05:04.661045] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-25T21:05:04.661193] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-25T21:05:04.662077] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-25T21:05:04.662161] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-25T21:05:04.663670] [DEBUG] [LOCAL ] EL: Trimmed 77429 records to 54154 (keeping 200 days of data) [2025-10-25T21:05:04.975272] [DEBUG] [LOCAL ] EL: Primary data saved (54154 records). [2025-10-25T21:05:04.975426] [INFO ] [MAIN ] EL: Full history saved. [2025-10-25T21:05:04.975555] [INFO ] [MAIN ] Update Progress: 721/2366 symbols. EL took 15.4s. Estimated remaining time: 4h 50m 24s [2025-10-25T21:05:05.142130] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:05:05.142313] [DEBUG] [LOCAL ] ELAN: No existing data file found in primary storage. [2025-10-25T21:05:05.142385] [WARN ] [MAIN ] ELAN: No existing data found, performing full refresh instead. [2025-10-25T21:05:05.142492] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-25T21:05:05.142562] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-25T21:05:05.142621] [DEBUG] [LOCAL ] ELAN: No primary data file found to delete. [2025-10-25T21:05:05.142703] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-25T21:05:05.491046] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:05:05.491399] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-25T21:05:07.236443] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T21:05:07.246874] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-25T21:05:08.983259] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T21:05:08.993128] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-25T21:05:10.914547] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T21:05:10.925313] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-25T21:05:11.969586] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T21:05:11.980584] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-25T21:05:13.153716] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T21:05:13.164677] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-25T21:05:14.195198] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T21:05:14.205796] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-25T21:05:15.467154] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T21:05:15.478684] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-25T21:05:16.550015] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T21:05:16.561315] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-25T21:05:17.360619] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T21:05:17.371947] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-25T21:05:18.206266] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T21:05:18.216663] [INFO ] [REMOTE ] ELAN: Full fetch complete (77094 records). [2025-10-25T21:05:18.216857] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-25T21:05:18.649406] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-25T21:05:18.649537] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-25T21:05:18.650446] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-25T21:05:18.650533] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-25T21:05:18.652092] [DEBUG] [LOCAL ] ELAN: Trimmed 77094 records to 54089 (keeping 200 days of data) [2025-10-25T21:05:18.955638] [DEBUG] [LOCAL ] ELAN: Primary data saved (54089 records). [2025-10-25T21:05:18.955830] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-25T21:05:18.955957] [INFO ] [MAIN ] Update Progress: 722/2366 symbols. ELAN took 14.0s. Estimated remaining time: 4h 50m 21s [2025-10-25T21:05:19.136446] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:05:19.136637] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-10-25T21:05:19.136732] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-10-25T21:05:19.136851] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-25T21:05:19.136928] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-25T21:05:19.137015] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-25T21:05:19.137096] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-25T21:05:19.498722] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:05:19.499084] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-25T21:05:20.130743] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-25T21:05:20.132687] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-25T21:05:20.752417] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T21:05:20.754276] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-25T21:05:21.472299] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-25T21:05:21.474301] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-25T21:05:22.191541] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T21:05:22.193532] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-25T21:05:22.911621] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T21:05:22.913551] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-25T21:05:23.615592] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-25T21:05:23.617635] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-25T21:05:24.370207] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T21:05:24.372274] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-25T21:05:25.073777] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-25T21:05:25.076011] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-25T21:05:25.786578] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T21:05:25.788143] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-25T21:05:26.432305] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T21:05:26.433489] [INFO ] [REMOTE ] ELC: Full fetch complete (4917 records). [2025-10-25T21:05:26.433578] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-25T21:05:26.794603] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-25T21:05:26.794749] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-25T21:05:26.794914] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-25T21:05:26.794983] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-25T21:05:26.795403] [DEBUG] [LOCAL ] ELC: Trimmed 4917 records to 3490 (keeping 200 days of data) [2025-10-25T21:05:26.816455] [DEBUG] [LOCAL ] ELC: Primary data saved (3490 records). [2025-10-25T21:05:26.816618] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-25T21:05:26.816776] [INFO ] [MAIN ] Update Progress: 723/2366 symbols. ELC took 7.9s. Estimated remaining time: 4h 50m 4s [2025-10-25T21:05:26.986813] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:05:26.986992] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-10-25T21:05:26.987060] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-10-25T21:05:26.987170] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-25T21:05:26.987239] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-25T21:05:26.987317] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-25T21:05:26.987386] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-25T21:05:27.331557] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:05:27.331923] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-25T21:05:29.265703] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-25T21:05:29.275687] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-25T21:05:31.356601] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-25T21:05:31.366832] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-25T21:05:33.659270] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-25T21:05:33.670285] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-25T21:05:34.894155] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T21:05:34.905115] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-25T21:05:35.998510] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T21:05:36.009904] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-25T21:05:36.989214] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T21:05:36.999940] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-25T21:05:38.255908] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T21:05:38.266883] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-25T21:05:39.325601] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T21:05:39.336741] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-25T21:05:40.268275] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T21:05:40.279240] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-25T21:05:41.125475] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T21:05:41.134567] [INFO ] [REMOTE ] ELF: Full fetch complete (75463 records). [2025-10-25T21:05:41.134746] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-25T21:05:41.521793] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-25T21:05:41.521918] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-25T21:05:41.522806] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-25T21:05:41.522885] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-25T21:05:41.524310] [DEBUG] [LOCAL ] ELF: Trimmed 75463 records to 52556 (keeping 200 days of data) [2025-10-25T21:05:41.827287] [DEBUG] [LOCAL ] ELF: Primary data saved (52556 records). [2025-10-25T21:05:41.827453] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-25T21:05:41.827663] [INFO ] [MAIN ] Update Progress: 724/2366 symbols. ELF took 15.0s. Estimated remaining time: 4h 50m 4s [2025-10-25T21:05:42.002179] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:05:42.002367] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-25T21:05:42.002437] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-25T21:05:42.002544] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-25T21:05:42.002621] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-25T21:05:42.002722] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-25T21:05:42.002788] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-25T21:05:42.357012] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:05:42.357417] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-25T21:05:43.852453] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T21:05:43.859125] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-25T21:05:45.323701] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T21:05:45.331823] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-25T21:05:46.867339] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T21:05:46.875860] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-25T21:05:48.419688] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T21:05:48.428549] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-25T21:05:49.975103] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-25T21:05:49.987787] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-25T21:05:51.524099] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T21:05:51.531694] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-25T21:05:53.105398] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T21:05:53.114749] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-25T21:05:54.635944] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T21:05:54.648093] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-25T21:05:56.159392] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T21:05:56.169895] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-25T21:05:57.772125] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-25T21:05:57.779492] [INFO ] [REMOTE ] ELME: Full fetch complete (56119 records). [2025-10-25T21:05:57.779637] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-25T21:05:58.160159] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-25T21:05:58.160270] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-25T21:05:58.161022] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-25T21:05:58.161101] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-25T21:05:58.162235] [DEBUG] [LOCAL ] ELME: Trimmed 56119 records to 39892 (keeping 200 days of data) [2025-10-25T21:05:58.393261] [DEBUG] [LOCAL ] ELME: Primary data saved (39892 records). [2025-10-25T21:05:58.393477] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-25T21:05:58.393614] [INFO ] [MAIN ] Update Progress: 725/2366 symbols. ELME took 16.6s. Estimated remaining time: 4h 50m 7s [2025-10-25T21:05:58.561621] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:05:58.561818] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-25T21:05:58.561897] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-25T21:05:58.562016] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-25T21:05:58.562093] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-25T21:05:58.562180] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-25T21:05:58.562252] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-25T21:05:58.912133] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:05:58.912480] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-25T21:06:00.077241] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T21:06:00.082690] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-25T21:06:01.887847] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T21:06:01.897336] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-25T21:06:04.204947] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-25T21:06:04.210323] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-25T21:06:05.522134] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T21:06:05.528556] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-25T21:06:07.180495] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T21:06:07.186719] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-25T21:06:08.572379] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T21:06:08.578575] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-25T21:06:10.032275] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T21:06:10.038684] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-25T21:06:11.242431] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T21:06:11.248268] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-25T21:06:12.409828] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T21:06:12.414841] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-25T21:06:13.776253] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T21:06:13.780879] [INFO ] [REMOTE ] ELP: Full fetch complete (36715 records). [2025-10-25T21:06:13.781005] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-25T21:06:14.146794] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-25T21:06:14.146906] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-25T21:06:14.147460] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-25T21:06:14.147560] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-25T21:06:14.148436] [DEBUG] [LOCAL ] ELP: Trimmed 36715 records to 25883 (keeping 200 days of data) [2025-10-25T21:06:14.292717] [DEBUG] [LOCAL ] ELP: Primary data saved (25883 records). [2025-10-25T21:06:14.292982] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-25T21:06:14.293158] [INFO ] [MAIN ] Update Progress: 726/2366 symbols. ELP took 15.9s. Estimated remaining time: 4h 50m 8s [2025-10-25T21:06:14.463794] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:06:14.463968] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-25T21:06:14.464041] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-25T21:06:14.464158] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-25T21:06:14.464238] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-25T21:06:14.464320] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-25T21:06:14.464400] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-25T21:06:14.809684] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:06:14.810009] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-25T21:06:15.363509] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-25T21:06:15.364690] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-25T21:06:15.814959] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-25T21:06:15.816090] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-25T21:06:16.278283] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T21:06:16.279370] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-25T21:06:16.806679] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-25T21:06:16.807800] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-25T21:06:17.285003] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T21:06:17.286036] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-25T21:06:17.766866] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-25T21:06:17.768103] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-25T21:06:18.218209] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-25T21:06:18.219245] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-25T21:06:18.787963] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T21:06:18.788892] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-25T21:06:19.220252] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-25T21:06:19.221173] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-25T21:06:19.660368] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-25T21:06:19.661535] [INFO ] [REMOTE ] ELPC: Full fetch complete (1309 records). [2025-10-25T21:06:19.661677] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-25T21:06:19.855747] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-25T21:06:19.855962] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:06:19.856038] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:06:19.856114] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-25T21:06:19.856225] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-25T21:06:19.856301] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-25T21:06:19.856382] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-25T21:06:19.856494] [INFO ] [MAIN ] Update Progress: 727/2366 symbols. ELPC took 5.6s. Estimated remaining time: 4h 49m 46s [2025-10-25T21:06:20.021376] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:06:20.021610] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-25T21:06:20.021699] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-25T21:06:20.021808] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-25T21:06:20.021880] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-25T21:06:20.021937] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-25T21:06:20.021997] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-25T21:06:20.370701] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:06:20.371019] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-25T21:06:21.983309] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-25T21:06:21.992783] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-25T21:06:23.586297] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T21:06:23.595049] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-25T21:06:25.298825] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T21:06:25.309038] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-25T21:06:26.158426] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T21:06:26.169004] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-25T21:06:27.129989] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T21:06:27.140514] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-25T21:06:27.961909] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T21:06:27.971987] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-25T21:06:28.895289] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T21:06:28.906311] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-25T21:06:29.910461] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T21:06:29.920961] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-25T21:06:30.923735] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T21:06:30.934772] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-25T21:06:31.841632] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T21:06:31.851133] [INFO ] [REMOTE ] ELS: Full fetch complete (71376 records). [2025-10-25T21:06:31.851290] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-25T21:06:32.234785] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-25T21:06:32.234909] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-25T21:06:32.235761] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-25T21:06:32.235840] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-25T21:06:32.237276] [DEBUG] [LOCAL ] ELS: Trimmed 71376 records to 50613 (keeping 200 days of data) [2025-10-25T21:06:32.531050] [DEBUG] [LOCAL ] ELS: Primary data saved (50613 records). [2025-10-25T21:06:32.531208] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-25T21:06:32.531314] [INFO ] [MAIN ] Update Progress: 728/2366 symbols. ELS took 12.7s. Estimated remaining time: 4h 49m 40s [2025-10-25T21:06:32.697390] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:06:32.697578] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-25T21:06:32.697674] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-25T21:06:32.697794] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-25T21:06:32.697858] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-25T21:06:32.697951] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-25T21:06:32.698018] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-25T21:06:33.062352] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:06:33.062777] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-25T21:06:35.046224] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-25T21:06:35.056542] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-25T21:06:36.992867] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T21:06:37.003220] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-25T21:06:39.002207] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T21:06:39.014505] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-25T21:06:40.041463] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T21:06:40.051960] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-25T21:06:40.921619] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T21:06:40.932086] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-25T21:06:41.914544] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T21:06:41.924673] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-25T21:06:42.970454] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T21:06:42.985442] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-25T21:06:43.994750] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T21:06:44.007294] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-25T21:06:44.796625] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T21:06:44.807613] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-25T21:06:45.623970] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T21:06:45.633186] [INFO ] [REMOTE ] ELV: Full fetch complete (73349 records). [2025-10-25T21:06:45.633342] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-25T21:06:46.019275] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-25T21:06:46.019420] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-25T21:06:46.020307] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-25T21:06:46.020389] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-25T21:06:46.021838] [DEBUG] [LOCAL ] ELV: Trimmed 73349 records to 51485 (keeping 200 days of data) [2025-10-25T21:06:46.325769] [DEBUG] [LOCAL ] ELV: Primary data saved (51485 records). [2025-10-25T21:06:46.325922] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-25T21:06:46.326058] [INFO ] [MAIN ] Update Progress: 729/2366 symbols. ELV took 13.8s. Estimated remaining time: 4h 49m 37s [2025-10-25T21:06:46.491821] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:06:46.492004] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-25T21:06:46.492073] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-25T21:06:46.492192] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-25T21:06:46.492264] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-25T21:06:46.492342] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-25T21:06:46.492429] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-25T21:06:46.850260] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:06:46.850591] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-25T21:06:47.192459] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T21:06:47.192834] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-25T21:06:47.192918] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T21:06:47.192994] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-25T21:06:47.193060] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T21:06:47.193133] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-25T21:06:47.193226] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-25T21:06:47.193295] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-25T21:06:47.193376] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-25T21:06:47.193485] [INFO ] [MAIN ] Update Progress: 730/2366 symbols. EMA took 0.9s. Estimated remaining time: 4h 49m 4s [2025-10-25T21:06:47.361861] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:06:47.362056] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-25T21:06:47.362126] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-25T21:06:47.362237] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-25T21:06:47.362308] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-25T21:06:47.362388] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-25T21:06:47.362458] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-25T21:06:47.727783] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:06:47.728160] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-25T21:06:48.954194] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-25T21:06:48.959069] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-25T21:06:50.263374] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-25T21:06:50.268979] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-25T21:06:51.507952] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T21:06:51.513398] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-25T21:06:52.759950] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T21:06:52.765192] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-25T21:06:53.998970] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T21:06:54.006108] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-25T21:06:55.070446] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T21:06:55.075019] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-25T21:06:56.258083] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T21:06:56.263594] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-25T21:06:57.432699] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T21:06:57.437935] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-25T21:06:58.562973] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T21:06:58.568008] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-25T21:06:59.699970] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T21:06:59.705691] [INFO ] [REMOTE ] EMD: Full fetch complete (31801 records). [2025-10-25T21:06:59.705851] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-25T21:07:00.089764] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-25T21:07:00.089889] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-25T21:07:00.090449] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-25T21:07:00.090526] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-25T21:07:00.091357] [DEBUG] [LOCAL ] EMD: Trimmed 31801 records to 20980 (keeping 200 days of data) [2025-10-25T21:07:00.212006] [DEBUG] [LOCAL ] EMD: Primary data saved (20980 records). [2025-10-25T21:07:00.212165] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-25T21:07:00.212341] [INFO ] [MAIN ] Update Progress: 731/2366 symbols. EMD took 13.0s. Estimated remaining time: 4h 48m 59s [2025-10-25T21:07:00.395175] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:07:00.395366] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-10-25T21:07:00.395439] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-10-25T21:07:00.395556] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-25T21:07:00.395628] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-25T21:07:00.395734] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-25T21:07:00.395806] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-25T21:07:00.757092] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:07:00.757432] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-25T21:07:02.410628] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T21:07:02.418003] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-25T21:07:04.069544] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T21:07:04.076936] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-25T21:07:05.742329] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T21:07:05.750438] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-25T21:07:07.417184] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T21:07:07.424856] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-25T21:07:09.011582] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T21:07:09.018803] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-25T21:07:10.554489] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T21:07:10.561606] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-25T21:07:12.203384] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T21:07:12.210139] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-25T21:07:13.604552] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T21:07:13.610002] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-25T21:07:15.322981] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T21:07:15.330050] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-25T21:07:17.102545] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T21:07:17.108551] [INFO ] [REMOTE ] EME: Full fetch complete (47067 records). [2025-10-25T21:07:17.108711] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-25T21:07:17.508959] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-25T21:07:17.509088] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-25T21:07:17.509805] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-25T21:07:17.509900] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-25T21:07:17.510885] [DEBUG] [LOCAL ] EME: Trimmed 47067 records to 31222 (keeping 200 days of data) [2025-10-25T21:07:17.702894] [DEBUG] [LOCAL ] EME: Primary data saved (31222 records). [2025-10-25T21:07:17.703057] [INFO ] [MAIN ] EME: Full history saved. [2025-10-25T21:07:17.703195] [INFO ] [MAIN ] Update Progress: 732/2366 symbols. EME took 17.5s. Estimated remaining time: 4h 49m 4s [2025-10-25T21:07:17.877293] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:07:17.877485] [DEBUG] [LOCAL ] EMF: No existing data file found in primary storage. [2025-10-25T21:07:17.877566] [WARN ] [MAIN ] EMF: No existing data found, performing full refresh instead. [2025-10-25T21:07:17.877732] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-25T21:07:17.877817] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-25T21:07:17.877935] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-10-25T21:07:17.878007] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-25T21:07:18.227490] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:07:18.227837] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-25T21:07:19.030100] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T21:07:19.032250] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-25T21:07:19.788898] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T21:07:19.790853] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-25T21:07:20.690490] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T21:07:20.692667] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-25T21:07:21.422189] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T21:07:21.423906] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-25T21:07:22.019673] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T21:07:22.021038] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-25T21:07:22.611418] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T21:07:22.612872] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-25T21:07:23.276825] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-25T21:07:23.278489] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-25T21:07:23.887035] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T21:07:23.888480] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-25T21:07:24.637827] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T21:07:24.639347] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-25T21:07:25.240095] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T21:07:25.241249] [INFO ] [REMOTE ] EMF: Full fetch complete (5989 records). [2025-10-25T21:07:25.241340] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-25T21:07:25.618078] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-25T21:07:25.618234] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-25T21:07:25.618441] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-25T21:07:25.618517] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-25T21:07:25.618955] [DEBUG] [LOCAL ] EMF: Trimmed 5989 records to 3134 (keeping 200 days of data) [2025-10-25T21:07:25.637777] [DEBUG] [LOCAL ] EMF: Primary data saved (3134 records). [2025-10-25T21:07:25.637885] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-25T21:07:25.638039] [INFO ] [MAIN ] Update Progress: 733/2366 symbols. EMF took 7.9s. Estimated remaining time: 4h 48m 47s [2025-10-25T21:07:25.815343] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:07:25.815543] [DEBUG] [LOCAL ] EMN: No existing data file found in primary storage. [2025-10-25T21:07:25.815613] [WARN ] [MAIN ] EMN: No existing data found, performing full refresh instead. [2025-10-25T21:07:25.815748] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-25T21:07:25.815817] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-25T21:07:25.815895] [DEBUG] [LOCAL ] EMN: No primary data file found to delete. [2025-10-25T21:07:25.815964] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-25T21:07:26.167458] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:07:26.167850] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-25T21:07:27.992689] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T21:07:28.002105] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-25T21:07:29.920967] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T21:07:29.932373] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-25T21:07:31.683551] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T21:07:31.693829] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-25T21:07:32.960200] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T21:07:32.970919] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-25T21:07:33.946575] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T21:07:33.957325] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-25T21:07:34.952500] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T21:07:34.963098] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-25T21:07:35.992895] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T21:07:36.003892] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-25T21:07:36.837788] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-25T21:07:36.848834] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-25T21:07:37.853177] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T21:07:37.864150] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-25T21:07:38.680214] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T21:07:38.689605] [INFO ] [REMOTE ] EMN: Full fetch complete (72449 records). [2025-10-25T21:07:38.689840] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-25T21:07:39.102519] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-25T21:07:39.103000] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-25T21:07:39.103852] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-25T21:07:39.103931] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-25T21:07:39.105244] [DEBUG] [LOCAL ] EMN: Trimmed 72449 records to 51587 (keeping 200 days of data) [2025-10-25T21:07:39.405715] [DEBUG] [LOCAL ] EMN: Primary data saved (51587 records). [2025-10-25T21:07:39.405881] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-25T21:07:39.406027] [INFO ] [MAIN ] Update Progress: 734/2366 symbols. EMN took 13.8s. Estimated remaining time: 4h 48m 44s [2025-10-25T21:07:39.577998] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:07:39.578223] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-10-25T21:07:39.578295] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-10-25T21:07:39.578404] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-25T21:07:39.578474] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-25T21:07:39.578554] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-25T21:07:39.578624] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-25T21:07:39.930993] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:07:39.931334] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-25T21:07:40.916520] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T21:07:40.919302] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-25T21:07:41.762042] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-25T21:07:41.764572] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-25T21:07:42.664922] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T21:07:42.667699] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-25T21:07:43.600963] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T21:07:43.604385] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-25T21:07:44.564856] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T21:07:44.567880] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-25T21:07:45.517242] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T21:07:45.520020] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-25T21:07:46.562915] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T21:07:46.567166] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-25T21:07:47.618672] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T21:07:47.622105] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-25T21:07:49.025966] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T21:07:49.030532] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-25T21:07:50.218349] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T21:07:50.221879] [INFO ] [REMOTE ] EMO: Full fetch complete (17825 records). [2025-10-25T21:07:50.221995] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-25T21:07:50.593161] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-25T21:07:50.593276] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-25T21:07:50.593768] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-25T21:07:50.593848] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-25T21:07:50.594403] [DEBUG] [LOCAL ] EMO: Trimmed 17825 records to 13551 (keeping 200 days of data) [2025-10-25T21:07:50.689117] [DEBUG] [LOCAL ] EMO: Primary data saved (13551 records). [2025-10-25T21:07:50.689331] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-25T21:07:50.689511] [INFO ] [MAIN ] Update Progress: 735/2366 symbols. EMO took 11.3s. Estimated remaining time: 4h 48m 34s [2025-10-25T21:07:50.882326] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:07:50.882552] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-25T21:07:50.882624] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-25T21:07:50.882758] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-25T21:07:50.882829] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-25T21:07:50.882911] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-25T21:07:50.882981] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-25T21:07:51.227586] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:07:51.227958] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-25T21:07:51.863125] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T21:07:51.864368] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-25T21:07:52.487820] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T21:07:52.489117] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-25T21:07:53.078200] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-25T21:07:53.080006] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-25T21:07:53.809006] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T21:07:53.810600] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-25T21:07:54.605979] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T21:07:54.607625] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-25T21:07:55.218525] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T21:07:55.219919] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-25T21:07:55.868366] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-25T21:07:55.869817] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-25T21:07:56.442702] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T21:07:56.443931] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-25T21:07:57.079905] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T21:07:57.081493] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-25T21:07:57.611207] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-25T21:07:57.612209] [INFO ] [REMOTE ] EMP: Full fetch complete (4047 records). [2025-10-25T21:07:57.612314] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-25T21:07:57.982720] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-25T21:07:57.982832] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-25T21:07:57.983001] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-25T21:07:57.983076] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-25T21:07:57.983514] [DEBUG] [LOCAL ] EMP: Trimmed 4047 records to 2902 (keeping 200 days of data) [2025-10-25T21:07:58.001088] [DEBUG] [LOCAL ] EMP: Primary data saved (2902 records). [2025-10-25T21:07:58.001179] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-25T21:07:58.001294] [INFO ] [MAIN ] Update Progress: 736/2366 symbols. EMP took 7.3s. Estimated remaining time: 4h 48m 17s [2025-10-25T21:07:58.175514] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:07:58.175769] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-10-25T21:07:58.175873] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-10-25T21:07:58.175965] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-25T21:07:58.176033] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-25T21:07:58.176114] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-25T21:07:58.176182] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-25T21:07:58.544637] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:07:58.544990] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-25T21:08:00.633633] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-25T21:08:00.644034] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-25T21:08:02.988199] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-25T21:08:03.001251] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-25T21:08:05.005172] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T21:08:05.017126] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-25T21:08:06.052494] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T21:08:06.063474] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-25T21:08:06.975899] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T21:08:06.986934] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-25T21:08:08.066610] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T21:08:08.077259] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-25T21:08:09.041341] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T21:08:09.052995] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-25T21:08:10.090007] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T21:08:10.101178] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-25T21:08:10.884686] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T21:08:10.896022] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-25T21:08:11.831824] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T21:08:11.841536] [INFO ] [REMOTE ] EMR: Full fetch complete (77181 records). [2025-10-25T21:08:11.841744] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-25T21:08:12.232163] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-25T21:08:12.232325] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-25T21:08:12.233385] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-25T21:08:12.233472] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-25T21:08:12.235012] [DEBUG] [LOCAL ] EMR: Trimmed 77181 records to 53907 (keeping 200 days of data) [2025-10-25T21:08:12.566574] [DEBUG] [LOCAL ] EMR: Primary data saved (53907 records). [2025-10-25T21:08:12.566802] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-25T21:08:12.566964] [INFO ] [MAIN ] Update Progress: 737/2366 symbols. EMR took 14.6s. Estimated remaining time: 4h 48m 15s [2025-10-25T21:08:12.742557] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:08:12.742777] [DEBUG] [LOCAL ] ENB: No existing data file found in primary storage. [2025-10-25T21:08:12.742847] [WARN ] [MAIN ] ENB: No existing data found, performing full refresh instead. [2025-10-25T21:08:12.742960] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-25T21:08:12.743030] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-25T21:08:12.743157] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-25T21:08:12.743228] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-25T21:08:13.086881] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:08:13.087193] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-25T21:08:15.118243] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-25T21:08:15.128718] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-25T21:08:17.156070] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-25T21:08:17.166241] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-25T21:08:19.177511] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-25T21:08:19.188597] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-25T21:08:19.792958] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T21:08:19.803917] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-25T21:08:21.051461] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T21:08:21.062682] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-25T21:08:22.529345] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T21:08:22.540077] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-25T21:08:23.792554] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T21:08:23.805701] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-25T21:08:24.802190] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T21:08:24.814303] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-25T21:08:25.994916] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T21:08:26.006233] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-25T21:08:27.033013] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T21:08:27.042625] [INFO ] [REMOTE ] ENB: Full fetch complete (77663 records). [2025-10-25T21:08:27.042805] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-25T21:08:27.435068] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-25T21:08:27.435210] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-25T21:08:27.436164] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-25T21:08:27.436248] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-25T21:08:27.437780] [DEBUG] [LOCAL ] ENB: Trimmed 77663 records to 54291 (keeping 200 days of data) [2025-10-25T21:08:27.749712] [DEBUG] [LOCAL ] ENB: Primary data saved (54291 records). [2025-10-25T21:08:27.749870] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-25T21:08:27.749999] [INFO ] [MAIN ] Update Progress: 738/2366 symbols. ENB took 15.2s. Estimated remaining time: 4h 48m 14s [2025-10-25T21:08:27.916315] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:08:27.916479] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-25T21:08:27.916558] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-25T21:08:27.916675] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-25T21:08:27.916742] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-25T21:08:27.916821] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-25T21:08:27.916868] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-25T21:08:28.267055] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:08:28.267442] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-25T21:08:29.572749] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T21:08:29.580694] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-25T21:08:31.005412] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T21:08:31.012116] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-25T21:08:32.616257] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T21:08:32.623620] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-25T21:08:34.414176] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T21:08:34.422545] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-25T21:08:35.944797] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T21:08:35.954015] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-25T21:08:37.464580] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T21:08:37.472811] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-25T21:08:39.046224] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T21:08:39.054677] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-25T21:08:40.556909] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T21:08:40.564712] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-25T21:08:42.008738] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T21:08:42.016348] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-25T21:08:43.363829] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T21:08:43.370276] [INFO ] [REMOTE ] ENIC: Full fetch complete (51307 records). [2025-10-25T21:08:43.370450] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-25T21:08:43.754782] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-25T21:08:43.754912] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-25T21:08:43.755718] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-25T21:08:43.755812] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-25T21:08:43.757113] [DEBUG] [LOCAL ] ENIC: Trimmed 51307 records to 36940 (keeping 200 days of data) [2025-10-25T21:08:43.961137] [DEBUG] [LOCAL ] ENIC: Primary data saved (36940 records). [2025-10-25T21:08:43.961370] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-25T21:08:43.961538] [INFO ] [MAIN ] Update Progress: 739/2366 symbols. ENIC took 16.2s. Estimated remaining time: 4h 48m 16s [2025-10-25T21:08:44.132484] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:08:44.132708] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-25T21:08:44.132779] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-25T21:08:44.132892] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-25T21:08:44.132962] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-25T21:08:44.133040] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-25T21:08:44.133106] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-25T21:08:44.486677] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:08:44.487010] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-25T21:08:45.103683] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T21:08:45.104969] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-25T21:08:45.675036] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T21:08:45.676857] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-25T21:08:46.229953] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-25T21:08:46.231230] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-25T21:08:46.860862] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-25T21:08:46.862292] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-25T21:08:47.495236] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T21:08:47.496375] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-25T21:08:48.058343] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T21:08:48.059488] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-25T21:08:48.620811] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-25T21:08:48.621970] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-25T21:08:49.159731] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-25T21:08:49.160877] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-25T21:08:49.668218] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-25T21:08:49.669317] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-25T21:08:50.126717] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T21:08:50.127548] [INFO ] [REMOTE ] ENO: Full fetch complete (2981 records). [2025-10-25T21:08:50.127638] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-25T21:08:50.485714] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-25T21:08:50.485833] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-25T21:08:50.485970] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-25T21:08:50.486044] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-25T21:08:50.486468] [DEBUG] [LOCAL ] ENO: Trimmed 2981 records to 1752 (keeping 200 days of data) [2025-10-25T21:08:50.497250] [DEBUG] [LOCAL ] ENO: Primary data saved (1752 records). [2025-10-25T21:08:50.497348] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-25T21:08:50.497470] [INFO ] [MAIN ] Update Progress: 740/2366 symbols. ENO took 6.5s. Estimated remaining time: 4h 47m 56s [2025-10-25T21:08:50.664964] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:08:50.665136] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-25T21:08:50.665208] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-25T21:08:50.665323] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-25T21:08:50.665390] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-25T21:08:50.665468] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-25T21:08:50.665536] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-25T21:08:51.028970] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:08:51.029365] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-25T21:08:52.543533] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T21:08:52.551992] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-25T21:08:53.929461] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T21:08:53.937172] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-25T21:08:55.669744] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T21:08:55.678833] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-25T21:08:57.338301] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T21:08:57.347668] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-25T21:08:59.025996] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T21:08:59.035273] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-25T21:09:01.121589] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-25T21:09:01.131562] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-25T21:09:03.734374] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-25T21:09:03.745409] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-25T21:09:05.455662] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T21:09:05.467551] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-25T21:09:07.042157] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T21:09:07.052557] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-25T21:09:08.516696] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T21:09:08.524042] [INFO ] [REMOTE ] ENOV: Full fetch complete (63298 records). [2025-10-25T21:09:08.524224] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-25T21:09:08.949109] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-25T21:09:08.949239] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-25T21:09:08.950095] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-25T21:09:08.950184] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-25T21:09:08.951541] [DEBUG] [LOCAL ] ENOV: Trimmed 63298 records to 45142 (keeping 200 days of data) [2025-10-25T21:09:09.211461] [DEBUG] [LOCAL ] ENOV: Primary data saved (45142 records). [2025-10-25T21:09:09.211618] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-25T21:09:09.211773] [INFO ] [MAIN ] Update Progress: 741/2366 symbols. ENOV took 18.7s. Estimated remaining time: 4h 48m 3s [2025-10-25T21:09:09.380345] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:09:09.380540] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-10-25T21:09:09.380611] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-10-25T21:09:09.380749] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-25T21:09:09.380821] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-25T21:09:09.380883] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-10-25T21:09:09.380947] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-25T21:09:09.733083] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:09:09.733517] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-25T21:09:11.338847] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-25T21:09:11.345827] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-25T21:09:12.828638] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:09:12.837012] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-25T21:09:14.522593] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T21:09:14.530453] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-25T21:09:16.306960] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T21:09:16.316238] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-25T21:09:18.020536] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T21:09:18.030202] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-25T21:09:19.675049] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T21:09:19.684290] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-25T21:09:21.565382] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-25T21:09:21.575734] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-25T21:09:23.280099] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T21:09:23.289840] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-25T21:09:24.863015] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T21:09:24.872070] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-25T21:09:26.626374] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T21:09:26.634011] [INFO ] [REMOTE ] ENR: Full fetch complete (59702 records). [2025-10-25T21:09:26.634151] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-25T21:09:27.111818] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-25T21:09:27.111991] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-25T21:09:27.112980] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-25T21:09:27.113073] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-25T21:09:27.114514] [DEBUG] [LOCAL ] ENR: Trimmed 59702 records to 44363 (keeping 200 days of data) [2025-10-25T21:09:27.437525] [DEBUG] [LOCAL ] ENR: Primary data saved (44363 records). [2025-10-25T21:09:27.437786] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-25T21:09:27.437976] [INFO ] [MAIN ] Update Progress: 742/2366 symbols. ENR took 18.2s. Estimated remaining time: 4h 48m 9s [2025-10-25T21:09:27.681834] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:09:27.682083] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-25T21:09:27.682168] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-25T21:09:27.682304] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-25T21:09:27.682393] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-25T21:09:27.682491] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-25T21:09:27.682573] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-25T21:09:28.137973] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:09:28.138325] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-25T21:09:29.388593] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T21:09:29.396558] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-25T21:09:30.838546] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T21:09:30.844810] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-25T21:09:32.231972] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T21:09:32.238377] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-25T21:09:33.705985] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T21:09:33.712289] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-25T21:09:35.175801] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T21:09:35.182416] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-25T21:09:36.688131] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T21:09:36.694893] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-25T21:09:38.155516] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T21:09:38.162229] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-25T21:09:39.533059] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T21:09:39.541330] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-25T21:09:40.902758] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-25T21:09:40.909702] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-25T21:09:42.488600] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T21:09:42.494696] [INFO ] [REMOTE ] ENS: Full fetch complete (42811 records). [2025-10-25T21:09:42.494824] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-25T21:09:42.894214] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-25T21:09:42.894375] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-25T21:09:42.895373] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-25T21:09:42.895461] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-25T21:09:42.896792] [DEBUG] [LOCAL ] ENS: Trimmed 42811 records to 30030 (keeping 200 days of data) [2025-10-25T21:09:43.085805] [DEBUG] [LOCAL ] ENS: Primary data saved (30030 records). [2025-10-25T21:09:43.086004] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-25T21:09:43.086145] [INFO ] [MAIN ] Update Progress: 743/2366 symbols. ENS took 15.6s. Estimated remaining time: 4h 48m 10s [2025-10-25T21:09:43.253127] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:09:43.253329] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-10-25T21:09:43.253400] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-10-25T21:09:43.253514] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-25T21:09:43.253585] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-25T21:09:43.253692] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-10-25T21:09:43.253764] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-25T21:09:43.608122] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:09:43.608468] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-25T21:09:44.731919] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T21:09:44.736587] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-25T21:09:46.042236] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T21:09:46.047885] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-25T21:09:47.376738] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T21:09:47.382289] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-25T21:09:48.909075] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T21:09:48.915573] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-25T21:09:50.082602] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T21:09:50.088296] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-25T21:09:51.211925] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T21:09:51.217160] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-25T21:09:52.643387] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T21:09:52.649676] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-25T21:09:53.708354] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T21:09:53.713996] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-25T21:09:54.978807] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-25T21:09:54.986962] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-25T21:09:56.122690] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T21:09:56.127163] [INFO ] [REMOTE ] ENVA: Full fetch complete (36770 records). [2025-10-25T21:09:56.127285] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-25T21:09:56.490051] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-25T21:09:56.490168] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-25T21:09:56.490752] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-25T21:09:56.490830] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-25T21:09:56.491673] [DEBUG] [LOCAL ] ENVA: Trimmed 36770 records to 25717 (keeping 200 days of data) [2025-10-25T21:09:56.636376] [DEBUG] [LOCAL ] ENVA: Primary data saved (25717 records). [2025-10-25T21:09:56.636535] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-25T21:09:56.636683] [INFO ] [MAIN ] Update Progress: 744/2366 symbols. ENVA took 13.6s. Estimated remaining time: 4h 48m 5s [2025-10-25T21:09:56.800595] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:09:56.800803] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-25T21:09:56.800873] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-25T21:09:56.800987] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-25T21:09:56.801057] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-25T21:09:56.801136] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-25T21:09:56.801205] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-25T21:09:57.147231] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:09:57.147567] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-25T21:09:58.250325] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T21:09:58.254143] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-25T21:09:59.137080] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-25T21:09:59.140221] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-25T21:10:00.067717] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T21:10:00.070826] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-25T21:10:01.298077] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T21:10:01.302041] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-25T21:10:02.345107] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T21:10:02.347954] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-25T21:10:03.440718] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T21:10:03.444638] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-25T21:10:04.653366] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T21:10:04.658756] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-25T21:10:05.699921] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T21:10:05.703527] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-25T21:10:06.700428] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T21:10:06.703883] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-25T21:10:07.719070] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T21:10:07.722500] [INFO ] [REMOTE ] EOD: Full fetch complete (20758 records). [2025-10-25T21:10:07.722633] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-25T21:10:08.099367] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-25T21:10:08.099548] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-25T21:10:08.100023] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-25T21:10:08.100103] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-25T21:10:08.100810] [DEBUG] [LOCAL ] EOD: Trimmed 20758 records to 15043 (keeping 200 days of data) [2025-10-25T21:10:08.181845] [DEBUG] [LOCAL ] EOD: Primary data saved (15043 records). [2025-10-25T21:10:08.182012] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-25T21:10:08.182142] [INFO ] [MAIN ] Update Progress: 745/2366 symbols. EOD took 11.5s. Estimated remaining time: 4h 47m 56s [2025-10-25T21:10:08.347782] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:10:08.348001] [DEBUG] [LOCAL ] EOG: No existing data file found in primary storage. [2025-10-25T21:10:08.348073] [WARN ] [MAIN ] EOG: No existing data found, performing full refresh instead. [2025-10-25T21:10:08.348186] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-25T21:10:08.348259] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-25T21:10:08.348340] [DEBUG] [LOCAL ] EOG: No primary data file found to delete. [2025-10-25T21:10:08.348408] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-25T21:10:08.697809] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:10:08.698213] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-25T21:10:10.717039] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-25T21:10:10.730962] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-25T21:10:12.535912] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T21:10:12.546159] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-25T21:10:14.618882] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T21:10:14.629890] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-25T21:10:15.789874] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T21:10:15.801068] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-25T21:10:16.736359] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T21:10:16.747394] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-25T21:10:17.999763] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T21:10:18.011056] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-25T21:10:19.064472] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T21:10:19.076021] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-25T21:10:20.144066] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T21:10:20.162539] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-25T21:10:20.839557] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-25T21:10:20.852385] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-25T21:10:21.956934] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T21:10:21.967449] [INFO ] [REMOTE ] EOG: Full fetch complete (77469 records). [2025-10-25T21:10:21.967702] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-25T21:10:22.382426] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-25T21:10:22.382670] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-25T21:10:22.383560] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-25T21:10:22.383668] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-25T21:10:22.385087] [DEBUG] [LOCAL ] EOG: Trimmed 77469 records to 54170 (keeping 200 days of data) [2025-10-25T21:10:22.714199] [DEBUG] [LOCAL ] EOG: Primary data saved (54170 records). [2025-10-25T21:10:22.714358] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-25T21:10:22.714488] [INFO ] [MAIN ] Update Progress: 746/2366 symbols. EOG took 14.5s. Estimated remaining time: 4h 47m 54s [2025-10-25T21:10:22.887281] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:10:22.887491] [DEBUG] [LOCAL ] EOI: No existing data file found in primary storage. [2025-10-25T21:10:22.887563] [WARN ] [MAIN ] EOI: No existing data found, performing full refresh instead. [2025-10-25T21:10:22.887705] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-25T21:10:22.887782] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-25T21:10:22.887863] [DEBUG] [LOCAL ] EOI: No primary data file found to delete. [2025-10-25T21:10:22.887956] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-25T21:10:23.244071] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:10:23.244384] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-25T21:10:24.141043] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T21:10:24.143930] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-25T21:10:25.030600] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T21:10:25.035337] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-25T21:10:26.024448] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T21:10:26.028042] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-25T21:10:27.181682] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T21:10:27.185378] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-25T21:10:28.084834] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T21:10:28.087468] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-25T21:10:28.936403] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T21:10:28.939092] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-25T21:10:29.837042] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T21:10:29.839827] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-25T21:10:30.808617] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T21:10:30.811250] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-25T21:10:31.784148] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T21:10:31.787175] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-25T21:10:32.689966] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T21:10:32.692438] [INFO ] [REMOTE ] EOI: Full fetch complete (15941 records). [2025-10-25T21:10:32.692543] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-25T21:10:33.079076] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-25T21:10:33.079202] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-25T21:10:33.079662] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-25T21:10:33.079756] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-25T21:10:33.080393] [DEBUG] [LOCAL ] EOI: Trimmed 15941 records to 10514 (keeping 200 days of data) [2025-10-25T21:10:33.141235] [DEBUG] [LOCAL ] EOI: Primary data saved (10514 records). [2025-10-25T21:10:33.141403] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-25T21:10:33.141570] [INFO ] [MAIN ] Update Progress: 747/2366 symbols. EOI took 10.4s. Estimated remaining time: 4h 47m 43s [2025-10-25T21:10:33.319917] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:10:33.320103] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-10-25T21:10:33.320172] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-10-25T21:10:33.320282] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-25T21:10:33.320352] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-25T21:10:33.320435] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-25T21:10:33.320500] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-25T21:10:33.680742] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:10:33.681115] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-25T21:10:34.750622] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T21:10:34.754488] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-25T21:10:35.791874] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-25T21:10:35.795699] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-25T21:10:36.976350] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T21:10:36.981155] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-25T21:10:38.165008] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T21:10:38.169879] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-25T21:10:39.073026] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T21:10:39.076374] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-25T21:10:40.218889] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T21:10:40.222265] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-25T21:10:41.298329] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T21:10:41.302819] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-25T21:10:42.232452] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T21:10:42.235496] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-25T21:10:43.302972] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T21:10:43.306603] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-25T21:10:44.329798] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T21:10:44.333123] [INFO ] [REMOTE ] EOS: Full fetch complete (22767 records). [2025-10-25T21:10:44.333257] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-25T21:10:44.718430] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-25T21:10:44.718554] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-25T21:10:44.719051] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-25T21:10:44.719131] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-25T21:10:44.719998] [DEBUG] [LOCAL ] EOS: Trimmed 22767 records to 14871 (keeping 200 days of data) [2025-10-25T21:10:44.808314] [DEBUG] [LOCAL ] EOS: Primary data saved (14871 records). [2025-10-25T21:10:44.808489] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-25T21:10:44.808621] [INFO ] [MAIN ] Update Progress: 748/2366 symbols. EOS took 11.7s. Estimated remaining time: 4h 47m 35s [2025-10-25T21:10:44.985713] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:10:44.985905] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-25T21:10:44.985975] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-25T21:10:44.986088] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-25T21:10:44.986171] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-25T21:10:44.986254] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-25T21:10:44.986323] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-25T21:10:45.359033] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:10:45.359400] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-25T21:10:46.231850] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-25T21:10:46.235120] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-25T21:10:47.135800] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T21:10:47.138548] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-25T21:10:47.908140] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T21:10:47.910262] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-25T21:10:48.771475] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T21:10:48.774067] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-25T21:10:49.444353] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-25T21:10:49.447398] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-25T21:10:50.234720] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T21:10:50.236782] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-25T21:10:51.120901] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T21:10:51.123005] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-25T21:10:51.961033] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T21:10:51.963193] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-25T21:10:52.897232] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T21:10:52.899542] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-25T21:10:53.719411] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T21:10:53.721665] [INFO ] [REMOTE ] EOT: Full fetch complete (10680 records). [2025-10-25T21:10:53.721791] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-25T21:10:54.094540] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-25T21:10:54.094698] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-25T21:10:54.095001] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-25T21:10:54.095095] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-25T21:10:54.095684] [DEBUG] [LOCAL ] EOT: Trimmed 10680 records to 7118 (keeping 200 days of data) [2025-10-25T21:10:54.139549] [DEBUG] [LOCAL ] EOT: Primary data saved (7118 records). [2025-10-25T21:10:54.139742] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-25T21:10:54.139880] [INFO ] [MAIN ] Update Progress: 749/2366 symbols. EOT took 9.3s. Estimated remaining time: 4h 47m 21s [2025-10-25T21:10:54.317378] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:10:54.317613] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-10-25T21:10:54.317705] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-10-25T21:10:54.317828] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-25T21:10:54.317919] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-25T21:10:54.318005] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-25T21:10:54.318073] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-25T21:10:54.684603] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:10:54.684992] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-25T21:10:55.901677] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T21:10:55.907521] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-25T21:10:57.234412] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T21:10:57.240588] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-25T21:10:58.579996] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T21:10:58.586608] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-25T21:10:59.873071] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T21:10:59.879450] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-25T21:11:01.309371] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T21:11:01.314260] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-25T21:11:03.090509] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-25T21:11:03.096216] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-25T21:11:04.623619] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T21:11:04.630627] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-25T21:11:06.037358] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T21:11:06.043452] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-25T21:11:07.499033] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T21:11:07.509052] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-25T21:11:08.718986] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T21:11:08.724813] [INFO ] [REMOTE ] EPAC: Full fetch complete (38851 records). [2025-10-25T21:11:08.724977] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-25T21:11:09.144219] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-25T21:11:09.144358] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-25T21:11:09.145161] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-25T21:11:09.145252] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-25T21:11:09.146313] [DEBUG] [LOCAL ] EPAC: Trimmed 38851 records to 26742 (keeping 200 days of data) [2025-10-25T21:11:09.303403] [DEBUG] [LOCAL ] EPAC: Primary data saved (26742 records). [2025-10-25T21:11:09.303604] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-25T21:11:09.303757] [INFO ] [MAIN ] Update Progress: 750/2366 symbols. EPAC took 15.2s. Estimated remaining time: 4h 47m 20s [2025-10-25T21:11:09.475053] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:11:09.475250] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-25T21:11:09.475322] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-25T21:11:09.475436] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-25T21:11:09.475508] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-25T21:11:09.475590] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-25T21:11:09.475682] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-25T21:11:09.828909] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:11:09.829290] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-25T21:11:11.369766] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T21:11:11.376703] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-25T21:11:13.076635] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T21:11:13.084141] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-25T21:11:14.838191] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T21:11:14.846942] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-25T21:11:16.661480] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T21:11:16.671118] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-25T21:11:18.428091] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T21:11:18.437614] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-25T21:11:19.998346] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-25T21:11:20.006254] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-25T21:11:21.560376] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T21:11:21.567777] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-25T21:11:23.230118] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T21:11:23.238942] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-25T21:11:24.963171] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T21:11:24.972403] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-25T21:11:26.736366] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-25T21:11:26.743483] [INFO ] [REMOTE ] EPAM: Full fetch complete (56682 records). [2025-10-25T21:11:26.743637] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-25T21:11:27.127050] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-25T21:11:27.127180] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-25T21:11:27.128031] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-25T21:11:27.128132] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-25T21:11:27.129270] [DEBUG] [LOCAL ] EPAM: Trimmed 56682 records to 39889 (keeping 200 days of data) [2025-10-25T21:11:27.358447] [DEBUG] [LOCAL ] EPAM: Primary data saved (39889 records). [2025-10-25T21:11:27.358609] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-25T21:11:27.358764] [INFO ] [MAIN ] Update Progress: 751/2366 symbols. EPAM took 18.1s. Estimated remaining time: 4h 47m 25s [2025-10-25T21:11:27.524939] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:11:27.525158] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-25T21:11:27.525249] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-25T21:11:27.525362] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-25T21:11:27.525438] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-25T21:11:27.525517] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-25T21:11:27.525585] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-25T21:11:27.892566] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:11:27.892931] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-25T21:11:29.462215] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T21:11:29.469513] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-25T21:11:31.133040] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T21:11:31.145301] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-25T21:11:32.818278] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T21:11:32.826890] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-25T21:11:34.425924] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T21:11:34.433802] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-25T21:11:36.021918] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T21:11:36.030941] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-25T21:11:37.688607] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T21:11:37.697007] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-25T21:11:39.358382] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-25T21:11:39.367576] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-25T21:11:40.950933] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T21:11:40.961471] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-25T21:11:42.589367] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T21:11:42.601777] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-25T21:11:43.896227] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T21:11:43.903222] [INFO ] [REMOTE ] EPC: Full fetch complete (57332 records). [2025-10-25T21:11:43.903380] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-25T21:11:44.290550] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-25T21:11:44.290690] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-25T21:11:44.291414] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-25T21:11:44.291491] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-25T21:11:44.292706] [DEBUG] [LOCAL ] EPC: Trimmed 57332 records to 40224 (keeping 200 days of data) [2025-10-25T21:11:44.523009] [DEBUG] [LOCAL ] EPC: Primary data saved (40224 records). [2025-10-25T21:11:44.523174] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-25T21:11:44.523369] [INFO ] [MAIN ] Update Progress: 752/2366 symbols. EPC took 17.2s. Estimated remaining time: 4h 47m 29s [2025-10-25T21:11:44.693922] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:11:44.694193] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-10-25T21:11:44.694265] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-10-25T21:11:44.694382] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-25T21:11:44.694460] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-25T21:11:44.694566] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-25T21:11:44.694637] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-25T21:11:45.041784] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:11:45.042105] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-25T21:11:46.885968] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T21:11:46.896393] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-25T21:11:49.036663] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-25T21:11:49.047552] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-25T21:11:51.109563] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T21:11:51.120709] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-25T21:11:52.282852] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T21:11:52.294683] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-25T21:11:53.289830] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T21:11:53.301017] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-25T21:11:54.169021] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T21:11:54.180002] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-25T21:11:55.172553] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T21:11:55.184179] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-25T21:11:56.249359] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T21:11:56.260834] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-25T21:11:57.248948] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T21:11:57.260184] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-25T21:11:58.142046] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T21:11:58.151919] [INFO ] [REMOTE ] EPD: Full fetch complete (77776 records). [2025-10-25T21:11:58.152066] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-25T21:11:58.551896] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-25T21:11:58.552023] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-25T21:11:58.552967] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-25T21:11:58.553052] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-25T21:11:58.554532] [DEBUG] [LOCAL ] EPD: Trimmed 77776 records to 54387 (keeping 200 days of data) [2025-10-25T21:11:58.869637] [DEBUG] [LOCAL ] EPD: Primary data saved (54387 records). [2025-10-25T21:11:58.869866] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-25T21:11:58.870043] [INFO ] [MAIN ] Update Progress: 753/2366 symbols. EPD took 14.3s. Estimated remaining time: 4h 47m 26s [2025-10-25T21:11:59.036772] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:11:59.036981] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-10-25T21:11:59.037056] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-10-25T21:11:59.037173] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-25T21:11:59.037243] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-25T21:11:59.037322] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-25T21:11:59.037387] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-25T21:11:59.384994] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:11:59.385401] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-25T21:12:01.079466] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T21:12:01.088044] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-25T21:12:02.883038] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T21:12:02.891217] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-25T21:12:04.624116] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T21:12:04.633842] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-25T21:12:06.503854] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-25T21:12:06.513249] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-25T21:12:08.299313] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-25T21:12:08.308329] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-25T21:12:09.851147] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T21:12:09.861684] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-25T21:12:11.687248] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T21:12:11.697107] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-25T21:12:13.390398] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T21:12:13.399964] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-25T21:12:15.112568] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T21:12:15.126956] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-25T21:12:16.753116] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T21:12:16.760888] [INFO ] [REMOTE ] EPR: Full fetch complete (63275 records). [2025-10-25T21:12:16.761042] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-25T21:12:17.145224] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-25T21:12:17.145343] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-25T21:12:17.146137] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-25T21:12:17.146217] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-25T21:12:17.147463] [DEBUG] [LOCAL ] EPR: Trimmed 63275 records to 44288 (keeping 200 days of data) [2025-10-25T21:12:17.410747] [DEBUG] [LOCAL ] EPR: Primary data saved (44288 records). [2025-10-25T21:12:17.410923] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-25T21:12:17.411039] [INFO ] [MAIN ] Update Progress: 754/2366 symbols. EPR took 18.5s. Estimated remaining time: 4h 47m 32s [2025-10-25T21:12:17.606524] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:12:17.606752] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-10-25T21:12:17.606828] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-10-25T21:12:17.606917] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-25T21:12:17.606988] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-25T21:12:17.607073] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-25T21:12:17.607120] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-25T21:12:18.105764] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:12:18.106252] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-25T21:12:19.660334] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T21:12:19.668723] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-25T21:12:21.405437] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T21:12:21.414892] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-25T21:12:23.076562] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T21:12:23.086760] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-25T21:12:24.226724] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T21:12:24.237449] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-25T21:12:25.036469] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T21:12:25.046489] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-25T21:12:25.931389] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T21:12:25.941463] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-25T21:12:26.877485] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T21:12:26.888405] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-25T21:12:27.855121] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T21:12:27.865164] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-25T21:12:28.858921] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T21:12:28.869113] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-25T21:12:29.865082] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T21:12:29.874746] [INFO ] [REMOTE ] EPRT: Full fetch complete (69612 records). [2025-10-25T21:12:29.874893] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-25T21:12:30.306333] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-25T21:12:30.306456] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-25T21:12:30.307365] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-25T21:12:30.307445] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-25T21:12:30.308930] [DEBUG] [LOCAL ] EPRT: Trimmed 69612 records to 49234 (keeping 200 days of data) [2025-10-25T21:12:30.623555] [DEBUG] [LOCAL ] EPRT: Primary data saved (49234 records). [2025-10-25T21:12:30.623754] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-25T21:12:30.623884] [INFO ] [MAIN ] Update Progress: 755/2366 symbols. EPRT took 13.2s. Estimated remaining time: 4h 47m 26s [2025-10-25T21:12:30.812058] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:12:30.812209] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-25T21:12:30.812280] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-25T21:12:30.812415] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-25T21:12:30.812489] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-25T21:12:30.812570] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-25T21:12:30.812661] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-25T21:12:31.201708] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:12:31.202119] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-25T21:12:32.087595] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-25T21:12:32.090852] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-25T21:12:33.112369] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T21:12:33.115671] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-25T21:12:34.157521] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T21:12:34.160136] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-25T21:12:35.204291] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T21:12:35.207575] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-25T21:12:36.028898] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T21:12:36.031082] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-25T21:12:36.887335] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T21:12:36.889949] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-25T21:12:37.996274] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T21:12:37.999855] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-25T21:12:38.965948] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T21:12:38.969400] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-25T21:12:39.873074] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T21:12:39.876202] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-25T21:12:40.767712] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T21:12:40.770493] [INFO ] [REMOTE ] EQBK: Full fetch complete (15625 records). [2025-10-25T21:12:40.770584] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-25T21:12:41.129553] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-25T21:12:41.129687] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-25T21:12:41.130086] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-25T21:12:41.130162] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-25T21:12:41.130703] [DEBUG] [LOCAL ] EQBK: Trimmed 15625 records to 11444 (keeping 200 days of data) [2025-10-25T21:12:41.196027] [DEBUG] [LOCAL ] EQBK: Primary data saved (11444 records). [2025-10-25T21:12:41.196176] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-25T21:12:41.196301] [INFO ] [MAIN ] Update Progress: 756/2366 symbols. EQBK took 10.6s. Estimated remaining time: 4h 47m 15s [2025-10-25T21:12:41.363439] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:12:41.363684] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-25T21:12:41.363746] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-25T21:12:41.363825] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-25T21:12:41.363890] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-25T21:12:41.363956] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-25T21:12:41.364021] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-25T21:12:41.714063] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:12:41.714382] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-25T21:12:43.395399] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T21:12:43.405744] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-25T21:12:44.996269] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T21:12:45.006749] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-25T21:12:46.937500] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T21:12:46.949319] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-25T21:12:47.978615] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T21:12:47.989677] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-25T21:12:49.057431] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T21:12:49.068493] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-25T21:12:50.206871] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T21:12:50.217372] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-25T21:12:51.289870] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T21:12:51.301236] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-25T21:12:52.243891] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T21:12:52.255088] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-25T21:12:53.441519] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T21:12:53.452822] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-25T21:12:54.306583] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T21:12:54.319064] [INFO ] [REMOTE ] EQH: Full fetch complete (76615 records). [2025-10-25T21:12:54.319219] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-25T21:12:54.709424] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-25T21:12:54.709547] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-25T21:12:54.710480] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-25T21:12:54.710563] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-25T21:12:54.712058] [DEBUG] [LOCAL ] EQH: Trimmed 76615 records to 53446 (keeping 200 days of data) [2025-10-25T21:12:55.015528] [DEBUG] [LOCAL ] EQH: Primary data saved (53446 records). [2025-10-25T21:12:55.015704] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-25T21:12:55.015817] [INFO ] [MAIN ] Update Progress: 757/2366 symbols. EQH took 13.8s. Estimated remaining time: 4h 47m 11s [2025-10-25T21:12:55.187784] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:12:55.187973] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-10-25T21:12:55.188049] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-10-25T21:12:55.188140] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-25T21:12:55.188210] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-25T21:12:55.188299] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-25T21:12:55.188369] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-25T21:12:55.543772] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:12:55.544111] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-25T21:12:57.542287] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-25T21:12:57.552900] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-25T21:12:59.395047] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T21:12:59.404958] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-25T21:13:02.036667] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-25T21:13:02.049228] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-25T21:13:03.127817] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T21:13:03.140512] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-25T21:13:04.051860] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T21:13:04.062847] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-25T21:13:05.107519] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T21:13:05.119950] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-25T21:13:06.329703] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T21:13:06.341315] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-25T21:13:07.323911] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T21:13:07.335083] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-25T21:13:08.432274] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T21:13:08.443557] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-25T21:13:09.367380] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T21:13:09.377429] [INFO ] [REMOTE ] EQNR: Full fetch complete (77017 records). [2025-10-25T21:13:09.377614] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-25T21:13:09.782950] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-25T21:13:09.783066] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-25T21:13:09.783967] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-25T21:13:09.784048] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-25T21:13:09.785558] [DEBUG] [LOCAL ] EQNR: Trimmed 77017 records to 53824 (keeping 200 days of data) [2025-10-25T21:13:10.097016] [DEBUG] [LOCAL ] EQNR: Primary data saved (53824 records). [2025-10-25T21:13:10.097169] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-25T21:13:10.097298] [INFO ] [MAIN ] Update Progress: 758/2366 symbols. EQNR took 15.1s. Estimated remaining time: 4h 47m 10s [2025-10-25T21:13:10.262124] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:13:10.262325] [DEBUG] [LOCAL ] EQR: No existing data file found in primary storage. [2025-10-25T21:13:10.262397] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-10-25T21:13:10.262509] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-25T21:13:10.262579] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-25T21:13:10.262681] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-25T21:13:10.262751] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-25T21:13:10.605445] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:13:10.605798] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-25T21:13:12.595507] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T21:13:12.605540] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-25T21:13:14.033392] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T21:13:14.043099] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-25T21:13:15.965261] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T21:13:15.975888] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-25T21:13:16.920231] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T21:13:16.931008] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-25T21:13:17.746535] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T21:13:17.757297] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-25T21:13:18.829434] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T21:13:18.840297] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-25T21:13:19.832267] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T21:13:19.844215] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-25T21:13:20.693029] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T21:13:20.703912] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-25T21:13:21.682826] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T21:13:21.693880] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-25T21:13:22.803192] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T21:13:22.812932] [INFO ] [REMOTE ] EQR: Full fetch complete (74628 records). [2025-10-25T21:13:22.813099] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-25T21:13:23.207050] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-25T21:13:23.207635] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-25T21:13:23.208597] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-25T21:13:23.208715] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-25T21:13:23.210207] [DEBUG] [LOCAL ] EQR: Trimmed 74628 records to 52563 (keeping 200 days of data) [2025-10-25T21:13:23.517810] [DEBUG] [LOCAL ] EQR: Primary data saved (52563 records). [2025-10-25T21:13:23.518028] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-25T21:13:23.518160] [INFO ] [MAIN ] Update Progress: 759/2366 symbols. EQR took 13.4s. Estimated remaining time: 4h 47m 5s [2025-10-25T21:13:23.684168] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:13:23.684424] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-25T21:13:23.684496] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-25T21:13:23.684584] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-25T21:13:23.684671] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-25T21:13:23.684740] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-25T21:13:23.684802] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-25T21:13:24.036151] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:13:24.036498] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-25T21:13:24.532165] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-25T21:13:24.533178] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-25T21:13:24.952450] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T21:13:24.953366] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-25T21:13:25.420856] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-25T21:13:25.421796] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-25T21:13:25.883344] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-25T21:13:25.884235] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-25T21:13:26.356230] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-25T21:13:26.357497] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-25T21:13:26.903066] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T21:13:26.904137] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-25T21:13:27.430212] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-25T21:13:27.431380] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-25T21:13:28.192958] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T21:13:28.194765] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-25T21:13:28.880565] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T21:13:28.882157] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-25T21:13:29.450966] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T21:13:29.451879] [INFO ] [REMOTE ] EQS: Full fetch complete (2367 records). [2025-10-25T21:13:29.451968] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-25T21:13:29.630322] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-25T21:13:29.630542] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:13:29.630616] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:13:29.630745] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-25T21:13:29.630843] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-25T21:13:29.630917] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-25T21:13:29.630999] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-25T21:13:29.631122] [INFO ] [MAIN ] Update Progress: 760/2366 symbols. EQS took 6.1s. Estimated remaining time: 4h 46m 44s [2025-10-25T21:13:29.828023] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:13:29.828235] [DEBUG] [LOCAL ] EQT: No existing data file found in primary storage. [2025-10-25T21:13:29.828306] [WARN ] [MAIN ] EQT: No existing data found, performing full refresh instead. [2025-10-25T21:13:29.828395] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-25T21:13:29.828462] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-25T21:13:29.828521] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-10-25T21:13:29.828581] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-25T21:13:30.177988] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:13:30.178313] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-25T21:13:32.890985] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-25T21:13:32.901360] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-25T21:13:34.934074] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-25T21:13:34.943966] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-25T21:13:37.014954] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T21:13:37.025955] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-25T21:13:38.047995] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T21:13:38.059260] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-25T21:13:39.085578] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T21:13:39.096773] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-25T21:13:40.117351] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T21:13:40.128424] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-25T21:13:41.102202] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T21:13:41.113778] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-25T21:13:42.410507] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T21:13:42.421866] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-25T21:13:43.489919] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T21:13:43.501325] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-25T21:13:44.335057] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T21:13:44.344750] [INFO ] [REMOTE ] EQT: Full fetch complete (77859 records). [2025-10-25T21:13:44.344912] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-25T21:13:44.741807] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-25T21:13:44.741943] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-25T21:13:44.742952] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-25T21:13:44.743042] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-25T21:13:44.744629] [DEBUG] [LOCAL ] EQT: Trimmed 77859 records to 54464 (keeping 200 days of data) [2025-10-25T21:13:45.066045] [DEBUG] [LOCAL ] EQT: Primary data saved (54464 records). [2025-10-25T21:13:45.066215] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-25T21:13:45.066370] [INFO ] [MAIN ] Update Progress: 761/2366 symbols. EQT took 15.4s. Estimated remaining time: 4h 46m 44s [2025-10-25T21:13:45.239105] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:13:45.239325] [DEBUG] [LOCAL ] EQV: No existing data file found in primary storage. [2025-10-25T21:13:45.239398] [WARN ] [MAIN ] EQV: No existing data found, performing full refresh instead. [2025-10-25T21:13:45.239510] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-25T21:13:45.239582] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-25T21:13:45.239695] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-10-25T21:13:45.239766] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-25T21:13:45.591954] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:13:45.592310] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-25T21:13:46.479263] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-25T21:13:46.481502] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-25T21:13:47.219547] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-25T21:13:47.221334] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-25T21:13:47.950540] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T21:13:47.952247] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-25T21:13:48.588759] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-25T21:13:48.590118] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-25T21:13:49.216367] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T21:13:49.217771] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-25T21:13:49.857679] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-25T21:13:49.859246] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-25T21:13:50.444006] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T21:13:50.445253] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-25T21:13:51.179598] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T21:13:51.181112] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-25T21:13:51.725803] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-25T21:13:51.727170] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-25T21:13:52.362057] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-25T21:13:52.363245] [INFO ] [REMOTE ] EQV: Full fetch complete (4831 records). [2025-10-25T21:13:52.363335] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-25T21:13:52.722257] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-25T21:13:52.722377] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-25T21:13:52.722575] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-25T21:13:52.722675] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-25T21:13:52.723138] [DEBUG] [LOCAL ] EQV: Trimmed 4831 records to 2822 (keeping 200 days of data) [2025-10-25T21:13:52.739073] [DEBUG] [LOCAL ] EQV: Primary data saved (2822 records). [2025-10-25T21:13:52.739206] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-25T21:13:52.739329] [INFO ] [MAIN ] Update Progress: 762/2366 symbols. EQV took 7.7s. Estimated remaining time: 4h 46m 27s [2025-10-25T21:13:52.905079] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:13:52.905288] [DEBUG] [LOCAL ] ERJ: No existing data file found in primary storage. [2025-10-25T21:13:52.905359] [WARN ] [MAIN ] ERJ: No existing data found, performing full refresh instead. [2025-10-25T21:13:52.905444] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-25T21:13:52.905510] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-25T21:13:52.905589] [DEBUG] [LOCAL ] ERJ: No primary data file found to delete. [2025-10-25T21:13:52.905679] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-25T21:13:53.249808] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:13:53.250129] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-25T21:13:54.902473] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T21:13:54.911933] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-25T21:13:56.800323] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-25T21:13:56.809940] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-25T21:13:58.634878] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T21:13:58.646103] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-25T21:13:59.557591] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T21:13:59.568215] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-25T21:14:00.516449] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T21:14:00.527239] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-25T21:14:01.640907] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T21:14:01.652262] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-25T21:14:02.690789] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T21:14:02.702070] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-25T21:14:03.569486] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T21:14:03.580173] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-25T21:14:04.621142] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T21:14:04.631485] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-25T21:14:05.534133] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T21:14:05.543241] [INFO ] [REMOTE ] ERJ: Full fetch complete (73098 records). [2025-10-25T21:14:05.543422] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-25T21:14:05.929975] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-25T21:14:05.930126] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-25T21:14:05.931027] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-25T21:14:05.931107] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-25T21:14:05.932451] [DEBUG] [LOCAL ] ERJ: Trimmed 73098 records to 51023 (keeping 200 days of data) [2025-10-25T21:14:06.213785] [DEBUG] [LOCAL ] ERJ: Primary data saved (51023 records). [2025-10-25T21:14:06.213936] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-25T21:14:06.214066] [INFO ] [MAIN ] Update Progress: 763/2366 symbols. ERJ took 13.5s. Estimated remaining time: 4h 46m 22s [2025-10-25T21:14:06.379369] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:14:06.379509] [DEBUG] [LOCAL ] ERO: No existing data file found in primary storage. [2025-10-25T21:14:06.379575] [WARN ] [MAIN ] ERO: No existing data found, performing full refresh instead. [2025-10-25T21:14:06.379706] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-25T21:14:06.379774] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-25T21:14:06.379853] [DEBUG] [LOCAL ] ERO: No primary data file found to delete. [2025-10-25T21:14:06.379919] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-25T21:14:06.777395] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:14:06.777849] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-25T21:14:08.346627] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T21:14:08.354449] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-25T21:14:09.781330] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T21:14:09.789878] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-25T21:14:11.236441] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T21:14:11.245277] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-25T21:14:12.958950] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-25T21:14:12.968862] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-25T21:14:14.468355] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T21:14:14.477539] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-25T21:14:16.061426] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T21:14:16.070069] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-25T21:14:17.965187] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-25T21:14:17.974967] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-25T21:14:19.474699] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T21:14:19.484292] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-25T21:14:21.344187] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T21:14:21.353950] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-25T21:14:23.062062] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-25T21:14:23.071115] [INFO ] [REMOTE ] ERO: Full fetch complete (60727 records). [2025-10-25T21:14:23.071284] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-25T21:14:23.459363] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-25T21:14:23.459486] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-25T21:14:23.460260] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-25T21:14:23.460341] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-25T21:14:23.461701] [DEBUG] [LOCAL ] ERO: Trimmed 60727 records to 42780 (keeping 200 days of data) [2025-10-25T21:14:23.706519] [DEBUG] [LOCAL ] ERO: Primary data saved (42780 records). [2025-10-25T21:14:23.706705] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-25T21:14:23.706858] [INFO ] [MAIN ] Update Progress: 764/2366 symbols. ERO took 17.5s. Estimated remaining time: 4h 46m 25s [2025-10-25T21:14:23.881139] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:14:23.881336] [DEBUG] [LOCAL ] ES: No existing data file found in primary storage. [2025-10-25T21:14:23.881406] [WARN ] [MAIN ] ES: No existing data found, performing full refresh instead. [2025-10-25T21:14:23.881518] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-25T21:14:23.881588] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-25T21:14:23.881697] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-25T21:14:23.881768] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-25T21:14:24.256820] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:14:24.257198] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-25T21:14:26.018606] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T21:14:26.029384] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-25T21:14:27.556241] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T21:14:27.566419] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-25T21:14:29.349184] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T21:14:29.359991] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-25T21:14:30.238997] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T21:14:30.250154] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-25T21:14:31.149881] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T21:14:31.160890] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-25T21:14:32.066554] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T21:14:32.077245] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-25T21:14:33.151679] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T21:14:33.162946] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-25T21:14:33.956954] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T21:14:33.967855] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-25T21:14:35.234573] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T21:14:35.249638] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-25T21:14:36.084349] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T21:14:36.094698] [INFO ] [REMOTE ] ES: Full fetch complete (76479 records). [2025-10-25T21:14:36.094895] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-25T21:14:36.491142] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-25T21:14:36.491260] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-25T21:14:36.492173] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-25T21:14:36.492252] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-25T21:14:36.493720] [DEBUG] [LOCAL ] ES: Trimmed 76479 records to 53468 (keeping 200 days of data) [2025-10-25T21:14:36.801261] [DEBUG] [LOCAL ] ES: Primary data saved (53468 records). [2025-10-25T21:14:36.801414] [INFO ] [MAIN ] ES: Full history saved. [2025-10-25T21:14:36.801551] [INFO ] [MAIN ] Update Progress: 765/2366 symbols. ES took 13.1s. Estimated remaining time: 4h 46m 19s [2025-10-25T21:14:36.971457] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:14:36.971694] [DEBUG] [LOCAL ] ESAB: No existing data file found in primary storage. [2025-10-25T21:14:36.971768] [WARN ] [MAIN ] ESAB: No existing data found, performing full refresh instead. [2025-10-25T21:14:36.971881] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-25T21:14:36.971953] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-25T21:14:36.972035] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-10-25T21:14:36.972105] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-25T21:14:37.315942] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:14:37.316289] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-25T21:14:38.444604] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T21:14:38.448872] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-25T21:14:39.609155] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T21:14:39.613782] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-25T21:14:40.947439] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T21:14:40.953479] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-25T21:14:42.195429] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T21:14:42.201432] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-25T21:14:43.425968] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T21:14:43.431462] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-25T21:14:44.375899] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T21:14:44.381067] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-25T21:14:45.414068] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T21:14:45.421287] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-25T21:14:46.769462] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T21:14:46.776286] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-25T21:14:48.115756] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T21:14:48.122542] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-25T21:14:49.318110] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T21:14:49.323415] [INFO ] [REMOTE ] ESAB: Full fetch complete (36493 records). [2025-10-25T21:14:49.323552] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-25T21:14:49.693243] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-25T21:14:49.693363] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-25T21:14:49.694072] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-25T21:14:49.694154] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-25T21:14:49.695036] [DEBUG] [LOCAL ] ESAB: Trimmed 36493 records to 26338 (keeping 200 days of data) [2025-10-25T21:14:49.854777] [DEBUG] [LOCAL ] ESAB: Primary data saved (26338 records). [2025-10-25T21:14:49.854940] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-25T21:14:49.855070] [INFO ] [MAIN ] Update Progress: 766/2366 symbols. ESAB took 13.1s. Estimated remaining time: 4h 46m 14s [2025-10-25T21:14:50.020343] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:14:50.020573] [DEBUG] [LOCAL ] ESE: No existing data file found in primary storage. [2025-10-25T21:14:50.020668] [WARN ] [MAIN ] ESE: No existing data found, performing full refresh instead. [2025-10-25T21:14:50.020785] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-25T21:14:50.020857] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-25T21:14:50.020929] [DEBUG] [LOCAL ] ESE: No primary data file found to delete. [2025-10-25T21:14:50.021008] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-25T21:14:50.373478] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:14:50.373823] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-25T21:14:51.281848] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T21:14:51.284450] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-25T21:14:52.383738] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T21:14:52.387178] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-25T21:14:53.455570] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T21:14:53.459729] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-25T21:14:54.547885] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T21:14:54.551879] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-25T21:14:55.727512] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T21:14:55.731426] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-25T21:14:56.911365] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T21:14:56.915297] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-25T21:14:57.967100] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T21:14:57.971894] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-25T21:14:59.224899] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-25T21:14:59.229313] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-25T21:15:00.425847] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-25T21:15:00.430250] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-25T21:15:02.113431] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T21:15:02.117222] [INFO ] [REMOTE ] ESE: Full fetch complete (22959 records). [2025-10-25T21:15:02.117359] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-25T21:15:02.565478] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-25T21:15:02.565716] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-25T21:15:02.566844] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-25T21:15:02.566932] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-25T21:15:02.568239] [DEBUG] [LOCAL ] ESE: Trimmed 22959 records to 16609 (keeping 200 days of data) [2025-10-25T21:15:02.676063] [DEBUG] [LOCAL ] ESE: Primary data saved (16609 records). [2025-10-25T21:15:02.676303] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-25T21:15:02.676470] [INFO ] [MAIN ] Update Progress: 767/2366 symbols. ESE took 12.8s. Estimated remaining time: 4h 46m 7s [2025-10-25T21:15:02.858049] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:15:02.858256] [DEBUG] [LOCAL ] ESI: No existing data file found in primary storage. [2025-10-25T21:15:02.858331] [WARN ] [MAIN ] ESI: No existing data found, performing full refresh instead. [2025-10-25T21:15:02.858450] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-25T21:15:02.858579] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-25T21:15:02.858705] [DEBUG] [LOCAL ] ESI: No primary data file found to delete. [2025-10-25T21:15:02.858778] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-25T21:15:03.232879] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:15:03.233362] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-25T21:15:08.060099] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (4.83 seconds). [2025-10-25T21:15:08.070539] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-25T21:15:09.701231] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T21:15:09.710843] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-25T21:15:11.457217] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T21:15:11.469016] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-25T21:15:12.615212] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T21:15:12.626254] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-25T21:15:13.323595] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-25T21:15:13.334185] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-25T21:15:14.216348] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T21:15:14.226930] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-25T21:15:14.974431] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T21:15:14.986007] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-25T21:15:15.902944] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T21:15:15.913242] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-25T21:15:16.917183] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T21:15:16.928603] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-25T21:15:17.866701] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T21:15:17.878213] [INFO ] [REMOTE ] ESI: Full fetch complete (73273 records). [2025-10-25T21:15:17.878410] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-25T21:15:18.284731] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-25T21:15:18.284841] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-25T21:15:18.285724] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-25T21:15:18.285802] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-25T21:15:18.287154] [DEBUG] [LOCAL ] ESI: Trimmed 73273 records to 51368 (keeping 200 days of data) [2025-10-25T21:15:18.588532] [DEBUG] [LOCAL ] ESI: Primary data saved (51368 records). [2025-10-25T21:15:18.588745] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-25T21:15:18.588899] [INFO ] [MAIN ] Update Progress: 768/2366 symbols. ESI took 15.9s. Estimated remaining time: 4h 46m 7s [2025-10-25T21:15:18.777244] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:15:18.777445] [DEBUG] [LOCAL ] ESNT: No existing data file found in primary storage. [2025-10-25T21:15:18.777531] [WARN ] [MAIN ] ESNT: No existing data found, performing full refresh instead. [2025-10-25T21:15:18.777695] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-25T21:15:18.777785] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-25T21:15:18.777893] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-10-25T21:15:18.778003] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-25T21:15:19.129608] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:15:19.130016] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-25T21:15:22.061611] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (2.93 seconds). [2025-10-25T21:15:22.070005] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-25T21:15:23.623718] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T21:15:23.632252] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-25T21:15:25.372030] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T21:15:25.380705] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-25T21:15:26.351904] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T21:15:26.360869] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-25T21:15:27.157010] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T21:15:27.164944] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-25T21:15:28.142399] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T21:15:28.150479] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-25T21:15:29.274416] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T21:15:29.283921] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-25T21:15:30.264473] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T21:15:30.272548] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-25T21:15:31.135301] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T21:15:31.143189] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-25T21:15:32.174406] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T21:15:32.181347] [INFO ] [REMOTE ] ESNT: Full fetch complete (57045 records). [2025-10-25T21:15:32.181463] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-25T21:15:32.578472] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-25T21:15:32.578584] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-25T21:15:32.579384] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-25T21:15:32.579462] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-25T21:15:32.580557] [DEBUG] [LOCAL ] ESNT: Trimmed 57045 records to 38439 (keeping 200 days of data) [2025-10-25T21:15:32.799127] [DEBUG] [LOCAL ] ESNT: Primary data saved (38439 records). [2025-10-25T21:15:32.799284] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-25T21:15:32.799414] [INFO ] [MAIN ] Update Progress: 769/2366 symbols. ESNT took 14.2s. Estimated remaining time: 4h 46m 4s [2025-10-25T21:15:32.965678] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:15:32.965904] [DEBUG] [LOCAL ] ESRT: No existing data file found in primary storage. [2025-10-25T21:15:32.965977] [WARN ] [MAIN ] ESRT: No existing data found, performing full refresh instead. [2025-10-25T21:15:32.966097] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-25T21:15:32.966165] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-25T21:15:32.966248] [DEBUG] [LOCAL ] ESRT: No primary data file found to delete. [2025-10-25T21:15:32.966297] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-25T21:15:33.316068] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:15:33.316406] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-25T21:15:34.914208] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T21:15:34.923080] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-25T21:15:36.401428] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:15:36.409803] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-25T21:15:38.118830] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T21:15:38.128396] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-25T21:15:39.066572] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T21:15:39.076597] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-25T21:15:41.201486] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-25T21:15:41.211138] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-25T21:15:42.402356] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T21:15:42.413006] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-25T21:15:43.611589] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T21:15:43.622859] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-25T21:15:44.779439] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T21:15:44.789108] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-25T21:15:45.630226] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T21:15:45.640069] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-25T21:15:46.593537] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T21:15:46.602351] [INFO ] [REMOTE ] ESRT: Full fetch complete (66771 records). [2025-10-25T21:15:46.602522] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-25T21:15:46.983779] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-25T21:15:46.983906] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-25T21:15:46.984738] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-25T21:15:46.984842] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-25T21:15:46.986159] [DEBUG] [LOCAL ] ESRT: Trimmed 66771 records to 47236 (keeping 200 days of data) [2025-10-25T21:15:47.247148] [DEBUG] [LOCAL ] ESRT: Primary data saved (47236 records). [2025-10-25T21:15:47.247301] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-25T21:15:47.247430] [INFO ] [MAIN ] Update Progress: 770/2366 symbols. ESRT took 14.4s. Estimated remaining time: 4h 46m 1s [2025-10-25T21:15:47.414336] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:15:47.414547] [DEBUG] [LOCAL ] ESS: No existing data file found in primary storage. [2025-10-25T21:15:47.414619] [WARN ] [MAIN ] ESS: No existing data found, performing full refresh instead. [2025-10-25T21:15:47.414752] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-25T21:15:47.414823] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-25T21:15:47.414904] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-10-25T21:15:47.414974] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-25T21:15:47.769200] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:15:47.769711] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-25T21:15:49.290958] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T21:15:49.297298] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-25T21:15:50.827259] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T21:15:50.833506] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-25T21:15:52.274144] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-25T21:15:52.280294] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-25T21:15:53.832852] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T21:15:53.841699] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-25T21:15:55.261016] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T21:15:55.267170] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-25T21:15:56.650503] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T21:15:56.660556] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-25T21:15:58.250982] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T21:15:58.257972] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-25T21:15:59.588528] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-25T21:15:59.595427] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-25T21:16:01.334478] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-25T21:16:01.340871] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-25T21:16:03.739759] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-25T21:16:03.745618] [INFO ] [REMOTE ] ESS: Full fetch complete (43893 records). [2025-10-25T21:16:03.745770] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-25T21:16:04.125016] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-25T21:16:04.125139] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-25T21:16:04.126025] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-25T21:16:04.126119] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-25T21:16:04.127271] [DEBUG] [LOCAL ] ESS: Trimmed 43893 records to 30589 (keeping 200 days of data) [2025-10-25T21:16:04.313152] [DEBUG] [LOCAL ] ESS: Primary data saved (30589 records). [2025-10-25T21:16:04.313327] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-25T21:16:04.313496] [INFO ] [MAIN ] Update Progress: 771/2366 symbols. ESS took 17.1s. Estimated remaining time: 4h 46m 3s [2025-10-25T21:16:04.480123] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:16:04.480351] [DEBUG] [LOCAL ] ESTC: No existing data file found in primary storage. [2025-10-25T21:16:04.480447] [WARN ] [MAIN ] ESTC: No existing data found, performing full refresh instead. [2025-10-25T21:16:04.480601] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-25T21:16:04.480714] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-25T21:16:04.480814] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-10-25T21:16:04.480903] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-25T21:16:04.833190] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:16:04.833596] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-25T21:16:06.524107] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T21:16:06.533795] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-25T21:16:08.432402] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T21:16:08.441606] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-25T21:16:10.283920] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-25T21:16:10.294671] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-25T21:16:12.237446] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T21:16:12.248061] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-25T21:16:14.165433] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-25T21:16:14.176357] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-25T21:16:16.006368] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T21:16:16.016859] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-25T21:16:17.834290] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-25T21:16:17.849500] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-25T21:16:19.597224] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-25T21:16:19.608700] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-25T21:16:21.368428] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-25T21:16:21.379476] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-25T21:16:23.259926] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T21:16:23.269303] [INFO ] [REMOTE ] ESTC: Full fetch complete (72496 records). [2025-10-25T21:16:23.269472] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-25T21:16:23.656605] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-25T21:16:23.656821] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-25T21:16:23.657692] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-25T21:16:23.657789] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-25T21:16:23.659229] [DEBUG] [LOCAL ] ESTC: Trimmed 72496 records to 50954 (keeping 200 days of data) [2025-10-25T21:16:23.970523] [DEBUG] [LOCAL ] ESTC: Primary data saved (50954 records). [2025-10-25T21:16:23.970707] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-25T21:16:23.970822] [INFO ] [MAIN ] Update Progress: 772/2366 symbols. ESTC took 19.7s. Estimated remaining time: 4h 46m 10s [2025-10-25T21:16:24.147754] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:16:24.147997] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-10-25T21:16:24.148072] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-10-25T21:16:24.148167] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-25T21:16:24.148237] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-25T21:16:24.148348] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-25T21:16:24.148425] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-25T21:16:24.516210] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:16:24.516545] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-25T21:16:26.650148] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-25T21:16:26.660761] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-25T21:16:28.856880] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-25T21:16:28.867244] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-25T21:16:31.207364] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-25T21:16:31.218421] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-25T21:16:33.581237] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-25T21:16:33.592478] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-25T21:16:35.846471] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-25T21:16:35.857789] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-25T21:16:38.177839] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-25T21:16:38.189307] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-25T21:16:40.458162] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-25T21:16:40.470008] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-25T21:16:42.654344] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-25T21:16:42.667589] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-25T21:16:44.975613] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-25T21:16:44.987413] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-25T21:16:47.158398] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-25T21:16:47.169322] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-25T21:16:47.169507] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-25T21:16:47.601327] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-25T21:16:47.601469] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-25T21:16:47.602853] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-25T21:16:47.602965] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-25T21:16:47.604939] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54569 (keeping 200 days of data) [2025-10-25T21:16:47.925013] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-25T21:16:47.925489] [INFO ] [MAIN ] ET: Full history saved. [2025-10-25T21:16:47.925633] [INFO ] [MAIN ] Update Progress: 773/2366 symbols. ET took 24.0s. Estimated remaining time: 4h 46m 27s [2025-10-25T21:16:48.092476] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:16:48.092670] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-10-25T21:16:48.092738] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-10-25T21:16:48.092829] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-25T21:16:48.092910] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-25T21:16:48.092996] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-10-25T21:16:48.093075] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-25T21:16:48.445627] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:16:48.445973] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-25T21:16:49.309882] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T21:16:49.312509] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-25T21:16:50.357253] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-25T21:16:50.361495] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-25T21:16:51.372749] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T21:16:51.376375] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-25T21:16:52.491181] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T21:16:52.495076] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-25T21:16:53.502001] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T21:16:53.505316] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-25T21:16:54.518520] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T21:16:54.521560] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-25T21:16:55.510412] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T21:16:55.513459] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-25T21:16:56.428207] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T21:16:56.431011] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-25T21:16:57.304683] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T21:16:57.307604] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-25T21:16:58.257210] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T21:16:58.260109] [INFO ] [REMOTE ] ETB: Full fetch complete (18466 records). [2025-10-25T21:16:58.260207] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-25T21:16:58.639171] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-25T21:16:58.639284] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-25T21:16:58.639708] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-25T21:16:58.639786] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-25T21:16:58.640346] [DEBUG] [LOCAL ] ETB: Trimmed 18466 records to 11883 (keeping 200 days of data) [2025-10-25T21:16:58.709979] [DEBUG] [LOCAL ] ETB: Primary data saved (11883 records). [2025-10-25T21:16:58.710139] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-25T21:16:58.710270] [INFO ] [MAIN ] Update Progress: 774/2366 symbols. ETB took 10.8s. Estimated remaining time: 4h 46m 16s [2025-10-25T21:16:58.878253] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:16:58.878461] [DEBUG] [LOCAL ] ETD: No existing data file found in primary storage. [2025-10-25T21:16:58.878531] [WARN ] [MAIN ] ETD: No existing data found, performing full refresh instead. [2025-10-25T21:16:58.878672] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-25T21:16:58.878750] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-25T21:16:58.878806] [DEBUG] [LOCAL ] ETD: No primary data file found to delete. [2025-10-25T21:16:58.878869] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-25T21:16:59.268392] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:16:59.268803] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-25T21:17:00.502735] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-25T21:17:00.509724] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-25T21:17:02.113959] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T21:17:02.121964] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-25T21:17:03.330376] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T21:17:03.339204] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-25T21:17:04.780866] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T21:17:04.787497] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-25T21:17:06.278543] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-25T21:17:06.292383] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-25T21:17:07.524062] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-25T21:17:07.529679] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-25T21:17:08.792745] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T21:17:08.798606] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-25T21:17:10.108275] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T21:17:10.114859] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-25T21:17:11.448010] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T21:17:11.454149] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-25T21:17:12.779345] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T21:17:12.784165] [INFO ] [REMOTE ] ETD: Full fetch complete (38464 records). [2025-10-25T21:17:12.784325] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-25T21:17:13.162004] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-25T21:17:13.162115] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-25T21:17:13.162727] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-25T21:17:13.162804] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-25T21:17:13.163679] [DEBUG] [LOCAL ] ETD: Trimmed 38464 records to 27368 (keeping 200 days of data) [2025-10-25T21:17:13.327853] [DEBUG] [LOCAL ] ETD: Primary data saved (27368 records). [2025-10-25T21:17:13.328066] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-25T21:17:13.328215] [INFO ] [MAIN ] Update Progress: 775/2366 symbols. ETD took 14.6s. Estimated remaining time: 4h 46m 13s [2025-10-25T21:17:13.495764] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:17:13.495973] [DEBUG] [LOCAL ] ETG: No existing data file found in primary storage. [2025-10-25T21:17:13.496042] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-10-25T21:17:13.496150] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-25T21:17:13.496225] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-25T21:17:13.496319] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-25T21:17:13.496390] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-25T21:17:13.842445] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:17:13.842829] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-25T21:17:14.953147] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T21:17:14.957968] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-25T21:17:15.739332] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T21:17:15.743188] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-25T21:17:17.052498] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T21:17:17.057219] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-25T21:17:18.257451] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T21:17:18.262714] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-25T21:17:19.379750] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T21:17:19.384504] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-25T21:17:20.529181] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-25T21:17:20.534212] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-25T21:17:21.685418] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T21:17:21.690685] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-25T21:17:22.805429] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T21:17:22.809294] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-25T21:17:23.825213] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T21:17:23.829067] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-25T21:17:24.887816] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T21:17:24.891317] [INFO ] [REMOTE ] ETG: Full fetch complete (24537 records). [2025-10-25T21:17:24.891443] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-25T21:17:25.297385] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-25T21:17:25.297538] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-25T21:17:25.298516] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-25T21:17:25.298609] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-25T21:17:25.299552] [DEBUG] [LOCAL ] ETG: Trimmed 24537 records to 16714 (keeping 200 days of data) [2025-10-25T21:17:25.403180] [DEBUG] [LOCAL ] ETG: Primary data saved (16714 records). [2025-10-25T21:17:25.403419] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-25T21:17:25.403586] [INFO ] [MAIN ] Update Progress: 776/2366 symbols. ETG took 12.1s. Estimated remaining time: 4h 46m 5s [2025-10-25T21:17:25.587933] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:17:25.588275] [DEBUG] [LOCAL ] ETJ: No existing data file found in primary storage. [2025-10-25T21:17:25.588355] [WARN ] [MAIN ] ETJ: No existing data found, performing full refresh instead. [2025-10-25T21:17:25.588487] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-25T21:17:25.588562] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-25T21:17:25.588670] [DEBUG] [LOCAL ] ETJ: No primary data file found to delete. [2025-10-25T21:17:25.588746] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-25T21:17:25.977363] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:17:25.977819] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-25T21:17:27.165454] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-25T21:17:27.170109] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-25T21:17:28.257987] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T21:17:28.262354] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-25T21:17:29.387853] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-25T21:17:29.392802] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-25T21:17:30.606127] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T21:17:30.611555] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-25T21:17:31.575518] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T21:17:31.578886] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-25T21:17:32.605192] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T21:17:32.609436] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-25T21:17:33.874833] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T21:17:33.883405] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-25T21:17:34.986102] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-25T21:17:34.990787] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-25T21:17:36.196631] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T21:17:36.201105] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-25T21:17:37.199438] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T21:17:37.202793] [INFO ] [REMOTE ] ETJ: Full fetch complete (25294 records). [2025-10-25T21:17:37.202956] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-25T21:17:37.566388] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-25T21:17:37.566489] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-25T21:17:37.567014] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-25T21:17:37.567091] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-25T21:17:37.567812] [DEBUG] [LOCAL ] ETJ: Trimmed 25294 records to 16575 (keeping 200 days of data) [2025-10-25T21:17:37.663859] [DEBUG] [LOCAL ] ETJ: Primary data saved (16575 records). [2025-10-25T21:17:37.664061] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-25T21:17:37.664203] [INFO ] [MAIN ] Update Progress: 777/2366 symbols. ETJ took 12.3s. Estimated remaining time: 4h 45m 57s [2025-10-25T21:17:37.830840] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:17:37.830999] [DEBUG] [LOCAL ] ETN: No existing data file found in primary storage. [2025-10-25T21:17:37.831085] [WARN ] [MAIN ] ETN: No existing data found, performing full refresh instead. [2025-10-25T21:17:37.831214] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-25T21:17:37.831300] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-25T21:17:37.831409] [DEBUG] [LOCAL ] ETN: No primary data file found to delete. [2025-10-25T21:17:37.831496] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-25T21:17:38.186779] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:17:38.187144] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-25T21:17:40.198308] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-25T21:17:40.208591] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-25T21:17:42.112998] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T21:17:42.123312] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-25T21:17:44.254333] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-25T21:17:44.265407] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-25T21:17:45.368985] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T21:17:45.380026] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-25T21:17:46.664194] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-25T21:17:46.675146] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-25T21:17:47.805055] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T21:17:47.815638] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-25T21:17:48.933190] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T21:17:48.944430] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-25T21:17:50.107134] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T21:17:50.118488] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-25T21:17:51.205362] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T21:17:51.216501] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-25T21:17:52.180070] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T21:17:52.189608] [INFO ] [REMOTE ] ETN: Full fetch complete (76617 records). [2025-10-25T21:17:52.189812] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-25T21:17:52.592159] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-25T21:17:52.592278] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-25T21:17:52.593241] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-25T21:17:52.593325] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-25T21:17:52.594764] [DEBUG] [LOCAL ] ETN: Trimmed 76617 records to 53313 (keeping 200 days of data) [2025-10-25T21:17:52.916587] [DEBUG] [LOCAL ] ETN: Primary data saved (53313 records). [2025-10-25T21:17:52.916790] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-25T21:17:52.916929] [INFO ] [MAIN ] Update Progress: 778/2366 symbols. ETN took 15.3s. Estimated remaining time: 4h 45m 55s [2025-10-25T21:17:53.086507] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:17:53.086719] [DEBUG] [LOCAL ] ETO: No existing data file found in primary storage. [2025-10-25T21:17:53.086792] [WARN ] [MAIN ] ETO: No existing data found, performing full refresh instead. [2025-10-25T21:17:53.086905] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-25T21:17:53.086977] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-25T21:17:53.087059] [DEBUG] [LOCAL ] ETO: No primary data file found to delete. [2025-10-25T21:17:53.087129] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-25T21:17:53.448300] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:17:53.448691] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-25T21:17:54.331461] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T21:17:54.333583] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-25T21:17:55.072621] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-25T21:17:55.074482] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-25T21:17:55.833331] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T21:17:55.835373] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-25T21:17:56.750402] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T21:17:56.752773] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-25T21:17:57.617900] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T21:17:57.620482] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-25T21:17:58.508314] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T21:17:58.510614] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-25T21:17:59.125208] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-25T21:17:59.127350] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-25T21:17:59.876710] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-25T21:17:59.878841] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-25T21:18:00.675757] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T21:18:00.677569] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-25T21:18:02.117630] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-25T21:18:02.119874] [INFO ] [REMOTE ] ETO: Full fetch complete (9672 records). [2025-10-25T21:18:02.119983] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-25T21:18:02.478417] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-25T21:18:02.478531] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-25T21:18:02.478809] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-25T21:18:02.478885] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-25T21:18:02.479333] [DEBUG] [LOCAL ] ETO: Trimmed 9672 records to 6954 (keeping 200 days of data) [2025-10-25T21:18:02.520559] [DEBUG] [LOCAL ] ETO: Primary data saved (6954 records). [2025-10-25T21:18:02.520714] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-25T21:18:02.520825] [INFO ] [MAIN ] Update Progress: 779/2366 symbols. ETO took 9.6s. Estimated remaining time: 4h 45m 42s [2025-10-25T21:18:02.685455] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:18:02.685661] [DEBUG] [LOCAL ] ETR: No existing data file found in primary storage. [2025-10-25T21:18:02.685734] [WARN ] [MAIN ] ETR: No existing data found, performing full refresh instead. [2025-10-25T21:18:02.685845] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-25T21:18:02.685915] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-25T21:18:02.685994] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-10-25T21:18:02.686059] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-25T21:18:03.035271] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:18:03.035668] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-25T21:18:04.845481] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T21:18:04.855774] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-25T21:18:06.538395] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T21:18:06.548748] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-25T21:18:08.511520] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-25T21:18:08.523107] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-25T21:18:09.546490] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T21:18:09.558063] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-25T21:18:10.421986] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T21:18:10.433154] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-25T21:18:11.375960] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T21:18:11.386798] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-25T21:18:12.620484] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T21:18:12.632180] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-25T21:18:13.724006] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T21:18:13.735118] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-25T21:18:14.668882] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T21:18:14.680288] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-25T21:18:15.826300] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T21:18:15.836121] [INFO ] [REMOTE ] ETR: Full fetch complete (77262 records). [2025-10-25T21:18:15.836314] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-25T21:18:16.248520] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-25T21:18:16.248682] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-25T21:18:16.249708] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-25T21:18:16.249803] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-25T21:18:16.251323] [DEBUG] [LOCAL ] ETR: Trimmed 77262 records to 53955 (keeping 200 days of data) [2025-10-25T21:18:16.565714] [DEBUG] [LOCAL ] ETR: Primary data saved (53955 records). [2025-10-25T21:18:16.565875] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-25T21:18:16.566063] [INFO ] [MAIN ] Update Progress: 780/2366 symbols. ETR took 14.0s. Estimated remaining time: 4h 45m 38s [2025-10-25T21:18:16.741190] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:18:16.741414] [DEBUG] [LOCAL ] ETSY: No existing data file found in primary storage. [2025-10-25T21:18:16.741503] [WARN ] [MAIN ] ETSY: No existing data found, performing full refresh instead. [2025-10-25T21:18:16.741670] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-25T21:18:16.741780] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-25T21:18:16.741890] [DEBUG] [LOCAL ] ETSY: No primary data file found to delete. [2025-10-25T21:18:16.741977] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-25T21:18:17.103549] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:18:17.103954] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-25T21:18:18.844093] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T21:18:18.854494] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-25T21:18:20.874297] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-25T21:18:20.884234] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-25T21:18:22.825067] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T21:18:22.839366] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-25T21:18:23.849191] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T21:18:23.860878] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-25T21:18:24.843427] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T21:18:24.856389] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-25T21:18:25.688885] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T21:18:25.699703] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-25T21:18:26.685098] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T21:18:26.696888] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-25T21:18:27.332750] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-25T21:18:27.344068] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-25T21:18:28.410343] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T21:18:28.421930] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-25T21:18:28.978748] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T21:18:28.989624] [INFO ] [REMOTE ] ETSY: Full fetch complete (77657 records). [2025-10-25T21:18:28.989890] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-25T21:18:29.385944] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-25T21:18:29.386066] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-25T21:18:29.387007] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-25T21:18:29.387097] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-25T21:18:29.388672] [DEBUG] [LOCAL ] ETSY: Trimmed 77657 records to 54338 (keeping 200 days of data) [2025-10-25T21:18:29.703524] [DEBUG] [LOCAL ] ETSY: Primary data saved (54338 records). [2025-10-25T21:18:29.703713] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-25T21:18:29.703866] [INFO ] [MAIN ] Update Progress: 781/2366 symbols. ETSY took 13.1s. Estimated remaining time: 4h 45m 32s [2025-10-25T21:18:29.872957] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:18:29.873200] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-10-25T21:18:29.873291] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-10-25T21:18:29.873402] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-25T21:18:29.873471] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-25T21:18:29.873549] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-25T21:18:29.873616] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-25T21:18:30.230667] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:18:30.231118] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-25T21:18:31.527606] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T21:18:31.533224] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-25T21:18:32.736327] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-25T21:18:32.741190] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-25T21:18:34.047039] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T21:18:34.052287] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-25T21:18:35.437534] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T21:18:35.443668] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-25T21:18:36.529049] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T21:18:36.533851] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-25T21:18:37.598032] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T21:18:37.602922] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-25T21:18:38.801234] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T21:18:38.806130] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-25T21:18:39.987102] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-25T21:18:39.991865] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-25T21:18:41.126421] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T21:18:41.131497] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-25T21:18:42.390744] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T21:18:42.395529] [INFO ] [REMOTE ] ETV: Full fetch complete (32151 records). [2025-10-25T21:18:42.395671] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-25T21:18:42.774306] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-25T21:18:42.774421] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-25T21:18:42.775080] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-25T21:18:42.775160] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-25T21:18:42.776039] [DEBUG] [LOCAL ] ETV: Trimmed 32151 records to 22125 (keeping 200 days of data) [2025-10-25T21:18:42.906213] [DEBUG] [LOCAL ] ETV: Primary data saved (22125 records). [2025-10-25T21:18:42.906362] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-25T21:18:42.906491] [INFO ] [MAIN ] Update Progress: 782/2366 symbols. ETV took 13.2s. Estimated remaining time: 4h 45m 26s [2025-10-25T21:18:43.083539] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:18:43.083774] [DEBUG] [LOCAL ] ETW: No existing data file found in primary storage. [2025-10-25T21:18:43.083846] [WARN ] [MAIN ] ETW: No existing data found, performing full refresh instead. [2025-10-25T21:18:43.083958] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-25T21:18:43.084029] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-25T21:18:43.084157] [DEBUG] [LOCAL ] ETW: No primary data file found to delete. [2025-10-25T21:18:43.084228] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-25T21:18:43.440574] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:18:43.440956] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-25T21:18:44.566416] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T21:18:44.571977] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-25T21:18:45.710451] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T21:18:45.715446] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-25T21:18:47.058991] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T21:18:47.064468] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-25T21:18:48.535144] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T21:18:48.542752] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-25T21:18:49.729358] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T21:18:49.734936] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-25T21:18:51.002225] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T21:18:51.007566] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-25T21:18:52.358694] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T21:18:52.365153] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-25T21:18:53.580078] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T21:18:53.587137] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-25T21:18:54.889433] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T21:18:54.894962] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-25T21:18:56.160062] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T21:18:56.165211] [INFO ] [REMOTE ] ETW: Full fetch complete (36468 records). [2025-10-25T21:18:56.165327] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-25T21:18:56.537970] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-25T21:18:56.538084] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-25T21:18:56.538713] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-25T21:18:56.538791] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-25T21:18:56.539635] [DEBUG] [LOCAL ] ETW: Trimmed 36468 records to 25508 (keeping 200 days of data) [2025-10-25T21:18:56.687287] [DEBUG] [LOCAL ] ETW: Primary data saved (25508 records). [2025-10-25T21:18:56.687434] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-25T21:18:56.687568] [INFO ] [MAIN ] Update Progress: 783/2366 symbols. ETW took 13.8s. Estimated remaining time: 4h 45m 21s [2025-10-25T21:18:56.866317] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:18:56.866527] [DEBUG] [LOCAL ] ETX: No existing data file found in primary storage. [2025-10-25T21:18:56.866606] [WARN ] [MAIN ] ETX: No existing data found, performing full refresh instead. [2025-10-25T21:18:56.866750] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-25T21:18:56.866822] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-25T21:18:56.866879] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-25T21:18:56.866941] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-25T21:18:57.244765] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:18:57.245154] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-25T21:18:57.984927] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-25T21:18:57.986370] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-25T21:18:58.638550] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-25T21:18:58.640377] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-25T21:18:59.215863] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T21:18:59.217338] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-25T21:18:59.925340] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T21:18:59.927026] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-25T21:19:00.697436] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T21:19:00.699159] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-25T21:19:02.828254] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-25T21:19:02.830899] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-25T21:19:03.573567] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T21:19:03.575629] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-25T21:19:04.391624] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T21:19:04.394572] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-25T21:19:05.220128] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-25T21:19:05.222222] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-25T21:19:05.889290] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T21:19:05.890801] [INFO ] [REMOTE ] ETX: Full fetch complete (6773 records). [2025-10-25T21:19:05.890895] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-25T21:19:06.260921] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-25T21:19:06.261060] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-25T21:19:06.261305] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-25T21:19:06.261387] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-25T21:19:06.261868] [DEBUG] [LOCAL ] ETX: Trimmed 6773 records to 5378 (keeping 200 days of data) [2025-10-25T21:19:06.293914] [DEBUG] [LOCAL ] ETX: Primary data saved (5378 records). [2025-10-25T21:19:06.294047] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-25T21:19:06.294179] [INFO ] [MAIN ] Update Progress: 784/2366 symbols. ETX took 9.6s. Estimated remaining time: 4h 45m 8s [2025-10-25T21:19:06.461587] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:19:06.461855] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-10-25T21:19:06.461952] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-10-25T21:19:06.462089] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-25T21:19:06.462166] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-25T21:19:06.462253] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-25T21:19:06.462330] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-25T21:19:06.817450] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:19:06.817814] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-25T21:19:08.107869] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-25T21:19:08.115067] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-25T21:19:09.264967] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T21:19:09.273360] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-25T21:19:10.563512] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T21:19:10.569207] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-25T21:19:12.105156] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T21:19:12.111511] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-25T21:19:13.345802] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T21:19:13.351906] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-25T21:19:14.428247] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T21:19:14.434127] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-25T21:19:15.720193] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-25T21:19:15.725987] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-25T21:19:16.883099] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T21:19:16.889552] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-25T21:19:18.045637] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T21:19:18.050517] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-25T21:19:19.120350] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T21:19:19.124722] [INFO ] [REMOTE ] ETY: Full fetch complete (33799 records). [2025-10-25T21:19:19.124853] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-25T21:19:19.492020] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-25T21:19:19.492150] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-25T21:19:19.492733] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-25T21:19:19.492813] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-25T21:19:19.493552] [DEBUG] [LOCAL ] ETY: Trimmed 33799 records to 22603 (keeping 200 days of data) [2025-10-25T21:19:19.625543] [DEBUG] [LOCAL ] ETY: Primary data saved (22603 records). [2025-10-25T21:19:19.625721] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-25T21:19:19.625850] [INFO ] [MAIN ] Update Progress: 785/2366 symbols. ETY took 13.3s. Estimated remaining time: 4h 45m 2s [2025-10-25T21:19:19.798050] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:19:19.798281] [DEBUG] [LOCAL ] EVC: No existing data file found in primary storage. [2025-10-25T21:19:19.798360] [WARN ] [MAIN ] EVC: No existing data found, performing full refresh instead. [2025-10-25T21:19:19.798476] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-25T21:19:19.798549] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-25T21:19:19.798632] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-10-25T21:19:19.798730] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-25T21:19:20.183664] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:19:20.184138] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-25T21:19:21.592360] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T21:19:21.598048] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-25T21:19:22.848258] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T21:19:22.853186] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-25T21:19:24.261311] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T21:19:24.267794] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-25T21:19:25.479981] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T21:19:25.485066] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-25T21:19:26.538367] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T21:19:26.543075] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-25T21:19:27.725148] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T21:19:27.731111] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-25T21:19:28.871880] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T21:19:28.876810] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-25T21:19:29.900354] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T21:19:29.904500] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-25T21:19:30.852117] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T21:19:30.858321] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-25T21:19:31.908054] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T21:19:31.911886] [INFO ] [REMOTE ] EVC: Full fetch complete (28611 records). [2025-10-25T21:19:31.912008] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-25T21:19:32.291808] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-25T21:19:32.292211] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-25T21:19:32.292781] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-25T21:19:32.292858] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-25T21:19:32.293695] [DEBUG] [LOCAL ] EVC: Trimmed 28611 records to 18007 (keeping 200 days of data) [2025-10-25T21:19:32.393984] [DEBUG] [LOCAL ] EVC: Primary data saved (18007 records). [2025-10-25T21:19:32.394157] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-25T21:19:32.394291] [INFO ] [MAIN ] Update Progress: 786/2366 symbols. EVC took 12.8s. Estimated remaining time: 4h 44m 55s [2025-10-25T21:19:32.560467] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:19:32.560753] [DEBUG] [LOCAL ] EVEX: No existing data file found in primary storage. [2025-10-25T21:19:32.560827] [WARN ] [MAIN ] EVEX: No existing data found, performing full refresh instead. [2025-10-25T21:19:32.560939] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-25T21:19:32.561008] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-25T21:19:32.561087] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-10-25T21:19:32.561152] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-25T21:19:32.916703] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:19:32.917114] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-25T21:19:34.091128] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T21:19:34.096619] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-25T21:19:35.216326] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T21:19:35.221130] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-25T21:19:36.330739] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-25T21:19:36.336147] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-25T21:19:37.434894] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T21:19:37.439905] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-25T21:19:38.485708] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T21:19:38.490339] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-25T21:19:39.715806] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-25T21:19:39.721813] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-25T21:19:41.189523] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T21:19:41.197853] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-25T21:19:42.752142] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T21:19:42.762002] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-25T21:19:44.475999] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T21:19:44.487058] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-25T21:19:46.254809] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T21:19:46.263815] [INFO ] [REMOTE ] EVEX: Full fetch complete (44278 records). [2025-10-25T21:19:46.263975] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-25T21:19:46.661605] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-25T21:19:46.661748] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-25T21:19:46.662482] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-25T21:19:46.662560] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-25T21:19:46.663552] [DEBUG] [LOCAL ] EVEX: Trimmed 44278 records to 33639 (keeping 200 days of data) [2025-10-25T21:19:46.843750] [DEBUG] [LOCAL ] EVEX: Primary data saved (33639 records). [2025-10-25T21:19:46.843926] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-25T21:19:46.844060] [INFO ] [MAIN ] Update Progress: 787/2366 symbols. EVEX took 14.4s. Estimated remaining time: 4h 44m 52s [2025-10-25T21:19:47.009696] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:19:47.009911] [DEBUG] [LOCAL ] EVF: No existing data file found in primary storage. [2025-10-25T21:19:47.009983] [WARN ] [MAIN ] EVF: No existing data found, performing full refresh instead. [2025-10-25T21:19:47.010101] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-25T21:19:47.010173] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-25T21:19:47.010255] [DEBUG] [LOCAL ] EVF: No primary data file found to delete. [2025-10-25T21:19:47.010325] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-25T21:19:47.359900] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:19:47.360291] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-25T21:19:48.059352] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T21:19:48.061159] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-25T21:19:48.770768] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T21:19:48.772548] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-25T21:19:49.603887] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-25T21:19:49.606397] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-25T21:19:50.401349] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T21:19:50.404444] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-25T21:19:51.175317] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T21:19:51.177315] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-25T21:19:52.103403] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T21:19:52.105705] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-25T21:19:53.167531] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T21:19:53.171419] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-25T21:19:54.003292] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-25T21:19:54.006907] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-25T21:19:55.012367] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T21:19:55.015341] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-25T21:19:55.947834] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T21:19:55.950423] [INFO ] [REMOTE ] EVF: Full fetch complete (12879 records). [2025-10-25T21:19:55.950523] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-25T21:19:56.306816] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-25T21:19:56.306940] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-25T21:19:56.307268] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-25T21:19:56.307341] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-25T21:19:56.307896] [DEBUG] [LOCAL ] EVF: Trimmed 12879 records to 9816 (keeping 200 days of data) [2025-10-25T21:19:56.362136] [DEBUG] [LOCAL ] EVF: Primary data saved (9816 records). [2025-10-25T21:19:56.362282] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-25T21:19:56.362413] [INFO ] [MAIN ] Update Progress: 788/2366 symbols. EVF took 9.5s. Estimated remaining time: 4h 44m 38s [2025-10-25T21:19:56.530376] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:19:56.530560] [DEBUG] [LOCAL ] EVG: No existing data file found in primary storage. [2025-10-25T21:19:56.530668] [WARN ] [MAIN ] EVG: No existing data found, performing full refresh instead. [2025-10-25T21:19:56.530806] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-25T21:19:56.530895] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-25T21:19:56.531007] [DEBUG] [LOCAL ] EVG: No primary data file found to delete. [2025-10-25T21:19:56.531095] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-25T21:19:56.880204] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:19:56.880524] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-25T21:19:57.660042] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T21:19:57.661788] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-25T21:19:58.362465] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T21:19:58.364107] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-25T21:19:59.069087] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-25T21:19:59.070949] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-25T21:19:59.930870] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T21:19:59.932917] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-25T21:20:00.844161] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-25T21:20:00.846183] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-25T21:20:02.361286] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T21:20:02.363195] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-25T21:20:04.232598] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-25T21:20:04.234949] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-25T21:20:05.980267] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-25T21:20:05.983082] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-25T21:20:06.689822] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T21:20:06.691766] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-25T21:20:07.437983] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T21:20:07.440297] [INFO ] [REMOTE ] EVG: Full fetch complete (8090 records). [2025-10-25T21:20:07.440403] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-25T21:20:07.833372] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-25T21:20:07.833538] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-25T21:20:07.833927] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-25T21:20:07.834036] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-25T21:20:07.834751] [DEBUG] [LOCAL ] EVG: Trimmed 8090 records to 5823 (keeping 200 days of data) [2025-10-25T21:20:07.876664] [DEBUG] [LOCAL ] EVG: Primary data saved (5823 records). [2025-10-25T21:20:07.876915] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-25T21:20:07.877119] [INFO ] [MAIN ] Update Progress: 789/2366 symbols. EVG took 11.5s. Estimated remaining time: 4h 44m 29s [2025-10-25T21:20:08.083285] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:20:08.083565] [DEBUG] [LOCAL ] EVH: No existing data file found in primary storage. [2025-10-25T21:20:08.083662] [WARN ] [MAIN ] EVH: No existing data found, performing full refresh instead. [2025-10-25T21:20:08.083791] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-25T21:20:08.083865] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-25T21:20:08.083950] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-10-25T21:20:08.084024] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-25T21:20:08.488373] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:20:08.489014] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-25T21:20:10.147811] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T21:20:10.157388] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-25T21:20:11.827434] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T21:20:11.837207] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-25T21:20:13.085922] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T21:20:13.096349] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-25T21:20:14.076201] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T21:20:14.086535] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-25T21:20:14.964993] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T21:20:14.975345] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-25T21:20:16.184788] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T21:20:16.195231] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-25T21:20:17.081217] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T21:20:17.091920] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-25T21:20:17.990753] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T21:20:18.007977] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-25T21:20:19.374570] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T21:20:19.385245] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-25T21:20:20.339231] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T21:20:20.348761] [INFO ] [REMOTE ] EVH: Full fetch complete (71922 records). [2025-10-25T21:20:20.348959] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-25T21:20:20.739440] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-25T21:20:20.739554] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-25T21:20:20.740433] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-25T21:20:20.740514] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-25T21:20:20.741846] [DEBUG] [LOCAL ] EVH: Trimmed 71922 records to 50344 (keeping 200 days of data) [2025-10-25T21:20:21.016254] [DEBUG] [LOCAL ] EVH: Primary data saved (50344 records). [2025-10-25T21:20:21.016415] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-25T21:20:21.016545] [INFO ] [MAIN ] Update Progress: 790/2366 symbols. EVH took 13.1s. Estimated remaining time: 4h 44m 23s [2025-10-25T21:20:21.188071] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:20:21.188303] [DEBUG] [LOCAL ] EVN: No existing data file found in primary storage. [2025-10-25T21:20:21.188374] [WARN ] [MAIN ] EVN: No existing data found, performing full refresh instead. [2025-10-25T21:20:21.188486] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-25T21:20:21.188555] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-25T21:20:21.188635] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-10-25T21:20:21.188729] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-25T21:20:21.553930] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:20:21.554294] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-25T21:20:22.605545] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T21:20:22.609912] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-25T21:20:23.487179] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-25T21:20:23.490417] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-25T21:20:24.445807] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T21:20:24.449158] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-25T21:20:25.406690] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T21:20:25.409986] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-25T21:20:26.250040] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T21:20:26.252462] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-25T21:20:27.135172] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T21:20:27.137511] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-25T21:20:27.881617] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T21:20:27.884527] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-25T21:20:28.888317] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T21:20:28.892098] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-25T21:20:29.817228] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T21:20:29.820419] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-25T21:20:30.698028] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T21:20:30.700669] [INFO ] [REMOTE ] EVN: Full fetch complete (17069 records). [2025-10-25T21:20:30.700768] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-25T21:20:31.059266] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-25T21:20:31.059379] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-25T21:20:31.059846] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-25T21:20:31.059942] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-25T21:20:31.060553] [DEBUG] [LOCAL ] EVN: Trimmed 17069 records to 11048 (keeping 200 days of data) [2025-10-25T21:20:31.124473] [DEBUG] [LOCAL ] EVN: Primary data saved (11048 records). [2025-10-25T21:20:31.124630] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-25T21:20:31.124846] [INFO ] [MAIN ] Update Progress: 791/2366 symbols. EVN took 10.1s. Estimated remaining time: 4h 44m 10s [2025-10-25T21:20:31.293131] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:20:31.293315] [DEBUG] [LOCAL ] EVR: No existing data file found in primary storage. [2025-10-25T21:20:31.293407] [WARN ] [MAIN ] EVR: No existing data found, performing full refresh instead. [2025-10-25T21:20:31.293556] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-25T21:20:31.293664] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-25T21:20:31.293766] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-10-25T21:20:31.293848] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-25T21:20:31.643917] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:20:31.644209] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-25T21:20:33.163478] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T21:20:33.170214] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-25T21:20:34.637606] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T21:20:34.644957] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-25T21:20:36.425504] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T21:20:36.433984] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-25T21:20:38.297409] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-25T21:20:38.307783] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-25T21:20:40.004173] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T21:20:40.012332] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-25T21:20:41.660078] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T21:20:41.667701] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-25T21:20:43.078554] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-25T21:20:43.087810] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-25T21:20:44.310720] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T21:20:44.317478] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-25T21:20:45.430721] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-25T21:20:45.437505] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-25T21:20:46.606871] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T21:20:46.613497] [INFO ] [REMOTE ] EVR: Full fetch complete (50450 records). [2025-10-25T21:20:46.613749] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-25T21:20:46.987428] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-25T21:20:46.987550] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-25T21:20:46.988368] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-25T21:20:46.988452] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-25T21:20:46.989535] [DEBUG] [LOCAL ] EVR: Trimmed 50450 records to 33926 (keeping 200 days of data) [2025-10-25T21:20:47.215979] [DEBUG] [LOCAL ] EVR: Primary data saved (33926 records). [2025-10-25T21:20:47.216157] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-25T21:20:47.216305] [INFO ] [MAIN ] Update Progress: 792/2366 symbols. EVR took 16.1s. Estimated remaining time: 4h 44m 10s [2025-10-25T21:20:47.383127] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:20:47.383319] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-10-25T21:20:47.383389] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-10-25T21:20:47.383501] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-25T21:20:47.383571] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-25T21:20:47.383675] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-10-25T21:20:47.383747] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-25T21:20:47.734174] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:20:47.734508] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-25T21:20:48.897583] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T21:20:48.902081] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-25T21:20:49.904528] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-25T21:20:49.908499] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-25T21:20:50.938016] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T21:20:50.942620] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-25T21:20:51.964256] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T21:20:51.969145] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-25T21:20:52.959046] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T21:20:52.963451] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-25T21:20:54.039531] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T21:20:54.044036] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-25T21:20:55.074545] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T21:20:55.078964] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-25T21:20:56.114437] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T21:20:56.118604] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-25T21:20:57.001123] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-25T21:20:57.004951] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-25T21:20:57.819462] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T21:20:57.823101] [INFO ] [REMOTE ] EVT: Full fetch complete (24897 records). [2025-10-25T21:20:57.823228] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-25T21:20:58.225868] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-25T21:20:58.225992] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-25T21:20:58.226546] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-25T21:20:58.226710] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-25T21:20:58.227454] [DEBUG] [LOCAL ] EVT: Trimmed 24897 records to 16696 (keeping 200 days of data) [2025-10-25T21:20:58.329440] [DEBUG] [LOCAL ] EVT: Primary data saved (16696 records). [2025-10-25T21:20:58.329621] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-25T21:20:58.329780] [INFO ] [MAIN ] Update Progress: 793/2366 symbols. EVT took 11.1s. Estimated remaining time: 4h 43m 60s [2025-10-25T21:20:58.497807] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:20:58.498030] [DEBUG] [LOCAL ] EVTC: No existing data file found in primary storage. [2025-10-25T21:20:58.498110] [WARN ] [MAIN ] EVTC: No existing data found, performing full refresh instead. [2025-10-25T21:20:58.498224] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-25T21:20:58.498294] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-25T21:20:58.498374] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-10-25T21:20:58.498444] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-25T21:20:58.849373] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:20:58.849768] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-25T21:20:59.940939] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T21:20:59.946013] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-25T21:21:01.216997] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T21:21:01.222147] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-25T21:21:03.079497] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T21:21:03.085753] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-25T21:21:04.332433] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T21:21:04.338614] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-25T21:21:05.602146] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T21:21:05.608333] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-25T21:21:06.615878] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T21:21:06.621153] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-25T21:21:07.936464] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-25T21:21:07.943775] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-25T21:21:09.016382] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T21:21:09.022353] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-25T21:21:10.279612] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-25T21:21:10.286160] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-25T21:21:11.501686] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T21:21:11.508937] [INFO ] [REMOTE ] EVTC: Full fetch complete (38524 records). [2025-10-25T21:21:11.509171] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-25T21:21:12.074944] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-25T21:21:12.075109] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-25T21:21:12.075953] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-25T21:21:12.076065] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-25T21:21:12.077774] [DEBUG] [LOCAL ] EVTC: Trimmed 38524 records to 27158 (keeping 200 days of data) [2025-10-25T21:21:12.251755] [DEBUG] [LOCAL ] EVTC: Primary data saved (27158 records). [2025-10-25T21:21:12.251930] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-25T21:21:12.252068] [INFO ] [MAIN ] Update Progress: 794/2366 symbols. EVTC took 13.9s. Estimated remaining time: 4h 43m 55s [2025-10-25T21:21:12.443754] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:21:12.443963] [DEBUG] [LOCAL ] EVTL: No existing data file found in primary storage. [2025-10-25T21:21:12.444037] [WARN ] [MAIN ] EVTL: No existing data found, performing full refresh instead. [2025-10-25T21:21:12.444155] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-25T21:21:12.444228] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-25T21:21:12.444311] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-10-25T21:21:12.444383] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-25T21:21:12.813739] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:21:12.814066] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-25T21:21:14.359938] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T21:21:14.366463] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-25T21:21:15.702817] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T21:21:15.709834] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-25T21:21:16.881852] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-25T21:21:16.887591] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-25T21:21:17.975456] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T21:21:17.980381] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-25T21:21:19.429822] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T21:21:19.436970] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-25T21:21:20.969202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T21:21:20.977704] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-25T21:21:22.978522] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-25T21:21:22.989465] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-25T21:21:24.671005] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T21:21:24.680531] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-25T21:21:26.703067] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-25T21:21:26.713290] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-25T21:21:28.768261] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-25T21:21:28.778192] [INFO ] [REMOTE ] EVTL: Full fetch complete (55116 records). [2025-10-25T21:21:28.778385] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-25T21:21:29.161305] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-25T21:21:29.161410] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-25T21:21:29.162241] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-25T21:21:29.162330] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-25T21:21:29.163592] [DEBUG] [LOCAL ] EVTL: Trimmed 55116 records to 42106 (keeping 200 days of data) [2025-10-25T21:21:29.395201] [DEBUG] [LOCAL ] EVTL: Primary data saved (42106 records). [2025-10-25T21:21:29.395379] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-25T21:21:29.395568] [INFO ] [MAIN ] Update Progress: 795/2366 symbols. EVTL took 17.1s. Estimated remaining time: 4h 43m 57s [2025-10-25T21:21:29.565827] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:21:29.566083] [DEBUG] [LOCAL ] EVTR: No existing data file found in primary storage. [2025-10-25T21:21:29.566178] [WARN ] [MAIN ] EVTR: No existing data found, performing full refresh instead. [2025-10-25T21:21:29.566334] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-25T21:21:29.566415] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-25T21:21:29.566521] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-10-25T21:21:29.566610] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-25T21:21:29.925480] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:21:29.925916] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-25T21:21:30.898778] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T21:21:30.902522] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-25T21:21:31.890208] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T21:21:31.894889] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-25T21:21:32.887289] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T21:21:32.893260] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-25T21:21:34.079174] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-25T21:21:34.084234] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-25T21:21:35.180052] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T21:21:35.185005] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-25T21:21:36.279757] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T21:21:36.284859] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-25T21:21:37.298677] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T21:21:37.303638] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-25T21:21:38.528137] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T21:21:38.534025] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-25T21:21:39.899223] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T21:21:39.906449] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-25T21:21:41.283467] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T21:21:41.289896] [INFO ] [REMOTE ] EVTR: Full fetch complete (34257 records). [2025-10-25T21:21:41.290009] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-25T21:21:41.675963] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-25T21:21:41.676081] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-25T21:21:41.676780] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-25T21:21:41.676862] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-25T21:21:41.677734] [DEBUG] [LOCAL ] EVTR: Trimmed 34257 records to 25943 (keeping 200 days of data) [2025-10-25T21:21:41.831697] [DEBUG] [LOCAL ] EVTR: Primary data saved (25943 records). [2025-10-25T21:21:41.831848] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-25T21:21:41.831979] [INFO ] [MAIN ] Update Progress: 796/2366 symbols. EVTR took 12.4s. Estimated remaining time: 4h 43m 49s [2025-10-25T21:21:42.013346] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:21:42.013546] [DEBUG] [LOCAL ] EW: No existing data file found in primary storage. [2025-10-25T21:21:42.013670] [WARN ] [MAIN ] EW: No existing data found, performing full refresh instead. [2025-10-25T21:21:42.013787] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-25T21:21:42.013863] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-25T21:21:42.013925] [DEBUG] [LOCAL ] EW: No primary data file found to delete. [2025-10-25T21:21:42.013987] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-25T21:21:42.407298] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:21:42.407675] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-25T21:21:44.173478] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T21:21:44.183668] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-25T21:21:45.722998] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T21:21:45.732998] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-25T21:21:47.584464] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T21:21:47.595551] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-25T21:21:49.267488] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T21:21:49.278715] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-25T21:21:51.157964] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-25T21:21:51.169453] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-25T21:21:52.867689] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T21:21:52.878406] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-25T21:21:54.625712] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T21:21:54.637318] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-25T21:21:56.344061] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T21:21:56.355488] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-25T21:21:58.243575] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T21:21:58.260500] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-25T21:22:00.042397] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-25T21:22:00.052062] [INFO ] [REMOTE ] EW: Full fetch complete (77502 records). [2025-10-25T21:22:00.052229] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-25T21:22:00.444783] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-25T21:22:00.444945] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-25T21:22:00.445869] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-25T21:22:00.445952] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-25T21:22:00.447486] [DEBUG] [LOCAL ] EW: Trimmed 77502 records to 54166 (keeping 200 days of data) [2025-10-25T21:22:00.750426] [DEBUG] [LOCAL ] EW: Primary data saved (54166 records). [2025-10-25T21:22:00.750585] [INFO ] [MAIN ] EW: Full history saved. [2025-10-25T21:22:00.750739] [INFO ] [MAIN ] Update Progress: 797/2366 symbols. EW took 18.9s. Estimated remaining time: 4h 43m 54s [2025-10-25T21:22:00.915906] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:22:00.916076] [DEBUG] [LOCAL ] EXG: No existing data file found in primary storage. [2025-10-25T21:22:00.916147] [WARN ] [MAIN ] EXG: No existing data found, performing full refresh instead. [2025-10-25T21:22:00.916235] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-25T21:22:00.916303] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-25T21:22:00.916363] [DEBUG] [LOCAL ] EXG: No primary data file found to delete. [2025-10-25T21:22:00.916471] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-25T21:22:01.264217] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:22:01.264598] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-25T21:22:03.099607] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T21:22:03.106578] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-25T21:22:04.917824] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T21:22:04.924760] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-25T21:22:06.368166] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-25T21:22:06.375983] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-25T21:22:07.863190] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T21:22:07.874616] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-25T21:22:09.111884] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T21:22:09.119062] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-25T21:22:10.525058] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T21:22:10.533239] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-25T21:22:11.977245] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-25T21:22:11.984887] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-25T21:22:13.424062] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T21:22:13.430901] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-25T21:22:14.591143] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T21:22:14.598780] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-25T21:22:15.817390] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T21:22:15.823431] [INFO ] [REMOTE ] EXG: Full fetch complete (49392 records). [2025-10-25T21:22:15.823569] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-25T21:22:16.195709] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-25T21:22:16.195831] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-25T21:22:16.196522] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-25T21:22:16.196595] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-25T21:22:16.197768] [DEBUG] [LOCAL ] EXG: Trimmed 49392 records to 34033 (keeping 200 days of data) [2025-10-25T21:22:16.389067] [DEBUG] [LOCAL ] EXG: Primary data saved (34033 records). [2025-10-25T21:22:16.389222] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-25T21:22:16.389359] [INFO ] [MAIN ] Update Progress: 798/2366 symbols. EXG took 15.6s. Estimated remaining time: 4h 43m 53s [2025-10-25T21:22:16.560955] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:22:16.561148] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-10-25T21:22:16.561218] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-10-25T21:22:16.561333] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-25T21:22:16.561407] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-25T21:22:16.561485] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-10-25T21:22:16.561551] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-25T21:22:16.910617] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:22:16.910978] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-25T21:22:18.474339] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T21:22:18.484479] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-25T21:22:20.300124] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T21:22:20.310088] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-25T21:22:22.308055] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T21:22:22.319520] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-25T21:22:23.966131] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T21:22:23.988329] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-25T21:22:25.773291] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-25T21:22:25.784235] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-25T21:22:27.560693] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-25T21:22:27.571459] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-25T21:22:29.372486] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T21:22:29.384011] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-25T21:22:31.046601] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T21:22:31.057842] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-25T21:22:33.099838] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-25T21:22:33.111265] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-25T21:22:35.353845] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-25T21:22:35.364262] [INFO ] [REMOTE ] EXK: Full fetch complete (76879 records). [2025-10-25T21:22:35.364461] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-25T21:22:35.764402] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-25T21:22:35.764522] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-25T21:22:35.765492] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-25T21:22:35.765575] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-25T21:22:35.767049] [DEBUG] [LOCAL ] EXK: Trimmed 76879 records to 53965 (keeping 200 days of data) [2025-10-25T21:22:36.070364] [DEBUG] [LOCAL ] EXK: Primary data saved (53965 records). [2025-10-25T21:22:36.070546] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-25T21:22:36.070704] [INFO ] [MAIN ] Update Progress: 799/2366 symbols. EXK took 19.7s. Estimated remaining time: 4h 43m 59s [2025-10-25T21:22:36.245371] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:22:36.245614] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-10-25T21:22:36.245728] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-10-25T21:22:36.245874] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-25T21:22:36.245957] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-25T21:22:36.246061] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-10-25T21:22:36.246150] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-25T21:22:36.608158] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:22:36.608547] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-25T21:22:37.996881] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T21:22:38.003881] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-25T21:22:39.428826] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T21:22:39.434561] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-25T21:22:40.815266] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T21:22:40.822284] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-25T21:22:42.171335] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T21:22:42.178441] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-25T21:22:43.555611] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T21:22:43.563181] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-25T21:22:44.895219] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T21:22:44.901945] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-25T21:22:46.359602] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T21:22:46.366925] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-25T21:22:47.586411] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T21:22:47.592420] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-25T21:22:48.762047] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T21:22:48.768142] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-25T21:22:49.976231] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T21:22:49.981337] [INFO ] [REMOTE ] EXP: Full fetch complete (42803 records). [2025-10-25T21:22:49.981448] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-25T21:22:50.372548] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-25T21:22:50.372674] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-25T21:22:50.373308] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-25T21:22:50.373384] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-25T21:22:50.374383] [DEBUG] [LOCAL ] EXP: Trimmed 42803 records to 29474 (keeping 200 days of data) [2025-10-25T21:22:50.553222] [DEBUG] [LOCAL ] EXP: Primary data saved (29474 records). [2025-10-25T21:22:50.553382] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-25T21:22:50.553517] [INFO ] [MAIN ] Update Progress: 800/2366 symbols. EXP took 14.5s. Estimated remaining time: 4h 43m 55s [2025-10-25T21:22:50.734706] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:22:50.734904] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-10-25T21:22:50.734976] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-10-25T21:22:50.735090] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-25T21:22:50.735162] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-25T21:22:50.735243] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-25T21:22:50.735314] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-25T21:22:51.111191] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:22:51.111538] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-25T21:22:52.662060] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T21:22:52.671372] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-25T21:22:54.191018] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T21:22:54.200604] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-25T21:22:55.866991] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T21:22:55.878993] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-25T21:22:57.681320] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-25T21:22:57.691981] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-25T21:22:59.450064] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T21:22:59.460357] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-25T21:23:06.519251] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (7.06 seconds). [2025-10-25T21:23:06.528756] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-25T21:23:08.631454] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-25T21:23:08.646337] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-25T21:23:10.391592] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-25T21:23:10.401674] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-25T21:23:12.069333] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T21:23:12.079391] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-25T21:23:13.529135] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T21:23:13.537494] [INFO ] [REMOTE ] EXPD: Full fetch complete (69368 records). [2025-10-25T21:23:13.537711] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-25T21:23:13.921750] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-25T21:23:13.921882] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-25T21:23:13.922772] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-25T21:23:13.922855] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-25T21:23:13.924244] [DEBUG] [LOCAL ] EXPD: Trimmed 69368 records to 48335 (keeping 200 days of data) [2025-10-25T21:23:14.211322] [DEBUG] [LOCAL ] EXPD: Primary data saved (48335 records). [2025-10-25T21:23:14.211516] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-25T21:23:14.211634] [INFO ] [MAIN ] Update Progress: 801/2366 symbols. EXPD took 23.7s. Estimated remaining time: 4h 44m 9s [2025-10-25T21:23:14.379395] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:23:14.379586] [DEBUG] [LOCAL ] EXR: No existing data file found in primary storage. [2025-10-25T21:23:14.379678] [WARN ] [MAIN ] EXR: No existing data found, performing full refresh instead. [2025-10-25T21:23:14.379794] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-25T21:23:14.379864] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-25T21:23:14.379945] [DEBUG] [LOCAL ] EXR: No primary data file found to delete. [2025-10-25T21:23:14.380013] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-25T21:23:14.730022] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:23:14.730391] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-25T21:23:16.471582] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T21:23:16.480777] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-25T21:23:17.932051] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T21:23:17.940845] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-25T21:23:19.451970] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-25T21:23:19.461375] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-25T21:23:21.100895] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T21:23:21.111012] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-25T21:23:22.814459] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T21:23:22.823780] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-25T21:23:24.242424] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T21:23:24.251606] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-25T21:23:25.833941] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-25T21:23:25.843949] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-25T21:23:27.526556] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T21:23:27.536706] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-25T21:23:29.230558] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T21:23:29.240222] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-25T21:23:30.806506] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T21:23:30.814883] [INFO ] [REMOTE ] EXR: Full fetch complete (66117 records). [2025-10-25T21:23:30.815017] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-25T21:23:31.204224] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-25T21:23:31.204340] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-25T21:23:31.205463] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-25T21:23:31.205558] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-25T21:23:31.207297] [DEBUG] [LOCAL ] EXR: Trimmed 66117 records to 46048 (keeping 200 days of data) [2025-10-25T21:23:31.483889] [DEBUG] [LOCAL ] EXR: Primary data saved (46048 records). [2025-10-25T21:23:31.484050] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-25T21:23:31.484179] [INFO ] [MAIN ] Update Progress: 802/2366 symbols. EXR took 17.3s. Estimated remaining time: 4h 44m 11s [2025-10-25T21:23:31.656279] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:23:31.656509] [DEBUG] [LOCAL ] F: No existing data file found in primary storage. [2025-10-25T21:23:31.656585] [WARN ] [MAIN ] F: No existing data found, performing full refresh instead. [2025-10-25T21:23:31.656733] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-25T21:23:31.656817] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-25T21:23:31.656902] [DEBUG] [LOCAL ] F: No primary data file found to delete. [2025-10-25T21:23:31.656970] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-25T21:23:32.018278] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:23:32.018596] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-25T21:23:34.735572] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-25T21:23:34.751118] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-25T21:23:37.211289] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-25T21:23:37.221278] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-25T21:23:39.785555] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-25T21:23:39.796945] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-25T21:23:42.144978] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-25T21:23:42.156392] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-25T21:23:44.725969] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-25T21:23:44.737950] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-25T21:23:46.943450] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-25T21:23:46.954299] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-25T21:23:49.605618] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-25T21:23:49.617474] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-25T21:23:52.203289] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-25T21:23:52.214988] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-25T21:23:54.699534] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-25T21:23:54.710932] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-25T21:23:57.075964] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-25T21:23:57.085986] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-25T21:23:57.086149] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-25T21:23:57.487335] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-25T21:23:57.487465] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-25T21:23:57.488417] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-25T21:23:57.488498] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-25T21:23:57.489951] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-25T21:23:57.820260] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-25T21:23:57.820448] [INFO ] [MAIN ] F: Full history saved. [2025-10-25T21:23:57.820583] [INFO ] [MAIN ] Update Progress: 803/2366 symbols. F took 26.3s. Estimated remaining time: 4h 44m 30s [2025-10-25T21:23:57.993427] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:23:57.993617] [DEBUG] [LOCAL ] FAF: No existing data file found in primary storage. [2025-10-25T21:23:57.993720] [WARN ] [MAIN ] FAF: No existing data found, performing full refresh instead. [2025-10-25T21:23:57.993852] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-25T21:23:57.993925] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-25T21:23:57.993985] [DEBUG] [LOCAL ] FAF: No primary data file found to delete. [2025-10-25T21:23:57.994048] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-25T21:23:58.370182] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:23:58.370590] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-25T21:23:59.658175] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-25T21:23:59.665397] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-25T21:24:01.057088] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T21:24:01.063931] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-25T21:24:02.608519] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T21:24:02.616985] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-25T21:24:04.201783] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T21:24:04.211344] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-25T21:24:05.597121] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T21:24:05.606196] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-25T21:24:07.105702] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T21:24:07.114753] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-25T21:24:08.771017] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-25T21:24:08.781221] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-25T21:24:10.125707] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T21:24:10.133740] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-25T21:24:11.681808] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-25T21:24:11.690217] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-25T21:24:13.135190] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-25T21:24:13.142508] [INFO ] [REMOTE ] FAF: Full fetch complete (58436 records). [2025-10-25T21:24:13.142688] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-25T21:24:13.531936] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-25T21:24:13.532070] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-25T21:24:13.532851] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-25T21:24:13.532931] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-25T21:24:13.534181] [DEBUG] [LOCAL ] FAF: Trimmed 58436 records to 42073 (keeping 200 days of data) [2025-10-25T21:24:13.785130] [DEBUG] [LOCAL ] FAF: Primary data saved (42073 records). [2025-10-25T21:24:13.785331] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-25T21:24:13.785463] [INFO ] [MAIN ] Update Progress: 804/2366 symbols. FAF took 16.0s. Estimated remaining time: 4h 44m 29s [2025-10-25T21:24:13.949465] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:24:13.949673] [DEBUG] [LOCAL ] FBIN: No existing data file found in primary storage. [2025-10-25T21:24:13.949746] [WARN ] [MAIN ] FBIN: No existing data found, performing full refresh instead. [2025-10-25T21:24:13.949858] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-25T21:24:13.949928] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-25T21:24:13.950008] [DEBUG] [LOCAL ] FBIN: No primary data file found to delete. [2025-10-25T21:24:13.950076] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-25T21:24:14.291038] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:24:14.291360] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-25T21:24:15.951372] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T21:24:15.961875] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-25T21:24:17.645008] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T21:24:17.656879] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-25T21:24:19.333845] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T21:24:19.344291] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-25T21:24:21.220392] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-25T21:24:21.231269] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-25T21:24:22.839526] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T21:24:22.850417] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-25T21:24:24.616983] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-25T21:24:24.627956] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-25T21:24:26.055845] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T21:24:26.066915] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-25T21:24:27.618909] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T21:24:27.629484] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-25T21:24:29.201955] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T21:24:29.212703] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-25T21:24:30.916456] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-25T21:24:30.925515] [INFO ] [REMOTE ] FBIN: Full fetch complete (72985 records). [2025-10-25T21:24:30.925729] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-25T21:24:31.310241] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-25T21:24:31.310357] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-25T21:24:31.311336] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-25T21:24:31.311420] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-25T21:24:31.312914] [DEBUG] [LOCAL ] FBIN: Trimmed 72985 records to 51100 (keeping 200 days of data) [2025-10-25T21:24:31.607160] [DEBUG] [LOCAL ] FBIN: Primary data saved (51100 records). [2025-10-25T21:24:31.607324] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-25T21:24:31.607456] [INFO ] [MAIN ] Update Progress: 805/2366 symbols. FBIN took 17.8s. Estimated remaining time: 4h 44m 31s [2025-10-25T21:24:31.801260] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:24:31.801497] [DEBUG] [LOCAL ] FBK: No existing data file found in primary storage. [2025-10-25T21:24:31.801585] [WARN ] [MAIN ] FBK: No existing data found, performing full refresh instead. [2025-10-25T21:24:31.801757] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-25T21:24:31.801845] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-25T21:24:31.801944] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-10-25T21:24:31.802032] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-25T21:24:32.170746] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:24:32.171095] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-25T21:24:33.170041] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T21:24:33.174082] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-25T21:24:34.061415] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T21:24:34.064889] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-25T21:24:35.070043] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T21:24:35.074343] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-25T21:24:36.315433] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T21:24:36.322103] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-25T21:24:37.279961] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T21:24:37.284585] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-25T21:24:38.301238] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T21:24:38.308467] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-25T21:24:39.643569] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T21:24:39.651428] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-25T21:24:40.880212] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T21:24:40.886754] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-25T21:24:41.954707] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T21:24:41.962964] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-25T21:24:43.183678] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T21:24:43.189957] [INFO ] [REMOTE ] FBK: Full fetch complete (35609 records). [2025-10-25T21:24:43.190067] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-25T21:24:43.556380] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-25T21:24:43.556493] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-25T21:24:43.557076] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-25T21:24:43.557154] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-25T21:24:43.558024] [DEBUG] [LOCAL ] FBK: Trimmed 35609 records to 27741 (keeping 200 days of data) [2025-10-25T21:24:43.716460] [DEBUG] [LOCAL ] FBK: Primary data saved (27741 records). [2025-10-25T21:24:43.716626] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-25T21:24:43.716773] [INFO ] [MAIN ] Update Progress: 806/2366 symbols. FBK took 12.1s. Estimated remaining time: 4h 44m 23s [2025-10-25T21:24:43.889090] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:24:43.889306] [DEBUG] [LOCAL ] FBP: No existing data file found in primary storage. [2025-10-25T21:24:43.889382] [WARN ] [MAIN ] FBP: No existing data found, performing full refresh instead. [2025-10-25T21:24:43.889497] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-25T21:24:43.889570] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-25T21:24:43.889635] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-10-25T21:24:43.889729] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-25T21:24:44.240798] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:24:44.241134] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-25T21:24:45.784807] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T21:24:45.793827] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-25T21:24:47.188356] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T21:24:47.196704] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-25T21:24:48.946739] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T21:24:48.962875] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-25T21:24:50.548113] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T21:24:50.558519] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-25T21:24:52.090144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T21:24:52.099376] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-25T21:24:53.587205] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T21:24:53.600880] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-25T21:24:55.267006] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-25T21:24:55.277312] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-25T21:24:56.933805] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T21:24:56.943869] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-25T21:24:58.529912] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T21:24:58.541619] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-25T21:25:04.375397] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (5.83 seconds). [2025-10-25T21:25:04.389445] [INFO ] [REMOTE ] FBP: Full fetch complete (66793 records). [2025-10-25T21:25:04.389767] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-25T21:25:04.828606] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-25T21:25:04.828807] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-25T21:25:04.829819] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-25T21:25:04.829909] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-25T21:25:04.831490] [DEBUG] [LOCAL ] FBP: Trimmed 66793 records to 46291 (keeping 200 days of data) [2025-10-25T21:25:05.116314] [DEBUG] [LOCAL ] FBP: Primary data saved (46291 records). [2025-10-25T21:25:05.116469] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-25T21:25:05.116597] [INFO ] [MAIN ] Update Progress: 807/2366 symbols. FBP took 21.4s. Estimated remaining time: 4h 44m 32s [2025-10-25T21:25:05.282831] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:25:05.283023] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-25T21:25:05.283097] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-25T21:25:05.283210] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-25T21:25:05.283295] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-25T21:25:05.283400] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-25T21:25:05.283480] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-25T21:25:05.636260] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:25:05.636599] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-25T21:25:06.874853] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T21:25:06.880942] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-25T21:25:08.173520] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T21:25:08.179960] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-25T21:25:09.543569] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T21:25:09.550473] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-25T21:25:11.045313] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T21:25:11.054900] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-25T21:25:12.491778] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-25T21:25:12.499059] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-25T21:25:13.827263] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T21:25:13.834927] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-25T21:25:15.182431] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T21:25:15.190436] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-25T21:25:16.598303] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T21:25:16.605507] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-25T21:25:18.118203] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T21:25:18.125789] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-25T21:25:19.488263] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T21:25:19.496178] [INFO ] [REMOTE ] FBRT: Full fetch complete (49546 records). [2025-10-25T21:25:19.496348] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-25T21:25:19.886713] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-25T21:25:19.886855] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-25T21:25:19.887668] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-25T21:25:19.887754] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-25T21:25:19.889065] [DEBUG] [LOCAL ] FBRT: Trimmed 49546 records to 35665 (keeping 200 days of data) [2025-10-25T21:25:20.103725] [DEBUG] [LOCAL ] FBRT: Primary data saved (35665 records). [2025-10-25T21:25:20.103917] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-25T21:25:20.104051] [INFO ] [MAIN ] Update Progress: 808/2366 symbols. FBRT took 15.0s. Estimated remaining time: 4h 44m 29s [2025-10-25T21:25:20.275266] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:25:20.275494] [DEBUG] [LOCAL ] FC: No existing data file found in primary storage. [2025-10-25T21:25:20.275566] [WARN ] [MAIN ] FC: No existing data found, performing full refresh instead. [2025-10-25T21:25:20.275714] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-25T21:25:20.275786] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-25T21:25:20.275866] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-10-25T21:25:20.275934] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-25T21:25:20.631453] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:25:20.631825] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-25T21:25:21.645135] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T21:25:21.648556] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-25T21:25:22.511247] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T21:25:22.514662] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-25T21:25:23.532120] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T21:25:23.536354] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-25T21:25:24.590248] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T21:25:24.594868] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-25T21:25:25.392293] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T21:25:25.395028] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-25T21:25:26.215727] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T21:25:26.219047] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-25T21:25:27.263777] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T21:25:27.268440] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-25T21:25:28.173308] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T21:25:28.177094] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-25T21:25:29.145084] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T21:25:29.148686] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-25T21:25:30.033670] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T21:25:30.036555] [INFO ] [REMOTE ] FC: Full fetch complete (21903 records). [2025-10-25T21:25:30.036722] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-25T21:25:30.402546] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-25T21:25:30.402684] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-25T21:25:30.403253] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-25T21:25:30.403353] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-25T21:25:30.404058] [DEBUG] [LOCAL ] FC: Trimmed 21903 records to 14480 (keeping 200 days of data) [2025-10-25T21:25:30.484027] [DEBUG] [LOCAL ] FC: Primary data saved (14480 records). [2025-10-25T21:25:30.484194] [INFO ] [MAIN ] FC: Full history saved. [2025-10-25T21:25:30.484377] [INFO ] [MAIN ] Update Progress: 809/2366 symbols. FC took 10.4s. Estimated remaining time: 4h 44m 17s [2025-10-25T21:25:30.652688] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:25:30.652917] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-25T21:25:30.653005] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-25T21:25:30.653149] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-25T21:25:30.653225] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-25T21:25:30.653330] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-25T21:25:30.653413] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-25T21:25:31.008337] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:25:31.009637] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-25T21:25:33.253433] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-25T21:25:33.262065] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-25T21:25:34.627928] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T21:25:34.635465] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-25T21:25:36.248327] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:25:36.262841] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-25T21:25:37.794827] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T21:25:37.804723] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-25T21:25:39.224877] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T21:25:39.233413] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-25T21:25:41.998341] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-25T21:25:42.006210] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-25T21:25:43.550180] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T21:25:43.559278] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-25T21:25:44.930637] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T21:25:44.939288] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-25T21:25:46.316780] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T21:25:46.324908] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-25T21:25:47.772121] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T21:25:47.779426] [INFO ] [REMOTE ] FCF: Full fetch complete (58084 records). [2025-10-25T21:25:47.779551] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-25T21:25:48.171939] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-25T21:25:48.172054] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-25T21:25:48.172898] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-25T21:25:48.172977] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-25T21:25:48.174201] [DEBUG] [LOCAL ] FCF: Trimmed 58084 records to 39629 (keeping 200 days of data) [2025-10-25T21:25:48.403294] [DEBUG] [LOCAL ] FCF: Primary data saved (39629 records). [2025-10-25T21:25:48.403473] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-25T21:25:48.403623] [INFO ] [MAIN ] Update Progress: 810/2366 symbols. FCF took 17.9s. Estimated remaining time: 4h 44m 19s [2025-10-25T21:25:48.582605] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:25:48.582832] [DEBUG] [LOCAL ] FCN: No existing data file found in primary storage. [2025-10-25T21:25:48.582937] [WARN ] [MAIN ] FCN: No existing data found, performing full refresh instead. [2025-10-25T21:25:48.583087] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-25T21:25:48.583180] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-25T21:25:48.583293] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-10-25T21:25:48.583385] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-25T21:25:48.956203] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:25:48.956564] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-25T21:25:50.000557] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-25T21:25:50.004486] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-25T21:25:51.223063] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T21:25:51.227639] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-25T21:25:52.383925] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T21:25:52.389830] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-25T21:25:53.509363] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T21:25:53.516292] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-25T21:25:54.806422] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T21:25:54.812896] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-25T21:25:56.560040] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T21:25:56.565769] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-25T21:25:57.785106] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T21:25:57.791503] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-25T21:25:58.847767] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T21:25:58.852842] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-25T21:25:59.936552] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T21:25:59.941709] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-25T21:26:01.518819] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T21:26:01.524211] [INFO ] [REMOTE ] FCN: Full fetch complete (36617 records). [2025-10-25T21:26:01.524373] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-25T21:26:01.905675] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-25T21:26:01.905790] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-25T21:26:01.906489] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-25T21:26:01.906573] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-25T21:26:01.907457] [DEBUG] [LOCAL ] FCN: Trimmed 36617 records to 26423 (keeping 200 days of data) [2025-10-25T21:26:02.060062] [DEBUG] [LOCAL ] FCN: Primary data saved (26423 records). [2025-10-25T21:26:02.060240] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-25T21:26:02.060428] [INFO ] [MAIN ] Update Progress: 811/2366 symbols. FCN took 13.7s. Estimated remaining time: 4h 44m 13s [2025-10-25T21:26:02.230686] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:26:02.230935] [DEBUG] [LOCAL ] FCPT: No existing data file found in primary storage. [2025-10-25T21:26:02.231023] [WARN ] [MAIN ] FCPT: No existing data found, performing full refresh instead. [2025-10-25T21:26:02.231183] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-25T21:26:02.231293] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-25T21:26:02.231392] [DEBUG] [LOCAL ] FCPT: No primary data file found to delete. [2025-10-25T21:26:02.231476] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-25T21:26:02.591580] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:26:02.592070] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-25T21:26:04.048800] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T21:26:04.055711] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-25T21:26:05.403150] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T21:26:05.410101] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-25T21:26:07.042915] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T21:26:07.051534] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-25T21:26:08.533130] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T21:26:08.543149] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-25T21:26:09.924012] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T21:26:09.931724] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-25T21:26:11.415376] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T21:26:11.422744] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-25T21:26:12.784280] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T21:26:12.792554] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-25T21:26:14.199749] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T21:26:14.207165] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-25T21:26:15.614218] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T21:26:15.622945] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-25T21:26:17.046102] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T21:26:17.053268] [INFO ] [REMOTE ] FCPT: Full fetch complete (53768 records). [2025-10-25T21:26:17.053461] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-25T21:26:17.426042] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-25T21:26:17.426184] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-25T21:26:17.426957] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-25T21:26:17.427060] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-25T21:26:17.428305] [DEBUG] [LOCAL ] FCPT: Trimmed 53768 records to 37417 (keeping 200 days of data) [2025-10-25T21:26:17.646549] [DEBUG] [LOCAL ] FCPT: Primary data saved (37417 records). [2025-10-25T21:26:17.646751] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-25T21:26:17.646885] [INFO ] [MAIN ] Update Progress: 812/2366 symbols. FCPT took 15.6s. Estimated remaining time: 4h 44m 11s [2025-10-25T21:26:17.818988] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:26:17.819145] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-25T21:26:17.819215] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-25T21:26:17.819339] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-25T21:26:17.819411] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-25T21:26:17.819489] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-25T21:26:17.819558] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-25T21:26:18.165861] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:26:18.166206] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-25T21:26:18.608612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-25T21:26:18.609591] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-25T21:26:19.031339] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T21:26:19.032452] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-25T21:26:19.368318] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-25T21:26:19.369328] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-25T21:26:19.795754] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-25T21:26:19.796943] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-25T21:26:20.210386] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-25T21:26:20.211311] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-25T21:26:20.621903] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-25T21:26:20.622956] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-25T21:26:20.964700] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-25T21:26:20.965696] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-25T21:26:21.348908] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-25T21:26:21.350214] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-25T21:26:21.687122] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-25T21:26:21.688309] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-25T21:26:21.955633] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-25T21:26:21.956437] [INFO ] [REMOTE ] FCRX: Full fetch complete (1626 records). [2025-10-25T21:26:21.956534] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-25T21:26:21.956978] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted. [2025-10-25T21:26:21.957063] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:26:21.957149] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:26:21.957246] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-25T21:26:21.957366] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-25T21:26:21.957448] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-25T21:26:21.957551] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-25T21:26:21.957741] [INFO ] [MAIN ] Update Progress: 813/2366 symbols. FCRX took 4.3s. Estimated remaining time: 4h 43m 47s [2025-10-25T21:26:22.123678] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:26:22.123907] [DEBUG] [LOCAL ] FCT: No existing data file found in primary storage. [2025-10-25T21:26:22.124002] [WARN ] [MAIN ] FCT: No existing data found, performing full refresh instead. [2025-10-25T21:26:22.124151] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-25T21:26:22.124233] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-25T21:26:22.124330] [DEBUG] [LOCAL ] FCT: No primary data file found to delete. [2025-10-25T21:26:22.124416] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-25T21:26:22.495271] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:26:22.495707] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-25T21:26:23.429786] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T21:26:23.434042] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-25T21:26:24.295160] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T21:26:24.298023] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-25T21:26:25.238325] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T21:26:25.242586] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-25T21:26:26.169524] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-25T21:26:26.173336] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-25T21:26:26.931081] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T21:26:26.934122] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-25T21:26:27.941361] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T21:26:27.945302] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-25T21:26:28.900785] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T21:26:28.904945] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-25T21:26:29.800171] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T21:26:29.803535] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-25T21:26:30.788747] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T21:26:30.792853] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-25T21:26:31.724172] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T21:26:31.727842] [INFO ] [REMOTE ] FCT: Full fetch complete (21482 records). [2025-10-25T21:26:31.727965] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-25T21:26:32.095024] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-25T21:26:32.095156] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-25T21:26:32.095638] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-25T21:26:32.095727] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-25T21:26:32.096419] [DEBUG] [LOCAL ] FCT: Trimmed 21482 records to 15148 (keeping 200 days of data) [2025-10-25T21:26:32.182593] [DEBUG] [LOCAL ] FCT: Primary data saved (15148 records). [2025-10-25T21:26:32.182792] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-25T21:26:32.182929] [INFO ] [MAIN ] Update Progress: 814/2366 symbols. FCT took 10.2s. Estimated remaining time: 4h 43m 35s [2025-10-25T21:26:32.352841] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:26:32.353038] [DEBUG] [LOCAL ] FCX: No existing data file found in primary storage. [2025-10-25T21:26:32.353111] [WARN ] [MAIN ] FCX: No existing data found, performing full refresh instead. [2025-10-25T21:26:32.353226] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-25T21:26:32.353298] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-25T21:26:32.353380] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-10-25T21:26:32.353452] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-25T21:26:32.704823] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:26:32.705155] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-25T21:26:34.797582] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-25T21:26:34.808105] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-25T21:26:36.651461] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T21:26:36.664977] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-25T21:26:38.962199] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-25T21:26:38.974093] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-25T21:26:41.035045] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-25T21:26:41.046988] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-25T21:26:43.089891] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-25T21:26:43.102239] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-25T21:26:44.913945] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T21:26:44.928928] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-25T21:26:47.313550] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-25T21:26:47.325351] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-25T21:26:49.309061] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-25T21:26:49.320199] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-25T21:26:51.433684] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-25T21:26:51.444907] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-25T21:26:53.895881] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-25T21:26:53.905423] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-25T21:26:53.905561] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-25T21:26:54.296097] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-25T21:26:54.296213] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-25T21:26:54.297313] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-25T21:26:54.297394] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-25T21:26:54.298861] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54481 (keeping 200 days of data) [2025-10-25T21:26:54.617144] [DEBUG] [LOCAL ] FCX: Primary data saved (54481 records). [2025-10-25T21:26:54.617305] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-25T21:26:54.617412] [INFO ] [MAIN ] Update Progress: 815/2366 symbols. FCX took 22.4s. Estimated remaining time: 4h 43m 46s [2025-10-25T21:26:54.786845] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:26:54.787021] [DEBUG] [LOCAL ] FDP: No existing data file found in primary storage. [2025-10-25T21:26:54.787098] [WARN ] [MAIN ] FDP: No existing data found, performing full refresh instead. [2025-10-25T21:26:54.787189] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-25T21:26:54.787254] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-25T21:26:54.787313] [DEBUG] [LOCAL ] FDP: No primary data file found to delete. [2025-10-25T21:26:54.787373] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-25T21:26:55.143355] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:26:55.143740] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-25T21:26:56.143089] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T21:26:56.148477] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-25T21:26:57.366222] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T21:26:57.372221] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-25T21:26:58.668468] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-25T21:26:58.675377] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-25T21:27:00.035358] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-25T21:27:00.042517] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-25T21:27:01.758255] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T21:27:01.765451] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-25T21:27:03.115849] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T21:27:03.122291] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-25T21:27:04.483026] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T21:27:04.490085] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-25T21:27:05.910055] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T21:27:05.917272] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-25T21:27:07.212324] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T21:27:07.219907] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-25T21:27:08.378034] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T21:27:08.383345] [INFO ] [REMOTE ] FDP: Full fetch complete (42864 records). [2025-10-25T21:27:08.383480] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-25T21:27:08.770661] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-25T21:27:08.770782] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-25T21:27:08.771412] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-25T21:27:08.771485] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-25T21:27:08.772414] [DEBUG] [LOCAL ] FDP: Trimmed 42864 records to 30019 (keeping 200 days of data) [2025-10-25T21:27:08.946073] [DEBUG] [LOCAL ] FDP: Primary data saved (30019 records). [2025-10-25T21:27:08.946233] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-25T21:27:08.946374] [INFO ] [MAIN ] Update Progress: 816/2366 symbols. FDP took 14.3s. Estimated remaining time: 4h 43m 41s [2025-10-25T21:27:09.119214] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:27:09.119424] [DEBUG] [LOCAL ] FDS: No existing data file found in primary storage. [2025-10-25T21:27:09.119502] [WARN ] [MAIN ] FDS: No existing data found, performing full refresh instead. [2025-10-25T21:27:09.119608] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-25T21:27:09.119706] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-25T21:27:09.119792] [DEBUG] [LOCAL ] FDS: No primary data file found to delete. [2025-10-25T21:27:09.119863] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-25T21:27:09.485528] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:27:09.485908] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-25T21:27:10.584158] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T21:27:10.589819] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-25T21:27:11.744522] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T21:27:11.749126] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-25T21:27:13.077130] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T21:27:13.083166] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-25T21:27:14.242207] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T21:27:14.249319] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-25T21:27:15.498913] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-25T21:27:15.504012] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-25T21:27:16.695324] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T21:27:16.702273] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-25T21:27:17.784151] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T21:27:17.790103] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-25T21:27:19.175734] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T21:27:19.182168] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-25T21:27:19.912163] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-25T21:27:19.920592] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-25T21:27:21.543086] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T21:27:21.550945] [INFO ] [REMOTE ] FDS: Full fetch complete (39633 records). [2025-10-25T21:27:21.551093] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-25T21:27:21.945052] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-25T21:27:21.945165] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-25T21:27:21.945864] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-25T21:27:21.945945] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-25T21:27:21.946881] [DEBUG] [LOCAL ] FDS: Trimmed 39633 records to 28600 (keeping 200 days of data) [2025-10-25T21:27:22.118331] [DEBUG] [LOCAL ] FDS: Primary data saved (28600 records). [2025-10-25T21:27:22.118490] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-25T21:27:22.118622] [INFO ] [MAIN ] Update Progress: 817/2366 symbols. FDS took 13.2s. Estimated remaining time: 4h 43m 34s [2025-10-25T21:27:22.285256] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:27:22.285448] [DEBUG] [LOCAL ] FDX: No existing data file found in primary storage. [2025-10-25T21:27:22.285517] [WARN ] [MAIN ] FDX: No existing data found, performing full refresh instead. [2025-10-25T21:27:22.285604] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-25T21:27:22.285698] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-25T21:27:22.285780] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-10-25T21:27:22.285849] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-25T21:27:22.635020] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:27:22.635373] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-25T21:27:24.483783] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-25T21:27:24.493808] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-25T21:27:26.389825] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T21:27:26.399692] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-25T21:27:28.464377] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T21:27:28.475868] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-25T21:27:30.525743] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-25T21:27:30.536430] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-25T21:27:32.423248] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-25T21:27:32.437566] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-25T21:27:34.503853] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-25T21:27:34.514352] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-25T21:27:36.522062] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-25T21:27:36.533536] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-25T21:27:38.458122] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-25T21:27:38.469171] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-25T21:27:40.687463] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-25T21:27:40.698554] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-25T21:27:42.670108] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-25T21:27:42.679058] [INFO ] [REMOTE ] FDX: Full fetch complete (74146 records). [2025-10-25T21:27:42.679207] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-25T21:27:43.071660] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-25T21:27:43.071781] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-25T21:27:43.072694] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-25T21:27:43.072772] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-25T21:27:43.074246] [DEBUG] [LOCAL ] FDX: Trimmed 74146 records to 51851 (keeping 200 days of data) [2025-10-25T21:27:43.387248] [DEBUG] [LOCAL ] FDX: Primary data saved (51851 records). [2025-10-25T21:27:43.387412] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-25T21:27:43.387522] [INFO ] [MAIN ] Update Progress: 818/2366 symbols. FDX took 21.3s. Estimated remaining time: 4h 43m 43s [2025-10-25T21:27:43.554866] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:27:43.555047] [DEBUG] [LOCAL ] FE: No existing data file found in primary storage. [2025-10-25T21:27:43.555117] [WARN ] [MAIN ] FE: No existing data found, performing full refresh instead. [2025-10-25T21:27:43.555228] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-25T21:27:43.555297] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-25T21:27:43.555376] [DEBUG] [LOCAL ] FE: No primary data file found to delete. [2025-10-25T21:27:43.555443] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-25T21:27:43.913069] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:27:43.913490] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-25T21:27:45.449058] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T21:27:45.461498] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-25T21:27:47.166352] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T21:27:47.177746] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-25T21:27:48.930918] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T21:27:48.941984] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-25T21:27:50.793224] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T21:27:50.805603] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-25T21:27:52.286737] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T21:27:52.298225] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-25T21:27:53.866487] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T21:27:53.877212] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-25T21:27:55.639461] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-25T21:27:55.650891] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-25T21:27:57.485783] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-25T21:27:57.499907] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-25T21:27:59.213910] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T21:27:59.225207] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-25T21:28:01.126083] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-25T21:28:01.135633] [INFO ] [REMOTE ] FE: Full fetch complete (77493 records). [2025-10-25T21:28:01.135814] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-25T21:28:01.523043] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-25T21:28:01.523159] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-25T21:28:01.524083] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-25T21:28:01.524162] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-25T21:28:01.525563] [DEBUG] [LOCAL ] FE: Trimmed 77493 records to 54210 (keeping 200 days of data) [2025-10-25T21:28:01.844893] [DEBUG] [LOCAL ] FE: Primary data saved (54210 records). [2025-10-25T21:28:01.845085] [INFO ] [MAIN ] FE: Full history saved. [2025-10-25T21:28:01.845220] [INFO ] [MAIN ] Update Progress: 819/2366 symbols. FE took 18.5s. Estimated remaining time: 4h 43m 46s [2025-10-25T21:28:02.018454] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:28:02.018697] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-25T21:28:02.018791] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-25T21:28:02.018915] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-25T21:28:02.018986] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-25T21:28:02.019067] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-25T21:28:02.019137] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-25T21:28:02.416961] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:28:02.417313] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-25T21:28:02.855489] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-25T21:28:02.856473] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-25T21:28:03.330365] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T21:28:03.331465] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-25T21:28:03.761813] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-25T21:28:03.762963] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-25T21:28:04.224750] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-25T21:28:04.226029] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-25T21:28:04.676356] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-25T21:28:04.677463] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-25T21:28:05.048603] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-25T21:28:05.049586] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-25T21:28:05.478481] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-25T21:28:05.479490] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-25T21:28:05.811274] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-25T21:28:05.812383] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-25T21:28:06.318719] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-25T21:28:06.320070] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-25T21:28:06.685720] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-25T21:28:06.686555] [INFO ] [REMOTE ] FENG: Full fetch complete (2265 records). [2025-10-25T21:28:06.686662] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-25T21:28:06.865030] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T21:28:06.865254] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:28:06.865327] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:28:06.865404] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-25T21:28:06.865497] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-25T21:28:06.865569] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-25T21:28:06.865678] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-25T21:28:06.865804] [INFO ] [MAIN ] Update Progress: 820/2366 symbols. FENG took 5.0s. Estimated remaining time: 4h 43m 24s [2025-10-25T21:28:07.033339] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:28:07.033530] [DEBUG] [LOCAL ] FERG: No existing data file found in primary storage. [2025-10-25T21:28:07.033600] [WARN ] [MAIN ] FERG: No existing data found, performing full refresh instead. [2025-10-25T21:28:07.033737] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-25T21:28:07.033810] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-25T21:28:07.033872] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-10-25T21:28:07.033936] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-25T21:28:07.388255] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:28:07.388604] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-25T21:28:09.173635] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T21:28:09.183545] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-25T21:28:10.664203] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:28:10.676332] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-25T21:28:12.668800] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T21:28:12.679419] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-25T21:28:14.659030] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-25T21:28:14.670493] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-25T21:28:16.278199] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T21:28:16.289169] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-25T21:28:17.964362] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-25T21:28:17.975434] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-25T21:28:19.658728] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T21:28:19.669581] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-25T21:28:21.181214] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T21:28:21.190776] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-25T21:28:23.055676] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T21:28:23.066689] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-25T21:28:24.568949] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T21:28:24.578313] [INFO ] [REMOTE ] FERG: Full fetch complete (71243 records). [2025-10-25T21:28:24.578470] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-25T21:28:25.015241] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-25T21:28:25.015722] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-25T21:28:25.018012] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-25T21:28:25.018240] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-25T21:28:25.020630] [DEBUG] [LOCAL ] FERG: Trimmed 71243 records to 49424 (keeping 200 days of data) [2025-10-25T21:28:25.444631] [DEBUG] [LOCAL ] FERG: Primary data saved (49424 records). [2025-10-25T21:28:25.444962] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-25T21:28:25.445200] [INFO ] [MAIN ] Update Progress: 821/2366 symbols. FERG took 18.6s. Estimated remaining time: 4h 43m 27s [2025-10-25T21:28:25.663389] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:28:25.663708] [DEBUG] [LOCAL ] FET: No existing data file found in primary storage. [2025-10-25T21:28:25.663784] [WARN ] [MAIN ] FET: No existing data found, performing full refresh instead. [2025-10-25T21:28:25.663921] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-25T21:28:25.663997] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-25T21:28:25.664081] [DEBUG] [LOCAL ] FET: No primary data file found to delete. [2025-10-25T21:28:25.664154] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-25T21:28:26.068745] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:28:26.069238] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-25T21:28:26.842380] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-25T21:28:26.845581] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-25T21:28:27.441298] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T21:28:27.444136] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-25T21:28:28.312384] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-25T21:28:28.315997] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-25T21:28:29.113439] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-25T21:28:29.116812] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-25T21:28:29.656625] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-25T21:28:29.659169] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-25T21:28:30.527479] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T21:28:30.530685] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-25T21:28:31.434766] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T21:28:31.438519] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-25T21:28:32.382282] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-25T21:28:32.386461] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-25T21:28:33.463608] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T21:28:33.469061] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-25T21:28:34.341204] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T21:28:34.344734] [INFO ] [REMOTE ] FET: Full fetch complete (18562 records). [2025-10-25T21:28:34.344912] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-25T21:28:34.751601] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-25T21:28:34.751756] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-25T21:28:34.752248] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-25T21:28:34.752330] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-25T21:28:34.752930] [DEBUG] [LOCAL ] FET: Trimmed 18562 records to 13196 (keeping 200 days of data) [2025-10-25T21:28:34.833973] [DEBUG] [LOCAL ] FET: Primary data saved (13196 records). [2025-10-25T21:28:34.834131] [INFO ] [MAIN ] FET: Full history saved. [2025-10-25T21:28:34.834266] [INFO ] [MAIN ] Update Progress: 822/2366 symbols. FET took 9.4s. Estimated remaining time: 4h 43m 13s [2025-10-25T21:28:35.027940] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:28:35.028153] [DEBUG] [LOCAL ] FF: No existing data file found in primary storage. [2025-10-25T21:28:35.028228] [WARN ] [MAIN ] FF: No existing data found, performing full refresh instead. [2025-10-25T21:28:35.028344] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-25T21:28:35.028417] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-25T21:28:35.028499] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-10-25T21:28:35.028572] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-25T21:28:35.457162] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:28:35.457631] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-25T21:28:36.568121] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T21:28:36.573567] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-25T21:28:37.762197] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-25T21:28:37.767416] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-25T21:28:39.149833] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T21:28:39.156480] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-25T21:28:40.630380] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T21:28:40.637404] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-25T21:28:41.819694] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T21:28:41.825471] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-25T21:28:42.999992] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T21:28:43.006059] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-25T21:28:44.108037] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T21:28:44.113167] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-25T21:28:45.246993] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T21:28:45.252201] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-25T21:28:46.263300] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T21:28:46.268280] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-25T21:28:47.260064] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T21:28:47.264810] [INFO ] [REMOTE ] FF: Full fetch complete (36293 records). [2025-10-25T21:28:47.264947] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-25T21:28:47.651578] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-25T21:28:47.651775] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-25T21:28:47.652450] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-25T21:28:47.652535] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-25T21:28:47.653498] [DEBUG] [LOCAL ] FF: Trimmed 36293 records to 23887 (keeping 200 days of data) [2025-10-25T21:28:47.784492] [DEBUG] [LOCAL ] FF: Primary data saved (23887 records). [2025-10-25T21:28:47.784676] [INFO ] [MAIN ] FF: Full history saved. [2025-10-25T21:28:47.784875] [INFO ] [MAIN ] Update Progress: 823/2366 symbols. FF took 13.0s. Estimated remaining time: 4h 43m 6s [2025-10-25T21:28:47.956555] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:28:47.956756] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-10-25T21:28:47.956827] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-10-25T21:28:47.956918] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-25T21:28:47.956986] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-25T21:28:47.957046] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-25T21:28:47.957087] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-25T21:28:48.318983] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:28:48.319321] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-25T21:28:48.986758] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-25T21:28:48.990032] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-25T21:28:49.662311] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T21:28:49.663962] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-25T21:28:50.364444] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-25T21:28:50.367467] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-25T21:28:51.108393] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T21:28:51.111277] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-25T21:28:51.677970] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T21:28:51.679607] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-25T21:28:52.182570] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-25T21:28:52.184275] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-25T21:28:52.831617] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-25T21:28:52.833322] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-25T21:28:53.523768] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-25T21:28:53.526358] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-25T21:28:54.248690] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T21:28:54.250875] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-25T21:28:54.925102] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T21:28:54.927215] [INFO ] [REMOTE ] FFA: Full fetch complete (8635 records). [2025-10-25T21:28:54.927316] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-25T21:28:55.317980] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-25T21:28:55.318126] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-25T21:28:55.318486] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-25T21:28:55.318567] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-25T21:28:55.319060] [DEBUG] [LOCAL ] FFA: Trimmed 8635 records to 5642 (keeping 200 days of data) [2025-10-25T21:28:55.357010] [DEBUG] [LOCAL ] FFA: Primary data saved (5642 records). [2025-10-25T21:28:55.357228] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-25T21:28:55.357401] [INFO ] [MAIN ] Update Progress: 824/2366 symbols. FFA took 7.6s. Estimated remaining time: 4h 42m 48s [2025-10-25T21:28:55.534065] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:28:55.534379] [DEBUG] [LOCAL ] FFC: No existing data file found in primary storage. [2025-10-25T21:28:55.534454] [WARN ] [MAIN ] FFC: No existing data found, performing full refresh instead. [2025-10-25T21:28:55.534584] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-25T21:28:55.534683] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-25T21:28:55.534768] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-10-25T21:28:55.534842] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-25T21:28:55.891002] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:28:55.891426] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-25T21:28:56.972185] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-25T21:28:56.976814] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-25T21:28:58.073218] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T21:28:58.077394] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-25T21:28:59.056230] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T21:28:59.060201] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-25T21:29:00.043761] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T21:29:00.048989] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-25T21:29:01.125791] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T21:29:01.132262] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-25T21:29:02.435762] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T21:29:02.440218] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-25T21:29:03.865424] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T21:29:03.869765] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-25T21:29:04.862953] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T21:29:04.867219] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-25T21:29:05.901016] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T21:29:05.905455] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-25T21:29:06.827256] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T21:29:06.830822] [INFO ] [REMOTE ] FFC: Full fetch complete (24505 records). [2025-10-25T21:29:06.830946] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-25T21:29:07.199740] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-25T21:29:07.199864] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-25T21:29:07.200462] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-25T21:29:07.200569] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-25T21:29:07.201324] [DEBUG] [LOCAL ] FFC: Trimmed 24505 records to 16845 (keeping 200 days of data) [2025-10-25T21:29:07.300915] [DEBUG] [LOCAL ] FFC: Primary data saved (16845 records). [2025-10-25T21:29:07.301098] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-25T21:29:07.301288] [INFO ] [MAIN ] Update Progress: 825/2366 symbols. FFC took 11.9s. Estimated remaining time: 4h 42m 39s [2025-10-25T21:29:07.472976] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:29:07.473209] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-10-25T21:29:07.473282] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-10-25T21:29:07.473403] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-25T21:29:07.473470] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-25T21:29:07.473529] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-10-25T21:29:07.473590] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-25T21:29:07.825181] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:29:07.825537] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-25T21:29:09.080625] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T21:29:09.087739] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-25T21:29:10.345089] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T21:29:10.352180] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-25T21:29:11.645241] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T21:29:11.652991] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-25T21:29:13.171052] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T21:29:13.182456] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-25T21:29:14.510454] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T21:29:14.518486] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-25T21:29:15.829285] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T21:29:15.839035] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-25T21:29:17.371721] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T21:29:17.380446] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-25T21:29:18.777514] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T21:29:18.785128] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-25T21:29:20.018759] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T21:29:20.025765] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-25T21:29:21.442676] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T21:29:21.449183] [INFO ] [REMOTE ] FFWM: Full fetch complete (51882 records). [2025-10-25T21:29:21.449308] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-25T21:29:21.827128] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-25T21:29:21.827237] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-25T21:29:21.827999] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-25T21:29:21.828078] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-25T21:29:21.829127] [DEBUG] [LOCAL ] FFWM: Trimmed 51882 records to 36144 (keeping 200 days of data) [2025-10-25T21:29:22.028195] [DEBUG] [LOCAL ] FFWM: Primary data saved (36144 records). [2025-10-25T21:29:22.028355] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-25T21:29:22.028487] [INFO ] [MAIN ] Update Progress: 826/2366 symbols. FFWM took 14.7s. Estimated remaining time: 4h 42m 35s [2025-10-25T21:29:22.197944] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:29:22.198167] [DEBUG] [LOCAL ] FG: No existing data file found in primary storage. [2025-10-25T21:29:22.198260] [WARN ] [MAIN ] FG: No existing data found, performing full refresh instead. [2025-10-25T21:29:22.198376] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-25T21:29:22.198445] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-25T21:29:22.198526] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-10-25T21:29:22.198595] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-25T21:29:22.544803] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:29:22.545147] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-25T21:29:23.376061] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-25T21:29:23.378722] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-25T21:29:24.253158] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-25T21:29:24.256056] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-25T21:29:25.313073] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T21:29:25.318347] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-25T21:29:26.627475] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T21:29:26.639230] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-25T21:29:27.709738] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T21:29:27.715272] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-25T21:29:28.754688] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T21:29:28.759258] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-25T21:29:29.784339] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T21:29:29.789509] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-25T21:29:31.009902] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T21:29:31.014544] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-25T21:29:32.050625] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T21:29:32.055360] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-25T21:29:33.014115] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-25T21:29:33.018308] [INFO ] [REMOTE ] FG: Full fetch complete (28969 records). [2025-10-25T21:29:33.018420] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-25T21:29:33.383601] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-25T21:29:33.383740] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-25T21:29:33.384294] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-25T21:29:33.384373] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-25T21:29:33.385126] [DEBUG] [LOCAL ] FG: Trimmed 28969 records to 21546 (keeping 200 days of data) [2025-10-25T21:29:33.508007] [DEBUG] [LOCAL ] FG: Primary data saved (21546 records). [2025-10-25T21:29:33.508159] [INFO ] [MAIN ] FG: Full history saved. [2025-10-25T21:29:33.508291] [INFO ] [MAIN ] Update Progress: 827/2366 symbols. FG took 11.5s. Estimated remaining time: 4h 42m 25s [2025-10-25T21:29:33.674604] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:29:33.674812] [DEBUG] [LOCAL ] FGN: No existing data file found in primary storage. [2025-10-25T21:29:33.674882] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-10-25T21:29:33.675001] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-25T21:29:33.675069] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-25T21:29:33.675127] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-25T21:29:33.675188] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-25T21:29:34.029730] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:29:34.030080] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-25T21:29:34.673362] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T21:29:34.675147] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-25T21:29:35.244418] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T21:29:35.245993] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-25T21:29:35.997839] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T21:29:35.999752] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-25T21:29:36.593438] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-25T21:29:36.595394] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-25T21:29:37.130471] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-25T21:29:37.132173] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-25T21:29:37.751779] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T21:29:37.753915] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-25T21:29:38.300123] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-25T21:29:38.301758] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-25T21:29:38.861827] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-25T21:29:38.863551] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-25T21:29:39.344229] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-25T21:29:39.346048] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-25T21:29:39.796634] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-25T21:29:39.797794] [INFO ] [REMOTE ] FGN: Full fetch complete (5440 records). [2025-10-25T21:29:39.797888] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-25T21:29:40.159718] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-25T21:29:40.159846] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-25T21:29:40.160088] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-25T21:29:40.160167] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-25T21:29:40.160604] [DEBUG] [LOCAL ] FGN: Trimmed 5440 records to 3584 (keeping 200 days of data) [2025-10-25T21:29:40.183858] [DEBUG] [LOCAL ] FGN: Primary data saved (3584 records). [2025-10-25T21:29:40.184035] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-25T21:29:40.184184] [INFO ] [MAIN ] Update Progress: 828/2366 symbols. FGN took 6.7s. Estimated remaining time: 4h 42m 6s [2025-10-25T21:29:40.349555] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:29:40.349804] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-25T21:29:40.349895] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-25T21:29:40.350041] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-25T21:29:40.350132] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-25T21:29:40.350239] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-25T21:29:40.350323] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-25T21:29:40.699186] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:29:40.699524] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-25T21:29:41.410475] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-25T21:29:41.413485] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-25T21:29:42.022821] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T21:29:42.024678] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-25T21:29:42.625561] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T21:29:42.627286] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-25T21:29:43.345090] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T21:29:43.347459] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-25T21:29:43.878969] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-25T21:29:43.880416] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-25T21:29:44.490744] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T21:29:44.492969] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-25T21:29:45.087065] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-25T21:29:45.089949] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-25T21:29:45.675325] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T21:29:45.677397] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-25T21:29:46.239788] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-25T21:29:46.241499] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-25T21:29:46.739755] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-25T21:29:46.741112] [INFO ] [REMOTE ] FGSN: Full fetch complete (8124 records). [2025-10-25T21:29:46.741203] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-25T21:29:46.942285] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-25T21:29:46.942511] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:29:46.942587] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:29:46.942693] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-25T21:29:46.942790] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-25T21:29:46.942861] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-25T21:29:46.942922] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-25T21:29:46.943065] [INFO ] [MAIN ] Update Progress: 829/2366 symbols. FGSN took 6.8s. Estimated remaining time: 4h 41m 47s [2025-10-25T21:29:47.128341] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:29:47.128520] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-10-25T21:29:47.128617] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-10-25T21:29:47.128773] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-25T21:29:47.128856] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-25T21:29:47.128944] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-25T21:29:47.129034] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-25T21:29:47.524144] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:29:47.524523] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-25T21:29:49.100341] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T21:29:49.108340] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-25T21:29:50.473927] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T21:29:50.481090] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-25T21:29:52.010089] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T21:29:52.019618] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-25T21:29:53.459000] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T21:29:53.470070] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-25T21:29:54.857863] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T21:29:54.867065] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-25T21:29:56.179054] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T21:29:56.187366] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-25T21:29:57.655920] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T21:29:57.664631] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-25T21:29:58.861004] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T21:29:58.870109] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-25T21:29:59.933026] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T21:29:59.941023] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-25T21:30:01.476055] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T21:30:01.482601] [INFO ] [REMOTE ] FHI: Full fetch complete (57372 records). [2025-10-25T21:30:01.482788] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-25T21:30:01.913463] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-25T21:30:01.913577] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-25T21:30:01.914399] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-25T21:30:01.914476] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-25T21:30:01.915665] [DEBUG] [LOCAL ] FHI: Trimmed 57372 records to 39980 (keeping 200 days of data) [2025-10-25T21:30:02.157443] [DEBUG] [LOCAL ] FHI: Primary data saved (39980 records). [2025-10-25T21:30:02.157616] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-25T21:30:02.157768] [INFO ] [MAIN ] Update Progress: 830/2366 symbols. FHI took 15.2s. Estimated remaining time: 4h 41m 44s [2025-10-25T21:30:02.335916] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:30:02.336105] [DEBUG] [LOCAL ] FHN: No existing data file found in primary storage. [2025-10-25T21:30:02.336177] [WARN ] [MAIN ] FHN: No existing data found, performing full refresh instead. [2025-10-25T21:30:02.336292] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-25T21:30:02.336363] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-25T21:30:02.336445] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-25T21:30:02.336517] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-25T21:30:02.716373] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:30:02.716851] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-25T21:30:04.783705] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-25T21:30:04.794136] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-25T21:30:06.646140] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-25T21:30:06.656221] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-25T21:30:08.450449] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T21:30:08.461484] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-25T21:30:10.270007] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T21:30:10.281766] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-25T21:30:12.122120] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-25T21:30:12.135618] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-25T21:30:13.839465] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T21:30:13.849988] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-25T21:30:15.352638] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T21:30:15.364163] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-25T21:30:17.275595] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-25T21:30:17.286817] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-25T21:30:18.664101] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T21:30:18.675926] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-25T21:30:20.575538] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-25T21:30:20.585749] [INFO ] [REMOTE ] FHN: Full fetch complete (77479 records). [2025-10-25T21:30:20.585973] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-25T21:30:20.999402] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-25T21:30:20.999576] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-25T21:30:21.001109] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-25T21:30:21.001284] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-25T21:30:21.003373] [DEBUG] [LOCAL ] FHN: Trimmed 77479 records to 54179 (keeping 200 days of data) [2025-10-25T21:30:21.349568] [DEBUG] [LOCAL ] FHN: Primary data saved (54179 records). [2025-10-25T21:30:21.349795] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-25T21:30:21.349965] [INFO ] [MAIN ] Update Progress: 831/2366 symbols. FHN took 19.2s. Estimated remaining time: 4h 41m 48s [2025-10-25T21:30:21.540625] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:30:21.540869] [DEBUG] [LOCAL ] FI: No existing data file found in primary storage. [2025-10-25T21:30:21.540948] [WARN ] [MAIN ] FI: No existing data found, performing full refresh instead. [2025-10-25T21:30:21.541081] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-25T21:30:21.541175] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-25T21:30:21.541260] [DEBUG] [LOCAL ] FI: No primary data file found to delete. [2025-10-25T21:30:21.541331] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-25T21:30:21.955206] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:30:21.955551] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-25T21:30:23.718035] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T21:30:23.729383] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-25T21:30:25.439530] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T21:30:25.450773] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-25T21:30:27.328486] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T21:30:27.341862] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-25T21:30:29.307956] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-25T21:30:29.319942] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-25T21:30:31.263322] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-25T21:30:31.274454] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-25T21:30:33.432074] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-25T21:30:33.443329] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-25T21:30:35.591663] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-25T21:30:35.603248] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-25T21:30:37.464481] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-25T21:30:37.476964] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-25T21:30:39.456400] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-25T21:30:39.467556] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-25T21:30:41.352507] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T21:30:41.362765] [INFO ] [REMOTE ] FI: Full fetch complete (77493 records). [2025-10-25T21:30:41.362926] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-25T21:30:41.822157] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-25T21:30:41.822279] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-25T21:30:41.823215] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-25T21:30:41.823296] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-25T21:30:41.824733] [DEBUG] [LOCAL ] FI: Trimmed 77493 records to 54355 (keeping 200 days of data) [2025-10-25T21:30:42.139869] [DEBUG] [LOCAL ] FI: Primary data saved (54355 records). [2025-10-25T21:30:42.140033] [INFO ] [MAIN ] FI: Full history saved. [2025-10-25T21:30:42.140168] [INFO ] [MAIN ] Update Progress: 832/2366 symbols. FI took 20.8s. Estimated remaining time: 4h 41m 55s [2025-10-25T21:30:42.303628] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:30:42.303828] [DEBUG] [LOCAL ] FICO: No existing data file found in primary storage. [2025-10-25T21:30:42.303899] [WARN ] [MAIN ] FICO: No existing data found, performing full refresh instead. [2025-10-25T21:30:42.304012] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-25T21:30:42.304082] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-25T21:30:42.304163] [DEBUG] [LOCAL ] FICO: No primary data file found to delete. [2025-10-25T21:30:42.304233] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-25T21:30:42.655928] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:30:42.656317] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-25T21:30:43.765118] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T21:30:43.770107] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-25T21:30:44.827118] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T21:30:44.831427] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-25T21:30:45.887391] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T21:30:45.891221] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-25T21:30:46.990437] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T21:30:46.994473] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-25T21:30:48.144414] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-25T21:30:48.151797] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-25T21:30:49.243607] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T21:30:49.248197] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-25T21:30:50.670431] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T21:30:50.676477] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-25T21:30:51.965123] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T21:30:51.973615] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-25T21:30:53.045586] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T21:30:53.050227] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-25T21:30:54.038275] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T21:30:54.046109] [INFO ] [REMOTE ] FICO: Full fetch complete (30140 records). [2025-10-25T21:30:54.046324] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-25T21:30:54.421907] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-25T21:30:54.422023] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-25T21:30:54.422790] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-25T21:30:54.422868] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-25T21:30:54.423692] [DEBUG] [LOCAL ] FICO: Trimmed 30140 records to 22292 (keeping 200 days of data) [2025-10-25T21:30:54.556368] [DEBUG] [LOCAL ] FICO: Primary data saved (22292 records). [2025-10-25T21:30:54.556524] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-25T21:30:54.556678] [INFO ] [MAIN ] Update Progress: 833/2366 symbols. FICO took 12.4s. Estimated remaining time: 4h 41m 46s [2025-10-25T21:30:54.727178] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:30:54.727391] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-25T21:30:54.727465] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-25T21:30:54.727584] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-25T21:30:54.727681] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-25T21:30:54.727758] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-25T21:30:54.727823] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-25T21:30:55.088835] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:30:55.089218] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-25T21:30:55.322241] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-25T21:30:55.323046] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-25T21:30:55.561116] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-25T21:30:55.562040] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-25T21:30:55.801147] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-25T21:30:55.802063] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-25T21:30:56.134425] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-25T21:30:56.135397] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-25T21:30:56.446511] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-25T21:30:56.447476] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-25T21:30:56.648904] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T21:30:56.649274] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-25T21:30:56.649361] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T21:30:56.649459] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-25T21:30:56.649527] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T21:30:56.649602] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-25T21:30:56.649738] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-25T21:30:56.649811] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-25T21:30:56.649892] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-25T21:30:56.650000] [INFO ] [MAIN ] Update Progress: 834/2366 symbols. FIG took 2.1s. Estimated remaining time: 4h 41m 19s [2025-10-25T21:30:56.843371] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:30:56.843576] [DEBUG] [LOCAL ] FIGS: No existing data file found in primary storage. [2025-10-25T21:30:56.843670] [WARN ] [MAIN ] FIGS: No existing data found, performing full refresh instead. [2025-10-25T21:30:56.843786] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-25T21:30:56.843857] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-25T21:30:56.843937] [DEBUG] [LOCAL ] FIGS: No primary data file found to delete. [2025-10-25T21:30:56.844007] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-25T21:30:57.189946] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:30:57.190271] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-25T21:30:58.677709] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-25T21:30:58.687277] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-25T21:31:00.199965] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T21:31:00.209335] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-25T21:31:01.921223] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T21:31:01.931951] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-25T21:31:03.592099] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T21:31:03.602186] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-25T21:31:05.171383] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T21:31:05.181816] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-25T21:31:06.694482] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T21:31:06.704431] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-25T21:31:08.359981] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-25T21:31:08.370576] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-25T21:31:09.942170] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T21:31:09.956289] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-25T21:31:11.449783] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T21:31:11.461252] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-25T21:31:13.245315] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-25T21:31:13.254149] [INFO ] [REMOTE ] FIGS: Full fetch complete (70738 records). [2025-10-25T21:31:13.254343] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-25T21:31:13.656799] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-25T21:31:13.656950] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-25T21:31:13.657836] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-25T21:31:13.657936] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-25T21:31:13.659310] [DEBUG] [LOCAL ] FIGS: Trimmed 70738 records to 49150 (keeping 200 days of data) [2025-10-25T21:31:13.922207] [DEBUG] [LOCAL ] FIGS: Primary data saved (49150 records). [2025-10-25T21:31:13.922384] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-25T21:31:13.922522] [INFO ] [MAIN ] Update Progress: 835/2366 symbols. FIGS took 17.3s. Estimated remaining time: 4h 41m 19s [2025-10-25T21:31:14.088156] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:31:14.088352] [DEBUG] [LOCAL ] FIHL: No existing data file found in primary storage. [2025-10-25T21:31:14.088422] [WARN ] [MAIN ] FIHL: No existing data found, performing full refresh instead. [2025-10-25T21:31:14.088534] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-25T21:31:14.088605] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-25T21:31:14.088856] [DEBUG] [LOCAL ] FIHL: No primary data file found to delete. [2025-10-25T21:31:14.088927] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-25T21:31:14.475015] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:31:14.475412] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-25T21:31:15.935937] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T21:31:15.942490] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-25T21:31:17.420350] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:31:17.427290] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-25T21:31:19.034624] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:31:19.044219] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-25T21:31:20.790733] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T21:31:20.800072] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-25T21:31:22.898886] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-25T21:31:22.906977] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-25T21:31:24.359750] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T21:31:24.368826] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-25T21:31:25.759982] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T21:31:25.769009] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-25T21:31:27.133577] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T21:31:27.142370] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-25T21:31:28.581521] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T21:31:28.592395] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-25T21:31:30.007690] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T21:31:30.014566] [INFO ] [REMOTE ] FIHL: Full fetch complete (56367 records). [2025-10-25T21:31:30.014713] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-25T21:31:30.402262] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-25T21:31:30.402375] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-25T21:31:30.403154] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-25T21:31:30.403274] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-25T21:31:30.404425] [DEBUG] [LOCAL ] FIHL: Trimmed 56367 records to 39562 (keeping 200 days of data) [2025-10-25T21:31:30.632257] [DEBUG] [LOCAL ] FIHL: Primary data saved (39562 records). [2025-10-25T21:31:30.632422] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-25T21:31:30.632559] [INFO ] [MAIN ] Update Progress: 836/2366 symbols. FIHL took 16.7s. Estimated remaining time: 4h 41m 19s [2025-10-25T21:31:30.808227] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:31:30.808418] [DEBUG] [LOCAL ] FINS: No existing data file found in primary storage. [2025-10-25T21:31:30.808490] [WARN ] [MAIN ] FINS: No existing data found, performing full refresh instead. [2025-10-25T21:31:30.808603] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-25T21:31:30.808695] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-25T21:31:30.808780] [DEBUG] [LOCAL ] FINS: No primary data file found to delete. [2025-10-25T21:31:30.808833] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-25T21:31:31.167799] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:31:31.168177] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-25T21:31:32.028332] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T21:31:32.030966] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-25T21:31:33.448063] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T21:31:33.450137] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-25T21:31:34.064381] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-25T21:31:34.066281] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-25T21:31:34.812719] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T21:31:34.815256] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-25T21:31:35.601668] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T21:31:35.604545] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-25T21:31:36.184890] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-25T21:31:36.187700] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-25T21:31:36.680171] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-25T21:31:36.682628] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-25T21:31:37.273606] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T21:31:37.275630] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-25T21:31:37.976497] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T21:31:37.978706] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-25T21:31:38.637823] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-25T21:31:38.639553] [INFO ] [REMOTE ] FINS: Full fetch complete (11581 records). [2025-10-25T21:31:38.639671] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-25T21:31:39.021735] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-25T21:31:39.021854] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-25T21:31:39.022183] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-25T21:31:39.022278] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-25T21:31:39.022863] [DEBUG] [LOCAL ] FINS: Trimmed 11581 records to 8341 (keeping 200 days of data) [2025-10-25T21:31:39.072923] [DEBUG] [LOCAL ] FINS: Primary data saved (8341 records). [2025-10-25T21:31:39.073086] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-25T21:31:39.073240] [INFO ] [MAIN ] Update Progress: 837/2366 symbols. FINS took 8.4s. Estimated remaining time: 4h 41m 3s [2025-10-25T21:31:39.249200] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:31:39.249399] [DEBUG] [LOCAL ] FINV: No existing data file found in primary storage. [2025-10-25T21:31:39.249478] [WARN ] [MAIN ] FINV: No existing data found, performing full refresh instead. [2025-10-25T21:31:39.249606] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-25T21:31:39.249699] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-25T21:31:39.249780] [DEBUG] [LOCAL ] FINV: No primary data file found to delete. [2025-10-25T21:31:39.249850] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-25T21:31:39.618412] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:31:39.618810] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-25T21:31:41.035924] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T21:31:41.044193] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-25T21:31:42.471860] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T21:31:42.480415] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-25T21:31:43.908116] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-25T21:31:43.917252] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-25T21:31:45.409720] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T21:31:45.422171] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-25T21:31:46.814361] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T21:31:46.823300] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-25T21:31:48.168479] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T21:31:48.177109] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-25T21:31:49.959746] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T21:31:49.970441] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-25T21:31:51.709906] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T21:31:51.720332] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-25T21:31:53.237115] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T21:31:53.247196] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-25T21:31:54.730731] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-25T21:31:54.739364] [INFO ] [REMOTE ] FINV: Full fetch complete (64991 records). [2025-10-25T21:31:54.739552] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-25T21:31:55.124479] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-25T21:31:55.124590] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-25T21:31:55.125435] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-25T21:31:55.125515] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-25T21:31:55.126808] [DEBUG] [LOCAL ] FINV: Trimmed 64991 records to 45901 (keeping 200 days of data) [2025-10-25T21:31:55.379696] [DEBUG] [LOCAL ] FINV: Primary data saved (45901 records). [2025-10-25T21:31:55.379869] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-25T21:31:55.380034] [INFO ] [MAIN ] Update Progress: 838/2366 symbols. FINV took 16.3s. Estimated remaining time: 4h 41m 1s [2025-10-25T21:31:55.549241] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:31:55.549435] [DEBUG] [LOCAL ] FIS: No existing data file found in primary storage. [2025-10-25T21:31:55.549524] [WARN ] [MAIN ] FIS: No existing data found, performing full refresh instead. [2025-10-25T21:31:55.549684] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-25T21:31:55.549774] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-25T21:31:55.549888] [DEBUG] [LOCAL ] FIS: No primary data file found to delete. [2025-10-25T21:31:55.549974] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-25T21:31:55.905807] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:31:55.906127] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-25T21:31:57.527635] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T21:31:57.537981] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-25T21:31:59.198163] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T21:31:59.211511] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-25T21:32:01.298804] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-25T21:32:01.311039] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-25T21:32:03.390391] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-25T21:32:03.401872] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-25T21:32:05.188936] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-25T21:32:05.200492] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-25T21:32:06.819018] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T21:32:06.830180] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-25T21:32:08.458438] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:32:08.470045] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-25T21:32:10.121340] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-25T21:32:10.132702] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-25T21:32:11.804410] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T21:32:11.816123] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-25T21:32:13.463949] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T21:32:13.473627] [INFO ] [REMOTE ] FIS: Full fetch complete (77394 records). [2025-10-25T21:32:13.473822] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-25T21:32:13.873216] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-25T21:32:13.873398] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-25T21:32:13.874347] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-25T21:32:13.874434] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-25T21:32:13.875945] [DEBUG] [LOCAL ] FIS: Trimmed 77394 records to 54105 (keeping 200 days of data) [2025-10-25T21:32:14.197533] [DEBUG] [LOCAL ] FIS: Primary data saved (54105 records). [2025-10-25T21:32:14.197711] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-25T21:32:14.197841] [INFO ] [MAIN ] Update Progress: 839/2366 symbols. FIS took 18.8s. Estimated remaining time: 4h 41m 5s [2025-10-25T21:32:14.372276] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:32:14.372459] [DEBUG] [LOCAL ] FIX: No existing data file found in primary storage. [2025-10-25T21:32:14.372531] [WARN ] [MAIN ] FIX: No existing data found, performing full refresh instead. [2025-10-25T21:32:14.372701] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-25T21:32:14.372781] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-25T21:32:14.372862] [DEBUG] [LOCAL ] FIX: No primary data file found to delete. [2025-10-25T21:32:14.372932] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-25T21:32:14.738001] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:32:14.738339] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-25T21:32:16.339571] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T21:32:16.346764] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-25T21:32:17.761490] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-25T21:32:17.768995] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-25T21:32:19.374086] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:32:19.382304] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-25T21:32:20.957954] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T21:32:20.966053] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-25T21:32:22.295743] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T21:32:22.302365] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-25T21:32:23.378349] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T21:32:23.384368] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-25T21:32:24.650712] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T21:32:24.657371] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-25T21:32:25.964604] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T21:32:25.974122] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-25T21:32:27.283490] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T21:32:27.290092] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-25T21:32:28.489887] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T21:32:28.495377] [INFO ] [REMOTE ] FIX: Full fetch complete (45688 records). [2025-10-25T21:32:28.495521] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-25T21:32:28.881800] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-25T21:32:28.881936] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-25T21:32:28.882615] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-25T21:32:28.882730] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-25T21:32:28.883736] [DEBUG] [LOCAL ] FIX: Trimmed 45688 records to 28996 (keeping 200 days of data) [2025-10-25T21:32:29.058784] [DEBUG] [LOCAL ] FIX: Primary data saved (28996 records). [2025-10-25T21:32:29.058951] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-25T21:32:29.059086] [INFO ] [MAIN ] Update Progress: 840/2366 symbols. FIX took 14.9s. Estimated remaining time: 4h 41m 0s [2025-10-25T21:32:29.223617] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:32:29.223831] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-25T21:32:29.223902] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-25T21:32:29.224015] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-25T21:32:29.224085] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-25T21:32:29.224209] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-25T21:32:29.224280] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-25T21:32:29.572961] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:32:29.573285] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-25T21:32:29.786685] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T21:32:29.787001] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-25T21:32:29.787098] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T21:32:29.787170] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-25T21:32:29.787238] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T21:32:29.787312] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-25T21:32:29.787402] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-25T21:32:29.787474] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-25T21:32:29.787555] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-25T21:32:29.787687] [INFO ] [MAIN ] Update Progress: 841/2366 symbols. FIXT took 0.7s. Estimated remaining time: 4h 40m 31s [2025-10-25T21:32:29.953010] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:32:29.953205] [DEBUG] [LOCAL ] FLC: No existing data file found in primary storage. [2025-10-25T21:32:29.953275] [WARN ] [MAIN ] FLC: No existing data found, performing full refresh instead. [2025-10-25T21:32:29.953364] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-25T21:32:29.953431] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-25T21:32:29.953496] [DEBUG] [LOCAL ] FLC: No primary data file found to delete. [2025-10-25T21:32:29.953558] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-25T21:32:30.297618] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:32:30.298027] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-25T21:32:30.913262] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T21:32:30.915025] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-25T21:32:31.530772] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T21:32:31.532467] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-25T21:32:32.111669] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T21:32:32.113696] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-25T21:32:32.821822] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T21:32:32.823998] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-25T21:32:33.450039] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T21:32:33.451772] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-25T21:32:34.072683] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T21:32:34.074387] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-25T21:32:34.726844] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-25T21:32:34.728759] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-25T21:32:35.536918] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-25T21:32:35.539057] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-25T21:32:36.112465] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T21:32:36.114188] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-25T21:32:36.628322] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-25T21:32:36.629824] [INFO ] [REMOTE ] FLC: Full fetch complete (7801 records). [2025-10-25T21:32:36.629921] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-25T21:32:36.997003] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-25T21:32:36.997232] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-25T21:32:36.997468] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-25T21:32:36.997540] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-25T21:32:36.998046] [DEBUG] [LOCAL ] FLC: Trimmed 7801 records to 5477 (keeping 200 days of data) [2025-10-25T21:32:37.030352] [DEBUG] [LOCAL ] FLC: Primary data saved (5477 records). [2025-10-25T21:32:37.030456] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-25T21:32:37.030580] [INFO ] [MAIN ] Update Progress: 842/2366 symbols. FLC took 7.2s. Estimated remaining time: 4h 40m 13s [2025-10-25T21:32:37.197680] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:32:37.197859] [DEBUG] [LOCAL ] FLG: No existing data file found in primary storage. [2025-10-25T21:32:37.197944] [WARN ] [MAIN ] FLG: No existing data found, performing full refresh instead. [2025-10-25T21:32:37.198059] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-25T21:32:37.198134] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-25T21:32:37.198216] [DEBUG] [LOCAL ] FLG: No primary data file found to delete. [2025-10-25T21:32:37.198286] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-25T21:32:37.545718] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:32:37.546051] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-25T21:32:39.449867] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T21:32:39.460341] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-25T21:32:41.397420] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T21:32:41.407851] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-25T21:32:43.317831] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-25T21:32:43.329049] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-25T21:32:45.158366] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T21:32:45.169773] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-25T21:32:47.065338] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-25T21:32:47.076553] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-25T21:32:48.730793] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T21:32:48.741402] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-25T21:32:50.734904] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-25T21:32:50.746528] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-25T21:32:52.425221] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T21:32:52.436494] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-25T21:32:54.113668] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-25T21:32:54.125320] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-25T21:32:55.799586] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-25T21:32:55.809538] [INFO ] [REMOTE ] FLG: Full fetch complete (77426 records). [2025-10-25T21:32:55.809719] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-25T21:32:56.198925] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-25T21:32:56.199052] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-25T21:32:56.200053] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-25T21:32:56.200151] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-25T21:32:56.201599] [DEBUG] [LOCAL ] FLG: Trimmed 77426 records to 54097 (keeping 200 days of data) [2025-10-25T21:32:56.514104] [DEBUG] [LOCAL ] FLG: Primary data saved (54097 records). [2025-10-25T21:32:56.514253] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-25T21:32:56.514387] [INFO ] [MAIN ] Update Progress: 843/2366 symbols. FLG took 19.5s. Estimated remaining time: 4h 40m 17s [2025-10-25T21:32:56.685515] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:32:56.685742] [DEBUG] [LOCAL ] FLNG: No existing data file found in primary storage. [2025-10-25T21:32:56.685826] [WARN ] [MAIN ] FLNG: No existing data found, performing full refresh instead. [2025-10-25T21:32:56.685968] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-25T21:32:56.686058] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-25T21:32:56.686166] [DEBUG] [LOCAL ] FLNG: No primary data file found to delete. [2025-10-25T21:32:56.686256] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-25T21:32:57.032874] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:32:57.033211] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-25T21:32:58.285406] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T21:32:58.292618] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-25T21:32:59.849311] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T21:32:59.857050] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-25T21:33:01.461134] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T21:33:01.468497] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-25T21:33:03.991270] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-25T21:33:03.998479] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-25T21:33:05.301854] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T21:33:05.309375] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-25T21:33:06.687295] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T21:33:06.697899] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-25T21:33:08.035248] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T21:33:08.043144] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-25T21:33:09.467302] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T21:33:09.475304] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-25T21:33:11.117491] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T21:33:11.125627] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-25T21:33:11.970794] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T21:33:11.976295] [INFO ] [REMOTE ] FLNG: Full fetch complete (49706 records). [2025-10-25T21:33:11.976411] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-25T21:33:12.367549] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-25T21:33:12.367704] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-25T21:33:12.368550] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-25T21:33:12.368632] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-25T21:33:12.369941] [DEBUG] [LOCAL ] FLNG: Trimmed 49706 records to 33679 (keeping 200 days of data) [2025-10-25T21:33:12.567956] [DEBUG] [LOCAL ] FLNG: Primary data saved (33679 records). [2025-10-25T21:33:12.568169] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-25T21:33:12.568330] [INFO ] [MAIN ] Update Progress: 844/2366 symbols. FLNG took 16.1s. Estimated remaining time: 4h 40m 15s [2025-10-25T21:33:12.736747] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:33:12.736967] [DEBUG] [LOCAL ] FLO: No existing data file found in primary storage. [2025-10-25T21:33:12.737054] [WARN ] [MAIN ] FLO: No existing data found, performing full refresh instead. [2025-10-25T21:33:12.737191] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-25T21:33:12.737281] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-25T21:33:12.737390] [DEBUG] [LOCAL ] FLO: No primary data file found to delete. [2025-10-25T21:33:12.737479] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-25T21:33:13.090694] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:33:13.091061] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-25T21:33:14.671215] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T21:33:14.681402] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-25T21:33:16.250342] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T21:33:16.260286] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-25T21:33:18.139105] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T21:33:18.149741] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-25T21:33:19.852101] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T21:33:19.862830] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-25T21:33:21.545920] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T21:33:21.557110] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-25T21:33:23.315560] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T21:33:23.326141] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-25T21:33:24.959813] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:33:24.971239] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-25T21:33:26.719676] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-25T21:33:26.730886] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-25T21:33:28.421130] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T21:33:28.432730] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-25T21:33:30.062026] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T21:33:30.071686] [INFO ] [REMOTE ] FLO: Full fetch complete (75403 records). [2025-10-25T21:33:30.071848] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-25T21:33:30.465761] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-25T21:33:30.465877] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-25T21:33:30.466785] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-25T21:33:30.466885] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-25T21:33:30.468337] [DEBUG] [LOCAL ] FLO: Trimmed 75403 records to 52834 (keeping 200 days of data) [2025-10-25T21:33:30.779635] [DEBUG] [LOCAL ] FLO: Primary data saved (52834 records). [2025-10-25T21:33:30.779820] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-25T21:33:30.779953] [INFO ] [MAIN ] Update Progress: 845/2366 symbols. FLO took 18.2s. Estimated remaining time: 4h 40m 17s [2025-10-25T21:33:30.948304] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:33:30.948490] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-25T21:33:30.948561] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-25T21:33:30.948694] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-25T21:33:30.948768] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-25T21:33:30.948849] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-25T21:33:30.948918] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-25T21:33:31.308034] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:33:31.308392] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-25T21:33:32.588040] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T21:33:32.592745] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-25T21:33:33.842967] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-25T21:33:33.849114] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-25T21:33:35.149503] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-25T21:33:35.156704] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-25T21:33:36.579435] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T21:33:36.585741] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-25T21:33:37.842207] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T21:33:37.849553] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-25T21:33:38.968540] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T21:33:38.974828] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-25T21:33:40.154753] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T21:33:40.160767] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-25T21:33:41.485132] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-25T21:33:41.491992] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-25T21:33:42.864148] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T21:33:42.870043] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-25T21:33:44.023110] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T21:33:44.028313] [INFO ] [REMOTE ] FLOC: Full fetch complete (41297 records). [2025-10-25T21:33:44.028434] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-25T21:33:44.233270] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-25T21:33:44.233801] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:33:44.233876] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:33:44.233949] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-25T21:33:44.234046] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-25T21:33:44.234160] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-25T21:33:44.234245] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-25T21:33:44.234344] [INFO ] [MAIN ] Update Progress: 846/2366 symbols. FLOC took 13.5s. Estimated remaining time: 4h 40m 10s [2025-10-25T21:33:44.404455] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:33:44.404662] [DEBUG] [LOCAL ] FLR: No existing data file found in primary storage. [2025-10-25T21:33:44.404735] [WARN ] [MAIN ] FLR: No existing data found, performing full refresh instead. [2025-10-25T21:33:44.404847] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-25T21:33:44.404919] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-25T21:33:44.404999] [DEBUG] [LOCAL ] FLR: No primary data file found to delete. [2025-10-25T21:33:44.405069] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-25T21:33:44.751737] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:33:44.752085] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-25T21:33:46.590147] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T21:33:46.600252] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-25T21:33:48.142287] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T21:33:48.152144] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-25T21:33:49.729909] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T21:33:49.741047] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-25T21:33:51.379805] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T21:33:51.390990] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-25T21:33:53.301152] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-25T21:33:53.312564] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-25T21:33:55.065214] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T21:33:55.076134] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-25T21:33:56.818759] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T21:33:56.830279] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-25T21:33:58.850897] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-25T21:33:58.865038] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-25T21:34:00.780894] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-25T21:34:00.793621] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-25T21:34:03.212767] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-25T21:34:03.222604] [INFO ] [REMOTE ] FLR: Full fetch complete (76910 records). [2025-10-25T21:34:03.222817] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-25T21:34:03.635625] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-25T21:34:03.635762] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-25T21:34:03.636684] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-25T21:34:03.636765] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-25T21:34:03.638208] [DEBUG] [LOCAL ] FLR: Trimmed 76910 records to 54025 (keeping 200 days of data) [2025-10-25T21:34:03.945995] [DEBUG] [LOCAL ] FLR: Primary data saved (54025 records). [2025-10-25T21:34:03.946174] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-25T21:34:03.946311] [INFO ] [MAIN ] Update Progress: 847/2366 symbols. FLR took 19.7s. Estimated remaining time: 4h 40m 15s [2025-10-25T21:34:04.118672] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:34:04.118844] [DEBUG] [LOCAL ] FLS: No existing data file found in primary storage. [2025-10-25T21:34:04.118921] [WARN ] [MAIN ] FLS: No existing data found, performing full refresh instead. [2025-10-25T21:34:04.119032] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-25T21:34:04.119105] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-25T21:34:04.119186] [DEBUG] [LOCAL ] FLS: No primary data file found to delete. [2025-10-25T21:34:04.119257] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-25T21:34:04.464838] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:34:04.465166] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-25T21:34:05.985556] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T21:34:05.995299] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-25T21:34:07.455925] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T21:34:07.465815] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-25T21:34:09.122247] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T21:34:09.132718] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-25T21:34:10.955371] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T21:34:10.965899] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-25T21:34:12.523234] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T21:34:12.532998] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-25T21:34:14.282729] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T21:34:14.293175] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-25T21:34:15.918897] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:34:15.929922] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-25T21:34:17.556848] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T21:34:17.567114] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-25T21:34:19.364970] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-25T21:34:19.375895] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-25T21:34:21.113986] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T21:34:21.123295] [INFO ] [REMOTE ] FLS: Full fetch complete (72545 records). [2025-10-25T21:34:21.123465] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-25T21:34:21.499788] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-25T21:34:21.499907] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-25T21:34:21.500821] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-25T21:34:21.500900] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-25T21:34:21.502271] [DEBUG] [LOCAL ] FLS: Trimmed 72545 records to 51134 (keeping 200 days of data) [2025-10-25T21:34:21.808732] [DEBUG] [LOCAL ] FLS: Primary data saved (51134 records). [2025-10-25T21:34:21.808906] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-25T21:34:21.809056] [INFO ] [MAIN ] Update Progress: 848/2366 symbols. FLS took 17.9s. Estimated remaining time: 4h 40m 16s [2025-10-25T21:34:21.976564] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:34:21.976777] [DEBUG] [LOCAL ] FLUT: No existing data file found in primary storage. [2025-10-25T21:34:21.976897] [WARN ] [MAIN ] FLUT: No existing data found, performing full refresh instead. [2025-10-25T21:34:21.977011] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-25T21:34:21.977081] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-25T21:34:21.977159] [DEBUG] [LOCAL ] FLUT: No primary data file found to delete. [2025-10-25T21:34:21.977228] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-25T21:34:22.336182] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:34:22.336518] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-25T21:34:24.145719] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T21:34:24.156134] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-25T21:34:25.747297] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T21:34:25.756679] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-25T21:34:27.418407] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T21:34:27.429310] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-25T21:34:29.167394] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T21:34:29.178126] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-25T21:34:30.790569] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T21:34:30.801030] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-25T21:34:32.355922] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T21:34:32.366291] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-25T21:34:34.101485] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T21:34:34.112837] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-25T21:34:35.699065] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T21:34:35.709569] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-25T21:34:37.434795] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T21:34:37.445766] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-25T21:34:39.320067] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-25T21:34:39.329432] [INFO ] [REMOTE ] FLUT: Full fetch complete (73395 records). [2025-10-25T21:34:39.329600] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-25T21:34:39.720388] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-25T21:34:39.720537] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-25T21:34:39.721583] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-25T21:34:39.721718] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-25T21:34:39.723226] [DEBUG] [LOCAL ] FLUT: Trimmed 73395 records to 51394 (keeping 200 days of data) [2025-10-25T21:34:40.019420] [DEBUG] [LOCAL ] FLUT: Primary data saved (51394 records). [2025-10-25T21:34:40.019616] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-25T21:34:40.019772] [INFO ] [MAIN ] Update Progress: 849/2366 symbols. FLUT took 18.2s. Estimated remaining time: 4h 40m 17s [2025-10-25T21:34:40.185353] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:34:40.185567] [DEBUG] [LOCAL ] FLXR: No existing data file found in primary storage. [2025-10-25T21:34:40.185640] [WARN ] [MAIN ] FLXR: No existing data found, performing full refresh instead. [2025-10-25T21:34:40.185769] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-25T21:34:40.185869] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-25T21:34:40.185954] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-10-25T21:34:40.186025] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-25T21:34:40.538506] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:34:40.538860] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-25T21:34:41.266421] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T21:34:41.269110] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-25T21:34:42.016227] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T21:34:42.019348] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-25T21:34:42.949187] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T21:34:42.953090] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-25T21:34:43.869835] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T21:34:43.874004] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-25T21:34:44.965498] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T21:34:44.969966] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-25T21:34:45.958706] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T21:34:45.962968] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-25T21:34:47.016875] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T21:34:47.022202] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-25T21:34:48.113443] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T21:34:48.118762] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-25T21:34:49.239077] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T21:34:49.245667] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-25T21:34:50.341878] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T21:34:50.347226] [INFO ] [REMOTE ] FLXR: Full fetch complete (27850 records). [2025-10-25T21:34:50.347350] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-25T21:34:50.706309] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-25T21:34:50.706421] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-25T21:34:50.706913] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-25T21:34:50.706994] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-25T21:34:50.707694] [DEBUG] [LOCAL ] FLXR: Trimmed 27850 records to 21785 (keeping 200 days of data) [2025-10-25T21:34:50.834205] [DEBUG] [LOCAL ] FLXR: Primary data saved (21785 records). [2025-10-25T21:34:50.834360] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-25T21:34:50.834499] [INFO ] [MAIN ] Update Progress: 850/2366 symbols. FLXR took 10.8s. Estimated remaining time: 4h 40m 6s [2025-10-25T21:34:51.004560] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:34:51.004907] [DEBUG] [LOCAL ] FMC: No existing data file found in primary storage. [2025-10-25T21:34:51.004983] [WARN ] [MAIN ] FMC: No existing data found, performing full refresh instead. [2025-10-25T21:34:51.005100] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-25T21:34:51.005175] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-25T21:34:51.005261] [DEBUG] [LOCAL ] FMC: No primary data file found to delete. [2025-10-25T21:34:51.005332] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-25T21:34:51.351819] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:34:51.352176] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-25T21:34:52.869455] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T21:34:52.879557] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-25T21:34:54.550823] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T21:34:54.561234] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-25T21:34:56.278626] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T21:34:56.289767] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-25T21:34:58.049135] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-25T21:34:58.060957] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-25T21:34:59.892235] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-25T21:34:59.903173] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-25T21:35:01.860677] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-25T21:35:01.872410] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-25T21:35:04.064121] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-25T21:35:04.075463] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-25T21:35:06.013705] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-25T21:35:06.024695] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-25T21:35:07.828890] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-25T21:35:07.839897] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-25T21:35:09.667030] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-25T21:35:09.676596] [INFO ] [REMOTE ] FMC: Full fetch complete (75423 records). [2025-10-25T21:35:09.676755] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-25T21:35:10.060992] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-25T21:35:10.061105] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-25T21:35:10.062025] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-25T21:35:10.062103] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-25T21:35:10.063427] [DEBUG] [LOCAL ] FMC: Trimmed 75423 records to 52635 (keeping 200 days of data) [2025-10-25T21:35:10.367142] [DEBUG] [LOCAL ] FMC: Primary data saved (52635 records). [2025-10-25T21:35:10.367301] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-25T21:35:10.367434] [INFO ] [MAIN ] Update Progress: 851/2366 symbols. FMC took 19.5s. Estimated remaining time: 4h 40m 10s [2025-10-25T21:35:10.533006] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:35:10.533189] [DEBUG] [LOCAL ] FMN: No existing data file found in primary storage. [2025-10-25T21:35:10.533268] [WARN ] [MAIN ] FMN: No existing data found, performing full refresh instead. [2025-10-25T21:35:10.533375] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-25T21:35:10.533458] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-25T21:35:10.533541] [DEBUG] [LOCAL ] FMN: No primary data file found to delete. [2025-10-25T21:35:10.533598] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-25T21:35:10.893559] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:35:10.893954] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-25T21:35:11.759482] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-25T21:35:11.762212] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-25T21:35:12.499044] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-25T21:35:12.501502] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-25T21:35:13.267572] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T21:35:13.270857] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-25T21:35:13.967320] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-25T21:35:13.969766] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-25T21:35:14.611810] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-25T21:35:14.613674] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-25T21:35:15.208356] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T21:35:15.210160] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-25T21:35:15.835709] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-25T21:35:15.837729] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-25T21:35:16.452464] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T21:35:16.454269] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-25T21:35:17.095496] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T21:35:17.097559] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-25T21:35:17.744891] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T21:35:17.746711] [INFO ] [REMOTE ] FMN: Full fetch complete (9790 records). [2025-10-25T21:35:17.746807] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-25T21:35:18.101397] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-25T21:35:18.101509] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-25T21:35:18.101817] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-25T21:35:18.101895] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-25T21:35:18.102310] [DEBUG] [LOCAL ] FMN: Trimmed 9790 records to 5508 (keeping 200 days of data) [2025-10-25T21:35:18.134748] [DEBUG] [LOCAL ] FMN: Primary data saved (5508 records). [2025-10-25T21:35:18.134859] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-25T21:35:18.134982] [INFO ] [MAIN ] Update Progress: 852/2366 symbols. FMN took 7.8s. Estimated remaining time: 4h 39m 53s [2025-10-25T21:35:18.312279] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:35:18.312493] [DEBUG] [LOCAL ] FMS: No existing data file found in primary storage. [2025-10-25T21:35:18.312564] [WARN ] [MAIN ] FMS: No existing data found, performing full refresh instead. [2025-10-25T21:35:18.312706] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-25T21:35:18.312778] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-25T21:35:18.312860] [DEBUG] [LOCAL ] FMS: No primary data file found to delete. [2025-10-25T21:35:18.312930] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-25T21:35:18.654410] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:35:18.654795] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-25T21:35:19.903768] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T21:35:19.909373] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-25T21:35:21.119557] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T21:35:21.124991] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-25T21:35:22.505243] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T21:35:22.511928] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-25T21:35:23.860372] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T21:35:23.867960] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-25T21:35:25.381702] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T21:35:25.389349] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-25T21:35:26.630828] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-25T21:35:26.637460] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-25T21:35:28.036714] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-25T21:35:28.042859] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-25T21:35:29.246410] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T21:35:29.253057] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-25T21:35:30.671581] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T21:35:30.678543] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-25T21:35:31.848300] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T21:35:31.854827] [INFO ] [REMOTE ] FMS: Full fetch complete (43140 records). [2025-10-25T21:35:31.854985] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-25T21:35:32.231626] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-25T21:35:32.231762] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-25T21:35:32.232441] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-25T21:35:32.232516] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-25T21:35:32.233478] [DEBUG] [LOCAL ] FMS: Trimmed 43140 records to 30723 (keeping 200 days of data) [2025-10-25T21:35:32.406424] [DEBUG] [LOCAL ] FMS: Primary data saved (30723 records). [2025-10-25T21:35:32.406583] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-25T21:35:32.406738] [INFO ] [MAIN ] Update Progress: 853/2366 symbols. FMS took 14.3s. Estimated remaining time: 4h 39m 47s [2025-10-25T21:35:32.575743] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:35:32.575925] [DEBUG] [LOCAL ] FMX: No existing data file found in primary storage. [2025-10-25T21:35:32.576005] [WARN ] [MAIN ] FMX: No existing data found, performing full refresh instead. [2025-10-25T21:35:32.576136] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-25T21:35:32.576208] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-25T21:35:32.576271] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-10-25T21:35:32.576336] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-25T21:35:32.932195] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:35:32.932521] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-25T21:35:34.314510] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T21:35:34.321888] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-25T21:35:36.051297] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T21:35:36.061791] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-25T21:35:37.612488] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T21:35:37.621046] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-25T21:35:39.279963] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T21:35:39.293368] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-25T21:35:40.819909] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T21:35:40.827907] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-25T21:35:42.304541] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T21:35:42.312340] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-25T21:35:43.792494] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T21:35:43.801347] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-25T21:35:45.414278] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T21:35:45.423336] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-25T21:35:46.972316] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-25T21:35:46.981861] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-25T21:35:48.333473] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T21:35:48.340041] [INFO ] [REMOTE ] FMX: Full fetch complete (57816 records). [2025-10-25T21:35:48.340170] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-25T21:35:48.713492] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-25T21:35:48.713594] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-25T21:35:48.714378] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-25T21:35:48.714455] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-25T21:35:48.715619] [DEBUG] [LOCAL ] FMX: Trimmed 57816 records to 40863 (keeping 200 days of data) [2025-10-25T21:35:48.959620] [DEBUG] [LOCAL ] FMX: Primary data saved (40863 records). [2025-10-25T21:35:48.959770] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-25T21:35:48.959905] [INFO ] [MAIN ] Update Progress: 854/2366 symbols. FMX took 16.6s. Estimated remaining time: 4h 39m 46s [2025-10-25T21:35:49.131722] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:35:49.131900] [DEBUG] [LOCAL ] FMY: No existing data file found in primary storage. [2025-10-25T21:35:49.131972] [WARN ] [MAIN ] FMY: No existing data found, performing full refresh instead. [2025-10-25T21:35:49.132085] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-25T21:35:49.132164] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-25T21:35:49.132245] [DEBUG] [LOCAL ] FMY: No primary data file found to delete. [2025-10-25T21:35:49.132316] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-25T21:35:49.516546] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:35:49.516912] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-25T21:35:49.861601] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-25T21:35:49.862552] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-25T21:35:50.301513] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-25T21:35:50.302605] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-25T21:35:50.579527] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-25T21:35:50.580561] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-25T21:35:50.998377] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-25T21:35:50.999461] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-25T21:35:51.375014] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-25T21:35:51.376051] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-25T21:35:51.792948] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-25T21:35:51.793957] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-25T21:35:52.236437] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-25T21:35:52.237500] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-25T21:35:52.711870] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-25T21:35:52.713144] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-25T21:35:53.151688] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-25T21:35:53.152896] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-25T21:35:53.563560] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-25T21:35:53.564346] [INFO ] [REMOTE ] FMY: Full fetch complete (1943 records). [2025-10-25T21:35:53.564434] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-25T21:35:53.950232] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-25T21:35:53.950402] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-25T21:35:53.950531] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-25T21:35:53.950608] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-25T21:35:53.951025] [DEBUG] [LOCAL ] FMY: Trimmed 1943 records to 1371 (keeping 200 days of data) [2025-10-25T21:35:53.959900] [DEBUG] [LOCAL ] FMY: Primary data saved (1371 records). [2025-10-25T21:35:53.959994] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-25T21:35:53.960140] [INFO ] [MAIN ] Update Progress: 855/2366 symbols. FMY took 5.0s. Estimated remaining time: 4h 39m 24s [2025-10-25T21:35:54.140142] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:35:54.140319] [DEBUG] [LOCAL ] FN: No existing data file found in primary storage. [2025-10-25T21:35:54.140393] [WARN ] [MAIN ] FN: No existing data found, performing full refresh instead. [2025-10-25T21:35:54.140531] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-25T21:35:54.140606] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-25T21:35:54.140708] [DEBUG] [LOCAL ] FN: No primary data file found to delete. [2025-10-25T21:35:54.140780] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-25T21:35:54.500407] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:35:54.500746] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-25T21:35:55.877130] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T21:35:55.885152] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-25T21:35:57.093554] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T21:35:57.102521] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-25T21:35:58.592237] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T21:35:58.603177] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-25T21:36:00.096107] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T21:36:00.105673] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-25T21:36:01.853425] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-25T21:36:01.862161] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-25T21:36:03.325964] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T21:36:03.333442] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-25T21:36:04.754576] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-25T21:36:04.762192] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-25T21:36:06.419008] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T21:36:06.428150] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-25T21:36:07.771030] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T21:36:07.778849] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-25T21:36:09.146953] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T21:36:09.154104] [INFO ] [REMOTE ] FN: Full fetch complete (56497 records). [2025-10-25T21:36:09.154322] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-25T21:36:09.547725] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-25T21:36:09.547873] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-25T21:36:09.548672] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-25T21:36:09.548751] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-25T21:36:09.549888] [DEBUG] [LOCAL ] FN: Trimmed 56497 records to 37847 (keeping 200 days of data) [2025-10-25T21:36:09.768556] [DEBUG] [LOCAL ] FN: Primary data saved (37847 records). [2025-10-25T21:36:09.768749] [INFO ] [MAIN ] FN: Full history saved. [2025-10-25T21:36:09.768865] [INFO ] [MAIN ] Update Progress: 856/2366 symbols. FN took 15.8s. Estimated remaining time: 4h 39m 21s [2025-10-25T21:36:09.941991] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:36:09.942196] [DEBUG] [LOCAL ] FNB: No existing data file found in primary storage. [2025-10-25T21:36:09.942267] [WARN ] [MAIN ] FNB: No existing data found, performing full refresh instead. [2025-10-25T21:36:09.942355] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-25T21:36:09.942423] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-25T21:36:09.942502] [DEBUG] [LOCAL ] FNB: No primary data file found to delete. [2025-10-25T21:36:09.942584] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-25T21:36:10.305845] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:36:10.306175] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-25T21:36:11.953579] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T21:36:11.964025] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-25T21:36:13.595916] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T21:36:13.606271] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-25T21:36:15.218669] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:36:15.230063] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-25T21:36:16.878743] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T21:36:16.891099] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-25T21:36:18.544113] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T21:36:18.554856] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-25T21:36:20.166298] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T21:36:20.176501] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-25T21:36:21.974280] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T21:36:21.986923] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-25T21:36:23.652426] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T21:36:23.663602] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-25T21:36:25.299239] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T21:36:25.311486] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-25T21:36:27.204304] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-25T21:36:27.214442] [INFO ] [REMOTE ] FNB: Full fetch complete (76241 records). [2025-10-25T21:36:27.214711] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-25T21:36:27.608308] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-25T21:36:27.608421] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-25T21:36:27.609350] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-25T21:36:27.609430] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-25T21:36:27.611100] [DEBUG] [LOCAL ] FNB: Trimmed 76241 records to 53382 (keeping 200 days of data) [2025-10-25T21:36:27.924922] [DEBUG] [LOCAL ] FNB: Primary data saved (53382 records). [2025-10-25T21:36:27.925078] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-25T21:36:27.925216] [INFO ] [MAIN ] Update Progress: 857/2366 symbols. FNB took 18.2s. Estimated remaining time: 4h 39m 23s [2025-10-25T21:36:28.091213] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:36:28.091388] [DEBUG] [LOCAL ] FND: No existing data file found in primary storage. [2025-10-25T21:36:28.091465] [WARN ] [MAIN ] FND: No existing data found, performing full refresh instead. [2025-10-25T21:36:28.091553] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-25T21:36:28.091621] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-25T21:36:28.091717] [DEBUG] [LOCAL ] FND: No primary data file found to delete. [2025-10-25T21:36:28.091786] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-25T21:36:28.440347] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:36:28.440753] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-25T21:36:30.016731] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T21:36:30.026511] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-25T21:36:31.951121] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T21:36:31.961410] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-25T21:36:33.615172] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T21:36:33.625956] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-25T21:36:35.455409] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T21:36:35.467476] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-25T21:36:37.395961] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-25T21:36:37.410978] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-25T21:36:39.114694] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T21:36:39.126072] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-25T21:36:40.955413] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T21:36:40.966884] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-25T21:36:42.496491] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T21:36:42.508383] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-25T21:36:44.113509] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T21:36:44.124706] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-25T21:36:45.868892] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T21:36:45.878301] [INFO ] [REMOTE ] FND: Full fetch complete (75091 records). [2025-10-25T21:36:45.878450] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-25T21:36:46.272875] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-25T21:36:46.273010] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-25T21:36:46.273946] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-25T21:36:46.274024] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-25T21:36:46.275449] [DEBUG] [LOCAL ] FND: Trimmed 75091 records to 52826 (keeping 200 days of data) [2025-10-25T21:36:46.575290] [DEBUG] [LOCAL ] FND: Primary data saved (52826 records). [2025-10-25T21:36:46.575451] [INFO ] [MAIN ] FND: Full history saved. [2025-10-25T21:36:46.575584] [INFO ] [MAIN ] Update Progress: 858/2366 symbols. FND took 18.7s. Estimated remaining time: 4h 39m 25s [2025-10-25T21:36:46.768276] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:36:46.768523] [DEBUG] [LOCAL ] FNF: No existing data file found in primary storage. [2025-10-25T21:36:46.768599] [WARN ] [MAIN ] FNF: No existing data found, performing full refresh instead. [2025-10-25T21:36:46.768745] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-25T21:36:46.768815] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-25T21:36:46.768894] [DEBUG] [LOCAL ] FNF: No primary data file found to delete. [2025-10-25T21:36:46.768963] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-25T21:36:47.114054] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:36:47.114376] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-25T21:36:48.655726] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T21:36:48.664817] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-25T21:36:50.217540] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T21:36:50.227169] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-25T21:36:51.955195] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T21:36:51.965668] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-25T21:36:53.459767] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T21:36:53.470916] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-25T21:36:55.024562] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-25T21:36:55.035100] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-25T21:36:56.636951] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T21:36:56.647376] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-25T21:36:58.274594] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:36:58.289282] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-25T21:36:59.860061] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T21:36:59.871195] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-25T21:37:01.604705] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T21:37:01.615024] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-25T21:37:03.287074] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-25T21:37:03.295902] [INFO ] [REMOTE ] FNF: Full fetch complete (69977 records). [2025-10-25T21:37:03.296063] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-25T21:37:03.686802] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-25T21:37:03.686933] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-25T21:37:03.687932] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-25T21:37:03.688027] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-25T21:37:03.689425] [DEBUG] [LOCAL ] FNF: Trimmed 69977 records to 49387 (keeping 200 days of data) [2025-10-25T21:37:03.981254] [DEBUG] [LOCAL ] FNF: Primary data saved (49387 records). [2025-10-25T21:37:03.981459] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-25T21:37:03.981611] [INFO ] [MAIN ] Update Progress: 859/2366 symbols. FNF took 17.4s. Estimated remaining time: 4h 39m 25s [2025-10-25T21:37:04.151312] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:37:04.151481] [DEBUG] [LOCAL ] FNV: No existing data file found in primary storage. [2025-10-25T21:37:04.151552] [WARN ] [MAIN ] FNV: No existing data found, performing full refresh instead. [2025-10-25T21:37:04.151688] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-25T21:37:04.151759] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-25T21:37:04.151840] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-10-25T21:37:04.151920] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-25T21:37:04.505593] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:37:04.505939] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-25T21:37:06.137829] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T21:37:06.146519] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-25T21:37:07.620343] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T21:37:07.632405] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-25T21:37:09.390953] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-25T21:37:09.402067] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-25T21:37:11.177771] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T21:37:11.189336] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-25T21:37:12.906269] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T21:37:12.916488] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-25T21:37:14.494884] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T21:37:14.504328] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-25T21:37:16.362376] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T21:37:16.372426] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-25T21:37:17.843563] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T21:37:17.854296] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-25T21:37:19.423076] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T21:37:19.432898] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-25T21:37:21.199393] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T21:37:21.208339] [INFO ] [REMOTE ] FNV: Full fetch complete (66970 records). [2025-10-25T21:37:21.208536] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-25T21:37:21.588317] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-25T21:37:21.588423] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-25T21:37:21.589280] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-25T21:37:21.589401] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-25T21:37:21.590704] [DEBUG] [LOCAL ] FNV: Trimmed 66970 records to 46719 (keeping 200 days of data) [2025-10-25T21:37:21.871662] [DEBUG] [LOCAL ] FNV: Primary data saved (46719 records). [2025-10-25T21:37:21.871864] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-25T21:37:21.871996] [INFO ] [MAIN ] Update Progress: 860/2366 symbols. FNV took 17.9s. Estimated remaining time: 4h 39m 25s [2025-10-25T21:37:22.041721] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:37:22.041933] [DEBUG] [LOCAL ] FOA: No existing data file found in primary storage. [2025-10-25T21:37:22.042026] [WARN ] [MAIN ] FOA: No existing data found, performing full refresh instead. [2025-10-25T21:37:22.042170] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-25T21:37:22.042270] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-25T21:37:22.042379] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-10-25T21:37:22.042469] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-25T21:37:22.395133] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:37:22.395584] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-25T21:37:23.517042] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T21:37:23.522146] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-25T21:37:24.454896] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T21:37:24.458789] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-25T21:37:25.425942] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T21:37:25.430307] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-25T21:37:26.305828] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T21:37:26.309457] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-25T21:37:27.176399] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T21:37:27.179735] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-25T21:37:27.931460] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T21:37:27.934189] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-25T21:37:28.756194] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T21:37:28.759261] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-25T21:37:29.678244] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T21:37:29.681969] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-25T21:37:30.836897] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T21:37:30.841115] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-25T21:37:31.780072] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T21:37:31.782925] [INFO ] [REMOTE ] FOA: Full fetch complete (20843 records). [2025-10-25T21:37:31.783027] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-25T21:37:32.146552] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-25T21:37:32.146684] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-25T21:37:32.147118] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-25T21:37:32.147196] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-25T21:37:32.147861] [DEBUG] [LOCAL ] FOA: Trimmed 20843 records to 13179 (keeping 200 days of data) [2025-10-25T21:37:32.220130] [DEBUG] [LOCAL ] FOA: Primary data saved (13179 records). [2025-10-25T21:37:32.220287] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-25T21:37:32.220399] [INFO ] [MAIN ] Update Progress: 861/2366 symbols. FOA took 10.3s. Estimated remaining time: 4h 39m 13s [2025-10-25T21:37:32.385573] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:37:32.385763] [DEBUG] [LOCAL ] FOF: No existing data file found in primary storage. [2025-10-25T21:37:32.385832] [WARN ] [MAIN ] FOF: No existing data found, performing full refresh instead. [2025-10-25T21:37:32.385950] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-25T21:37:32.386000] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-25T21:37:32.386075] [DEBUG] [LOCAL ] FOF: No primary data file found to delete. [2025-10-25T21:37:32.386121] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-25T21:37:32.731822] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:37:32.732159] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-25T21:37:33.599982] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-25T21:37:33.602202] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-25T21:37:34.308633] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T21:37:34.310866] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-25T21:37:35.036903] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T21:37:35.041335] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-25T21:37:35.859719] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T21:37:35.862909] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-25T21:37:36.635161] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T21:37:36.637451] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-25T21:37:37.393735] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T21:37:37.396207] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-25T21:37:38.146221] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T21:37:38.148762] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-25T21:37:38.889337] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-25T21:37:38.891865] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-25T21:37:39.670812] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T21:37:39.673786] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-25T21:37:40.392177] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T21:37:40.394401] [INFO ] [REMOTE ] FOF: Full fetch complete (11889 records). [2025-10-25T21:37:40.394508] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-25T21:37:40.755516] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-25T21:37:40.755632] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-25T21:37:40.755983] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-25T21:37:40.756059] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-25T21:37:40.756529] [DEBUG] [LOCAL ] FOF: Trimmed 11889 records to 8488 (keeping 200 days of data) [2025-10-25T21:37:40.816875] [DEBUG] [LOCAL ] FOF: Primary data saved (8488 records). [2025-10-25T21:37:40.817051] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-25T21:37:40.817187] [INFO ] [MAIN ] Update Progress: 862/2366 symbols. FOF took 8.6s. Estimated remaining time: 4h 38m 57s [2025-10-25T21:37:40.984726] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:37:40.984962] [DEBUG] [LOCAL ] FOR: No existing data file found in primary storage. [2025-10-25T21:37:40.985036] [WARN ] [MAIN ] FOR: No existing data found, performing full refresh instead. [2025-10-25T21:37:40.985150] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-25T21:37:40.985226] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-25T21:37:40.985285] [DEBUG] [LOCAL ] FOR: No primary data file found to delete. [2025-10-25T21:37:40.985350] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-25T21:37:41.336498] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:37:41.336982] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-25T21:37:42.453547] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T21:37:42.459224] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-25T21:37:43.579976] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T21:37:43.584775] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-25T21:37:44.599322] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T21:37:44.603985] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-25T21:37:45.834274] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T21:37:45.840491] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-25T21:37:46.880830] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-25T21:37:46.885489] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-25T21:37:47.866556] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T21:37:47.870819] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-25T21:37:48.933183] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T21:37:48.940444] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-25T21:37:50.111950] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T21:37:50.116683] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-25T21:37:50.867396] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T21:37:50.871619] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-25T21:37:51.744423] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T21:37:51.747584] [INFO ] [REMOTE ] FOR: Full fetch complete (29509 records). [2025-10-25T21:37:51.747712] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-25T21:37:52.139447] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-25T21:37:52.139571] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-25T21:37:52.140160] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-25T21:37:52.140237] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-25T21:37:52.141040] [DEBUG] [LOCAL ] FOR: Trimmed 29509 records to 19663 (keeping 200 days of data) [2025-10-25T21:37:52.249129] [DEBUG] [LOCAL ] FOR: Primary data saved (19663 records). [2025-10-25T21:37:52.249326] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-25T21:37:52.249460] [INFO ] [MAIN ] Update Progress: 863/2366 symbols. FOR took 11.4s. Estimated remaining time: 4h 38m 47s [2025-10-25T21:37:52.417157] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:37:52.417356] [DEBUG] [LOCAL ] FOUR: No existing data file found in primary storage. [2025-10-25T21:37:52.417427] [WARN ] [MAIN ] FOUR: No existing data found, performing full refresh instead. [2025-10-25T21:37:52.417566] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-25T21:37:52.417638] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-25T21:37:52.417735] [DEBUG] [LOCAL ] FOUR: No primary data file found to delete. [2025-10-25T21:37:52.417778] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-25T21:37:52.770450] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:37:52.770810] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-25T21:37:54.375205] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T21:37:54.384901] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-25T21:37:55.973404] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T21:37:55.983627] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-25T21:37:57.700167] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T21:37:57.710838] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-25T21:37:59.531417] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T21:37:59.542135] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-25T21:38:01.325779] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-25T21:38:01.336195] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-25T21:38:03.129753] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-25T21:38:03.139591] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-25T21:38:04.769033] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:38:04.780224] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-25T21:38:06.724903] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-25T21:38:06.735725] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-25T21:38:08.536584] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-25T21:38:08.547807] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-25T21:38:10.383815] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-25T21:38:10.393156] [INFO ] [REMOTE ] FOUR: Full fetch complete (72224 records). [2025-10-25T21:38:10.393328] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-25T21:38:10.787375] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-25T21:38:10.787509] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-25T21:38:10.788448] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-25T21:38:10.788540] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-25T21:38:10.790062] [DEBUG] [LOCAL ] FOUR: Trimmed 72224 records to 50380 (keeping 200 days of data) [2025-10-25T21:38:11.101970] [DEBUG] [LOCAL ] FOUR: Primary data saved (50380 records). [2025-10-25T21:38:11.102157] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-25T21:38:11.102337] [INFO ] [MAIN ] Update Progress: 864/2366 symbols. FOUR took 18.9s. Estimated remaining time: 4h 38m 49s [2025-10-25T21:38:11.274902] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:38:11.275173] [DEBUG] [LOCAL ] FPF: No existing data file found in primary storage. [2025-10-25T21:38:11.275248] [WARN ] [MAIN ] FPF: No existing data found, performing full refresh instead. [2025-10-25T21:38:11.275364] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-25T21:38:11.275437] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-25T21:38:11.275522] [DEBUG] [LOCAL ] FPF: No primary data file found to delete. [2025-10-25T21:38:11.275635] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-25T21:38:11.618102] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:38:11.618426] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-25T21:38:12.692961] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T21:38:12.697139] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-25T21:38:13.599563] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T21:38:13.605520] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-25T21:38:14.530472] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-25T21:38:14.536822] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-25T21:38:15.181937] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-25T21:38:15.189624] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-25T21:38:16.125034] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T21:38:16.128829] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-25T21:38:17.090946] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T21:38:17.095412] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-25T21:38:18.079306] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T21:38:18.084172] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-25T21:38:19.079313] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T21:38:19.084352] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-25T21:38:20.063856] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T21:38:20.068285] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-25T21:38:21.080452] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T21:38:21.084921] [INFO ] [REMOTE ] FPF: Full fetch complete (26578 records). [2025-10-25T21:38:21.085020] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-25T21:38:21.446795] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-25T21:38:21.446906] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-25T21:38:21.447445] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-25T21:38:21.447520] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-25T21:38:21.448251] [DEBUG] [LOCAL ] FPF: Trimmed 26578 records to 19027 (keeping 200 days of data) [2025-10-25T21:38:21.557846] [DEBUG] [LOCAL ] FPF: Primary data saved (19027 records). [2025-10-25T21:38:21.558013] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-25T21:38:21.558147] [INFO ] [MAIN ] Update Progress: 865/2366 symbols. FPF took 10.5s. Estimated remaining time: 4h 38m 37s [2025-10-25T21:38:21.722970] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:38:21.723160] [DEBUG] [LOCAL ] FPH: No existing data file found in primary storage. [2025-10-25T21:38:21.723230] [WARN ] [MAIN ] FPH: No existing data found, performing full refresh instead. [2025-10-25T21:38:21.723348] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-25T21:38:21.723417] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-25T21:38:21.723496] [DEBUG] [LOCAL ] FPH: No primary data file found to delete. [2025-10-25T21:38:21.723565] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-25T21:38:22.075371] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:38:22.075820] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-25T21:38:23.353927] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T21:38:23.359942] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-25T21:38:24.459160] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T21:38:24.465194] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-25T21:38:25.483896] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T21:38:25.488612] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-25T21:38:26.514392] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T21:38:26.519528] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-25T21:38:27.473670] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T21:38:27.478008] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-25T21:38:28.403193] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T21:38:28.407032] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-25T21:38:29.558035] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-25T21:38:29.563581] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-25T21:38:30.542116] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T21:38:30.546736] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-25T21:38:31.644862] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T21:38:31.649501] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-25T21:38:32.624728] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T21:38:32.628271] [INFO ] [REMOTE ] FPH: Full fetch complete (30819 records). [2025-10-25T21:38:32.628366] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-25T21:38:33.010638] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-25T21:38:33.010813] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-25T21:38:33.011409] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-25T21:38:33.011488] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-25T21:38:33.012273] [DEBUG] [LOCAL ] FPH: Trimmed 30819 records to 19472 (keeping 200 days of data) [2025-10-25T21:38:33.118098] [DEBUG] [LOCAL ] FPH: Primary data saved (19472 records). [2025-10-25T21:38:33.118285] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-25T21:38:33.118434] [INFO ] [MAIN ] Update Progress: 866/2366 symbols. FPH took 11.6s. Estimated remaining time: 4h 38m 26s [2025-10-25T21:38:33.287286] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:38:33.287485] [DEBUG] [LOCAL ] FPI: No existing data file found in primary storage. [2025-10-25T21:38:33.287557] [WARN ] [MAIN ] FPI: No existing data found, performing full refresh instead. [2025-10-25T21:38:33.287694] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-25T21:38:33.287768] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-25T21:38:33.287867] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-10-25T21:38:33.287942] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-25T21:38:33.641112] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:38:33.641492] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-25T21:38:34.814122] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T21:38:34.819471] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-25T21:38:35.975688] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T21:38:35.982175] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-25T21:38:37.337385] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T21:38:37.343834] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-25T21:38:38.309107] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T21:38:38.316111] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-25T21:38:39.591552] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-25T21:38:39.599311] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-25T21:38:40.812975] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T21:38:40.820114] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-25T21:38:42.255952] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-25T21:38:42.263583] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-25T21:38:43.421713] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T21:38:43.427993] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-25T21:38:44.636298] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T21:38:44.646343] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-25T21:38:45.992152] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T21:38:45.997847] [INFO ] [REMOTE ] FPI: Full fetch complete (43711 records). [2025-10-25T21:38:45.997954] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-25T21:38:46.378205] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-25T21:38:46.378342] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-25T21:38:46.379102] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-25T21:38:46.379181] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-25T21:38:46.380191] [DEBUG] [LOCAL ] FPI: Trimmed 43711 records to 31756 (keeping 200 days of data) [2025-10-25T21:38:46.568741] [DEBUG] [LOCAL ] FPI: Primary data saved (31756 records). [2025-10-25T21:38:46.568899] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-25T21:38:46.569032] [INFO ] [MAIN ] Update Progress: 867/2366 symbols. FPI took 13.5s. Estimated remaining time: 4h 38m 19s [2025-10-25T21:38:46.739611] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:38:46.739834] [DEBUG] [LOCAL ] FR: No existing data file found in primary storage. [2025-10-25T21:38:46.739906] [WARN ] [MAIN ] FR: No existing data found, performing full refresh instead. [2025-10-25T21:38:46.740023] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-25T21:38:46.740093] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-25T21:38:46.740174] [DEBUG] [LOCAL ] FR: No primary data file found to delete. [2025-10-25T21:38:46.740241] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-25T21:38:47.096523] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:38:47.096893] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-25T21:38:48.597479] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T21:38:48.606483] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-25T21:38:50.033511] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T21:38:50.042123] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-25T21:38:51.356995] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T21:38:51.370172] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-25T21:38:53.008416] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T21:38:53.019541] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-25T21:38:54.647148] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T21:38:54.657153] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-25T21:38:56.120180] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T21:38:56.129572] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-25T21:38:57.741739] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T21:38:57.752560] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-25T21:38:58.958928] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T21:38:58.968054] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-25T21:39:00.605861] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T21:39:00.615811] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-25T21:39:02.389744] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T21:39:02.399001] [INFO ] [REMOTE ] FR: Full fetch complete (67327 records). [2025-10-25T21:39:02.399198] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-25T21:39:02.806217] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-25T21:39:02.806379] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-25T21:39:02.807726] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-25T21:39:02.807816] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-25T21:39:02.809834] [DEBUG] [LOCAL ] FR: Trimmed 67327 records to 47298 (keeping 200 days of data) [2025-10-25T21:39:03.086450] [DEBUG] [LOCAL ] FR: Primary data saved (47298 records). [2025-10-25T21:39:03.086614] [INFO ] [MAIN ] FR: Full history saved. [2025-10-25T21:39:03.086774] [INFO ] [MAIN ] Update Progress: 868/2366 symbols. FR took 16.5s. Estimated remaining time: 4h 38m 17s [2025-10-25T21:39:03.251413] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:39:03.251600] [DEBUG] [LOCAL ] FRA: No existing data file found in primary storage. [2025-10-25T21:39:03.251694] [WARN ] [MAIN ] FRA: No existing data found, performing full refresh instead. [2025-10-25T21:39:03.251808] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-25T21:39:03.251880] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-25T21:39:03.251963] [DEBUG] [LOCAL ] FRA: No primary data file found to delete. [2025-10-25T21:39:03.252034] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-25T21:39:03.605999] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:39:03.606458] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-25T21:39:04.843574] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T21:39:04.852250] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-25T21:39:05.786946] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T21:39:05.791491] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-25T21:39:06.750161] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T21:39:06.754593] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-25T21:39:07.856465] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T21:39:07.860809] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-25T21:39:08.784311] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T21:39:08.789263] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-25T21:39:09.732284] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T21:39:09.736169] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-25T21:39:10.748719] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T21:39:10.752466] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-25T21:39:11.559734] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-25T21:39:11.562943] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-25T21:39:12.361153] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T21:39:12.364515] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-25T21:39:13.238586] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T21:39:13.241508] [INFO ] [REMOTE ] FRA: Full fetch complete (23161 records). [2025-10-25T21:39:13.241614] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-25T21:39:13.606297] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-25T21:39:13.606462] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-25T21:39:13.606943] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-25T21:39:13.607047] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-25T21:39:13.607746] [DEBUG] [LOCAL ] FRA: Trimmed 23161 records to 14173 (keeping 200 days of data) [2025-10-25T21:39:13.690527] [DEBUG] [LOCAL ] FRA: Primary data saved (14173 records). [2025-10-25T21:39:13.690708] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-25T21:39:13.690858] [INFO ] [MAIN ] Update Progress: 869/2366 symbols. FRA took 10.6s. Estimated remaining time: 4h 38m 5s [2025-10-25T21:39:13.857214] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:39:13.857419] [DEBUG] [LOCAL ] FRGE: No existing data file found in primary storage. [2025-10-25T21:39:13.857509] [WARN ] [MAIN ] FRGE: No existing data found, performing full refresh instead. [2025-10-25T21:39:13.857669] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-25T21:39:13.857760] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-25T21:39:13.857891] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-10-25T21:39:13.857977] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-25T21:39:14.214918] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:39:14.215235] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-25T21:39:15.582461] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T21:39:15.589781] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-25T21:39:16.805783] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T21:39:16.813184] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-25T21:39:17.912739] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T21:39:17.919383] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-25T21:39:19.102634] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T21:39:19.108569] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-25T21:39:20.077785] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-25T21:39:20.082174] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-25T21:39:20.961246] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T21:39:20.964743] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-25T21:39:21.953784] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T21:39:21.957591] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-25T21:39:23.005294] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T21:39:23.009337] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-25T21:39:23.795351] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T21:39:23.798628] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-25T21:39:24.603017] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T21:39:24.605603] [INFO ] [REMOTE ] FRGE: Full fetch complete (29768 records). [2025-10-25T21:39:24.605777] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-25T21:39:25.002075] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-25T21:39:25.002197] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-25T21:39:25.002782] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-25T21:39:25.002861] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-25T21:39:25.003678] [DEBUG] [LOCAL ] FRGE: Trimmed 29768 records to 15673 (keeping 200 days of data) [2025-10-25T21:39:25.093723] [DEBUG] [LOCAL ] FRGE: Primary data saved (15673 records). [2025-10-25T21:39:25.093904] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-25T21:39:25.094037] [INFO ] [MAIN ] Update Progress: 870/2366 symbols. FRGE took 11.4s. Estimated remaining time: 4h 37m 54s [2025-10-25T21:39:25.271889] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:39:25.272072] [DEBUG] [LOCAL ] FRO: No existing data file found in primary storage. [2025-10-25T21:39:25.272143] [WARN ] [MAIN ] FRO: No existing data found, performing full refresh instead. [2025-10-25T21:39:25.272255] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-25T21:39:25.272327] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-25T21:39:25.272408] [DEBUG] [LOCAL ] FRO: No primary data file found to delete. [2025-10-25T21:39:25.272479] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-25T21:39:25.622897] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:39:25.623206] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-25T21:39:27.492706] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T21:39:27.502913] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-25T21:39:29.252136] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-25T21:39:29.262155] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-25T21:39:31.276308] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-25T21:39:31.287002] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-25T21:39:33.137291] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T21:39:33.148026] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-25T21:39:35.109795] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-25T21:39:35.121439] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-25T21:39:36.692090] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T21:39:36.703196] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-25T21:39:38.466770] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-25T21:39:38.480419] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-25T21:39:40.136127] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T21:39:40.146835] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-25T21:39:42.077680] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-25T21:39:42.088818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-25T21:39:43.824130] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T21:39:43.833635] [INFO ] [REMOTE ] FRO: Full fetch complete (75384 records). [2025-10-25T21:39:43.833838] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-25T21:39:44.253833] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-25T21:39:44.253966] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-25T21:39:44.255158] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-25T21:39:44.255247] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-25T21:39:44.256768] [DEBUG] [LOCAL ] FRO: Trimmed 75384 records to 52440 (keeping 200 days of data) [2025-10-25T21:39:44.595467] [DEBUG] [LOCAL ] FRO: Primary data saved (52440 records). [2025-10-25T21:39:44.595638] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-25T21:39:44.595806] [INFO ] [MAIN ] Update Progress: 871/2366 symbols. FRO took 19.5s. Estimated remaining time: 4h 37m 58s [2025-10-25T21:39:44.787476] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:39:44.787728] [DEBUG] [LOCAL ] FRT: No existing data file found in primary storage. [2025-10-25T21:39:44.787808] [WARN ] [MAIN ] FRT: No existing data found, performing full refresh instead. [2025-10-25T21:39:44.787958] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-25T21:39:44.788031] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-25T21:39:44.788114] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-25T21:39:44.788187] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-25T21:39:45.189871] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:39:45.190236] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-25T21:39:46.790238] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T21:39:46.798409] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-25T21:39:48.244039] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T21:39:48.251954] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-25T21:39:49.862337] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:39:49.871637] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-25T21:39:51.535387] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T21:39:51.545123] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-25T21:39:53.015847] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T21:39:53.024924] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-25T21:39:54.436138] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T21:39:54.444473] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-25T21:39:55.961183] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T21:39:55.970883] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-25T21:39:57.593455] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T21:39:57.602798] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-25T21:39:58.373711] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T21:39:58.382305] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-25T21:39:59.684560] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-25T21:39:59.691913] [INFO ] [REMOTE ] FRT: Full fetch complete (60421 records). [2025-10-25T21:39:59.692098] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-25T21:40:00.111890] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-25T21:40:00.112028] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-25T21:40:00.112833] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-25T21:40:00.112913] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-25T21:40:00.114329] [DEBUG] [LOCAL ] FRT: Trimmed 60421 records to 41967 (keeping 200 days of data) [2025-10-25T21:40:00.364857] [DEBUG] [LOCAL ] FRT: Primary data saved (41967 records). [2025-10-25T21:40:00.365010] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-25T21:40:00.365142] [INFO ] [MAIN ] Update Progress: 872/2366 symbols. FRT took 15.8s. Estimated remaining time: 4h 37m 54s [2025-10-25T21:40:00.532141] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:40:00.532326] [DEBUG] [LOCAL ] FSCO: No existing data file found in primary storage. [2025-10-25T21:40:00.532397] [WARN ] [MAIN ] FSCO: No existing data found, performing full refresh instead. [2025-10-25T21:40:00.532508] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-25T21:40:00.532578] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-25T21:40:00.532683] [DEBUG] [LOCAL ] FSCO: No primary data file found to delete. [2025-10-25T21:40:00.532753] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-25T21:40:00.886713] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:40:00.887075] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-25T21:40:02.524945] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T21:40:02.534122] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-25T21:40:04.264098] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T21:40:04.272002] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-25T21:40:05.454000] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T21:40:05.462209] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-25T21:40:06.659664] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T21:40:06.669057] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-25T21:40:08.208621] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T21:40:08.216876] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-25T21:40:09.448069] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-25T21:40:09.455155] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-25T21:40:10.851540] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-25T21:40:10.862385] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-25T21:40:15.785253] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (4.92 seconds). [2025-10-25T21:40:15.793495] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-25T21:40:17.483218] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T21:40:17.493602] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-25T21:40:18.996740] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T21:40:19.004907] [INFO ] [REMOTE ] FSCO: Full fetch complete (55293 records). [2025-10-25T21:40:19.005062] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-25T21:40:19.401166] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-25T21:40:19.401283] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-25T21:40:19.402083] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-25T21:40:19.402163] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-25T21:40:19.403245] [DEBUG] [LOCAL ] FSCO: Trimmed 55293 records to 39084 (keeping 200 days of data) [2025-10-25T21:40:19.621264] [DEBUG] [LOCAL ] FSCO: Primary data saved (39084 records). [2025-10-25T21:40:19.621429] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-25T21:40:19.621559] [INFO ] [MAIN ] Update Progress: 873/2366 symbols. FSCO took 19.3s. Estimated remaining time: 4h 37m 57s [2025-10-25T21:40:19.794219] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:40:19.794432] [DEBUG] [LOCAL ] FSK: No existing data file found in primary storage. [2025-10-25T21:40:19.794504] [WARN ] [MAIN ] FSK: No existing data found, performing full refresh instead. [2025-10-25T21:40:19.794625] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-25T21:40:19.794718] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-25T21:40:19.794796] [DEBUG] [LOCAL ] FSK: No primary data file found to delete. [2025-10-25T21:40:19.794862] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-25T21:40:20.179260] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:40:20.179585] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-25T21:40:21.985705] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T21:40:21.995427] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-25T21:40:23.646522] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T21:40:23.655884] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-25T21:40:25.573235] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T21:40:25.584016] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-25T21:40:27.228001] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T21:40:27.239436] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-25T21:40:28.878858] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T21:40:28.889236] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-25T21:40:30.568599] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-25T21:40:30.578059] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-25T21:40:32.210271] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:40:32.220427] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-25T21:40:37.216306] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (5.00 seconds). [2025-10-25T21:40:37.227191] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-25T21:40:39.120682] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T21:40:39.131479] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-25T21:40:40.944256] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-25T21:40:40.953878] [INFO ] [REMOTE ] FSK: Full fetch complete (72116 records). [2025-10-25T21:40:40.954042] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-25T21:40:41.365985] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-25T21:40:41.366113] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-25T21:40:41.366998] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-25T21:40:41.367076] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-25T21:40:41.368426] [DEBUG] [LOCAL ] FSK: Trimmed 72116 records to 50191 (keeping 200 days of data) [2025-10-25T21:40:41.663470] [DEBUG] [LOCAL ] FSK: Primary data saved (50191 records). [2025-10-25T21:40:41.663671] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-25T21:40:41.663815] [INFO ] [MAIN ] Update Progress: 874/2366 symbols. FSK took 22.0s. Estimated remaining time: 4h 38m 4s [2025-10-25T21:40:41.839252] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:40:41.839450] [DEBUG] [LOCAL ] FSLY: No existing data file found in primary storage. [2025-10-25T21:40:41.839520] [WARN ] [MAIN ] FSLY: No existing data found, performing full refresh instead. [2025-10-25T21:40:41.839628] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-25T21:40:41.839712] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-25T21:40:41.839771] [DEBUG] [LOCAL ] FSLY: No primary data file found to delete. [2025-10-25T21:40:41.839810] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-25T21:40:42.220485] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:40:42.220842] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-25T21:40:43.886593] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T21:40:43.896839] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-25T21:40:45.654528] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T21:40:45.664559] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-25T21:40:47.356606] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T21:40:47.367451] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-25T21:40:49.185569] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T21:40:49.196207] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-25T21:40:50.796311] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T21:40:50.806998] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-25T21:40:52.293092] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T21:40:52.303278] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-25T21:40:53.910983] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T21:40:53.921923] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-25T21:40:55.392602] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T21:40:55.403500] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-25T21:40:56.883073] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T21:40:56.894815] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-25T21:40:58.499344] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-25T21:40:58.509104] [INFO ] [REMOTE ] FSLY: Full fetch complete (74889 records). [2025-10-25T21:40:58.509283] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-25T21:40:58.955582] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-25T21:40:58.955721] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-25T21:40:58.956741] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-25T21:40:58.956835] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-25T21:40:58.958375] [DEBUG] [LOCAL ] FSLY: Trimmed 74889 records to 52033 (keeping 200 days of data) [2025-10-25T21:40:59.255476] [DEBUG] [LOCAL ] FSLY: Primary data saved (52033 records). [2025-10-25T21:40:59.255634] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-25T21:40:59.255788] [INFO ] [MAIN ] Update Progress: 875/2366 symbols. FSLY took 17.6s. Estimated remaining time: 4h 38m 4s [2025-10-25T21:40:59.421137] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:40:59.421320] [DEBUG] [LOCAL ] FSM: No existing data file found in primary storage. [2025-10-25T21:40:59.421390] [WARN ] [MAIN ] FSM: No existing data found, performing full refresh instead. [2025-10-25T21:40:59.421501] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-25T21:40:59.421570] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-25T21:40:59.421670] [DEBUG] [LOCAL ] FSM: No primary data file found to delete. [2025-10-25T21:40:59.421738] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-25T21:40:59.778276] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:40:59.778637] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-25T21:41:01.722264] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T21:41:01.732225] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-25T21:41:03.785167] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-25T21:41:03.795024] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-25T21:41:05.400191] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:41:05.411229] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-25T21:41:07.179199] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T21:41:07.190286] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-25T21:41:08.910061] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T21:41:08.921178] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-25T21:41:10.671370] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T21:41:10.682004] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-25T21:41:12.412623] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T21:41:12.425925] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-25T21:41:14.189058] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T21:41:14.200203] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-25T21:41:15.980839] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T21:41:15.992129] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-25T21:41:17.743887] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T21:41:17.753747] [INFO ] [REMOTE ] FSM: Full fetch complete (77180 records). [2025-10-25T21:41:17.753936] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-25T21:41:18.147017] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-25T21:41:18.147141] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-25T21:41:18.148134] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-25T21:41:18.148216] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-25T21:41:18.149687] [DEBUG] [LOCAL ] FSM: Trimmed 77180 records to 54078 (keeping 200 days of data) [2025-10-25T21:41:18.447585] [DEBUG] [LOCAL ] FSM: Primary data saved (54078 records). [2025-10-25T21:41:18.447776] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-25T21:41:18.447978] [INFO ] [MAIN ] Update Progress: 876/2366 symbols. FSM took 19.2s. Estimated remaining time: 4h 38m 7s [2025-10-25T21:41:18.613855] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:41:18.614062] [DEBUG] [LOCAL ] FSS: No existing data file found in primary storage. [2025-10-25T21:41:18.614133] [WARN ] [MAIN ] FSS: No existing data found, performing full refresh instead. [2025-10-25T21:41:18.614218] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-25T21:41:18.614285] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-25T21:41:18.614365] [DEBUG] [LOCAL ] FSS: No primary data file found to delete. [2025-10-25T21:41:18.614435] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-25T21:41:18.969354] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:41:18.969733] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-25T21:41:20.133240] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T21:41:20.139248] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-25T21:41:21.604181] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T21:41:21.611292] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-25T21:41:22.983069] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T21:41:22.991360] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-25T21:41:24.417855] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T21:41:24.426754] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-25T21:41:25.897624] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T21:41:25.908806] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-25T21:41:27.186869] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T21:41:27.193877] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-25T21:41:28.746955] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T21:41:28.755257] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-25T21:41:29.948155] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-25T21:41:29.954716] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-25T21:41:31.992514] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-25T21:41:31.998939] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-25T21:41:33.279066] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T21:41:33.284375] [INFO ] [REMOTE ] FSS: Full fetch complete (48333 records). [2025-10-25T21:41:33.284517] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-25T21:41:33.654123] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-25T21:41:33.654239] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-25T21:41:33.654980] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-25T21:41:33.655060] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-25T21:41:33.656156] [DEBUG] [LOCAL ] FSS: Trimmed 48333 records to 33423 (keeping 200 days of data) [2025-10-25T21:41:33.856824] [DEBUG] [LOCAL ] FSS: Primary data saved (33423 records). [2025-10-25T21:41:33.857081] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-25T21:41:33.857250] [INFO ] [MAIN ] Update Progress: 877/2366 symbols. FSS took 15.4s. Estimated remaining time: 4h 38m 3s [2025-10-25T21:41:34.025139] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:41:34.025383] [DEBUG] [LOCAL ] FT: No existing data file found in primary storage. [2025-10-25T21:41:34.025454] [WARN ] [MAIN ] FT: No existing data found, performing full refresh instead. [2025-10-25T21:41:34.025566] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-25T21:41:34.025636] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-25T21:41:34.025739] [DEBUG] [LOCAL ] FT: No primary data file found to delete. [2025-10-25T21:41:34.025808] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-25T21:41:34.372261] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:41:34.372592] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-25T21:41:34.986039] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T21:41:34.988180] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-25T21:41:35.597516] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T21:41:35.599262] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-25T21:41:36.248692] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-25T21:41:36.250558] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-25T21:41:36.943435] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-25T21:41:36.945699] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-25T21:41:37.651665] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T21:41:37.653906] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-25T21:41:38.231824] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-25T21:41:38.233565] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-25T21:41:39.031122] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-25T21:41:39.033453] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-25T21:41:39.735178] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-25T21:41:39.737461] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-25T21:41:40.525436] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T21:41:40.527750] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-25T21:41:41.243336] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T21:41:41.245408] [INFO ] [REMOTE ] FT: Full fetch complete (9327 records). [2025-10-25T21:41:41.245505] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-25T21:41:41.605984] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-25T21:41:41.606124] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-25T21:41:41.606394] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-25T21:41:41.606477] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-25T21:41:41.606973] [DEBUG] [LOCAL ] FT: Trimmed 9327 records to 6909 (keeping 200 days of data) [2025-10-25T21:41:41.646246] [DEBUG] [LOCAL ] FT: Primary data saved (6909 records). [2025-10-25T21:41:41.646411] [INFO ] [MAIN ] FT: Full history saved. [2025-10-25T21:41:41.646554] [INFO ] [MAIN ] Update Progress: 878/2366 symbols. FT took 7.8s. Estimated remaining time: 4h 37m 46s [2025-10-25T21:41:41.813227] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:41:41.813448] [DEBUG] [LOCAL ] FTHY: No existing data file found in primary storage. [2025-10-25T21:41:41.813517] [WARN ] [MAIN ] FTHY: No existing data found, performing full refresh instead. [2025-10-25T21:41:41.813627] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-25T21:41:41.813716] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-25T21:41:41.813815] [DEBUG] [LOCAL ] FTHY: No primary data file found to delete. [2025-10-25T21:41:41.813885] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-25T21:41:42.167697] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:41:42.168091] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-25T21:41:43.100344] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T21:41:43.105129] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-25T21:41:43.819231] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T21:41:43.821850] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-25T21:41:44.586240] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T21:41:44.588838] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-25T21:41:45.496121] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T21:41:45.500274] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-25T21:41:46.460566] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T21:41:46.463385] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-25T21:41:47.183960] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T21:41:47.186674] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-25T21:41:48.039637] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T21:41:48.042929] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-25T21:41:48.889889] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T21:41:48.893067] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-25T21:41:49.688617] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T21:41:49.691770] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-25T21:41:50.431863] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T21:41:50.434829] [INFO ] [REMOTE ] FTHY: Full fetch complete (17263 records). [2025-10-25T21:41:50.434931] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-25T21:41:50.790471] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-25T21:41:50.790578] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-25T21:41:50.790969] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-25T21:41:50.791048] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-25T21:41:50.791604] [DEBUG] [LOCAL ] FTHY: Trimmed 17263 records to 12452 (keeping 200 days of data) [2025-10-25T21:41:50.863245] [DEBUG] [LOCAL ] FTHY: Primary data saved (12452 records). [2025-10-25T21:41:50.863394] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-25T21:41:50.863525] [INFO ] [MAIN ] Update Progress: 879/2366 symbols. FTHY took 9.2s. Estimated remaining time: 4h 37m 31s [2025-10-25T21:41:51.031698] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:41:51.031921] [DEBUG] [LOCAL ] FTI: No existing data file found in primary storage. [2025-10-25T21:41:51.032000] [WARN ] [MAIN ] FTI: No existing data found, performing full refresh instead. [2025-10-25T21:41:51.032114] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-25T21:41:51.032185] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-25T21:41:51.032271] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-10-25T21:41:51.032342] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-25T21:41:51.381959] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:41:51.382285] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-25T21:41:53.008549] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T21:41:53.018969] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-25T21:41:54.675220] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T21:41:54.685397] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-25T21:41:56.397009] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T21:41:56.408111] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-25T21:41:58.242218] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T21:41:58.253206] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-25T21:42:00.040141] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-25T21:42:00.058161] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-25T21:42:02.341805] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-25T21:42:02.352796] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-25T21:42:04.763634] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-25T21:42:04.775146] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-25T21:42:06.704739] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-25T21:42:06.716085] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-25T21:42:08.439313] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T21:42:08.451899] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-25T21:42:10.067605] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T21:42:10.077425] [INFO ] [REMOTE ] FTI: Full fetch complete (77334 records). [2025-10-25T21:42:10.077615] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-25T21:42:10.472471] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-25T21:42:10.472598] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-25T21:42:10.473558] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-25T21:42:10.473669] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-25T21:42:10.475230] [DEBUG] [LOCAL ] FTI: Trimmed 77334 records to 54073 (keeping 200 days of data) [2025-10-25T21:42:10.785635] [DEBUG] [LOCAL ] FTI: Primary data saved (54073 records). [2025-10-25T21:42:10.785815] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-25T21:42:10.785927] [INFO ] [MAIN ] Update Progress: 880/2366 symbols. FTI took 19.9s. Estimated remaining time: 4h 37m 35s [2025-10-25T21:42:10.980314] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:42:10.980550] [DEBUG] [LOCAL ] FTK: No existing data file found in primary storage. [2025-10-25T21:42:10.980612] [WARN ] [MAIN ] FTK: No existing data found, performing full refresh instead. [2025-10-25T21:42:10.980743] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-25T21:42:10.980815] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-25T21:42:10.980876] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-10-25T21:42:10.980937] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-25T21:42:11.355848] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:42:11.356209] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-25T21:42:12.486438] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T21:42:12.492201] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-25T21:42:13.863086] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T21:42:13.867855] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-25T21:42:15.128906] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-25T21:42:15.135129] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-25T21:42:16.434540] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T21:42:16.439865] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-25T21:42:17.729796] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T21:42:17.737245] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-25T21:42:19.137841] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-25T21:42:19.146347] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-25T21:42:20.537007] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T21:42:20.545790] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-25T21:42:21.924084] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T21:42:21.931477] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-25T21:42:23.214185] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T21:42:23.221712] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-25T21:42:24.515634] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T21:42:24.522230] [INFO ] [REMOTE ] FTK: Full fetch complete (44191 records). [2025-10-25T21:42:24.522426] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-25T21:42:24.910081] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-25T21:42:24.910235] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-25T21:42:24.911169] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-25T21:42:24.911254] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-25T21:42:24.912772] [DEBUG] [LOCAL ] FTK: Trimmed 44191 records to 33491 (keeping 200 days of data) [2025-10-25T21:42:25.121045] [DEBUG] [LOCAL ] FTK: Primary data saved (33491 records). [2025-10-25T21:42:25.121301] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-25T21:42:25.121478] [INFO ] [MAIN ] Update Progress: 881/2366 symbols. FTK took 14.3s. Estimated remaining time: 4h 37m 29s [2025-10-25T21:42:25.305689] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:42:25.305988] [DEBUG] [LOCAL ] FTS: No existing data file found in primary storage. [2025-10-25T21:42:25.306067] [WARN ] [MAIN ] FTS: No existing data found, performing full refresh instead. [2025-10-25T21:42:25.306196] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-25T21:42:25.306272] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-25T21:42:25.306363] [DEBUG] [LOCAL ] FTS: No primary data file found to delete. [2025-10-25T21:42:25.306439] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-25T21:42:25.670271] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:42:25.670630] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-25T21:42:27.100302] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T21:42:27.108515] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-25T21:42:28.464163] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-25T21:42:28.473366] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-25T21:42:30.000309] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T21:42:30.008987] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-25T21:42:31.488701] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T21:42:31.498248] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-25T21:42:32.906513] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T21:42:32.915513] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-25T21:42:34.282127] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T21:42:34.291247] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-25T21:42:35.568004] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T21:42:35.578015] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-25T21:42:37.122628] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T21:42:37.131429] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-25T21:42:39.163607] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-25T21:42:39.172486] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-25T21:42:40.711987] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T21:42:40.719996] [INFO ] [REMOTE ] FTS: Full fetch complete (60866 records). [2025-10-25T21:42:40.720141] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-25T21:42:41.128137] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-25T21:42:41.128252] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-25T21:42:41.129072] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-25T21:42:41.129151] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-25T21:42:41.130339] [DEBUG] [LOCAL ] FTS: Trimmed 60866 records to 43082 (keeping 200 days of data) [2025-10-25T21:42:41.378289] [DEBUG] [LOCAL ] FTS: Primary data saved (43082 records). [2025-10-25T21:42:41.378444] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-25T21:42:41.378578] [INFO ] [MAIN ] Update Progress: 882/2366 symbols. FTS took 16.3s. Estimated remaining time: 4h 37m 26s [2025-10-25T21:42:41.545762] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:42:41.545951] [DEBUG] [LOCAL ] FTV: No existing data file found in primary storage. [2025-10-25T21:42:41.546022] [WARN ] [MAIN ] FTV: No existing data found, performing full refresh instead. [2025-10-25T21:42:41.546132] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-25T21:42:41.546201] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-25T21:42:41.546282] [DEBUG] [LOCAL ] FTV: No primary data file found to delete. [2025-10-25T21:42:41.546351] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-25T21:42:41.949228] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:42:41.949571] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-25T21:42:43.621399] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T21:42:43.631951] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-25T21:42:45.342376] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T21:42:45.352274] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-25T21:42:47.145447] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T21:42:47.156315] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-25T21:42:48.953144] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-25T21:42:48.965723] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-25T21:42:50.718405] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-25T21:42:50.729953] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-25T21:42:52.861771] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-25T21:42:52.878947] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-25T21:42:54.687996] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-25T21:42:54.699373] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-25T21:42:56.597750] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-25T21:42:56.609273] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-25T21:42:58.425762] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T21:42:58.437393] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-25T21:42:59.977626] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T21:42:59.987750] [INFO ] [REMOTE ] FTV: Full fetch complete (76614 records). [2025-10-25T21:42:59.987975] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-25T21:43:00.379111] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-25T21:43:00.379232] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-25T21:43:00.380186] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-25T21:43:00.380267] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-25T21:43:00.381787] [DEBUG] [LOCAL ] FTV: Trimmed 76614 records to 53787 (keeping 200 days of data) [2025-10-25T21:43:00.699447] [DEBUG] [LOCAL ] FTV: Primary data saved (53787 records). [2025-10-25T21:43:00.699609] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-25T21:43:00.699770] [INFO ] [MAIN ] Update Progress: 883/2366 symbols. FTV took 19.3s. Estimated remaining time: 4h 37m 28s [2025-10-25T21:43:00.863425] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:43:00.863619] [DEBUG] [LOCAL ] FTWO: No existing data file found in primary storage. [2025-10-25T21:43:00.863711] [WARN ] [MAIN ] FTWO: No existing data found, performing full refresh instead. [2025-10-25T21:43:00.863820] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-25T21:43:00.863890] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-25T21:43:00.863969] [DEBUG] [LOCAL ] FTWO: No primary data file found to delete. [2025-10-25T21:43:00.864041] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-25T21:43:01.208389] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:43:01.208710] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-25T21:43:02.088927] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T21:43:02.090544] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-25T21:43:02.629083] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-25T21:43:02.630460] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-25T21:43:03.076187] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-25T21:43:03.077446] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-25T21:43:03.438575] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-25T21:43:03.439680] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-25T21:43:03.805712] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-25T21:43:03.806807] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-25T21:43:04.268739] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-25T21:43:04.270008] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-25T21:43:04.720766] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-25T21:43:04.722021] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-25T21:43:05.182679] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T21:43:05.184056] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-25T21:43:05.642608] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-25T21:43:05.644268] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-25T21:43:06.302118] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-25T21:43:06.303291] [INFO ] [REMOTE ] FTWO: Full fetch complete (3318 records). [2025-10-25T21:43:06.303391] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-25T21:43:06.665699] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-25T21:43:06.665835] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-25T21:43:06.665981] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-25T21:43:06.666053] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-25T21:43:06.666428] [DEBUG] [LOCAL ] FTWO: Trimmed 3318 records to 1980 (keeping 200 days of data) [2025-10-25T21:43:06.678607] [DEBUG] [LOCAL ] FTWO: Primary data saved (1980 records). [2025-10-25T21:43:06.678708] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-25T21:43:06.678829] [INFO ] [MAIN ] Update Progress: 884/2366 symbols. FTWO took 6.0s. Estimated remaining time: 4h 37m 8s [2025-10-25T21:43:06.844034] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:43:06.844220] [DEBUG] [LOCAL ] FUBO: No existing data file found in primary storage. [2025-10-25T21:43:06.844289] [WARN ] [MAIN ] FUBO: No existing data found, performing full refresh instead. [2025-10-25T21:43:06.844396] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-25T21:43:06.844463] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-25T21:43:06.844520] [DEBUG] [LOCAL ] FUBO: No primary data file found to delete. [2025-10-25T21:43:06.844579] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-25T21:43:07.187741] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:43:07.188106] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-25T21:43:09.628143] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-25T21:43:09.638801] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-25T21:43:12.097206] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-25T21:43:12.107302] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-25T21:43:14.577952] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-25T21:43:14.589107] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-25T21:43:16.740129] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-25T21:43:16.752223] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-25T21:43:19.048023] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-25T21:43:19.059293] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-25T21:43:21.001582] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-25T21:43:21.012391] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-25T21:43:23.312552] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-25T21:43:23.324253] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-25T21:43:25.323321] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-25T21:43:25.335571] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-25T21:43:27.446942] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-25T21:43:27.459384] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-25T21:43:29.360677] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-25T21:43:29.370559] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-25T21:43:29.370759] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-25T21:43:29.756607] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-25T21:43:29.756760] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-25T21:43:29.757720] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-25T21:43:29.757834] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-25T21:43:29.759358] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 54493 (keeping 200 days of data) [2025-10-25T21:43:30.057357] [DEBUG] [LOCAL ] FUBO: Primary data saved (54493 records). [2025-10-25T21:43:30.057538] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-25T21:43:30.057703] [INFO ] [MAIN ] Update Progress: 885/2366 symbols. FUBO took 23.4s. Estimated remaining time: 4h 37m 17s [2025-10-25T21:43:30.224805] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:43:30.225001] [DEBUG] [LOCAL ] FUL: No existing data file found in primary storage. [2025-10-25T21:43:30.225077] [WARN ] [MAIN ] FUL: No existing data found, performing full refresh instead. [2025-10-25T21:43:30.225196] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-25T21:43:30.225269] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-25T21:43:30.225354] [DEBUG] [LOCAL ] FUL: No primary data file found to delete. [2025-10-25T21:43:30.225429] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-25T21:43:30.604202] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:43:30.604818] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-25T21:43:32.072883] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T21:43:32.083247] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-25T21:43:33.363832] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-25T21:43:33.370575] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-25T21:43:34.760197] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T21:43:34.768261] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-25T21:43:36.282252] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T21:43:36.291313] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-25T21:43:37.604320] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T21:43:37.610474] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-25T21:43:38.886439] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T21:43:38.893203] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-25T21:43:40.233734] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T21:43:40.242633] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-25T21:43:41.496421] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-25T21:43:41.503133] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-25T21:43:42.819768] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T21:43:42.827527] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-25T21:43:44.170583] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-25T21:43:44.176328] [INFO ] [REMOTE ] FUL: Full fetch complete (47809 records). [2025-10-25T21:43:44.176440] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-25T21:43:44.555744] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-25T21:43:44.555870] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-25T21:43:44.556691] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-25T21:43:44.556773] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-25T21:43:44.557924] [DEBUG] [LOCAL ] FUL: Trimmed 47809 records to 32473 (keeping 200 days of data) [2025-10-25T21:43:44.745823] [DEBUG] [LOCAL ] FUL: Primary data saved (32473 records). [2025-10-25T21:43:44.745987] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-25T21:43:44.746131] [INFO ] [MAIN ] Update Progress: 886/2366 symbols. FUL took 14.7s. Estimated remaining time: 4h 37m 12s [2025-10-25T21:43:44.914253] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:43:44.914475] [DEBUG] [LOCAL ] FUN: No existing data file found in primary storage. [2025-10-25T21:43:44.914548] [WARN ] [MAIN ] FUN: No existing data found, performing full refresh instead. [2025-10-25T21:43:44.914686] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-25T21:43:44.914761] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-25T21:43:44.914844] [DEBUG] [LOCAL ] FUN: No primary data file found to delete. [2025-10-25T21:43:44.914915] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-25T21:43:45.265850] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:43:45.266189] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-25T21:43:46.730394] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T21:43:46.739486] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-25T21:43:48.092901] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T21:43:48.101901] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-25T21:43:49.726720] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T21:43:49.737319] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-25T21:43:51.524084] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T21:43:51.534680] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-25T21:43:53.323846] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-25T21:43:53.334776] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-25T21:43:54.862011] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T21:43:54.872271] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-25T21:43:56.732128] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T21:43:56.744188] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-25T21:43:58.426506] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T21:43:58.438013] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-25T21:44:00.287860] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-25T21:44:00.299877] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-25T21:44:02.526991] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-25T21:44:02.537002] [INFO ] [REMOTE ] FUN: Full fetch complete (73599 records). [2025-10-25T21:44:02.537243] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-25T21:44:02.924175] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-25T21:44:02.924287] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-25T21:44:02.925200] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-25T21:44:02.925281] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-25T21:44:02.926637] [DEBUG] [LOCAL ] FUN: Trimmed 73599 records to 52795 (keeping 200 days of data) [2025-10-25T21:44:03.218266] [DEBUG] [LOCAL ] FUN: Primary data saved (52795 records). [2025-10-25T21:44:03.218426] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-25T21:44:03.218559] [INFO ] [MAIN ] Update Progress: 887/2366 symbols. FUN took 18.5s. Estimated remaining time: 4h 37m 13s [2025-10-25T21:44:03.389710] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:44:03.389949] [DEBUG] [LOCAL ] FVR: No existing data file found in primary storage. [2025-10-25T21:44:03.390023] [WARN ] [MAIN ] FVR: No existing data found, performing full refresh instead. [2025-10-25T21:44:03.390136] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-25T21:44:03.390207] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-25T21:44:03.390288] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-10-25T21:44:03.390361] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-25T21:44:03.737858] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:44:03.738173] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-25T21:44:04.728905] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T21:44:04.733455] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-25T21:44:05.678911] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T21:44:05.682363] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-25T21:44:06.839267] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T21:44:06.844404] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-25T21:44:07.985114] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T21:44:07.989936] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-25T21:44:09.061756] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T21:44:09.067135] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-25T21:44:10.284333] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T21:44:10.290103] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-25T21:44:11.355342] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T21:44:11.360571] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-25T21:44:12.454538] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T21:44:12.459701] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-25T21:44:13.412457] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T21:44:13.416728] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-25T21:44:14.347716] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T21:44:14.351372] [INFO ] [REMOTE ] FVR: Full fetch complete (29220 records). [2025-10-25T21:44:14.351543] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-25T21:44:14.734794] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-25T21:44:14.734931] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-25T21:44:14.735607] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-25T21:44:14.735711] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-25T21:44:14.736620] [DEBUG] [LOCAL ] FVR: Trimmed 29220 records to 21021 (keeping 200 days of data) [2025-10-25T21:44:14.859440] [DEBUG] [LOCAL ] FVR: Primary data saved (21021 records). [2025-10-25T21:44:14.859600] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-25T21:44:14.859766] [INFO ] [MAIN ] Update Progress: 888/2366 symbols. FVR took 11.6s. Estimated remaining time: 4h 37m 2s [2025-10-25T21:44:15.033372] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:44:15.033592] [DEBUG] [LOCAL ] FVRR: No existing data file found in primary storage. [2025-10-25T21:44:15.033690] [WARN ] [MAIN ] FVRR: No existing data found, performing full refresh instead. [2025-10-25T21:44:15.033821] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-25T21:44:15.033897] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-25T21:44:15.033964] [DEBUG] [LOCAL ] FVRR: No primary data file found to delete. [2025-10-25T21:44:15.034028] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-25T21:44:15.383956] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:44:15.384289] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-25T21:44:16.973292] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T21:44:16.981918] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-25T21:44:18.545921] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T21:44:18.554246] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-25T21:44:20.133684] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T21:44:20.142851] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-25T21:44:21.474030] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-25T21:44:21.482329] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-25T21:44:22.861761] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T21:44:22.870793] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-25T21:44:24.075110] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T21:44:24.083157] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-25T21:44:25.754483] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-25T21:44:25.764044] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-25T21:44:27.358614] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T21:44:27.368170] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-25T21:44:28.967468] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T21:44:28.976755] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-25T21:44:30.669107] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T21:44:30.676638] [INFO ] [REMOTE ] FVRR: Full fetch complete (59203 records). [2025-10-25T21:44:30.676785] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-25T21:44:31.050241] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-25T21:44:31.050347] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-25T21:44:31.051128] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-25T21:44:31.051203] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-25T21:44:31.052340] [DEBUG] [LOCAL ] FVRR: Trimmed 59203 records to 41105 (keeping 200 days of data) [2025-10-25T21:44:31.277471] [DEBUG] [LOCAL ] FVRR: Primary data saved (41105 records). [2025-10-25T21:44:31.277620] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-25T21:44:31.277771] [INFO ] [MAIN ] Update Progress: 889/2366 symbols. FVRR took 16.4s. Estimated remaining time: 4h 36m 60s [2025-10-25T21:44:31.441744] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:44:31.441918] [DEBUG] [LOCAL ] FXED: No existing data file found in primary storage. [2025-10-25T21:44:31.441988] [WARN ] [MAIN ] FXED: No existing data found, performing full refresh instead. [2025-10-25T21:44:31.442092] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-25T21:44:31.442161] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-25T21:44:31.442221] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-10-25T21:44:31.442282] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-25T21:44:31.791888] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:44:31.792194] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-25T21:44:32.245299] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-25T21:44:32.246262] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-25T21:44:32.586833] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-25T21:44:32.587943] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-25T21:44:32.973480] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-25T21:44:32.974551] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-25T21:44:33.462787] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-25T21:44:33.463825] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-25T21:44:33.735681] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-25T21:44:33.736629] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-25T21:44:34.070096] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-25T21:44:34.071118] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-25T21:44:34.496061] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-25T21:44:34.497190] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-25T21:44:34.927937] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-25T21:44:34.929082] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-25T21:44:35.356019] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-25T21:44:35.357129] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-25T21:44:35.714396] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-25T21:44:35.715251] [INFO ] [REMOTE ] FXED: Full fetch complete (1791 records). [2025-10-25T21:44:35.715343] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-25T21:44:36.064241] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-25T21:44:36.064356] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-25T21:44:36.064477] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-25T21:44:36.064553] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-25T21:44:36.064938] [DEBUG] [LOCAL ] FXED: Trimmed 1791 records to 1249 (keeping 200 days of data) [2025-10-25T21:44:36.072749] [DEBUG] [LOCAL ] FXED: Primary data saved (1249 records). [2025-10-25T21:44:36.072830] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-25T21:44:36.072950] [INFO ] [MAIN ] Update Progress: 890/2366 symbols. FXED took 4.8s. Estimated remaining time: 4h 36m 38s [2025-10-25T21:44:36.242766] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:44:36.242976] [DEBUG] [LOCAL ] G: No existing data file found in primary storage. [2025-10-25T21:44:36.243048] [WARN ] [MAIN ] G: No existing data found, performing full refresh instead. [2025-10-25T21:44:36.243176] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-25T21:44:36.243251] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-25T21:44:36.243333] [DEBUG] [LOCAL ] G: No primary data file found to delete. [2025-10-25T21:44:36.243404] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-25T21:44:36.604251] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:44:36.604574] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-25T21:44:38.178328] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T21:44:38.188661] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-25T21:44:39.895732] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T21:44:39.905212] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-25T21:44:41.476666] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T21:44:41.487224] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-25T21:44:42.997442] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T21:44:43.008623] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-25T21:44:44.626847] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T21:44:44.637334] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-25T21:44:46.264549] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-25T21:44:46.274925] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-25T21:44:47.879172] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T21:44:47.892898] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-25T21:44:49.498041] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T21:44:49.509453] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-25T21:44:51.108357] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T21:44:51.119317] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-25T21:44:52.771837] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T21:44:52.781389] [INFO ] [REMOTE ] G: Full fetch complete (72331 records). [2025-10-25T21:44:52.781529] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-25T21:44:53.180594] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-25T21:44:53.180728] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-25T21:44:53.181775] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-25T21:44:53.181853] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-25T21:44:53.183365] [DEBUG] [LOCAL ] G: Trimmed 72331 records to 50825 (keeping 200 days of data) [2025-10-25T21:44:53.482733] [DEBUG] [LOCAL ] G: Primary data saved (50825 records). [2025-10-25T21:44:53.482895] [INFO ] [MAIN ] G: Full history saved. [2025-10-25T21:44:53.483083] [INFO ] [MAIN ] Update Progress: 891/2366 symbols. G took 17.4s. Estimated remaining time: 4h 36m 37s [2025-10-25T21:44:53.658503] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:44:53.658712] [DEBUG] [LOCAL ] GAB: No existing data file found in primary storage. [2025-10-25T21:44:53.658782] [WARN ] [MAIN ] GAB: No existing data found, performing full refresh instead. [2025-10-25T21:44:53.658877] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-25T21:44:53.658960] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-25T21:44:53.659059] [DEBUG] [LOCAL ] GAB: No primary data file found to delete. [2025-10-25T21:44:53.659134] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-25T21:44:54.015693] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:44:54.016033] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-25T21:44:55.169189] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T21:44:55.174568] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-25T21:44:56.206009] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T21:44:56.210715] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-25T21:44:57.514075] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-25T21:44:57.520787] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-25T21:44:58.948885] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T21:44:58.956894] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-25T21:45:00.045425] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T21:45:00.051539] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-25T21:45:01.692849] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T21:45:01.699677] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-25T21:45:03.523339] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-25T21:45:03.529769] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-25T21:45:04.672193] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T21:45:04.677534] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-25T21:45:05.932524] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T21:45:05.939679] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-25T21:45:07.133371] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T21:45:07.138618] [INFO ] [REMOTE ] GAB: Full fetch complete (39344 records). [2025-10-25T21:45:07.138798] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-25T21:45:07.512348] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-25T21:45:07.512483] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-25T21:45:07.513367] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-25T21:45:07.513461] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-25T21:45:07.514698] [DEBUG] [LOCAL ] GAB: Trimmed 39344 records to 27743 (keeping 200 days of data) [2025-10-25T21:45:07.674117] [DEBUG] [LOCAL ] GAB: Primary data saved (27743 records). [2025-10-25T21:45:07.674273] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-25T21:45:07.674409] [INFO ] [MAIN ] Update Progress: 892/2366 symbols. GAB took 14.2s. Estimated remaining time: 4h 36m 30s [2025-10-25T21:45:07.851211] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:45:07.851451] [DEBUG] [LOCAL ] GAM: No existing data file found in primary storage. [2025-10-25T21:45:07.851526] [WARN ] [MAIN ] GAM: No existing data found, performing full refresh instead. [2025-10-25T21:45:07.851693] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-25T21:45:07.851768] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-25T21:45:07.851848] [DEBUG] [LOCAL ] GAM: No primary data file found to delete. [2025-10-25T21:45:07.851919] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-25T21:45:08.211814] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:45:08.212152] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-25T21:45:08.910105] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T21:45:08.911786] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-25T21:45:09.658492] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T21:45:09.660460] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-25T21:45:10.380071] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-25T21:45:10.382665] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-25T21:45:10.998756] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-25T21:45:11.000768] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-25T21:45:11.567534] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T21:45:11.569225] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-25T21:45:12.138368] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T21:45:12.139836] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-25T21:45:12.766693] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-25T21:45:12.768600] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-25T21:45:13.383919] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-25T21:45:13.386067] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-25T21:45:13.921607] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-25T21:45:13.923063] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-25T21:45:14.500837] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T21:45:14.502161] [INFO ] [REMOTE ] GAM: Full fetch complete (6439 records). [2025-10-25T21:45:14.502252] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-25T21:45:14.862784] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-25T21:45:14.862894] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-25T21:45:14.863104] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-25T21:45:14.863179] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-25T21:45:14.863628] [DEBUG] [LOCAL ] GAM: Trimmed 6439 records to 3866 (keeping 200 days of data) [2025-10-25T21:45:14.885349] [DEBUG] [LOCAL ] GAM: Primary data saved (3866 records). [2025-10-25T21:45:14.885449] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-25T21:45:14.885582] [INFO ] [MAIN ] Update Progress: 893/2366 symbols. GAM took 7.2s. Estimated remaining time: 4h 36m 12s [2025-10-25T21:45:15.055223] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:45:15.055430] [DEBUG] [LOCAL ] GAP: No existing data file found in primary storage. [2025-10-25T21:45:15.055512] [WARN ] [MAIN ] GAP: No existing data found, performing full refresh instead. [2025-10-25T21:45:15.055626] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-25T21:45:15.055717] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-25T21:45:15.055849] [DEBUG] [LOCAL ] GAP: No primary data file found to delete. [2025-10-25T21:45:15.055920] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-25T21:45:15.431797] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:45:15.432095] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-25T21:45:17.357004] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T21:45:17.367422] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-25T21:45:18.679880] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T21:45:18.690038] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-25T21:45:20.750620] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T21:45:20.762015] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-25T21:45:22.543713] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T21:45:22.555104] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-25T21:45:24.591114] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-25T21:45:24.602721] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-25T21:45:26.591559] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-25T21:45:26.602466] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-25T21:45:28.392988] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-25T21:45:28.404735] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-25T21:45:30.141992] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T21:45:30.153170] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-25T21:45:32.167490] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-25T21:45:32.178995] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-25T21:45:33.870021] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T21:45:33.879628] [INFO ] [REMOTE ] GAP: Full fetch complete (77814 records). [2025-10-25T21:45:33.879824] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-25T21:45:34.286536] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-25T21:45:34.286709] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-25T21:45:34.287923] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-25T21:45:34.288006] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-25T21:45:34.289995] [DEBUG] [LOCAL ] GAP: Trimmed 77814 records to 54433 (keeping 200 days of data) [2025-10-25T21:45:34.617073] [DEBUG] [LOCAL ] GAP: Primary data saved (54433 records). [2025-10-25T21:45:34.617235] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-25T21:45:34.617378] [INFO ] [MAIN ] Update Progress: 894/2366 symbols. GAP took 19.7s. Estimated remaining time: 4h 36m 15s [2025-10-25T21:45:34.793501] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:45:34.793722] [DEBUG] [LOCAL ] GATX: No existing data file found in primary storage. [2025-10-25T21:45:34.793794] [WARN ] [MAIN ] GATX: No existing data found, performing full refresh instead. [2025-10-25T21:45:34.793904] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-25T21:45:34.793982] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-25T21:45:34.794064] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-10-25T21:45:34.794135] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-25T21:45:35.160833] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:45:35.161241] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-25T21:45:36.185851] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T21:45:36.190005] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-25T21:45:37.094380] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T21:45:37.099417] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-25T21:45:38.173302] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T21:45:38.177213] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-25T21:45:39.401042] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T21:45:39.406417] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-25T21:45:40.525238] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T21:45:40.529560] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-25T21:45:41.483122] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T21:45:41.487504] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-25T21:45:42.537113] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T21:45:42.541687] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-25T21:45:43.590724] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T21:45:43.594536] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-25T21:45:44.699393] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T21:45:44.704291] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-25T21:45:45.583590] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T21:45:45.586780] [INFO ] [REMOTE ] GATX: Full fetch complete (25080 records). [2025-10-25T21:45:45.586876] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-25T21:45:45.944496] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-25T21:45:45.944611] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-25T21:45:45.945147] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-25T21:45:45.945241] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-25T21:45:45.945916] [DEBUG] [LOCAL ] GATX: Trimmed 25080 records to 18267 (keeping 200 days of data) [2025-10-25T21:45:46.055294] [DEBUG] [LOCAL ] GATX: Primary data saved (18267 records). [2025-10-25T21:45:46.055455] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-25T21:45:46.055596] [INFO ] [MAIN ] Update Progress: 895/2366 symbols. GATX took 11.4s. Estimated remaining time: 4h 36m 4s [2025-10-25T21:45:46.224747] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:45:46.225028] [DEBUG] [LOCAL ] GBAB: No existing data file found in primary storage. [2025-10-25T21:45:46.225102] [WARN ] [MAIN ] GBAB: No existing data found, performing full refresh instead. [2025-10-25T21:45:46.225219] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-25T21:45:46.225290] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-25T21:45:46.225370] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-10-25T21:45:46.225440] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-25T21:45:46.576443] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:45:46.576832] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-25T21:45:47.512607] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T21:45:47.515821] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-25T21:45:48.465507] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T21:45:48.468959] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-25T21:45:49.247406] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-25T21:45:49.250572] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-25T21:45:50.261178] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T21:45:50.264865] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-25T21:45:51.016597] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-25T21:45:51.019630] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-25T21:45:51.967506] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T21:45:51.971379] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-25T21:45:52.843785] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T21:45:52.847619] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-25T21:45:53.668510] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T21:45:53.671833] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-25T21:45:54.444018] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T21:45:54.447104] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-25T21:45:55.176217] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T21:45:55.178769] [INFO ] [REMOTE ] GBAB: Full fetch complete (18575 records). [2025-10-25T21:45:55.178865] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-25T21:45:55.548446] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-25T21:45:55.548557] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-25T21:45:55.549021] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-25T21:45:55.549100] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-25T21:45:55.549693] [DEBUG] [LOCAL ] GBAB: Trimmed 18575 records to 12835 (keeping 200 days of data) [2025-10-25T21:45:55.625234] [DEBUG] [LOCAL ] GBAB: Primary data saved (12835 records). [2025-10-25T21:45:55.625396] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-25T21:45:55.625563] [INFO ] [MAIN ] Update Progress: 896/2366 symbols. GBAB took 9.6s. Estimated remaining time: 4h 35m 50s [2025-10-25T21:45:55.809517] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:45:55.809729] [DEBUG] [LOCAL ] GBCI: No existing data file found in primary storage. [2025-10-25T21:45:55.809806] [WARN ] [MAIN ] GBCI: No existing data found, performing full refresh instead. [2025-10-25T21:45:55.809916] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-25T21:45:55.809985] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-25T21:45:55.810049] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-10-25T21:45:55.810112] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-25T21:45:56.158759] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:45:56.159142] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-25T21:45:57.613565] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T21:45:57.622148] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-25T21:45:59.143258] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T21:45:59.151109] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-25T21:46:00.572193] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T21:46:00.580808] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-25T21:46:03.309315] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-25T21:46:03.318247] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-25T21:46:04.837137] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T21:46:04.845339] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-25T21:46:06.293043] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T21:46:06.301187] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-25T21:46:07.812308] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T21:46:07.821773] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-25T21:46:09.353679] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T21:46:09.362690] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-25T21:46:10.910800] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-25T21:46:10.919611] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-25T21:46:12.372097] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T21:46:12.381005] [INFO ] [REMOTE ] GBCI: Full fetch complete (59531 records). [2025-10-25T21:46:12.381176] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-25T21:46:12.758351] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-25T21:46:12.758467] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-25T21:46:12.759273] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-25T21:46:12.759355] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-25T21:46:12.760547] [DEBUG] [LOCAL ] GBCI: Trimmed 59531 records to 41806 (keeping 200 days of data) [2025-10-25T21:46:13.003272] [DEBUG] [LOCAL ] GBCI: Primary data saved (41806 records). [2025-10-25T21:46:13.003439] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-25T21:46:13.003573] [INFO ] [MAIN ] Update Progress: 897/2366 symbols. GBCI took 17.4s. Estimated remaining time: 4h 35m 49s [2025-10-25T21:46:13.170255] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:46:13.170432] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-25T21:46:13.170502] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-25T21:46:13.170612] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-25T21:46:13.170708] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-25T21:46:13.170794] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-25T21:46:13.170865] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-25T21:46:13.532475] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:46:13.532897] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-25T21:46:13.864417] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-25T21:46:13.865321] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-25T21:46:14.118908] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-25T21:46:14.120027] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-25T21:46:14.461560] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-25T21:46:14.462548] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-25T21:46:14.973046] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-25T21:46:14.974115] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-25T21:46:15.389800] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-25T21:46:15.390826] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-25T21:46:15.630679] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-25T21:46:15.631524] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-25T21:46:15.891351] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-25T21:46:15.892254] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-25T21:46:16.344623] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-25T21:46:16.345940] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-25T21:46:16.711548] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-25T21:46:16.712489] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-25T21:46:17.061121] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-25T21:46:17.061917] [INFO ] [REMOTE ] GBLI: Full fetch complete (1290 records). [2025-10-25T21:46:17.062022] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-25T21:46:17.254073] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-25T21:46:17.254266] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-25T21:46:17.254353] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-25T21:46:17.254441] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-25T21:46:17.254538] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-25T21:46:17.254613] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-25T21:46:17.254720] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-25T21:46:17.254847] [INFO ] [MAIN ] Update Progress: 898/2366 symbols. GBLI took 4.3s. Estimated remaining time: 4h 35m 26s [2025-10-25T21:46:17.433735] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:46:17.433932] [DEBUG] [LOCAL ] GBTG: No existing data file found in primary storage. [2025-10-25T21:46:17.434004] [WARN ] [MAIN ] GBTG: No existing data found, performing full refresh instead. [2025-10-25T21:46:17.434120] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-25T21:46:17.434192] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-25T21:46:17.434275] [DEBUG] [LOCAL ] GBTG: No primary data file found to delete. [2025-10-25T21:46:17.434346] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-25T21:46:17.821802] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:46:17.822139] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-25T21:46:19.074033] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T21:46:19.082724] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-25T21:46:20.326178] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T21:46:20.332910] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-25T21:46:21.726555] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T21:46:21.735796] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-25T21:46:23.218055] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T21:46:23.227173] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-25T21:46:24.782821] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T21:46:24.792469] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-25T21:46:26.244382] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T21:46:26.253327] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-25T21:46:27.624503] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T21:46:27.633017] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-25T21:46:28.887283] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-25T21:46:28.895986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-25T21:46:30.331604] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T21:46:30.340318] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-25T21:46:31.707013] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T21:46:31.714359] [INFO ] [REMOTE ] GBTG: Full fetch complete (56882 records). [2025-10-25T21:46:31.714515] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-25T21:46:32.100848] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-25T21:46:32.100977] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-25T21:46:32.101857] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-25T21:46:32.101942] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-25T21:46:32.103262] [DEBUG] [LOCAL ] GBTG: Trimmed 56882 records to 40762 (keeping 200 days of data) [2025-10-25T21:46:32.327257] [DEBUG] [LOCAL ] GBTG: Primary data saved (40762 records). [2025-10-25T21:46:32.327425] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-25T21:46:32.327557] [INFO ] [MAIN ] Update Progress: 899/2366 symbols. GBTG took 15.1s. Estimated remaining time: 4h 35m 21s [2025-10-25T21:46:32.497986] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:46:32.498207] [DEBUG] [LOCAL ] GBX: No existing data file found in primary storage. [2025-10-25T21:46:32.498283] [WARN ] [MAIN ] GBX: No existing data found, performing full refresh instead. [2025-10-25T21:46:32.498397] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-25T21:46:32.498467] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-25T21:46:32.498548] [DEBUG] [LOCAL ] GBX: No primary data file found to delete. [2025-10-25T21:46:32.498618] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-25T21:46:32.855031] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:46:32.855394] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-25T21:46:34.307050] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T21:46:34.313861] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-25T21:46:35.540319] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T21:46:35.547229] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-25T21:46:36.674949] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-25T21:46:36.681378] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-25T21:46:38.184485] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T21:46:38.194139] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-25T21:46:39.278913] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T21:46:39.284479] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-25T21:46:40.387372] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T21:46:40.396715] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-25T21:46:41.901444] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T21:46:41.909882] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-25T21:46:42.968827] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T21:46:42.974570] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-25T21:46:44.091140] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T21:46:44.096705] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-25T21:46:45.128408] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T21:46:45.133451] [INFO ] [REMOTE ] GBX: Full fetch complete (42584 records). [2025-10-25T21:46:45.133620] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-25T21:46:45.510022] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-25T21:46:45.510143] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-25T21:46:45.510859] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-25T21:46:45.510948] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-25T21:46:45.512030] [DEBUG] [LOCAL ] GBX: Trimmed 42584 records to 28498 (keeping 200 days of data) [2025-10-25T21:46:45.679214] [DEBUG] [LOCAL ] GBX: Primary data saved (28498 records). [2025-10-25T21:46:45.679406] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-25T21:46:45.679610] [INFO ] [MAIN ] Update Progress: 900/2366 symbols. GBX took 13.4s. Estimated remaining time: 4h 35m 13s [2025-10-25T21:46:45.846538] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:46:45.846749] [DEBUG] [LOCAL ] GCI: No existing data file found in primary storage. [2025-10-25T21:46:45.846850] [WARN ] [MAIN ] GCI: No existing data found, performing full refresh instead. [2025-10-25T21:46:45.847005] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-25T21:46:45.847091] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-25T21:46:45.847199] [DEBUG] [LOCAL ] GCI: No primary data file found to delete. [2025-10-25T21:46:45.847282] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-25T21:46:46.203813] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:46:46.204257] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-25T21:46:47.551087] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T21:46:47.559449] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-25T21:46:49.034819] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:46:49.043879] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-25T21:46:50.708224] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T21:46:50.718519] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-25T21:46:52.179519] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T21:46:52.189273] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-25T21:46:53.709359] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T21:46:53.720432] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-25T21:46:55.226600] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T21:46:55.236571] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-25T21:46:56.847055] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T21:46:56.856504] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-25T21:46:58.365233] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T21:46:58.374850] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-25T21:46:59.958074] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T21:46:59.967417] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-25T21:47:01.804568] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-25T21:47:01.813675] [INFO ] [REMOTE ] GCI: Full fetch complete (63299 records). [2025-10-25T21:47:01.813878] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-25T21:47:02.206226] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-25T21:47:02.206355] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-25T21:47:02.207214] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-25T21:47:02.207298] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-25T21:47:02.208762] [DEBUG] [LOCAL ] GCI: Trimmed 63299 records to 44213 (keeping 200 days of data) [2025-10-25T21:47:02.445471] [DEBUG] [LOCAL ] GCI: Primary data saved (44213 records). [2025-10-25T21:47:02.445637] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-25T21:47:02.445798] [INFO ] [MAIN ] Update Progress: 901/2366 symbols. GCI took 16.8s. Estimated remaining time: 4h 35m 11s [2025-10-25T21:47:02.617811] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:47:02.618019] [DEBUG] [LOCAL ] GCO: No existing data file found in primary storage. [2025-10-25T21:47:02.618089] [WARN ] [MAIN ] GCO: No existing data found, performing full refresh instead. [2025-10-25T21:47:02.618201] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-25T21:47:02.618271] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-25T21:47:02.618351] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-25T21:47:02.618419] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-25T21:47:02.981351] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:47:02.981700] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-25T21:47:04.008529] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T21:47:04.014307] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-25T21:47:05.205593] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-25T21:47:05.210313] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-25T21:47:06.636400] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-25T21:47:06.643379] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-25T21:47:07.950815] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T21:47:07.957619] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-25T21:47:09.004933] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T21:47:09.010394] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-25T21:47:10.084316] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T21:47:10.090304] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-25T21:47:10.993099] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-25T21:47:10.997906] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-25T21:47:12.047408] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-25T21:47:12.052394] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-25T21:47:13.186081] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T21:47:13.191216] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-25T21:47:14.038806] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T21:47:14.041990] [INFO ] [REMOTE ] GCO: Full fetch complete (34578 records). [2025-10-25T21:47:14.042099] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-25T21:47:14.423238] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-25T21:47:14.423363] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-25T21:47:14.423985] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-25T21:47:14.424082] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-25T21:47:14.425141] [DEBUG] [LOCAL ] GCO: Trimmed 34578 records to 23030 (keeping 200 days of data) [2025-10-25T21:47:14.568499] [DEBUG] [LOCAL ] GCO: Primary data saved (23030 records). [2025-10-25T21:47:14.568701] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-25T21:47:14.568869] [INFO ] [MAIN ] Update Progress: 902/2366 symbols. GCO took 12.1s. Estimated remaining time: 4h 35m 1s [2025-10-25T21:47:14.750595] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:47:14.750849] [DEBUG] [LOCAL ] GCTS: No existing data file found in primary storage. [2025-10-25T21:47:14.750922] [WARN ] [MAIN ] GCTS: No existing data found, performing full refresh instead. [2025-10-25T21:47:14.751037] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-25T21:47:14.751109] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-25T21:47:14.751191] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-10-25T21:47:14.751264] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-25T21:47:15.123333] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:47:15.123740] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-25T21:47:16.167697] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-25T21:47:16.171388] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-25T21:47:17.245592] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-25T21:47:17.251267] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-25T21:47:18.114071] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T21:47:18.117502] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-25T21:47:19.214760] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T21:47:19.218746] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-25T21:47:20.346137] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T21:47:20.351502] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-25T21:47:21.876068] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T21:47:21.883049] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-25T21:47:22.950677] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T21:47:22.956053] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-25T21:47:23.956298] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T21:47:23.960173] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-25T21:47:25.046553] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T21:47:25.051323] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-25T21:47:25.964864] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-25T21:47:25.968575] [INFO ] [REMOTE ] GCTS: Full fetch complete (26649 records). [2025-10-25T21:47:25.968700] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-25T21:47:26.335898] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-25T21:47:26.336026] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-25T21:47:26.336707] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-25T21:47:26.336821] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-25T21:47:26.337698] [DEBUG] [LOCAL ] GCTS: Trimmed 26649 records to 20476 (keeping 200 days of data) [2025-10-25T21:47:26.468687] [DEBUG] [LOCAL ] GCTS: Primary data saved (20476 records). [2025-10-25T21:47:26.468862] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-25T21:47:26.469001] [INFO ] [MAIN ] Update Progress: 903/2366 symbols. GCTS took 11.9s. Estimated remaining time: 4h 34m 51s [2025-10-25T21:47:26.636365] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:47:26.636558] [DEBUG] [LOCAL ] GCV: No existing data file found in primary storage. [2025-10-25T21:47:26.636627] [WARN ] [MAIN ] GCV: No existing data found, performing full refresh instead. [2025-10-25T21:47:26.636754] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-25T21:47:26.636823] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-25T21:47:26.636902] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-10-25T21:47:26.636971] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-25T21:47:26.992107] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:47:26.992467] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-25T21:47:27.547884] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-25T21:47:27.549363] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-25T21:47:28.124099] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T21:47:28.125827] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-25T21:47:28.740977] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-25T21:47:28.743539] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-25T21:47:29.498141] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T21:47:29.500790] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-25T21:47:30.114171] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-25T21:47:30.116224] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-25T21:47:30.834755] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T21:47:30.836706] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-25T21:47:31.550369] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T21:47:31.552441] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-25T21:47:32.350094] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T21:47:32.352404] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-25T21:47:33.242687] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-25T21:47:33.245433] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-25T21:47:34.062737] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T21:47:34.065214] [INFO ] [REMOTE ] GCV: Full fetch complete (10080 records). [2025-10-25T21:47:34.065332] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-25T21:47:34.466479] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-25T21:47:34.466610] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-25T21:47:34.466942] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-25T21:47:34.467018] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-25T21:47:34.467522] [DEBUG] [LOCAL ] GCV: Trimmed 10080 records to 8030 (keeping 200 days of data) [2025-10-25T21:47:34.514017] [DEBUG] [LOCAL ] GCV: Primary data saved (8030 records). [2025-10-25T21:47:34.514175] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-25T21:47:34.514310] [INFO ] [MAIN ] Update Progress: 904/2366 symbols. GCV took 8.0s. Estimated remaining time: 4h 34m 34s [2025-10-25T21:47:34.682248] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:47:34.682445] [DEBUG] [LOCAL ] GD: No existing data file found in primary storage. [2025-10-25T21:47:34.682517] [WARN ] [MAIN ] GD: No existing data found, performing full refresh instead. [2025-10-25T21:47:34.682633] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-25T21:47:34.682747] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-25T21:47:34.682841] [DEBUG] [LOCAL ] GD: No primary data file found to delete. [2025-10-25T21:47:34.682911] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-25T21:47:35.038227] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:47:35.038620] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-25T21:47:36.739760] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T21:47:36.749917] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-25T21:47:38.429395] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T21:47:38.439343] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-25T21:47:40.178067] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T21:47:40.188454] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-25T21:47:42.028794] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T21:47:42.039604] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-25T21:47:43.758135] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T21:47:43.768283] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-25T21:47:45.411842] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T21:47:45.421703] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-25T21:47:47.107980] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-25T21:47:47.118517] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-25T21:47:48.908513] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T21:47:48.918168] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-25T21:47:50.536824] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T21:47:50.546548] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-25T21:47:51.244152] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T21:47:51.252574] [INFO ] [REMOTE ] GD: Full fetch complete (69634 records). [2025-10-25T21:47:51.252756] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-25T21:47:51.642268] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-25T21:47:51.642381] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-25T21:47:51.643271] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-25T21:47:51.643352] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-25T21:47:51.644726] [DEBUG] [LOCAL ] GD: Trimmed 69634 records to 47208 (keeping 200 days of data) [2025-10-25T21:47:51.938837] [DEBUG] [LOCAL ] GD: Primary data saved (47208 records). [2025-10-25T21:47:51.938990] [INFO ] [MAIN ] GD: Full history saved. [2025-10-25T21:47:51.939164] [INFO ] [MAIN ] Update Progress: 905/2366 symbols. GD took 17.4s. Estimated remaining time: 4h 34m 33s [2025-10-25T21:47:52.105199] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:47:52.105385] [DEBUG] [LOCAL ] GDDY: No existing data file found in primary storage. [2025-10-25T21:47:52.105458] [WARN ] [MAIN ] GDDY: No existing data found, performing full refresh instead. [2025-10-25T21:47:52.105570] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-25T21:47:52.105662] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-25T21:47:52.105755] [DEBUG] [LOCAL ] GDDY: No primary data file found to delete. [2025-10-25T21:47:52.105826] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-25T21:47:52.460387] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:47:52.460789] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-25T21:47:54.149434] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T21:47:54.159017] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-25T21:47:55.726840] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T21:47:55.736438] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-25T21:47:57.609495] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T21:47:57.620813] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-25T21:47:59.451572] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T21:47:59.462382] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-25T21:48:01.364487] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-25T21:48:01.375084] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-25T21:48:02.860695] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T21:48:02.870896] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-25T21:48:05.129813] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-25T21:48:05.140507] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-25T21:48:06.838144] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T21:48:06.849359] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-25T21:48:08.680982] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-25T21:48:08.691843] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-25T21:48:10.519801] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-25T21:48:10.529122] [INFO ] [REMOTE ] GDDY: Full fetch complete (72089 records). [2025-10-25T21:48:10.529312] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-25T21:48:10.924012] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-25T21:48:10.924148] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-25T21:48:10.925056] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-25T21:48:10.925136] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-25T21:48:10.926532] [DEBUG] [LOCAL ] GDDY: Trimmed 72089 records to 50276 (keeping 200 days of data) [2025-10-25T21:48:11.211835] [DEBUG] [LOCAL ] GDDY: Primary data saved (50276 records). [2025-10-25T21:48:11.211990] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-25T21:48:11.212130] [INFO ] [MAIN ] Update Progress: 906/2366 symbols. GDDY took 19.3s. Estimated remaining time: 4h 34m 34s [2025-10-25T21:48:11.385016] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:48:11.385257] [DEBUG] [LOCAL ] GDIV: No existing data file found in primary storage. [2025-10-25T21:48:11.385330] [WARN ] [MAIN ] GDIV: No existing data found, performing full refresh instead. [2025-10-25T21:48:11.385444] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-25T21:48:11.385513] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-25T21:48:11.385594] [DEBUG] [LOCAL ] GDIV: No primary data file found to delete. [2025-10-25T21:48:11.385666] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-25T21:48:11.732597] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:48:11.733154] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-25T21:48:12.285805] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-25T21:48:12.288339] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-25T21:48:12.833383] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-25T21:48:12.835083] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-25T21:48:13.405400] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T21:48:13.407079] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-25T21:48:13.993738] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-25T21:48:13.995820] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-25T21:48:14.654229] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T21:48:14.655948] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-25T21:48:15.178432] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-25T21:48:15.179900] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-25T21:48:15.822376] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T21:48:15.823821] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-25T21:48:16.283579] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T21:48:16.284950] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-25T21:48:16.777958] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-25T21:48:16.779517] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-25T21:48:17.239940] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T21:48:17.241203] [INFO ] [REMOTE ] GDIV: Full fetch complete (5427 records). [2025-10-25T21:48:17.241302] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-25T21:48:17.612668] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-25T21:48:17.612788] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-25T21:48:17.612983] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-25T21:48:17.613058] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-25T21:48:17.613471] [DEBUG] [LOCAL ] GDIV: Trimmed 5427 records to 3552 (keeping 200 days of data) [2025-10-25T21:48:17.634116] [DEBUG] [LOCAL ] GDIV: Primary data saved (3552 records). [2025-10-25T21:48:17.634198] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-25T21:48:17.634323] [INFO ] [MAIN ] Update Progress: 907/2366 symbols. GDIV took 6.4s. Estimated remaining time: 4h 34m 15s [2025-10-25T21:48:17.797173] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:48:17.797333] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-10-25T21:48:17.797403] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-10-25T21:48:17.797509] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-25T21:48:17.797579] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-25T21:48:17.797639] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-10-25T21:48:17.797735] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-25T21:48:18.147203] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:48:18.147539] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-25T21:48:18.601865] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-25T21:48:18.603183] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-25T21:48:19.064416] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-25T21:48:19.066001] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-25T21:48:19.507849] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-25T21:48:19.509464] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-25T21:48:19.989913] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-25T21:48:19.991462] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-25T21:48:20.426903] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-25T21:48:20.428027] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-25T21:48:20.873570] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-25T21:48:20.874931] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-25T21:48:21.354637] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-25T21:48:21.356035] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-25T21:48:21.841963] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-25T21:48:21.843414] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-25T21:48:22.458083] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T21:48:22.459566] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-25T21:48:22.918270] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T21:48:22.919258] [INFO ] [REMOTE ] GDL: Full fetch complete (3444 records). [2025-10-25T21:48:22.919347] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-25T21:48:23.276209] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-25T21:48:23.276320] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-25T21:48:23.276475] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-25T21:48:23.276550] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-25T21:48:23.276953] [DEBUG] [LOCAL ] GDL: Trimmed 3444 records to 2532 (keeping 200 days of data) [2025-10-25T21:48:23.291419] [DEBUG] [LOCAL ] GDL: Primary data saved (2532 records). [2025-10-25T21:48:23.291506] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-25T21:48:23.291632] [INFO ] [MAIN ] Update Progress: 908/2366 symbols. GDL took 5.7s. Estimated remaining time: 4h 33m 55s [2025-10-25T21:48:23.456623] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:48:23.456861] [DEBUG] [LOCAL ] GDO: No existing data file found in primary storage. [2025-10-25T21:48:23.456933] [WARN ] [MAIN ] GDO: No existing data found, performing full refresh instead. [2025-10-25T21:48:23.457070] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-25T21:48:23.457141] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-25T21:48:23.457202] [DEBUG] [LOCAL ] GDO: No primary data file found to delete. [2025-10-25T21:48:23.457264] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-25T21:48:23.820931] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:48:23.821296] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-25T21:48:24.522557] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T21:48:24.524527] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-25T21:48:25.096987] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-25T21:48:25.098772] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-25T21:48:25.683102] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T21:48:25.685091] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-25T21:48:26.372048] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-25T21:48:26.375758] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-25T21:48:27.000075] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-25T21:48:27.003207] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-25T21:48:27.578725] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-25T21:48:27.580552] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-25T21:48:28.185864] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-25T21:48:28.187786] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-25T21:48:28.895485] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T21:48:28.897718] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-25T21:48:29.555856] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T21:48:29.557865] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-25T21:48:30.127078] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T21:48:30.128539] [INFO ] [REMOTE ] GDO: Full fetch complete (8437 records). [2025-10-25T21:48:30.128627] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-25T21:48:30.484132] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-25T21:48:30.484254] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-25T21:48:30.484483] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-25T21:48:30.484556] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-25T21:48:30.485018] [DEBUG] [LOCAL ] GDO: Trimmed 8437 records to 5931 (keeping 200 days of data) [2025-10-25T21:48:30.520097] [DEBUG] [LOCAL ] GDO: Primary data saved (5931 records). [2025-10-25T21:48:30.520232] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-25T21:48:30.520365] [INFO ] [MAIN ] Update Progress: 909/2366 symbols. GDO took 7.2s. Estimated remaining time: 4h 33m 37s [2025-10-25T21:48:30.687502] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:48:30.687716] [DEBUG] [LOCAL ] GDOT: No existing data file found in primary storage. [2025-10-25T21:48:30.687805] [WARN ] [MAIN ] GDOT: No existing data found, performing full refresh instead. [2025-10-25T21:48:30.687900] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-25T21:48:30.687966] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-25T21:48:30.688045] [DEBUG] [LOCAL ] GDOT: No primary data file found to delete. [2025-10-25T21:48:30.688132] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-25T21:48:31.038639] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:48:31.039126] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-25T21:48:32.281393] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T21:48:32.287945] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-25T21:48:33.348567] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T21:48:33.354490] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-25T21:48:35.016576] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T21:48:35.026209] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-25T21:48:36.468612] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T21:48:36.476367] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-25T21:48:37.816020] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T21:48:37.823984] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-25T21:48:39.127686] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T21:48:39.135453] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-25T21:48:40.605762] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T21:48:40.614467] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-25T21:48:41.989105] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T21:48:41.997159] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-25T21:48:43.526272] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T21:48:43.534915] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-25T21:48:44.901827] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T21:48:44.908719] [INFO ] [REMOTE ] GDOT: Full fetch complete (53729 records). [2025-10-25T21:48:44.908858] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-25T21:48:45.296548] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-25T21:48:45.296683] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-25T21:48:45.297469] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-25T21:48:45.297565] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-25T21:48:45.298790] [DEBUG] [LOCAL ] GDOT: Trimmed 53729 records to 38172 (keeping 200 days of data) [2025-10-25T21:48:45.505572] [DEBUG] [LOCAL ] GDOT: Primary data saved (38172 records). [2025-10-25T21:48:45.505751] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-25T21:48:45.505891] [INFO ] [MAIN ] Update Progress: 910/2366 symbols. GDOT took 15.0s. Estimated remaining time: 4h 33m 32s [2025-10-25T21:48:45.674233] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:48:45.674438] [DEBUG] [LOCAL ] GDV: No existing data file found in primary storage. [2025-10-25T21:48:45.674508] [WARN ] [MAIN ] GDV: No existing data found, performing full refresh instead. [2025-10-25T21:48:45.674620] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-25T21:48:45.674708] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-25T21:48:45.674792] [DEBUG] [LOCAL ] GDV: No primary data file found to delete. [2025-10-25T21:48:45.674861] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-25T21:48:46.031079] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:48:46.031503] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-25T21:48:47.093042] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-25T21:48:47.097423] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-25T21:48:48.146340] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T21:48:48.150522] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-25T21:48:49.160875] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T21:48:49.165576] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-25T21:48:50.245411] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T21:48:50.250876] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-25T21:48:51.231248] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T21:48:51.235877] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-25T21:48:52.227011] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T21:48:52.231422] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-25T21:48:53.305469] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T21:48:53.311609] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-25T21:48:54.341973] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T21:48:54.346130] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-25T21:48:55.250315] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T21:48:55.255937] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-25T21:48:56.234273] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T21:48:56.237808] [INFO ] [REMOTE ] GDV: Full fetch complete (28167 records). [2025-10-25T21:48:56.237908] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-25T21:48:56.616453] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-25T21:48:56.616567] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-25T21:48:56.617208] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-25T21:48:56.617292] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-25T21:48:56.618092] [DEBUG] [LOCAL ] GDV: Trimmed 28167 records to 19349 (keeping 200 days of data) [2025-10-25T21:48:56.730525] [DEBUG] [LOCAL ] GDV: Primary data saved (19349 records). [2025-10-25T21:48:56.730709] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-25T21:48:56.730846] [INFO ] [MAIN ] Update Progress: 911/2366 symbols. GDV took 11.2s. Estimated remaining time: 4h 33m 21s [2025-10-25T21:48:56.899621] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:48:56.899864] [DEBUG] [LOCAL ] GE: No existing data file found in primary storage. [2025-10-25T21:48:56.899936] [WARN ] [MAIN ] GE: No existing data found, performing full refresh instead. [2025-10-25T21:48:56.900050] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-25T21:48:56.900122] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-25T21:48:56.900204] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-10-25T21:48:56.900275] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-25T21:48:57.253749] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:48:57.254103] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-25T21:48:59.105735] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-25T21:48:59.116767] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-25T21:49:01.315500] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-25T21:49:01.325891] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-25T21:49:03.288715] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-25T21:49:03.299665] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-25T21:49:05.335689] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-25T21:49:05.347448] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-25T21:49:07.572057] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-25T21:49:07.583281] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-25T21:49:09.670395] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-25T21:49:09.681518] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-25T21:49:11.912925] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-25T21:49:11.924800] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-25T21:49:14.052234] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-25T21:49:14.066720] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-25T21:49:16.073935] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-25T21:49:16.085229] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-25T21:49:16.819378] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T21:49:16.829198] [INFO ] [REMOTE ] GE: Full fetch complete (77861 records). [2025-10-25T21:49:16.829347] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-25T21:49:17.216598] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-25T21:49:17.216729] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-25T21:49:17.217710] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-25T21:49:17.217804] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-25T21:49:17.219223] [DEBUG] [LOCAL ] GE: Trimmed 77861 records to 54473 (keeping 200 days of data) [2025-10-25T21:49:17.564548] [DEBUG] [LOCAL ] GE: Primary data saved (54473 records). [2025-10-25T21:49:17.564757] [INFO ] [MAIN ] GE: Full history saved. [2025-10-25T21:49:17.564927] [INFO ] [MAIN ] Update Progress: 912/2366 symbols. GE took 20.8s. Estimated remaining time: 4h 33m 25s [2025-10-25T21:49:17.734785] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:49:17.734991] [DEBUG] [LOCAL ] GEF: No existing data file found in primary storage. [2025-10-25T21:49:17.735063] [WARN ] [MAIN ] GEF: No existing data found, performing full refresh instead. [2025-10-25T21:49:17.735177] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-25T21:49:17.735248] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-25T21:49:17.735329] [DEBUG] [LOCAL ] GEF: No primary data file found to delete. [2025-10-25T21:49:17.735398] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-25T21:49:18.086193] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:49:18.086503] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-25T21:49:19.193253] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T21:49:19.197575] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-25T21:49:20.084694] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T21:49:20.088581] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-25T21:49:21.161286] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T21:49:21.165861] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-25T21:49:22.000103] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-25T21:49:22.004891] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-25T21:49:22.573571] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T21:49:22.577084] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-25T21:49:23.870049] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T21:49:23.875900] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-25T21:49:24.995771] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T21:49:25.001975] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-25T21:49:26.028149] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T21:49:26.032901] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-25T21:49:27.090307] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T21:49:27.095549] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-25T21:49:28.220775] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T21:49:28.224821] [INFO ] [REMOTE ] GEF: Full fetch complete (29280 records). [2025-10-25T21:49:28.224940] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-25T21:49:28.603843] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-25T21:49:28.603983] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-25T21:49:28.604548] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-25T21:49:28.604624] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-25T21:49:28.605374] [DEBUG] [LOCAL ] GEF: Trimmed 29280 records to 20945 (keeping 200 days of data) [2025-10-25T21:49:28.747159] [DEBUG] [LOCAL ] GEF: Primary data saved (20945 records). [2025-10-25T21:49:28.747318] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-25T21:49:28.747489] [INFO ] [MAIN ] Update Progress: 913/2366 symbols. GEF took 11.2s. Estimated remaining time: 4h 33m 13s [2025-10-25T21:49:28.919318] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:49:28.919524] [DEBUG] [LOCAL ] GEL: No existing data file found in primary storage. [2025-10-25T21:49:28.919611] [WARN ] [MAIN ] GEL: No existing data found, performing full refresh instead. [2025-10-25T21:49:28.919747] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-25T21:49:28.919819] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-25T21:49:28.919900] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-25T21:49:28.919972] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-25T21:49:29.277861] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:49:29.278216] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-25T21:49:30.546871] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T21:49:30.553845] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-25T21:49:31.681624] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T21:49:31.688719] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-25T21:49:32.845307] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T21:49:32.855206] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-25T21:49:34.166988] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T21:49:34.173530] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-25T21:49:35.645553] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T21:49:35.652873] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-25T21:49:37.038002] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T21:49:37.046277] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-25T21:49:38.326915] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T21:49:38.334362] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-25T21:49:39.796157] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T21:49:39.804078] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-25T21:49:40.992633] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T21:49:40.998450] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-25T21:49:42.020015] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T21:49:42.024318] [INFO ] [REMOTE ] GEL: Full fetch complete (47802 records). [2025-10-25T21:49:42.024438] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-25T21:49:42.409015] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-25T21:49:42.409140] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-25T21:49:42.409975] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-25T21:49:42.410062] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-25T21:49:42.411164] [DEBUG] [LOCAL ] GEL: Trimmed 47802 records to 31489 (keeping 200 days of data) [2025-10-25T21:49:42.589179] [DEBUG] [LOCAL ] GEL: Primary data saved (31489 records). [2025-10-25T21:49:42.589335] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-25T21:49:42.589533] [INFO ] [MAIN ] Update Progress: 914/2366 symbols. GEL took 13.8s. Estimated remaining time: 4h 33m 6s [2025-10-25T21:49:42.760251] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:49:42.760441] [DEBUG] [LOCAL ] GENI: No existing data file found in primary storage. [2025-10-25T21:49:42.760527] [WARN ] [MAIN ] GENI: No existing data found, performing full refresh instead. [2025-10-25T21:49:42.760704] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-25T21:49:42.760790] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-25T21:49:42.760891] [DEBUG] [LOCAL ] GENI: No primary data file found to delete. [2025-10-25T21:49:42.760969] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-25T21:49:43.125927] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:49:43.126259] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-25T21:49:44.682844] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T21:49:44.692775] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-25T21:49:46.233404] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T21:49:46.242936] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-25T21:49:47.880034] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T21:49:47.890911] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-25T21:49:49.475017] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T21:49:49.486260] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-25T21:49:51.116233] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T21:49:51.127474] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-25T21:49:52.725197] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T21:49:52.736218] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-25T21:49:54.690962] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-25T21:49:54.703482] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-25T21:49:56.495040] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T21:49:56.506062] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-25T21:49:58.362200] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T21:49:58.373311] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-25T21:50:00.112079] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T21:50:00.121937] [INFO ] [REMOTE ] GENI: Full fetch complete (76060 records). [2025-10-25T21:50:00.122081] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-25T21:50:00.504385] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-25T21:50:00.504498] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-25T21:50:00.505434] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-25T21:50:00.505514] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-25T21:50:00.506923] [DEBUG] [LOCAL ] GENI: Trimmed 76060 records to 53659 (keeping 200 days of data) [2025-10-25T21:50:00.807020] [DEBUG] [LOCAL ] GENI: Primary data saved (53659 records). [2025-10-25T21:50:00.807191] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-25T21:50:00.807321] [INFO ] [MAIN ] Update Progress: 915/2366 symbols. GENI took 18.2s. Estimated remaining time: 4h 33m 6s [2025-10-25T21:50:00.972694] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:50:00.972847] [DEBUG] [LOCAL ] GEO: No existing data file found in primary storage. [2025-10-25T21:50:00.972918] [WARN ] [MAIN ] GEO: No existing data found, performing full refresh instead. [2025-10-25T21:50:00.973024] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-25T21:50:00.973095] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-25T21:50:00.973156] [DEBUG] [LOCAL ] GEO: No primary data file found to delete. [2025-10-25T21:50:00.973218] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-25T21:50:01.326499] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:50:01.326849] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-25T21:50:03.558584] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-25T21:50:03.568961] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-25T21:50:05.373194] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T21:50:05.383156] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-25T21:50:07.304361] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T21:50:07.316426] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-25T21:50:09.038636] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T21:50:09.050860] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-25T21:50:10.777299] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T21:50:10.788178] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-25T21:50:12.500794] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T21:50:12.511254] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-25T21:50:14.469537] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-25T21:50:14.480855] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-25T21:50:16.466412] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-25T21:50:16.478634] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-25T21:50:18.286484] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-25T21:50:18.297294] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-25T21:50:19.729899] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T21:50:19.739024] [INFO ] [REMOTE ] GEO: Full fetch complete (75443 records). [2025-10-25T21:50:19.739168] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-25T21:50:20.124257] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-25T21:50:20.124373] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-25T21:50:20.125327] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-25T21:50:20.125407] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-25T21:50:20.126869] [DEBUG] [LOCAL ] GEO: Trimmed 75443 records to 52386 (keeping 200 days of data) [2025-10-25T21:50:20.421730] [DEBUG] [LOCAL ] GEO: Primary data saved (52386 records). [2025-10-25T21:50:20.421918] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-25T21:50:20.422073] [INFO ] [MAIN ] Update Progress: 916/2366 symbols. GEO took 19.6s. Estimated remaining time: 4h 33m 7s [2025-10-25T21:50:20.588818] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:50:20.588997] [DEBUG] [LOCAL ] GES: No existing data file found in primary storage. [2025-10-25T21:50:20.589067] [WARN ] [MAIN ] GES: No existing data found, performing full refresh instead. [2025-10-25T21:50:20.589179] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-25T21:50:20.589248] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-25T21:50:20.589331] [DEBUG] [LOCAL ] GES: No primary data file found to delete. [2025-10-25T21:50:20.589399] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-25T21:50:20.937137] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:50:20.937466] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-25T21:50:22.555182] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T21:50:22.564060] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-25T21:50:24.119448] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T21:50:24.127735] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-25T21:50:25.713108] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T21:50:25.728262] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-25T21:50:27.458240] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T21:50:27.468233] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-25T21:50:28.932117] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T21:50:28.940089] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-25T21:50:30.463817] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T21:50:30.472095] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-25T21:50:31.967952] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T21:50:31.975612] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-25T21:50:33.535603] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T21:50:33.548879] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-25T21:50:34.840199] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-25T21:50:34.848186] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-25T21:50:36.172417] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-25T21:50:36.179035] [INFO ] [REMOTE ] GES: Full fetch complete (58230 records). [2025-10-25T21:50:36.179187] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-25T21:50:36.589051] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-25T21:50:36.589219] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-25T21:50:36.590490] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-25T21:50:36.590576] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-25T21:50:36.591931] [DEBUG] [LOCAL ] GES: Trimmed 58230 records to 38332 (keeping 200 days of data) [2025-10-25T21:50:36.818848] [DEBUG] [LOCAL ] GES: Primary data saved (38332 records). [2025-10-25T21:50:36.819035] [INFO ] [MAIN ] GES: Full history saved. [2025-10-25T21:50:36.819175] [INFO ] [MAIN ] Update Progress: 917/2366 symbols. GES took 16.4s. Estimated remaining time: 4h 33m 4s [2025-10-25T21:50:37.006202] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:50:37.006417] [DEBUG] [LOCAL ] GETY: No existing data file found in primary storage. [2025-10-25T21:50:37.006509] [WARN ] [MAIN ] GETY: No existing data found, performing full refresh instead. [2025-10-25T21:50:37.006674] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-25T21:50:37.006766] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-25T21:50:37.006852] [DEBUG] [LOCAL ] GETY: No primary data file found to delete. [2025-10-25T21:50:37.006938] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-25T21:50:37.370240] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:50:37.370569] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-25T21:50:39.122172] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T21:50:39.131910] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-25T21:50:40.605617] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T21:50:40.614414] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-25T21:50:42.189824] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T21:50:42.198851] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-25T21:50:43.658033] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T21:50:43.666361] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-25T21:50:45.010350] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T21:50:45.018051] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-25T21:50:46.530823] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T21:50:46.538731] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-25T21:50:47.973239] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T21:50:47.983487] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-25T21:50:49.354987] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T21:50:49.362398] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-25T21:50:50.716027] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T21:50:50.723685] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-25T21:50:52.027487] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-25T21:50:52.034585] [INFO ] [REMOTE ] GETY: Full fetch complete (55457 records). [2025-10-25T21:50:52.034736] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-25T21:50:52.404760] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-25T21:50:52.404878] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-25T21:50:52.405663] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-25T21:50:52.405740] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-25T21:50:52.406808] [DEBUG] [LOCAL ] GETY: Trimmed 55457 records to 35795 (keeping 200 days of data) [2025-10-25T21:50:52.597563] [DEBUG] [LOCAL ] GETY: Primary data saved (35795 records). [2025-10-25T21:50:52.597748] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-25T21:50:52.597902] [INFO ] [MAIN ] Update Progress: 918/2366 symbols. GETY took 15.8s. Estimated remaining time: 4h 32m 60s [2025-10-25T21:50:52.766472] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:50:52.766692] [DEBUG] [LOCAL ] GEV: No existing data file found in primary storage. [2025-10-25T21:50:52.766765] [WARN ] [MAIN ] GEV: No existing data found, performing full refresh instead. [2025-10-25T21:50:52.766850] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-25T21:50:52.766917] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-25T21:50:52.766995] [DEBUG] [LOCAL ] GEV: No primary data file found to delete. [2025-10-25T21:50:52.767061] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-25T21:50:53.110787] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:50:53.111147] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-25T21:50:55.366246] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-25T21:50:55.376809] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-25T21:50:57.372325] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T21:50:57.382429] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-25T21:50:59.720981] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-25T21:50:59.732214] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-25T21:51:02.264362] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-25T21:51:02.275568] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-25T21:51:04.469055] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-25T21:51:04.481118] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-25T21:51:06.682164] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-25T21:51:06.693798] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-25T21:51:09.070011] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-25T21:51:09.081881] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-25T21:51:11.367623] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-25T21:51:11.379272] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-25T21:51:13.848005] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-25T21:51:13.859472] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-25T21:51:14.221140] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-25T21:51:14.230929] [INFO ] [REMOTE ] GEV: Full fetch complete (77059 records). [2025-10-25T21:51:14.231099] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-25T21:51:14.628253] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-25T21:51:14.628397] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-25T21:51:14.629431] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-25T21:51:14.629514] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-25T21:51:14.630968] [DEBUG] [LOCAL ] GEV: Trimmed 77059 records to 53767 (keeping 200 days of data) [2025-10-25T21:51:14.959373] [DEBUG] [LOCAL ] GEV: Primary data saved (53767 records). [2025-10-25T21:51:14.959533] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-25T21:51:14.959687] [INFO ] [MAIN ] Update Progress: 919/2366 symbols. GEV took 22.4s. Estimated remaining time: 4h 33m 6s [2025-10-25T21:51:15.124151] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:51:15.124328] [DEBUG] [LOCAL ] GF: No existing data file found in primary storage. [2025-10-25T21:51:15.124399] [WARN ] [MAIN ] GF: No existing data found, performing full refresh instead. [2025-10-25T21:51:15.124509] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-25T21:51:15.124585] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-25T21:51:15.124689] [DEBUG] [LOCAL ] GF: No primary data file found to delete. [2025-10-25T21:51:15.124759] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-25T21:51:15.491580] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:51:15.491961] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-25T21:51:16.034850] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-25T21:51:16.036255] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-25T21:51:16.643396] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T21:51:16.645122] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-25T21:51:17.375989] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T21:51:17.378213] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-25T21:51:17.957682] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-25T21:51:17.959354] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-25T21:51:18.563334] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T21:51:18.565095] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-25T21:51:19.115992] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T21:51:19.117529] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-25T21:51:19.557966] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-25T21:51:19.559270] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-25T21:51:20.088315] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-25T21:51:20.090320] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-25T21:51:20.643237] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-25T21:51:20.644375] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-25T21:51:21.017171] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-25T21:51:21.018108] [INFO ] [REMOTE ] GF: Full fetch complete (4795 records). [2025-10-25T21:51:21.018200] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-25T21:51:21.398112] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-25T21:51:21.398268] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-25T21:51:21.398477] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-25T21:51:21.398576] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-25T21:51:21.399150] [DEBUG] [LOCAL ] GF: Trimmed 4795 records to 2647 (keeping 200 days of data) [2025-10-25T21:51:21.415118] [DEBUG] [LOCAL ] GF: Primary data saved (2647 records). [2025-10-25T21:51:21.415282] [INFO ] [MAIN ] GF: Full history saved. [2025-10-25T21:51:21.415468] [INFO ] [MAIN ] Update Progress: 920/2366 symbols. GF took 6.5s. Estimated remaining time: 4h 32m 47s [2025-10-25T21:51:21.586402] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:51:21.586629] [DEBUG] [LOCAL ] GFF: No existing data file found in primary storage. [2025-10-25T21:51:21.586753] [WARN ] [MAIN ] GFF: No existing data found, performing full refresh instead. [2025-10-25T21:51:21.586902] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-25T21:51:21.587002] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-25T21:51:21.587125] [DEBUG] [LOCAL ] GFF: No primary data file found to delete. [2025-10-25T21:51:21.587220] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-25T21:51:21.950199] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:51:21.950538] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-25T21:51:23.171118] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T21:51:23.177161] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-25T21:51:24.466301] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T21:51:24.472914] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-25T21:51:25.942617] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T21:51:25.949887] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-25T21:51:27.469255] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T21:51:27.477413] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-25T21:51:28.900958] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T21:51:28.907947] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-25T21:51:29.967905] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T21:51:29.973757] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-25T21:51:31.147898] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T21:51:31.154433] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-25T21:51:32.524608] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T21:51:32.532144] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-25T21:51:33.653797] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T21:51:33.659895] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-25T21:51:34.797824] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T21:51:34.802411] [INFO ] [REMOTE ] GFF: Full fetch complete (43512 records). [2025-10-25T21:51:34.802514] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-25T21:51:35.172187] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-25T21:51:35.172328] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-25T21:51:35.173077] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-25T21:51:35.173159] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-25T21:51:35.174191] [DEBUG] [LOCAL ] GFF: Trimmed 43512 records to 29679 (keeping 200 days of data) [2025-10-25T21:51:35.347492] [DEBUG] [LOCAL ] GFF: Primary data saved (29679 records). [2025-10-25T21:51:35.347675] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-25T21:51:35.347834] [INFO ] [MAIN ] Update Progress: 921/2366 symbols. GFF took 13.9s. Estimated remaining time: 4h 32m 40s [2025-10-25T21:51:35.516031] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:51:35.516231] [DEBUG] [LOCAL ] GFI: No existing data file found in primary storage. [2025-10-25T21:51:35.516306] [WARN ] [MAIN ] GFI: No existing data found, performing full refresh instead. [2025-10-25T21:51:35.516421] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-25T21:51:35.516492] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-25T21:51:35.516572] [DEBUG] [LOCAL ] GFI: No primary data file found to delete. [2025-10-25T21:51:35.516662] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-25T21:51:35.871154] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:51:35.871603] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-25T21:51:37.608429] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T21:51:37.619062] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-25T21:51:39.399291] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T21:51:39.410763] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-25T21:51:41.406059] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T21:51:41.417189] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-25T21:51:43.360375] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T21:51:43.371973] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-25T21:51:45.199355] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-25T21:51:45.210450] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-25T21:51:46.969890] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T21:51:46.980573] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-25T21:51:48.958797] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-25T21:51:48.970341] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-25T21:51:50.534374] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T21:51:50.545516] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-25T21:51:52.480968] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-25T21:51:52.492348] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-25T21:51:54.647297] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-25T21:51:54.657201] [INFO ] [REMOTE ] GFI: Full fetch complete (77000 records). [2025-10-25T21:51:54.657365] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-25T21:51:55.054249] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-25T21:51:55.054363] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-25T21:51:55.055392] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-25T21:51:55.055480] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-25T21:51:55.056995] [DEBUG] [LOCAL ] GFI: Trimmed 77000 records to 53895 (keeping 200 days of data) [2025-10-25T21:51:55.371699] [DEBUG] [LOCAL ] GFI: Primary data saved (53895 records). [2025-10-25T21:51:55.371888] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-25T21:51:55.372004] [INFO ] [MAIN ] Update Progress: 922/2366 symbols. GFI took 20.0s. Estimated remaining time: 4h 32m 42s [2025-10-25T21:51:55.537134] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:51:55.537310] [DEBUG] [LOCAL ] GFL: No existing data file found in primary storage. [2025-10-25T21:51:55.537382] [WARN ] [MAIN ] GFL: No existing data found, performing full refresh instead. [2025-10-25T21:51:55.537486] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-25T21:51:55.537556] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-25T21:51:55.537659] [DEBUG] [LOCAL ] GFL: No primary data file found to delete. [2025-10-25T21:51:55.537729] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-25T21:51:55.883954] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:51:55.884273] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-25T21:51:57.442416] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T21:51:57.451727] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-25T21:51:59.050428] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T21:51:59.059548] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-25T21:52:00.783501] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T21:52:00.797406] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-25T21:52:02.352078] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T21:52:02.364261] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-25T21:52:04.022672] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T21:52:04.033471] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-25T21:52:05.552386] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T21:52:05.561473] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-25T21:52:07.143782] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-25T21:52:07.154721] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-25T21:52:08.678552] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T21:52:08.688519] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-25T21:52:10.362294] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T21:52:10.372777] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-25T21:52:11.838861] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T21:52:11.847897] [INFO ] [REMOTE ] GFL: Full fetch complete (69623 records). [2025-10-25T21:52:11.848079] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-25T21:52:12.241573] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-25T21:52:12.241704] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-25T21:52:12.242560] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-25T21:52:12.242630] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-25T21:52:12.243904] [DEBUG] [LOCAL ] GFL: Trimmed 69623 records to 48095 (keeping 200 days of data) [2025-10-25T21:52:12.526164] [DEBUG] [LOCAL ] GFL: Primary data saved (48095 records). [2025-10-25T21:52:12.526327] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-25T21:52:12.526463] [INFO ] [MAIN ] Update Progress: 923/2366 symbols. GFL took 17.2s. Estimated remaining time: 4h 32m 40s [2025-10-25T21:52:12.692207] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:52:12.692418] [DEBUG] [LOCAL ] GFR: No existing data file found in primary storage. [2025-10-25T21:52:12.692489] [WARN ] [MAIN ] GFR: No existing data found, performing full refresh instead. [2025-10-25T21:52:12.692600] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-25T21:52:12.692693] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-25T21:52:12.692794] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-10-25T21:52:12.692863] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-25T21:52:13.041940] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:52:13.042261] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-25T21:52:13.827040] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T21:52:13.829440] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-25T21:52:14.587503] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T21:52:14.589965] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-25T21:52:15.350396] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T21:52:15.353781] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-25T21:52:16.295260] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T21:52:16.298688] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-25T21:52:16.803083] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-25T21:52:16.805955] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-25T21:52:17.468669] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-25T21:52:17.470788] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-25T21:52:18.086661] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-25T21:52:18.088756] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-25T21:52:18.671684] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-25T21:52:18.673725] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-25T21:52:19.304419] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T21:52:19.307057] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-25T21:52:19.952731] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T21:52:19.954352] [INFO ] [REMOTE ] GFR: Full fetch complete (11921 records). [2025-10-25T21:52:19.954444] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-25T21:52:20.310591] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-25T21:52:20.310733] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-25T21:52:20.311070] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-25T21:52:20.311151] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-25T21:52:20.311669] [DEBUG] [LOCAL ] GFR: Trimmed 11921 records to 7419 (keeping 200 days of data) [2025-10-25T21:52:20.353985] [DEBUG] [LOCAL ] GFR: Primary data saved (7419 records). [2025-10-25T21:52:20.354178] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-25T21:52:20.354322] [INFO ] [MAIN ] Update Progress: 924/2366 symbols. GFR took 7.8s. Estimated remaining time: 4h 32m 23s [2025-10-25T21:52:20.545512] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:52:20.545773] [DEBUG] [LOCAL ] GGB: No existing data file found in primary storage. [2025-10-25T21:52:20.545851] [WARN ] [MAIN ] GGB: No existing data found, performing full refresh instead. [2025-10-25T21:52:20.545984] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-25T21:52:20.546061] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-25T21:52:20.546146] [DEBUG] [LOCAL ] GGB: No primary data file found to delete. [2025-10-25T21:52:20.546220] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-25T21:52:20.936831] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:52:20.937288] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-25T21:52:22.660451] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T21:52:22.670776] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-25T21:52:24.197589] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T21:52:24.207385] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-25T21:52:25.877547] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T21:52:25.887960] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-25T21:52:27.608348] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T21:52:27.618966] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-25T21:52:29.419215] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T21:52:29.429828] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-25T21:52:31.391935] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-25T21:52:31.402191] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-25T21:52:33.625031] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-25T21:52:33.636326] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-25T21:52:35.348838] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T21:52:35.360898] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-25T21:52:36.998728] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T21:52:37.009974] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-25T21:52:38.814146] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-25T21:52:38.823791] [INFO ] [REMOTE ] GGB: Full fetch complete (74397 records). [2025-10-25T21:52:38.823958] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-25T21:52:39.221407] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-25T21:52:39.221537] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-25T21:52:39.222548] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-25T21:52:39.222636] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-25T21:52:39.224143] [DEBUG] [LOCAL ] GGB: Trimmed 74397 records to 52322 (keeping 200 days of data) [2025-10-25T21:52:39.518731] [DEBUG] [LOCAL ] GGB: Primary data saved (52322 records). [2025-10-25T21:52:39.518886] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-25T21:52:39.519019] [INFO ] [MAIN ] Update Progress: 925/2366 symbols. GGB took 19.2s. Estimated remaining time: 4h 32m 24s [2025-10-25T21:52:39.693592] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:52:39.693822] [DEBUG] [LOCAL ] GGG: No existing data file found in primary storage. [2025-10-25T21:52:39.693909] [WARN ] [MAIN ] GGG: No existing data found, performing full refresh instead. [2025-10-25T21:52:39.694049] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-25T21:52:39.694139] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-25T21:52:39.694252] [DEBUG] [LOCAL ] GGG: No primary data file found to delete. [2025-10-25T21:52:39.694338] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-25T21:52:40.044952] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:52:40.045311] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-25T21:52:41.470813] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T21:52:41.480943] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-25T21:52:42.961910] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:52:42.969623] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-25T21:52:44.427982] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T21:52:44.437119] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-25T21:52:45.995527] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T21:52:46.005572] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-25T21:52:47.392383] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-25T21:52:47.401156] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-25T21:52:48.742451] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T21:52:48.750872] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-25T21:52:50.462118] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-25T21:52:50.477033] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-25T21:52:52.017978] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T21:52:52.027010] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-25T21:52:53.507493] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T21:52:53.516108] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-25T21:52:54.991028] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T21:52:54.998927] [INFO ] [REMOTE ] GGG: Full fetch complete (59606 records). [2025-10-25T21:52:54.999118] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-25T21:52:55.381925] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-25T21:52:55.382041] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-25T21:52:55.382829] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-25T21:52:55.382908] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-25T21:52:55.383992] [DEBUG] [LOCAL ] GGG: Trimmed 59606 records to 41285 (keeping 200 days of data) [2025-10-25T21:52:55.628983] [DEBUG] [LOCAL ] GGG: Primary data saved (41285 records). [2025-10-25T21:52:55.629161] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-25T21:52:55.629305] [INFO ] [MAIN ] Update Progress: 926/2366 symbols. GGG took 16.1s. Estimated remaining time: 4h 32m 20s [2025-10-25T21:52:55.794633] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:52:55.794789] [DEBUG] [LOCAL ] GGT: No existing data file found in primary storage. [2025-10-25T21:52:55.794839] [WARN ] [MAIN ] GGT: No existing data found, performing full refresh instead. [2025-10-25T21:52:55.794940] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-25T21:52:55.795011] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-25T21:52:55.795093] [DEBUG] [LOCAL ] GGT: No primary data file found to delete. [2025-10-25T21:52:55.795162] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-25T21:52:56.163879] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:52:56.164196] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-25T21:52:56.897354] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T21:52:56.899594] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-25T21:52:57.684031] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T21:52:57.686566] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-25T21:52:58.484703] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T21:52:58.488150] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-25T21:52:59.310924] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T21:52:59.314342] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-25T21:53:00.291388] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T21:53:00.295745] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-25T21:53:01.637349] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T21:53:01.641009] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-25T21:53:02.669208] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T21:53:02.673096] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-25T21:53:03.542602] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-25T21:53:03.545946] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-25T21:53:04.566903] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T21:53:04.570512] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-25T21:53:05.465046] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T21:53:05.468276] [INFO ] [REMOTE ] GGT: Full fetch complete (19131 records). [2025-10-25T21:53:05.468378] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-25T21:53:05.827895] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-25T21:53:05.828004] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-25T21:53:05.828385] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-25T21:53:05.828473] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-25T21:53:05.829069] [DEBUG] [LOCAL ] GGT: Trimmed 19131 records to 14679 (keeping 200 days of data) [2025-10-25T21:53:05.910857] [DEBUG] [LOCAL ] GGT: Primary data saved (14679 records). [2025-10-25T21:53:05.911014] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-25T21:53:05.911152] [INFO ] [MAIN ] Update Progress: 927/2366 symbols. GGT took 10.3s. Estimated remaining time: 4h 32m 7s [2025-10-25T21:53:06.084319] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:06.084539] [DEBUG] [LOCAL ] GGZ: No existing data file found in primary storage. [2025-10-25T21:53:06.084610] [WARN ] [MAIN ] GGZ: No existing data found, performing full refresh instead. [2025-10-25T21:53:06.084744] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-25T21:53:06.084813] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-25T21:53:06.084874] [DEBUG] [LOCAL ] GGZ: No primary data file found to delete. [2025-10-25T21:53:06.084936] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-25T21:53:06.437111] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:06.437464] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-25T21:53:07.011795] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-25T21:53:07.013399] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-25T21:53:07.449391] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-25T21:53:07.450777] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-25T21:53:07.914321] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T21:53:07.915753] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-25T21:53:08.452257] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-25T21:53:08.453757] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-25T21:53:08.989818] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-25T21:53:08.991311] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-25T21:53:09.526757] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-25T21:53:09.528024] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-25T21:53:09.968672] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-25T21:53:09.969971] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-25T21:53:10.429327] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T21:53:10.430601] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-25T21:53:10.884285] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-25T21:53:10.885578] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-25T21:53:11.341232] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T21:53:11.342264] [INFO ] [REMOTE ] GGZ: Full fetch complete (3792 records). [2025-10-25T21:53:11.342359] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-25T21:53:11.707386] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-25T21:53:11.707526] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-25T21:53:11.707725] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-25T21:53:11.707832] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-25T21:53:11.708222] [DEBUG] [LOCAL ] GGZ: Trimmed 3792 records to 2362 (keeping 200 days of data) [2025-10-25T21:53:11.723688] [DEBUG] [LOCAL ] GGZ: Primary data saved (2362 records). [2025-10-25T21:53:11.723774] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-25T21:53:11.723903] [INFO ] [MAIN ] Update Progress: 928/2366 symbols. GGZ took 5.8s. Estimated remaining time: 4h 31m 47s [2025-10-25T21:53:11.898181] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:11.898382] [DEBUG] [LOCAL ] GHC: No existing data file found in primary storage. [2025-10-25T21:53:11.898452] [WARN ] [MAIN ] GHC: No existing data found, performing full refresh instead. [2025-10-25T21:53:11.898564] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-25T21:53:11.898633] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-25T21:53:11.898738] [DEBUG] [LOCAL ] GHC: No primary data file found to delete. [2025-10-25T21:53:11.898805] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-25T21:53:12.272271] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:12.272676] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-25T21:53:12.792805] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-25T21:53:12.793904] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-25T21:53:13.316112] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-25T21:53:13.317236] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-25T21:53:13.829026] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-25T21:53:13.830249] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-25T21:53:14.433166] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T21:53:14.434816] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-25T21:53:14.916769] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T21:53:14.918079] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-25T21:53:15.532419] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T21:53:15.534261] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-25T21:53:16.215496] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-25T21:53:16.216901] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-25T21:53:16.709280] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-25T21:53:16.710542] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-25T21:53:17.242500] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-25T21:53:17.243855] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-25T21:53:17.859421] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T21:53:17.860801] [INFO ] [REMOTE ] GHC: Full fetch complete (3703 records). [2025-10-25T21:53:17.860889] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-25T21:53:18.222036] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-25T21:53:18.222148] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-25T21:53:18.222301] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-25T21:53:18.222374] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-25T21:53:18.222796] [DEBUG] [LOCAL ] GHC: Trimmed 3703 records to 2993 (keeping 200 days of data) [2025-10-25T21:53:18.242032] [DEBUG] [LOCAL ] GHC: Primary data saved (2993 records). [2025-10-25T21:53:18.242134] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-25T21:53:18.242262] [INFO ] [MAIN ] Update Progress: 929/2366 symbols. GHC took 6.5s. Estimated remaining time: 4h 31m 28s [2025-10-25T21:53:18.417533] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:18.417743] [DEBUG] [LOCAL ] GHG: No existing data file found in primary storage. [2025-10-25T21:53:18.417853] [WARN ] [MAIN ] GHG: No existing data found, performing full refresh instead. [2025-10-25T21:53:18.417965] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-25T21:53:18.418034] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-25T21:53:18.418112] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-10-25T21:53:18.418181] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-25T21:53:18.790574] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:18.790938] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-25T21:53:19.175440] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-25T21:53:19.176421] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-25T21:53:19.619788] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-25T21:53:19.620970] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-25T21:53:20.023600] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-25T21:53:20.025007] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-25T21:53:20.611356] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-25T21:53:20.612907] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-25T21:53:21.225877] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-25T21:53:21.227548] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-25T21:53:21.645840] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-25T21:53:21.647007] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-25T21:53:22.199174] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-25T21:53:22.200713] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-25T21:53:22.660445] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T21:53:22.661842] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-25T21:53:23.236293] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T21:53:23.238039] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-25T21:53:23.722420] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T21:53:23.723615] [INFO ] [REMOTE ] GHG: Full fetch complete (4213 records). [2025-10-25T21:53:23.723721] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-25T21:53:24.079284] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-25T21:53:24.079413] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-25T21:53:24.079574] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-25T21:53:24.079668] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-25T21:53:24.080058] [DEBUG] [LOCAL ] GHG: Trimmed 4213 records to 3310 (keeping 200 days of data) [2025-10-25T21:53:24.097727] [DEBUG] [LOCAL ] GHG: Primary data saved (3310 records). [2025-10-25T21:53:24.097855] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-25T21:53:24.097987] [INFO ] [MAIN ] Update Progress: 930/2366 symbols. GHG took 5.9s. Estimated remaining time: 4h 31m 9s [2025-10-25T21:53:24.266422] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:24.266611] [DEBUG] [LOCAL ] GHI: No existing data file found in primary storage. [2025-10-25T21:53:24.266704] [WARN ] [MAIN ] GHI: No existing data found, performing full refresh instead. [2025-10-25T21:53:24.266817] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-25T21:53:24.266893] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-25T21:53:24.266953] [DEBUG] [LOCAL ] GHI: No primary data file found to delete. [2025-10-25T21:53:24.267022] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-25T21:53:24.637023] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:24.637391] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-25T21:53:25.531638] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-25T21:53:25.534376] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-25T21:53:26.145044] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T21:53:26.147054] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-25T21:53:26.875370] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T21:53:26.877510] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-25T21:53:27.601475] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T21:53:27.603902] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-25T21:53:28.240111] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-25T21:53:28.242090] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-25T21:53:28.848635] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T21:53:28.850624] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-25T21:53:29.814008] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T21:53:29.816513] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-25T21:53:30.574576] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T21:53:30.577029] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-25T21:53:31.291889] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T21:53:31.294156] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-25T21:53:32.195521] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T21:53:32.198478] [INFO ] [REMOTE ] GHI: Full fetch complete (11399 records). [2025-10-25T21:53:32.198594] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-25T21:53:32.559328] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-25T21:53:32.559457] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-25T21:53:32.559768] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-25T21:53:32.559863] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-25T21:53:32.560386] [DEBUG] [LOCAL ] GHI: Trimmed 11399 records to 8101 (keeping 200 days of data) [2025-10-25T21:53:32.608107] [DEBUG] [LOCAL ] GHI: Primary data saved (8101 records). [2025-10-25T21:53:32.608253] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-25T21:53:32.608422] [INFO ] [MAIN ] Update Progress: 931/2366 symbols. GHI took 8.5s. Estimated remaining time: 4h 30m 53s [2025-10-25T21:53:32.786784] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:32.786992] [DEBUG] [LOCAL ] GHLD: No existing data file found in primary storage. [2025-10-25T21:53:32.787098] [WARN ] [MAIN ] GHLD: No existing data found, performing full refresh instead. [2025-10-25T21:53:32.787242] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-25T21:53:32.787331] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-25T21:53:32.787437] [DEBUG] [LOCAL ] GHLD: No primary data file found to delete. [2025-10-25T21:53:32.787526] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-25T21:53:33.138169] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:33.138466] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-25T21:53:33.566167] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-25T21:53:33.567157] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-25T21:53:33.938965] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-25T21:53:33.939963] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-25T21:53:34.398449] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T21:53:34.399753] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-25T21:53:34.881085] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-25T21:53:34.882249] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-25T21:53:35.322463] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-25T21:53:35.323592] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-25T21:53:35.971685] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-25T21:53:35.973430] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-25T21:53:36.659193] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-25T21:53:36.661035] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-25T21:53:37.101681] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-25T21:53:37.103699] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-25T21:53:37.719588] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T21:53:37.721357] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-25T21:53:38.286329] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T21:53:38.287725] [INFO ] [REMOTE ] GHLD: Full fetch complete (5149 records). [2025-10-25T21:53:38.287837] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-25T21:53:38.652720] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-25T21:53:38.652830] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-25T21:53:38.653025] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-25T21:53:38.653109] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-25T21:53:38.653521] [DEBUG] [LOCAL ] GHLD: Trimmed 5149 records to 4362 (keeping 200 days of data) [2025-10-25T21:53:38.678548] [DEBUG] [LOCAL ] GHLD: Primary data saved (4362 records). [2025-10-25T21:53:38.678636] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-25T21:53:38.678790] [INFO ] [MAIN ] Update Progress: 932/2366 symbols. GHLD took 6.1s. Estimated remaining time: 4h 30m 33s [2025-10-25T21:53:38.850338] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:38.850544] [DEBUG] [LOCAL ] GHM: No existing data file found in primary storage. [2025-10-25T21:53:38.850616] [WARN ] [MAIN ] GHM: No existing data found, performing full refresh instead. [2025-10-25T21:53:38.850768] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-25T21:53:38.850839] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-25T21:53:38.850921] [DEBUG] [LOCAL ] GHM: No primary data file found to delete. [2025-10-25T21:53:38.850988] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-25T21:53:39.205594] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:39.205961] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-25T21:53:40.023723] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T21:53:40.026976] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-25T21:53:41.109551] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T21:53:41.114184] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-25T21:53:42.061798] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T21:53:42.065684] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-25T21:53:42.877673] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T21:53:42.882307] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-25T21:53:43.703300] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T21:53:43.706782] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-25T21:53:44.681196] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T21:53:44.685382] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-25T21:53:45.736516] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T21:53:45.740929] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-25T21:53:46.728524] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T21:53:46.733160] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-25T21:53:47.760095] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T21:53:47.764837] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-25T21:53:48.717871] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T21:53:48.721256] [INFO ] [REMOTE ] GHM: Full fetch complete (21867 records). [2025-10-25T21:53:48.721368] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-25T21:53:49.110791] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-25T21:53:49.110941] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-25T21:53:49.111752] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-25T21:53:49.111836] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-25T21:53:49.112617] [DEBUG] [LOCAL ] GHM: Trimmed 21867 records to 14511 (keeping 200 days of data) [2025-10-25T21:53:49.202326] [DEBUG] [LOCAL ] GHM: Primary data saved (14511 records). [2025-10-25T21:53:49.202572] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-25T21:53:49.202807] [INFO ] [MAIN ] Update Progress: 933/2366 symbols. GHM took 10.5s. Estimated remaining time: 4h 30m 21s [2025-10-25T21:53:49.376678] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:53:49.377011] [DEBUG] [LOCAL ] GHY: No existing data file found in primary storage. [2025-10-25T21:53:49.377104] [WARN ] [MAIN ] GHY: No existing data found, performing full refresh instead. [2025-10-25T21:53:49.377233] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-25T21:53:49.377310] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-25T21:53:49.377380] [DEBUG] [LOCAL ] GHY: No primary data file found to delete. [2025-10-25T21:53:49.377448] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-25T21:53:49.750531] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:53:49.750996] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-25T21:53:51.096408] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T21:53:51.103163] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-25T21:53:52.090769] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T21:53:52.095209] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-25T21:53:52.977224] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T21:53:52.982631] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-25T21:53:54.205689] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T21:53:54.211370] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-25T21:53:55.229336] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T21:53:55.234162] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-25T21:53:55.837429] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-25T21:53:55.841243] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-25T21:53:57.033165] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-25T21:53:57.039243] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-25T21:53:58.002684] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T21:53:58.007235] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-25T21:53:58.952636] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T21:53:58.957349] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-25T21:54:00.126299] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T21:54:00.131368] [INFO ] [REMOTE ] GHY: Full fetch complete (32210 records). [2025-10-25T21:54:00.131492] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-25T21:54:00.516366] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-25T21:54:00.516482] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-25T21:54:00.517124] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-25T21:54:00.517205] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-25T21:54:00.518101] [DEBUG] [LOCAL ] GHY: Trimmed 32210 records to 21125 (keeping 200 days of data) [2025-10-25T21:54:00.638852] [DEBUG] [LOCAL ] GHY: Primary data saved (21125 records). [2025-10-25T21:54:00.639005] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-25T21:54:00.639140] [INFO ] [MAIN ] Update Progress: 934/2366 symbols. GHY took 11.4s. Estimated remaining time: 4h 30m 10s [2025-10-25T21:54:00.802152] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:54:00.802336] [DEBUG] [LOCAL ] GIB: No existing data file found in primary storage. [2025-10-25T21:54:00.802407] [WARN ] [MAIN ] GIB: No existing data found, performing full refresh instead. [2025-10-25T21:54:00.802493] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-25T21:54:00.802559] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-25T21:54:00.802617] [DEBUG] [LOCAL ] GIB: No primary data file found to delete. [2025-10-25T21:54:00.802686] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-25T21:54:01.149839] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:54:01.150186] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-25T21:54:03.286062] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-25T21:54:03.291624] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-25T21:54:04.639317] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T21:54:04.645770] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-25T21:54:06.064468] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T21:54:06.072438] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-25T21:54:07.446996] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T21:54:07.454942] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-25T21:54:08.622439] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T21:54:08.628814] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-25T21:54:09.797319] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T21:54:09.804180] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-25T21:54:11.137856] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T21:54:11.145024] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-25T21:54:12.406707] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T21:54:12.414411] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-25T21:54:13.832552] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T21:54:13.839966] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-25T21:54:15.068977] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T21:54:15.074902] [INFO ] [REMOTE ] GIB: Full fetch complete (46455 records). [2025-10-25T21:54:15.075045] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-25T21:54:15.459228] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-25T21:54:15.459351] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-25T21:54:15.460105] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-25T21:54:15.460191] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-25T21:54:15.461268] [DEBUG] [LOCAL ] GIB: Trimmed 46455 records to 31725 (keeping 200 days of data) [2025-10-25T21:54:15.650356] [DEBUG] [LOCAL ] GIB: Primary data saved (31725 records). [2025-10-25T21:54:15.650523] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-25T21:54:15.650706] [INFO ] [MAIN ] Update Progress: 935/2366 symbols. GIB took 15.0s. Estimated remaining time: 4h 30m 4s [2025-10-25T21:54:15.834801] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:54:15.835016] [DEBUG] [LOCAL ] GIC: No existing data file found in primary storage. [2025-10-25T21:54:15.835094] [WARN ] [MAIN ] GIC: No existing data found, performing full refresh instead. [2025-10-25T21:54:15.835186] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-25T21:54:15.835253] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-25T21:54:15.835317] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-10-25T21:54:15.835381] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-25T21:54:16.204534] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:54:16.204915] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-25T21:54:17.120779] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-25T21:54:17.124158] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-25T21:54:17.978051] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-25T21:54:17.981395] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-25T21:54:18.931219] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T21:54:18.934818] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-25T21:54:19.998690] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T21:54:20.003011] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-25T21:54:20.824013] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T21:54:20.827070] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-25T21:54:21.694032] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T21:54:21.697040] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-25T21:54:22.506625] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-25T21:54:22.509984] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-25T21:54:23.493041] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T21:54:23.497429] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-25T21:54:24.360430] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T21:54:24.364329] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-25T21:54:25.156503] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T21:54:25.159030] [INFO ] [REMOTE ] GIC: Full fetch complete (19639 records). [2025-10-25T21:54:25.159123] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-25T21:54:25.538537] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-25T21:54:25.538670] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-25T21:54:25.539170] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-25T21:54:25.539294] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-25T21:54:25.540006] [DEBUG] [LOCAL ] GIC: Trimmed 19639 records to 13286 (keeping 200 days of data) [2025-10-25T21:54:25.616136] [DEBUG] [LOCAL ] GIC: Primary data saved (13286 records). [2025-10-25T21:54:25.616295] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-25T21:54:25.616487] [INFO ] [MAIN ] Update Progress: 936/2366 symbols. GIC took 10.0s. Estimated remaining time: 4h 29m 51s [2025-10-25T21:54:25.790481] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:54:25.790736] [DEBUG] [LOCAL ] GIL: No existing data file found in primary storage. [2025-10-25T21:54:25.790833] [WARN ] [MAIN ] GIL: No existing data found, performing full refresh instead. [2025-10-25T21:54:25.790981] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-25T21:54:25.791060] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-25T21:54:25.791170] [DEBUG] [LOCAL ] GIL: No primary data file found to delete. [2025-10-25T21:54:25.791249] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-25T21:54:26.157702] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:54:26.158200] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-25T21:54:27.766771] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-25T21:54:27.774927] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-25T21:54:29.117181] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T21:54:29.125265] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-25T21:54:30.778569] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T21:54:30.791471] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-25T21:54:32.355850] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T21:54:32.365472] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-25T21:54:33.833483] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T21:54:33.842666] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-25T21:54:35.208008] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T21:54:35.216183] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-25T21:54:36.604536] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T21:54:36.613552] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-25T21:54:38.222078] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T21:54:38.232187] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-25T21:54:39.660614] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T21:54:39.671138] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-25T21:54:41.121062] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T21:54:41.131238] [INFO ] [REMOTE ] GIL: Full fetch complete (62715 records). [2025-10-25T21:54:41.131423] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-25T21:54:41.519688] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-25T21:54:41.519810] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-25T21:54:41.520764] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-25T21:54:41.520847] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-25T21:54:41.522175] [DEBUG] [LOCAL ] GIL: Trimmed 62715 records to 44636 (keeping 200 days of data) [2025-10-25T21:54:41.779957] [DEBUG] [LOCAL ] GIL: Primary data saved (44636 records). [2025-10-25T21:54:41.780117] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-25T21:54:41.780258] [INFO ] [MAIN ] Update Progress: 937/2366 symbols. GIL took 16.2s. Estimated remaining time: 4h 29m 47s [2025-10-25T21:54:41.962980] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:54:41.963167] [DEBUG] [LOCAL ] GIS: No existing data file found in primary storage. [2025-10-25T21:54:41.963238] [WARN ] [MAIN ] GIS: No existing data found, performing full refresh instead. [2025-10-25T21:54:41.963329] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-25T21:54:41.963428] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-25T21:54:41.963509] [DEBUG] [LOCAL ] GIS: No primary data file found to delete. [2025-10-25T21:54:41.963577] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-25T21:54:42.312883] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:54:42.313224] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-25T21:54:43.959721] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T21:54:43.970596] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-25T21:54:45.776206] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-25T21:54:45.786449] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-25T21:54:47.620857] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T21:54:47.632091] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-25T21:54:49.454609] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T21:54:49.466185] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-25T21:54:51.475536] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-25T21:54:51.487152] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-25T21:54:53.297862] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T21:54:53.309133] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-25T21:54:55.274702] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-25T21:54:55.286890] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-25T21:54:57.310125] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-25T21:54:57.321463] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-25T21:54:59.389639] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-25T21:54:59.400969] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-25T21:55:00.214570] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T21:55:00.225865] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-25T21:55:00.226185] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-25T21:55:00.649022] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-25T21:55:00.649182] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-25T21:55:00.650442] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-25T21:55:00.650529] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-25T21:55:00.652503] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 54455 (keeping 200 days of data) [2025-10-25T21:55:00.999044] [DEBUG] [LOCAL ] GIS: Primary data saved (54455 records). [2025-10-25T21:55:00.999293] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-25T21:55:00.999475] [INFO ] [MAIN ] Update Progress: 938/2366 symbols. GIS took 19.2s. Estimated remaining time: 4h 29m 47s [2025-10-25T21:55:01.181257] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:55:01.181542] [DEBUG] [LOCAL ] GKOS: No existing data file found in primary storage. [2025-10-25T21:55:01.181623] [WARN ] [MAIN ] GKOS: No existing data found, performing full refresh instead. [2025-10-25T21:55:01.181806] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-25T21:55:01.181886] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-25T21:55:01.181977] [DEBUG] [LOCAL ] GKOS: No primary data file found to delete. [2025-10-25T21:55:01.182055] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-25T21:55:01.674401] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:55:01.675152] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-25T21:55:03.351215] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T21:55:03.358828] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-25T21:55:04.928220] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T21:55:04.938349] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-25T21:55:06.563199] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T21:55:06.572301] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-25T21:55:08.097082] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T21:55:08.106739] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-25T21:55:09.554035] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T21:55:09.563338] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-25T21:55:11.035711] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T21:55:11.044463] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-25T21:55:12.590405] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T21:55:12.599717] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-25T21:55:14.106845] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T21:55:14.115616] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-25T21:55:15.662552] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-25T21:55:15.671733] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-25T21:55:17.057867] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-25T21:55:17.066253] [INFO ] [REMOTE ] GKOS: Full fetch complete (60701 records). [2025-10-25T21:55:17.066494] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-25T21:55:17.481867] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-25T21:55:17.482033] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-25T21:55:17.483208] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-25T21:55:17.483302] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-25T21:55:17.485177] [DEBUG] [LOCAL ] GKOS: Trimmed 60701 records to 43058 (keeping 200 days of data) [2025-10-25T21:55:17.742979] [DEBUG] [LOCAL ] GKOS: Primary data saved (43058 records). [2025-10-25T21:55:17.743198] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-25T21:55:17.743373] [INFO ] [MAIN ] Update Progress: 939/2366 symbols. GKOS took 16.7s. Estimated remaining time: 4h 29m 44s [2025-10-25T21:55:17.916354] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:55:17.916675] [DEBUG] [LOCAL ] GL: No existing data file found in primary storage. [2025-10-25T21:55:17.916762] [WARN ] [MAIN ] GL: No existing data found, performing full refresh instead. [2025-10-25T21:55:17.916899] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-25T21:55:17.916974] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-25T21:55:17.917060] [DEBUG] [LOCAL ] GL: No primary data file found to delete. [2025-10-25T21:55:17.917142] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-25T21:55:18.302544] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:55:18.303007] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-25T21:55:19.720886] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T21:55:19.731695] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-25T21:55:21.239994] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T21:55:21.247681] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-25T21:55:22.529456] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-25T21:55:22.538177] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-25T21:55:24.071348] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T21:55:24.080187] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-25T21:55:25.480463] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T21:55:25.488929] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-25T21:55:26.870381] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T21:55:26.877477] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-25T21:55:28.339360] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T21:55:28.348784] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-25T21:55:29.739797] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T21:55:29.749133] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-25T21:55:30.429248] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-25T21:55:30.436616] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-25T21:55:30.874172] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-25T21:55:30.881146] [INFO ] [REMOTE ] GL: Full fetch complete (54969 records). [2025-10-25T21:55:30.881279] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-25T21:55:31.259175] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-25T21:55:31.259329] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-25T21:55:31.260155] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-25T21:55:31.260233] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-25T21:55:31.261341] [DEBUG] [LOCAL ] GL: Trimmed 54969 records to 38036 (keeping 200 days of data) [2025-10-25T21:55:31.495073] [DEBUG] [LOCAL ] GL: Primary data saved (38036 records). [2025-10-25T21:55:31.495239] [INFO ] [MAIN ] GL: Full history saved. [2025-10-25T21:55:31.495377] [INFO ] [MAIN ] Update Progress: 940/2366 symbols. GL took 13.8s. Estimated remaining time: 4h 29m 37s [2025-10-25T21:55:31.665529] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:55:31.665767] [DEBUG] [LOCAL ] GLOB: No existing data file found in primary storage. [2025-10-25T21:55:31.665861] [WARN ] [MAIN ] GLOB: No existing data found, performing full refresh instead. [2025-10-25T21:55:31.665991] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-25T21:55:31.666074] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-25T21:55:31.666196] [DEBUG] [LOCAL ] GLOB: No primary data file found to delete. [2025-10-25T21:55:31.666267] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-25T21:55:32.033287] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:55:32.033613] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-25T21:55:33.500313] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T21:55:33.507541] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-25T21:55:34.983016] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:55:34.990712] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-25T21:55:36.701994] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T21:55:36.716336] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-25T21:55:38.245868] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T21:55:38.255041] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-25T21:55:40.008214] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-25T21:55:40.018729] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-25T21:55:41.550696] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T21:55:41.565296] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-25T21:55:43.293734] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T21:55:43.304154] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-25T21:55:45.044898] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T21:55:45.055608] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-25T21:55:46.545076] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T21:55:46.555967] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-25T21:55:48.186090] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T21:55:48.195324] [INFO ] [REMOTE ] GLOB: Full fetch complete (66429 records). [2025-10-25T21:55:48.195512] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-25T21:55:48.611181] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-25T21:55:48.611303] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-25T21:55:48.612266] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-25T21:55:48.612348] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-25T21:55:48.613733] [DEBUG] [LOCAL ] GLOB: Trimmed 66429 records to 48732 (keeping 200 days of data) [2025-10-25T21:55:48.897139] [DEBUG] [LOCAL ] GLOB: Primary data saved (48732 records). [2025-10-25T21:55:48.897309] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-25T21:55:48.897448] [INFO ] [MAIN ] Update Progress: 941/2366 symbols. GLOB took 17.4s. Estimated remaining time: 4h 29m 34s [2025-10-25T21:55:49.071061] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:55:49.071430] [DEBUG] [LOCAL ] GLP: No existing data file found in primary storage. [2025-10-25T21:55:49.071503] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-10-25T21:55:49.071677] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-25T21:55:49.071751] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-25T21:55:49.071835] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-10-25T21:55:49.071904] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-25T21:55:49.427416] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:55:49.427821] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-25T21:55:50.230570] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T21:55:50.233296] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-25T21:55:51.134382] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T21:55:51.137199] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-25T21:55:51.882393] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T21:55:51.885419] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-25T21:55:52.639343] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T21:55:52.641585] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-25T21:55:53.462816] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T21:55:53.465898] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-25T21:55:54.461492] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T21:55:54.464212] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-25T21:55:55.178234] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T21:55:55.180388] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-25T21:55:55.996619] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T21:55:55.999494] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-25T21:55:56.840801] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T21:55:56.844150] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-25T21:55:57.565204] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T21:55:57.567215] [INFO ] [REMOTE ] GLP: Full fetch complete (14221 records). [2025-10-25T21:55:57.567301] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-25T21:55:57.928709] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-25T21:55:57.928823] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-25T21:55:57.929188] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-25T21:55:57.929265] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-25T21:55:57.929847] [DEBUG] [LOCAL ] GLP: Trimmed 14221 records to 9295 (keeping 200 days of data) [2025-10-25T21:55:57.983154] [DEBUG] [LOCAL ] GLP: Primary data saved (9295 records). [2025-10-25T21:55:57.983310] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-25T21:55:57.983448] [INFO ] [MAIN ] Update Progress: 942/2366 symbols. GLP took 9.1s. Estimated remaining time: 4h 29m 20s [2025-10-25T21:55:58.149839] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:55:58.150081] [DEBUG] [LOCAL ] GLW: No existing data file found in primary storage. [2025-10-25T21:55:58.150184] [WARN ] [MAIN ] GLW: No existing data found, performing full refresh instead. [2025-10-25T21:55:58.150351] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-25T21:55:58.150454] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-25T21:55:58.150580] [DEBUG] [LOCAL ] GLW: No primary data file found to delete. [2025-10-25T21:55:58.150706] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-25T21:55:58.523952] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:55:58.524406] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-25T21:56:00.265639] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T21:56:00.276632] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-25T21:56:02.461084] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-25T21:56:02.471984] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-25T21:56:04.337366] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T21:56:04.348352] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-25T21:56:06.215541] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-25T21:56:06.226784] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-25T21:56:08.029610] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T21:56:08.041198] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-25T21:56:09.790698] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T21:56:09.802542] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-25T21:56:11.802203] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-25T21:56:11.815098] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-25T21:56:13.454201] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T21:56:13.465501] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-25T21:56:15.427732] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-25T21:56:15.439774] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-25T21:56:16.214533] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T21:56:16.225449] [INFO ] [REMOTE ] GLW: Full fetch complete (77798 records). [2025-10-25T21:56:16.225752] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-25T21:56:16.637898] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-25T21:56:16.638065] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-25T21:56:16.639469] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-25T21:56:16.639560] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-25T21:56:16.641741] [DEBUG] [LOCAL ] GLW: Trimmed 77798 records to 54415 (keeping 200 days of data) [2025-10-25T21:56:16.994674] [DEBUG] [LOCAL ] GLW: Primary data saved (54415 records). [2025-10-25T21:56:16.994914] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-25T21:56:16.995116] [INFO ] [MAIN ] Update Progress: 943/2366 symbols. GLW took 19.0s. Estimated remaining time: 4h 29m 20s [2025-10-25T21:56:17.175831] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:56:17.176139] [DEBUG] [LOCAL ] GM: No existing data file found in primary storage. [2025-10-25T21:56:17.176235] [WARN ] [MAIN ] GM: No existing data found, performing full refresh instead. [2025-10-25T21:56:17.176364] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-25T21:56:17.176437] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-25T21:56:17.176521] [DEBUG] [LOCAL ] GM: No primary data file found to delete. [2025-10-25T21:56:17.176595] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-25T21:56:17.550091] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:56:17.551171] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-25T21:56:19.561678] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-25T21:56:19.573050] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-25T21:56:21.602314] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-25T21:56:21.613072] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-25T21:56:23.687876] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T21:56:23.699125] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-25T21:56:26.074724] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-25T21:56:26.086343] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-25T21:56:28.076256] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T21:56:28.087503] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-25T21:56:29.978994] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-25T21:56:29.992502] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-25T21:56:32.160694] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-25T21:56:32.172531] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-25T21:56:34.068419] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-25T21:56:34.079914] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-25T21:56:35.880825] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-25T21:56:35.893185] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-25T21:56:36.267559] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-25T21:56:36.277786] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-25T21:56:36.277949] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-25T21:56:36.712764] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-25T21:56:36.712887] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-25T21:56:36.713983] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-25T21:56:36.714083] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-25T21:56:36.715577] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54509 (keeping 200 days of data) [2025-10-25T21:56:37.053176] [DEBUG] [LOCAL ] GM: Primary data saved (54509 records). [2025-10-25T21:56:37.053379] [INFO ] [MAIN ] GM: Full history saved. [2025-10-25T21:56:37.053533] [INFO ] [MAIN ] Update Progress: 944/2366 symbols. GM took 20.1s. Estimated remaining time: 4h 29m 22s [2025-10-25T21:56:37.228794] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:56:37.229009] [DEBUG] [LOCAL ] GME: No existing data file found in primary storage. [2025-10-25T21:56:37.229082] [WARN ] [MAIN ] GME: No existing data found, performing full refresh instead. [2025-10-25T21:56:37.229195] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-25T21:56:37.229267] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-25T21:56:37.229350] [DEBUG] [LOCAL ] GME: No primary data file found to delete. [2025-10-25T21:56:37.229421] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-25T21:56:37.631886] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:56:37.632276] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-25T21:56:39.869733] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-25T21:56:39.880587] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-25T21:56:42.291272] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-25T21:56:42.302459] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-25T21:56:44.531465] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-25T21:56:44.543050] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-25T21:56:47.216399] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-25T21:56:47.227475] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-25T21:56:49.447977] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-25T21:56:49.459307] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-25T21:56:51.727412] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-25T21:56:51.738580] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-25T21:56:54.394076] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-25T21:56:54.405710] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-25T21:56:56.889041] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-25T21:56:56.900395] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-25T21:56:59.215917] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-25T21:56:59.228362] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-25T21:57:01.931771] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-25T21:57:01.941671] [INFO ] [REMOTE ] GME: Full fetch complete (77919 records). [2025-10-25T21:57:01.941885] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-25T21:57:02.336391] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-25T21:57:02.336506] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-25T21:57:02.337636] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-25T21:57:02.337767] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-25T21:57:02.339339] [DEBUG] [LOCAL ] GME: Trimmed 77919 records to 54557 (keeping 200 days of data) [2025-10-25T21:57:02.645263] [DEBUG] [LOCAL ] GME: Primary data saved (54557 records). [2025-10-25T21:57:02.645419] [INFO ] [MAIN ] GME: Full history saved. [2025-10-25T21:57:02.645560] [INFO ] [MAIN ] Update Progress: 945/2366 symbols. GME took 25.6s. Estimated remaining time: 4h 29m 32s [2025-10-25T21:57:02.811753] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:57:02.811946] [DEBUG] [LOCAL ] GMED: No existing data file found in primary storage. [2025-10-25T21:57:02.812015] [WARN ] [MAIN ] GMED: No existing data found, performing full refresh instead. [2025-10-25T21:57:02.812123] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-25T21:57:02.812202] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-25T21:57:02.812281] [DEBUG] [LOCAL ] GMED: No primary data file found to delete. [2025-10-25T21:57:02.812350] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-25T21:57:03.164502] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:57:03.164899] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-25T21:57:04.823689] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T21:57:04.833138] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-25T21:57:06.421779] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T21:57:06.432232] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-25T21:57:08.047156] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T21:57:08.057822] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-25T21:57:09.639000] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T21:57:09.648904] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-25T21:57:11.282190] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T21:57:11.292662] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-25T21:57:12.963364] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T21:57:12.973284] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-25T21:57:14.654747] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T21:57:14.665938] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-25T21:57:16.112609] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T21:57:16.123519] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-25T21:57:17.663385] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T21:57:17.673751] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-25T21:57:19.101098] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T21:57:19.109693] [INFO ] [REMOTE ] GMED: Full fetch complete (70183 records). [2025-10-25T21:57:19.109848] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-25T21:57:19.596778] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-25T21:57:19.596947] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-25T21:57:19.598699] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-25T21:57:19.598819] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-25T21:57:19.600784] [DEBUG] [LOCAL ] GMED: Trimmed 70183 records to 48786 (keeping 200 days of data) [2025-10-25T21:57:19.954448] [DEBUG] [LOCAL ] GMED: Primary data saved (48786 records). [2025-10-25T21:57:19.954697] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-25T21:57:19.954905] [INFO ] [MAIN ] Update Progress: 946/2366 symbols. GMED took 17.3s. Estimated remaining time: 4h 29m 29s [2025-10-25T21:57:20.210306] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:57:20.210635] [DEBUG] [LOCAL ] GMRE: No existing data file found in primary storage. [2025-10-25T21:57:20.210754] [WARN ] [MAIN ] GMRE: No existing data found, performing full refresh instead. [2025-10-25T21:57:20.210906] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-25T21:57:20.211001] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-25T21:57:20.211109] [DEBUG] [LOCAL ] GMRE: No primary data file found to delete. [2025-10-25T21:57:20.211199] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-25T21:57:20.595105] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:57:20.595466] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-25T21:57:21.910529] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T21:57:21.917980] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-25T21:57:23.179398] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T21:57:23.185844] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-25T21:57:24.514211] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T21:57:24.521416] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-25T21:57:26.038527] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T21:57:26.046952] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-25T21:57:27.425099] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T21:57:27.433193] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-25T21:57:28.852389] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T21:57:28.860833] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-25T21:57:30.198635] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T21:57:30.207932] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-25T21:57:31.619575] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T21:57:31.628465] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-25T21:57:32.943521] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T21:57:32.951212] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-25T21:57:34.013319] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T21:57:34.018144] [INFO ] [REMOTE ] GMRE: Full fetch complete (51624 records). [2025-10-25T21:57:34.018255] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-25T21:57:34.392063] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-25T21:57:34.392176] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-25T21:57:34.392938] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-25T21:57:34.393017] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-25T21:57:34.394085] [DEBUG] [LOCAL ] GMRE: Trimmed 51624 records to 36688 (keeping 200 days of data) [2025-10-25T21:57:34.606778] [DEBUG] [LOCAL ] GMRE: Primary data saved (36688 records). [2025-10-25T21:57:34.606939] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-25T21:57:34.607075] [INFO ] [MAIN ] Update Progress: 947/2366 symbols. GMRE took 14.7s. Estimated remaining time: 4h 29m 23s [2025-10-25T21:57:34.778914] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:57:34.779157] [DEBUG] [LOCAL ] GNE: No existing data file found in primary storage. [2025-10-25T21:57:34.779229] [WARN ] [MAIN ] GNE: No existing data found, performing full refresh instead. [2025-10-25T21:57:34.779351] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-25T21:57:34.779422] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-25T21:57:34.779500] [DEBUG] [LOCAL ] GNE: No primary data file found to delete. [2025-10-25T21:57:34.779566] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-25T21:57:35.128509] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:57:35.128848] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-25T21:57:35.919330] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-25T21:57:35.921975] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-25T21:57:36.656051] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T21:57:36.658469] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-25T21:57:37.539906] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T21:57:37.542789] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-25T21:57:38.367997] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-25T21:57:38.371305] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-25T21:57:39.383920] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T21:57:39.387618] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-25T21:57:40.591836] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T21:57:40.597335] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-25T21:57:41.657708] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T21:57:41.663191] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-25T21:57:42.679875] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T21:57:42.684948] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-25T21:57:43.585296] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T21:57:43.589574] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-25T21:57:44.378053] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T21:57:44.381220] [INFO ] [REMOTE ] GNE: Full fetch complete (22652 records). [2025-10-25T21:57:44.381375] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-25T21:57:44.760795] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-25T21:57:44.760953] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-25T21:57:44.761527] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-25T21:57:44.761621] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-25T21:57:44.762320] [DEBUG] [LOCAL ] GNE: Trimmed 22652 records to 18312 (keeping 200 days of data) [2025-10-25T21:57:44.867188] [DEBUG] [LOCAL ] GNE: Primary data saved (18312 records). [2025-10-25T21:57:44.867360] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-25T21:57:44.867497] [INFO ] [MAIN ] Update Progress: 948/2366 symbols. GNE took 10.3s. Estimated remaining time: 4h 29m 10s [2025-10-25T21:57:45.037301] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:57:45.037572] [DEBUG] [LOCAL ] GNK: No existing data file found in primary storage. [2025-10-25T21:57:45.037683] [WARN ] [MAIN ] GNK: No existing data found, performing full refresh instead. [2025-10-25T21:57:45.037850] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-25T21:57:45.037933] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-25T21:57:45.038039] [DEBUG] [LOCAL ] GNK: No primary data file found to delete. [2025-10-25T21:57:45.038137] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-25T21:57:45.388273] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:57:45.388609] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-25T21:57:46.781567] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T21:57:46.788623] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-25T21:57:48.202001] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-25T21:57:48.209425] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-25T21:57:49.863415] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T21:57:49.872572] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-25T21:57:51.388886] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T21:57:51.398189] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-25T21:57:52.765453] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T21:57:52.774299] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-25T21:57:53.862835] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T21:57:53.875030] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-25T21:57:55.505752] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T21:57:55.515245] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-25T21:57:56.907154] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-25T21:57:56.916067] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-25T21:57:58.243159] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T21:57:58.253318] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-25T21:57:59.448953] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T21:57:59.455849] [INFO ] [REMOTE ] GNK: Full fetch complete (57157 records). [2025-10-25T21:57:59.456035] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-25T21:57:59.858156] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-25T21:57:59.858303] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-25T21:57:59.859214] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-25T21:57:59.859308] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-25T21:57:59.860592] [DEBUG] [LOCAL ] GNK: Trimmed 57157 records to 39934 (keeping 200 days of data) [2025-10-25T21:58:00.092454] [DEBUG] [LOCAL ] GNK: Primary data saved (39934 records). [2025-10-25T21:58:00.092639] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-25T21:58:00.092799] [INFO ] [MAIN ] Update Progress: 949/2366 symbols. GNK took 15.2s. Estimated remaining time: 4h 29m 4s [2025-10-25T21:58:00.275518] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:58:00.275759] [DEBUG] [LOCAL ] GNL: No existing data file found in primary storage. [2025-10-25T21:58:00.275835] [WARN ] [MAIN ] GNL: No existing data found, performing full refresh instead. [2025-10-25T21:58:00.275954] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-25T21:58:00.276034] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-25T21:58:00.276097] [DEBUG] [LOCAL ] GNL: No primary data file found to delete. [2025-10-25T21:58:00.276162] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-25T21:58:00.632146] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:58:00.632502] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-25T21:58:02.923460] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-25T21:58:02.933143] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-25T21:58:04.409310] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T21:58:04.418464] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-25T21:58:05.931455] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-25T21:58:05.942201] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-25T21:58:07.581882] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T21:58:07.593440] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-25T21:58:09.143094] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-25T21:58:09.153155] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-25T21:58:10.605158] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T21:58:10.615042] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-25T21:58:12.345789] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T21:58:12.356387] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-25T21:58:14.037206] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T21:58:14.046894] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-25T21:58:15.491259] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T21:58:15.505994] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-25T21:58:17.028635] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-25T21:58:17.036978] [INFO ] [REMOTE ] GNL: Full fetch complete (68013 records). [2025-10-25T21:58:17.037135] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-25T21:58:17.425378] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-25T21:58:17.425490] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-25T21:58:17.426420] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-25T21:58:17.426504] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-25T21:58:17.427941] [DEBUG] [LOCAL ] GNL: Trimmed 68013 records to 47104 (keeping 200 days of data) [2025-10-25T21:58:17.687772] [DEBUG] [LOCAL ] GNL: Primary data saved (47104 records). [2025-10-25T21:58:17.687944] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-25T21:58:17.688122] [INFO ] [MAIN ] Update Progress: 950/2366 symbols. GNL took 17.6s. Estimated remaining time: 4h 29m 2s [2025-10-25T21:58:17.875088] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:58:17.875342] [DEBUG] [LOCAL ] GNRC: No existing data file found in primary storage. [2025-10-25T21:58:17.875437] [WARN ] [MAIN ] GNRC: No existing data found, performing full refresh instead. [2025-10-25T21:58:17.875586] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-25T21:58:17.875700] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-25T21:58:17.875813] [DEBUG] [LOCAL ] GNRC: No primary data file found to delete. [2025-10-25T21:58:17.875899] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-25T21:58:18.244911] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:58:18.245239] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-25T21:58:19.813508] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T21:58:19.822793] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-25T21:58:21.353764] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T21:58:21.363509] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-25T21:58:22.901513] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T21:58:22.911059] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-25T21:58:24.644728] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T21:58:24.654839] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-25T21:58:26.124421] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T21:58:26.134003] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-25T21:58:27.583124] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T21:58:27.593957] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-25T21:58:29.180682] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T21:58:29.192235] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-25T21:58:30.711053] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T21:58:30.721740] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-25T21:58:31.770387] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T21:58:31.780521] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-25T21:58:32.789370] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T21:58:32.797772] [INFO ] [REMOTE ] GNRC: Full fetch complete (65727 records). [2025-10-25T21:58:32.797920] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-25T21:58:33.183747] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-25T21:58:33.183896] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-25T21:58:33.184804] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-25T21:58:33.184910] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-25T21:58:33.186235] [DEBUG] [LOCAL ] GNRC: Trimmed 65727 records to 45998 (keeping 200 days of data) [2025-10-25T21:58:33.450403] [DEBUG] [LOCAL ] GNRC: Primary data saved (45998 records). [2025-10-25T21:58:33.450552] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-25T21:58:33.450706] [INFO ] [MAIN ] Update Progress: 951/2366 symbols. GNRC took 15.8s. Estimated remaining time: 4h 28m 57s [2025-10-25T21:58:33.618270] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:58:33.618474] [DEBUG] [LOCAL ] GNT: No existing data file found in primary storage. [2025-10-25T21:58:33.618586] [WARN ] [MAIN ] GNT: No existing data found, performing full refresh instead. [2025-10-25T21:58:33.618730] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-25T21:58:33.618796] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-25T21:58:33.618880] [DEBUG] [LOCAL ] GNT: No primary data file found to delete. [2025-10-25T21:58:33.618949] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-25T21:58:33.974441] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:58:33.974807] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-25T21:58:34.554477] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-25T21:58:34.556246] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-25T21:58:35.145398] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-25T21:58:35.147292] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-25T21:58:35.804581] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-25T21:58:35.806609] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-25T21:58:36.525851] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T21:58:36.528379] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-25T21:58:37.403956] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T21:58:37.406158] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-25T21:58:38.149034] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T21:58:38.151550] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-25T21:58:38.855205] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T21:58:38.857601] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-25T21:58:39.467534] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T21:58:39.469681] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-25T21:58:40.249912] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T21:58:40.252969] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-25T21:58:40.993608] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T21:58:40.996122] [INFO ] [REMOTE ] GNT: Full fetch complete (11469 records). [2025-10-25T21:58:40.996221] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-25T21:58:41.363201] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-25T21:58:41.363315] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-25T21:58:41.363611] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-25T21:58:41.363704] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-25T21:58:41.364164] [DEBUG] [LOCAL ] GNT: Trimmed 11469 records to 8728 (keeping 200 days of data) [2025-10-25T21:58:41.411750] [DEBUG] [LOCAL ] GNT: Primary data saved (8728 records). [2025-10-25T21:58:41.411888] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-25T21:58:41.412033] [INFO ] [MAIN ] Update Progress: 952/2366 symbols. GNT took 8.0s. Estimated remaining time: 4h 28m 40s [2025-10-25T21:58:41.581795] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:58:41.582061] [DEBUG] [LOCAL ] GNW: No existing data file found in primary storage. [2025-10-25T21:58:41.582132] [WARN ] [MAIN ] GNW: No existing data found, performing full refresh instead. [2025-10-25T21:58:41.582221] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-25T21:58:41.582292] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-25T21:58:41.582425] [DEBUG] [LOCAL ] GNW: No primary data file found to delete. [2025-10-25T21:58:41.582496] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-25T21:58:41.935781] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:58:41.936104] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-25T21:58:43.407566] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T21:58:43.417173] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-25T21:58:44.867125] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T21:58:44.876420] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-25T21:58:46.523411] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T21:58:46.534032] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-25T21:58:48.043156] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T21:58:48.053908] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-25T21:58:49.744623] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T21:58:49.755576] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-25T21:58:51.334463] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T21:58:51.344932] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-25T21:58:52.985869] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T21:58:52.996903] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-25T21:58:54.464405] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T21:58:54.480007] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-25T21:58:56.098817] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T21:58:56.109503] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-25T21:58:57.884207] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T21:58:57.896968] [INFO ] [REMOTE ] GNW: Full fetch complete (73909 records). [2025-10-25T21:58:57.897137] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-25T21:58:58.283027] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-25T21:58:58.283138] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-25T21:58:58.284065] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-25T21:58:58.284144] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-25T21:58:58.285535] [DEBUG] [LOCAL ] GNW: Trimmed 73909 records to 52087 (keeping 200 days of data) [2025-10-25T21:58:58.570825] [DEBUG] [LOCAL ] GNW: Primary data saved (52087 records). [2025-10-25T21:58:58.570990] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-25T21:58:58.571132] [INFO ] [MAIN ] Update Progress: 953/2366 symbols. GNW took 17.2s. Estimated remaining time: 4h 28m 38s [2025-10-25T21:58:58.736212] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:58:58.736400] [DEBUG] [LOCAL ] GOF: No existing data file found in primary storage. [2025-10-25T21:58:58.736469] [WARN ] [MAIN ] GOF: No existing data found, performing full refresh instead. [2025-10-25T21:58:58.736577] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-25T21:58:58.736674] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-25T21:58:58.736765] [DEBUG] [LOCAL ] GOF: No primary data file found to delete. [2025-10-25T21:58:58.736834] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-25T21:58:59.081461] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:58:59.081880] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-25T21:59:00.808351] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T21:59:00.816939] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-25T21:59:02.554475] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T21:59:02.563274] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-25T21:59:04.141590] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T21:59:04.151980] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-25T21:59:05.806534] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T21:59:05.816967] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-25T21:59:07.443229] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T21:59:07.452533] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-25T21:59:09.005025] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T21:59:09.013689] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-25T21:59:10.727450] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-25T21:59:10.736870] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-25T21:59:12.480686] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T21:59:12.490274] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-25T21:59:14.074547] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T21:59:14.084471] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-25T21:59:15.712040] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T21:59:15.725767] [INFO ] [REMOTE ] GOF: Full fetch complete (62736 records). [2025-10-25T21:59:15.726040] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-25T21:59:16.292932] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-25T21:59:16.293078] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-25T21:59:16.294126] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-25T21:59:16.294224] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-25T21:59:16.295711] [DEBUG] [LOCAL ] GOF: Trimmed 62736 records to 43412 (keeping 200 days of data) [2025-10-25T21:59:16.569469] [DEBUG] [LOCAL ] GOF: Primary data saved (43412 records). [2025-10-25T21:59:16.569635] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-25T21:59:16.569839] [INFO ] [MAIN ] Update Progress: 954/2366 symbols. GOF took 18.0s. Estimated remaining time: 4h 28m 36s [2025-10-25T21:59:16.776340] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:59:16.776556] [DEBUG] [LOCAL ] GOLF: No existing data file found in primary storage. [2025-10-25T21:59:16.776631] [WARN ] [MAIN ] GOLF: No existing data found, performing full refresh instead. [2025-10-25T21:59:16.776768] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-25T21:59:16.776842] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-25T21:59:16.776924] [DEBUG] [LOCAL ] GOLF: No primary data file found to delete. [2025-10-25T21:59:16.776994] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-25T21:59:17.127971] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:59:17.128336] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-25T21:59:18.311983] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T21:59:18.317768] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-25T21:59:19.627585] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T21:59:19.635396] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-25T21:59:20.992603] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T21:59:21.000975] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-25T21:59:22.399445] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T21:59:22.408178] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-25T21:59:23.813416] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T21:59:23.821951] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-25T21:59:25.149872] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T21:59:25.156421] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-25T21:59:26.385633] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T21:59:26.392869] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-25T21:59:27.668453] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T21:59:27.675437] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-25T21:59:28.816712] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T21:59:28.822906] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-25T21:59:29.882569] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T21:59:29.888334] [INFO ] [REMOTE ] GOLF: Full fetch complete (45309 records). [2025-10-25T21:59:29.888565] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-25T21:59:30.280327] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-25T21:59:30.280481] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-25T21:59:30.281560] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-25T21:59:30.281679] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-25T21:59:30.282950] [DEBUG] [LOCAL ] GOLF: Trimmed 45309 records to 30614 (keeping 200 days of data) [2025-10-25T21:59:30.471935] [DEBUG] [LOCAL ] GOLF: Primary data saved (30614 records). [2025-10-25T21:59:30.472169] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-25T21:59:30.472349] [INFO ] [MAIN ] Update Progress: 955/2366 symbols. GOLF took 13.9s. Estimated remaining time: 4h 28m 28s [2025-10-25T21:59:30.662349] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:59:30.662714] [DEBUG] [LOCAL ] GOOS: No existing data file found in primary storage. [2025-10-25T21:59:30.662794] [WARN ] [MAIN ] GOOS: No existing data found, performing full refresh instead. [2025-10-25T21:59:30.662959] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-25T21:59:30.663036] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-25T21:59:30.663121] [DEBUG] [LOCAL ] GOOS: No primary data file found to delete. [2025-10-25T21:59:30.663193] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-25T21:59:31.055552] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:59:31.056026] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-25T21:59:32.645415] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T21:59:32.654505] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-25T21:59:34.271452] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T21:59:34.281677] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-25T21:59:35.808868] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T21:59:35.819734] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-25T21:59:37.260383] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T21:59:37.270801] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-25T21:59:38.749953] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T21:59:38.760133] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-25T21:59:40.338153] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T21:59:40.348669] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-25T21:59:42.043799] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-25T21:59:42.055080] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-25T21:59:43.602905] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T21:59:43.614023] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-25T21:59:45.119176] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T21:59:45.129184] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-25T21:59:46.688142] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-25T21:59:46.696055] [INFO ] [REMOTE ] GOOS: Full fetch complete (64580 records). [2025-10-25T21:59:46.696255] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-25T21:59:47.106505] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-25T21:59:47.106699] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-25T21:59:47.108169] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-25T21:59:47.108272] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-25T21:59:47.110282] [DEBUG] [LOCAL ] GOOS: Trimmed 64580 records to 44601 (keeping 200 days of data) [2025-10-25T21:59:47.379152] [DEBUG] [LOCAL ] GOOS: Primary data saved (44601 records). [2025-10-25T21:59:47.379378] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-25T21:59:47.379562] [INFO ] [MAIN ] Update Progress: 956/2366 symbols. GOOS took 16.9s. Estimated remaining time: 4h 28m 25s [2025-10-25T21:59:47.557128] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T21:59:47.557462] [DEBUG] [LOCAL ] GOTU: No existing data file found in primary storage. [2025-10-25T21:59:47.557545] [WARN ] [MAIN ] GOTU: No existing data found, performing full refresh instead. [2025-10-25T21:59:47.557709] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-25T21:59:47.557814] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-25T21:59:47.557900] [DEBUG] [LOCAL ] GOTU: No primary data file found to delete. [2025-10-25T21:59:47.557977] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-25T21:59:47.964913] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T21:59:47.965417] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-25T21:59:49.549098] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T21:59:49.558531] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-25T21:59:51.068445] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T21:59:51.077482] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-25T21:59:52.825352] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T21:59:52.835878] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-25T21:59:54.417083] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T21:59:54.426008] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-25T21:59:56.231149] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T21:59:56.240068] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-25T21:59:57.522505] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T21:59:57.530090] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-25T21:59:58.797287] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T21:59:58.805059] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-25T22:00:00.127082] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-25T22:00:00.134955] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-25T22:00:01.673852] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T22:00:01.682095] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-25T22:00:03.749296] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-25T22:00:03.755985] [INFO ] [REMOTE ] GOTU: Full fetch complete (57963 records). [2025-10-25T22:00:03.756195] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-25T22:00:04.168489] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-25T22:00:04.168632] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-25T22:00:04.169557] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-25T22:00:04.169671] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-25T22:00:04.171034] [DEBUG] [LOCAL ] GOTU: Trimmed 57963 records to 37178 (keeping 200 days of data) [2025-10-25T22:00:04.378108] [DEBUG] [LOCAL ] GOTU: Primary data saved (37178 records). [2025-10-25T22:00:04.378295] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-25T22:00:04.378672] [INFO ] [MAIN ] Update Progress: 957/2366 symbols. GOTU took 17.0s. Estimated remaining time: 4h 28m 22s [2025-10-25T22:00:04.555541] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:00:04.555801] [DEBUG] [LOCAL ] GPC: No existing data file found in primary storage. [2025-10-25T22:00:04.555876] [WARN ] [MAIN ] GPC: No existing data found, performing full refresh instead. [2025-10-25T22:00:04.555990] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-25T22:00:04.556060] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-25T22:00:04.556140] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-25T22:00:04.556208] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-25T22:00:04.909213] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:00:04.909553] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-25T22:00:06.741040] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T22:00:06.751128] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-25T22:00:08.475140] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T22:00:08.485356] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-25T22:00:10.305610] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T22:00:10.316124] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-25T22:00:12.272454] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-25T22:00:12.283928] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-25T22:00:14.033638] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-25T22:00:14.043584] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-25T22:00:15.612158] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T22:00:15.621505] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-25T22:00:17.439739] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-25T22:00:17.449910] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-25T22:00:18.877258] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T22:00:18.886613] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-25T22:00:20.389929] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T22:00:20.399534] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-25T22:00:21.926482] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-25T22:00:21.935091] [INFO ] [REMOTE ] GPC: Full fetch complete (68680 records). [2025-10-25T22:00:21.935267] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-25T22:00:22.321684] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-25T22:00:22.321802] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-25T22:00:22.322692] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-25T22:00:22.322773] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-25T22:00:22.324056] [DEBUG] [LOCAL ] GPC: Trimmed 68680 records to 46604 (keeping 200 days of data) [2025-10-25T22:00:22.605812] [DEBUG] [LOCAL ] GPC: Primary data saved (46604 records). [2025-10-25T22:00:22.605981] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-25T22:00:22.606145] [INFO ] [MAIN ] Update Progress: 958/2366 symbols. GPC took 18.2s. Estimated remaining time: 4h 28m 20s [2025-10-25T22:00:22.777409] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:00:22.777601] [DEBUG] [LOCAL ] GPI: No existing data file found in primary storage. [2025-10-25T22:00:22.777693] [WARN ] [MAIN ] GPI: No existing data found, performing full refresh instead. [2025-10-25T22:00:22.777831] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-25T22:00:22.777903] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-25T22:00:22.777960] [DEBUG] [LOCAL ] GPI: No primary data file found to delete. [2025-10-25T22:00:22.778026] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-25T22:00:23.126710] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:00:23.127035] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-25T22:00:24.124138] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T22:00:24.127514] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-25T22:00:25.015570] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T22:00:25.018845] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-25T22:00:26.194866] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-25T22:00:26.199174] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-25T22:00:27.290187] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T22:00:27.294951] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-25T22:00:28.108717] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T22:00:28.111734] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-25T22:00:29.015210] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T22:00:29.018868] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-25T22:00:30.065917] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T22:00:30.070503] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-25T22:00:30.967485] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T22:00:30.971389] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-25T22:00:31.961904] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T22:00:31.965940] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-25T22:00:33.023769] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-25T22:00:33.028076] [INFO ] [REMOTE ] GPI: Full fetch complete (21935 records). [2025-10-25T22:00:33.028208] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-25T22:00:33.411922] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-25T22:00:33.412043] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-25T22:00:33.412528] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-25T22:00:33.412600] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-25T22:00:33.413302] [DEBUG] [LOCAL ] GPI: Trimmed 21935 records to 14990 (keeping 200 days of data) [2025-10-25T22:00:33.503873] [DEBUG] [LOCAL ] GPI: Primary data saved (14990 records). [2025-10-25T22:00:33.504041] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-25T22:00:33.504182] [INFO ] [MAIN ] Update Progress: 959/2366 symbols. GPI took 10.9s. Estimated remaining time: 4h 28m 8s [2025-10-25T22:00:33.670836] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:00:33.671041] [DEBUG] [LOCAL ] GPJA: No existing data file found in primary storage. [2025-10-25T22:00:33.671112] [WARN ] [MAIN ] GPJA: No existing data found, performing full refresh instead. [2025-10-25T22:00:33.671221] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-25T22:00:33.671291] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-25T22:00:33.671371] [DEBUG] [LOCAL ] GPJA: No primary data file found to delete. [2025-10-25T22:00:33.671440] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-25T22:00:34.023993] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:00:34.024327] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-25T22:00:35.202680] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T22:00:35.205921] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-25T22:00:35.666589] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-25T22:00:35.668197] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-25T22:00:36.276235] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-25T22:00:36.277694] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-25T22:00:36.853353] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-25T22:00:36.855079] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-25T22:00:37.301359] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-25T22:00:37.302677] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-25T22:00:37.943670] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-25T22:00:37.945470] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-25T22:00:38.529071] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T22:00:38.530870] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-25T22:00:39.082040] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T22:00:39.084162] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-25T22:00:39.688345] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-25T22:00:39.690308] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-25T22:00:40.170335] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T22:00:40.171480] [INFO ] [REMOTE ] GPJA: Full fetch complete (6787 records). [2025-10-25T22:00:40.171578] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-25T22:00:40.535394] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-25T22:00:40.535513] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-25T22:00:40.535787] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-25T22:00:40.535890] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-25T22:00:40.536390] [DEBUG] [LOCAL ] GPJA: Trimmed 6787 records to 4140 (keeping 200 days of data) [2025-10-25T22:00:40.560848] [DEBUG] [LOCAL ] GPJA: Primary data saved (4140 records). [2025-10-25T22:00:40.560980] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-25T22:00:40.561192] [INFO ] [MAIN ] Update Progress: 960/2366 symbols. GPJA took 7.1s. Estimated remaining time: 4h 27m 50s [2025-10-25T22:00:40.730439] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:00:40.730695] [DEBUG] [LOCAL ] GPK: No existing data file found in primary storage. [2025-10-25T22:00:40.730781] [WARN ] [MAIN ] GPK: No existing data found, performing full refresh instead. [2025-10-25T22:00:40.730930] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-25T22:00:40.731024] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-25T22:00:40.731117] [DEBUG] [LOCAL ] GPK: No primary data file found to delete. [2025-10-25T22:00:40.731198] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-25T22:00:41.084861] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:00:41.085216] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-25T22:00:42.839217] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T22:00:42.850540] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-25T22:00:44.399906] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T22:00:44.410707] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-25T22:00:45.985845] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T22:00:45.996686] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-25T22:00:47.703944] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-25T22:00:47.715361] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-25T22:00:49.297255] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T22:00:49.308225] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-25T22:00:50.932789] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T22:00:50.943860] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-25T22:00:52.647611] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-25T22:00:52.659527] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-25T22:00:54.359119] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T22:00:54.370974] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-25T22:00:56.020158] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T22:00:56.033011] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-25T22:00:57.805017] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T22:00:57.814845] [INFO ] [REMOTE ] GPK: Full fetch complete (76096 records). [2025-10-25T22:00:57.815024] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-25T22:00:58.207604] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-25T22:00:58.207786] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-25T22:00:58.208822] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-25T22:00:58.208905] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-25T22:00:58.210422] [DEBUG] [LOCAL ] GPK: Trimmed 76096 records to 53551 (keeping 200 days of data) [2025-10-25T22:00:58.527919] [DEBUG] [LOCAL ] GPK: Primary data saved (53551 records). [2025-10-25T22:00:58.528098] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-25T22:00:58.528238] [INFO ] [MAIN ] Update Progress: 961/2366 symbols. GPK took 18.0s. Estimated remaining time: 4h 27m 48s [2025-10-25T22:00:58.704677] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:00:58.704981] [DEBUG] [LOCAL ] GPMT: No existing data file found in primary storage. [2025-10-25T22:00:58.705055] [WARN ] [MAIN ] GPMT: No existing data found, performing full refresh instead. [2025-10-25T22:00:58.705170] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-25T22:00:58.705239] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-25T22:00:58.705316] [DEBUG] [LOCAL ] GPMT: No primary data file found to delete. [2025-10-25T22:00:58.705382] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-25T22:00:59.084808] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:00:59.085134] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-25T22:01:00.212389] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T22:01:00.217421] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-25T22:01:01.278855] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T22:01:01.283773] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-25T22:01:02.629701] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T22:01:02.636160] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-25T22:01:03.907080] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T22:01:03.914495] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-25T22:01:05.209323] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T22:01:05.215944] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-25T22:01:06.582481] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T22:01:06.590934] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-25T22:01:07.607148] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T22:01:07.612546] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-25T22:01:08.682234] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T22:01:08.687061] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-25T22:01:09.662676] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T22:01:09.666544] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-25T22:01:10.568484] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T22:01:10.572428] [INFO ] [REMOTE ] GPMT: Full fetch complete (36162 records). [2025-10-25T22:01:10.572538] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-25T22:01:10.938796] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-25T22:01:10.938926] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-25T22:01:10.939575] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-25T22:01:10.939672] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-25T22:01:10.940637] [DEBUG] [LOCAL ] GPMT: Trimmed 36162 records to 26165 (keeping 200 days of data) [2025-10-25T22:01:11.088596] [DEBUG] [LOCAL ] GPMT: Primary data saved (26165 records). [2025-10-25T22:01:11.088800] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-25T22:01:11.088948] [INFO ] [MAIN ] Update Progress: 962/2366 symbols. GPMT took 12.6s. Estimated remaining time: 4h 27m 38s [2025-10-25T22:01:11.256286] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:01:11.256500] [DEBUG] [LOCAL ] GPN: No existing data file found in primary storage. [2025-10-25T22:01:11.256588] [WARN ] [MAIN ] GPN: No existing data found, performing full refresh instead. [2025-10-25T22:01:11.256754] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-25T22:01:11.256844] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-25T22:01:11.256950] [DEBUG] [LOCAL ] GPN: No primary data file found to delete. [2025-10-25T22:01:11.257039] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-25T22:01:11.607049] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:01:11.607469] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-25T22:01:13.295193] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T22:01:13.305297] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-25T22:01:14.844097] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:01:14.854628] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-25T22:01:16.693023] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-25T22:01:16.703949] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-25T22:01:18.460475] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-25T22:01:18.471745] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-25T22:01:20.369801] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-25T22:01:20.380886] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-25T22:01:21.992600] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T22:01:22.003062] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-25T22:01:24.129445] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-25T22:01:24.140502] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-25T22:01:25.884741] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T22:01:25.896446] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-25T22:01:27.602606] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T22:01:27.613822] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-25T22:01:28.332108] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T22:01:28.344250] [INFO ] [REMOTE ] GPN: Full fetch complete (74992 records). [2025-10-25T22:01:28.344458] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-25T22:01:28.755894] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-25T22:01:28.756031] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-25T22:01:28.757146] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-25T22:01:28.757239] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-25T22:01:28.758877] [DEBUG] [LOCAL ] GPN: Trimmed 74992 records to 52523 (keeping 200 days of data) [2025-10-25T22:01:29.088496] [DEBUG] [LOCAL ] GPN: Primary data saved (52523 records). [2025-10-25T22:01:29.088728] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-25T22:01:29.088886] [INFO ] [MAIN ] Update Progress: 963/2366 symbols. GPN took 18.0s. Estimated remaining time: 4h 27m 37s [2025-10-25T22:01:29.271039] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:01:29.271257] [DEBUG] [LOCAL ] GPOR: No existing data file found in primary storage. [2025-10-25T22:01:29.271330] [WARN ] [MAIN ] GPOR: No existing data found, performing full refresh instead. [2025-10-25T22:01:29.271417] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-25T22:01:29.271486] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-25T22:01:29.271547] [DEBUG] [LOCAL ] GPOR: No primary data file found to delete. [2025-10-25T22:01:29.271610] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-25T22:01:29.623947] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:01:29.624306] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-25T22:01:31.008359] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-25T22:01:31.014322] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-25T22:01:32.241075] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T22:01:32.246197] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-25T22:01:33.420256] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-25T22:01:33.426218] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-25T22:01:34.534016] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T22:01:34.539077] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-25T22:01:35.618248] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T22:01:35.625600] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-25T22:01:36.673677] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T22:01:36.678762] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-25T22:01:37.919624] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T22:01:37.925120] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-25T22:01:39.012166] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T22:01:39.017508] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-25T22:01:40.269933] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T22:01:40.276132] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-25T22:01:41.519549] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T22:01:41.525053] [INFO ] [REMOTE ] GPOR: Full fetch complete (34857 records). [2025-10-25T22:01:41.525204] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-25T22:01:41.914524] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-25T22:01:41.914679] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-25T22:01:41.915334] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-25T22:01:41.915410] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-25T22:01:41.916395] [DEBUG] [LOCAL ] GPOR: Trimmed 34857 records to 23736 (keeping 200 days of data) [2025-10-25T22:01:42.054806] [DEBUG] [LOCAL ] GPOR: Primary data saved (23736 records). [2025-10-25T22:01:42.054975] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-25T22:01:42.055115] [INFO ] [MAIN ] Update Progress: 964/2366 symbols. GPOR took 13.0s. Estimated remaining time: 4h 27m 27s [2025-10-25T22:01:42.222478] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:01:42.222693] [DEBUG] [LOCAL ] GPRK: No existing data file found in primary storage. [2025-10-25T22:01:42.222752] [WARN ] [MAIN ] GPRK: No existing data found, performing full refresh instead. [2025-10-25T22:01:42.222830] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-25T22:01:42.222896] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-25T22:01:42.222954] [DEBUG] [LOCAL ] GPRK: No primary data file found to delete. [2025-10-25T22:01:42.222992] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-25T22:01:42.598913] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:01:42.599205] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-25T22:01:43.989734] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T22:01:44.004012] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-25T22:01:45.325209] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-25T22:01:45.333444] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-25T22:01:46.874304] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T22:01:46.887155] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-25T22:01:48.421114] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T22:01:48.430145] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-25T22:01:50.055087] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T22:01:50.064440] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-25T22:01:51.483678] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T22:01:51.492030] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-25T22:01:52.975425] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T22:01:52.984028] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-25T22:01:54.292221] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T22:01:54.301403] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-25T22:01:55.783449] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T22:01:55.793401] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-25T22:01:57.053406] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-25T22:01:57.061569] [INFO ] [REMOTE ] GPRK: Full fetch complete (58567 records). [2025-10-25T22:01:57.061757] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-25T22:01:57.439124] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-25T22:01:57.439242] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-25T22:01:57.440077] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-25T22:01:57.440157] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-25T22:01:57.441300] [DEBUG] [LOCAL ] GPRK: Trimmed 58567 records to 40591 (keeping 200 days of data) [2025-10-25T22:01:57.664551] [DEBUG] [LOCAL ] GPRK: Primary data saved (40591 records). [2025-10-25T22:01:57.664724] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-25T22:01:57.664873] [INFO ] [MAIN ] Update Progress: 965/2366 symbols. GPRK took 15.6s. Estimated remaining time: 4h 27m 22s [2025-10-25T22:01:57.832503] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:01:57.832719] [DEBUG] [LOCAL ] GRBK: No existing data file found in primary storage. [2025-10-25T22:01:57.832791] [WARN ] [MAIN ] GRBK: No existing data found, performing full refresh instead. [2025-10-25T22:01:57.832907] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-25T22:01:57.832976] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-25T22:01:57.833054] [DEBUG] [LOCAL ] GRBK: No primary data file found to delete. [2025-10-25T22:01:57.833123] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-25T22:01:58.192325] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:01:58.192719] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-25T22:01:59.428952] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T22:01:59.435138] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-25T22:02:00.884524] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T22:02:00.890989] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-25T22:02:02.410774] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T22:02:02.417249] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-25T22:02:04.239734] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T22:02:04.246242] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-25T22:02:05.619967] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T22:02:05.626093] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-25T22:02:06.749245] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T22:02:06.754917] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-25T22:02:07.801982] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T22:02:07.808388] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-25T22:02:08.966401] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-25T22:02:08.975451] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-25T22:02:10.111020] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T22:02:10.116843] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-25T22:02:11.408411] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T22:02:11.413456] [INFO ] [REMOTE ] GRBK: Full fetch complete (39816 records). [2025-10-25T22:02:11.413669] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-25T22:02:11.788757] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-25T22:02:11.788948] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-25T22:02:11.789724] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-25T22:02:11.789804] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-25T22:02:11.790858] [DEBUG] [LOCAL ] GRBK: Trimmed 39816 records to 26936 (keeping 200 days of data) [2025-10-25T22:02:11.946613] [DEBUG] [LOCAL ] GRBK: Primary data saved (26936 records). [2025-10-25T22:02:11.946807] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-25T22:02:11.946930] [INFO ] [MAIN ] Update Progress: 966/2366 symbols. GRBK took 14.3s. Estimated remaining time: 4h 27m 15s [2025-10-25T22:02:12.111387] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:02:12.111628] [DEBUG] [LOCAL ] GRC: No existing data file found in primary storage. [2025-10-25T22:02:12.111720] [WARN ] [MAIN ] GRC: No existing data found, performing full refresh instead. [2025-10-25T22:02:12.111842] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-25T22:02:12.111913] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-25T22:02:12.111992] [DEBUG] [LOCAL ] GRC: No primary data file found to delete. [2025-10-25T22:02:12.112061] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-25T22:02:12.469469] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:02:12.469861] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-25T22:02:13.256166] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-25T22:02:13.258776] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-25T22:02:13.977421] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T22:02:13.979878] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-25T22:02:14.789374] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T22:02:14.792060] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-25T22:02:15.712996] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T22:02:15.715908] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-25T22:02:16.564614] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-25T22:02:16.567064] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-25T22:02:17.284097] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T22:02:17.286329] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-25T22:02:18.066123] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T22:02:18.068847] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-25T22:02:18.798857] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T22:02:18.803026] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-25T22:02:19.543795] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-25T22:02:19.546594] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-25T22:02:20.601578] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T22:02:20.604442] [INFO ] [REMOTE ] GRC: Full fetch complete (13539 records). [2025-10-25T22:02:20.604546] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-25T22:02:20.971141] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-25T22:02:20.971260] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-25T22:02:20.971683] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-25T22:02:20.971763] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-25T22:02:20.972338] [DEBUG] [LOCAL ] GRC: Trimmed 13539 records to 9494 (keeping 200 days of data) [2025-10-25T22:02:21.031184] [DEBUG] [LOCAL ] GRC: Primary data saved (9494 records). [2025-10-25T22:02:21.031390] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-25T22:02:21.031530] [INFO ] [MAIN ] Update Progress: 967/2366 symbols. GRC took 9.1s. Estimated remaining time: 4h 26m 60s [2025-10-25T22:02:21.204755] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:02:21.204974] [DEBUG] [LOCAL ] GRDN: No existing data file found in primary storage. [2025-10-25T22:02:21.205055] [WARN ] [MAIN ] GRDN: No existing data found, performing full refresh instead. [2025-10-25T22:02:21.205186] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-25T22:02:21.205258] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-25T22:02:21.205317] [DEBUG] [LOCAL ] GRDN: No primary data file found to delete. [2025-10-25T22:02:21.205382] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-25T22:02:21.571096] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:02:21.571436] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-25T22:02:22.333323] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-25T22:02:22.336165] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-25T22:02:23.134826] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-25T22:02:23.137247] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-25T22:02:24.034203] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T22:02:24.037921] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-25T22:02:24.998065] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T22:02:25.001779] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-25T22:02:25.825289] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T22:02:25.830061] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-25T22:02:26.935481] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T22:02:26.940520] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-25T22:02:28.014073] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T22:02:28.018369] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-25T22:02:29.028092] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T22:02:29.033276] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-25T22:02:30.315423] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T22:02:30.322133] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-25T22:02:31.470751] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T22:02:31.475605] [INFO ] [REMOTE ] GRDN: Full fetch complete (26801 records). [2025-10-25T22:02:31.475729] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-25T22:02:31.853261] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-25T22:02:31.853375] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-25T22:02:31.854013] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-25T22:02:31.854092] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-25T22:02:31.854873] [DEBUG] [LOCAL ] GRDN: Trimmed 26801 records to 21735 (keeping 200 days of data) [2025-10-25T22:02:31.981219] [DEBUG] [LOCAL ] GRDN: Primary data saved (21735 records). [2025-10-25T22:02:31.981684] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-25T22:02:31.981840] [INFO ] [MAIN ] Update Progress: 968/2366 symbols. GRDN took 11.0s. Estimated remaining time: 4h 26m 48s [2025-10-25T22:02:32.151600] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:02:32.151810] [DEBUG] [LOCAL ] GRMN: No existing data file found in primary storage. [2025-10-25T22:02:32.151882] [WARN ] [MAIN ] GRMN: No existing data found, performing full refresh instead. [2025-10-25T22:02:32.151996] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-25T22:02:32.152068] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-25T22:02:32.152148] [DEBUG] [LOCAL ] GRMN: No primary data file found to delete. [2025-10-25T22:02:32.152252] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-25T22:02:32.517552] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:02:32.517933] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-25T22:02:33.943669] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T22:02:33.951911] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-25T22:02:35.480521] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T22:02:35.488947] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-25T22:02:37.222254] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T22:02:37.231634] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-25T22:02:38.705176] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T22:02:38.715134] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-25T22:02:39.987592] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T22:02:39.996182] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-25T22:02:41.458554] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T22:02:41.467051] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-25T22:02:43.197251] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T22:02:43.206897] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-25T22:02:44.603727] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T22:02:44.612596] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-25T22:02:46.182484] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T22:02:46.191112] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-25T22:02:46.848788] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-25T22:02:46.855626] [INFO ] [REMOTE ] GRMN: Full fetch complete (59387 records). [2025-10-25T22:02:46.855835] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-25T22:02:47.245344] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-25T22:02:47.245463] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-25T22:02:47.246367] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-25T22:02:47.246450] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-25T22:02:47.247611] [DEBUG] [LOCAL ] GRMN: Trimmed 59387 records to 40287 (keeping 200 days of data) [2025-10-25T22:02:47.488511] [DEBUG] [LOCAL ] GRMN: Primary data saved (40287 records). [2025-10-25T22:02:47.488728] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-25T22:02:47.488864] [INFO ] [MAIN ] Update Progress: 969/2366 symbols. GRMN took 15.5s. Estimated remaining time: 4h 26m 42s [2025-10-25T22:02:47.654166] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:02:47.654346] [DEBUG] [LOCAL ] GRND: No existing data file found in primary storage. [2025-10-25T22:02:47.654416] [WARN ] [MAIN ] GRND: No existing data found, performing full refresh instead. [2025-10-25T22:02:47.654527] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-25T22:02:47.654603] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-25T22:02:47.654706] [DEBUG] [LOCAL ] GRND: No primary data file found to delete. [2025-10-25T22:02:47.654774] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-25T22:02:48.003497] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:02:48.003900] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-25T22:02:49.600922] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T22:02:49.609979] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-25T22:02:51.215872] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T22:02:51.224571] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-25T22:02:52.873469] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T22:02:52.884994] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-25T22:02:54.639195] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T22:02:54.650899] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-25T22:02:56.222454] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T22:02:56.233954] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-25T22:02:57.822098] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T22:02:57.834312] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-25T22:02:59.570883] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T22:02:59.581609] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-25T22:03:01.536884] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-25T22:03:01.549210] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-25T22:03:03.176206] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T22:03:03.186942] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-25T22:03:04.860114] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-25T22:03:04.869445] [INFO ] [REMOTE ] GRND: Full fetch complete (71914 records). [2025-10-25T22:03:04.869599] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-25T22:03:05.259885] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-25T22:03:05.260004] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-25T22:03:05.261015] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-25T22:03:05.261104] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-25T22:03:05.262586] [DEBUG] [LOCAL ] GRND: Trimmed 71914 records to 50935 (keeping 200 days of data) [2025-10-25T22:03:05.545598] [DEBUG] [LOCAL ] GRND: Primary data saved (50935 records). [2025-10-25T22:03:05.545773] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-25T22:03:05.545921] [INFO ] [MAIN ] Update Progress: 970/2366 symbols. GRND took 18.1s. Estimated remaining time: 4h 26m 40s [2025-10-25T22:03:05.711775] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:03:05.711964] [DEBUG] [LOCAL ] GRNT: No existing data file found in primary storage. [2025-10-25T22:03:05.712034] [WARN ] [MAIN ] GRNT: No existing data found, performing full refresh instead. [2025-10-25T22:03:05.712148] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-25T22:03:05.712218] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-25T22:03:05.712303] [DEBUG] [LOCAL ] GRNT: No primary data file found to delete. [2025-10-25T22:03:05.712354] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-25T22:03:06.065561] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:03:06.065921] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-25T22:03:07.349808] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T22:03:07.356222] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-25T22:03:08.476371] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T22:03:08.482262] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-25T22:03:09.828407] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T22:03:09.835824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-25T22:03:10.980548] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T22:03:10.988816] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-25T22:03:12.180422] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T22:03:12.187184] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-25T22:03:13.573601] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T22:03:13.581618] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-25T22:03:14.932089] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T22:03:14.939528] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-25T22:03:16.287811] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T22:03:16.295471] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-25T22:03:17.706363] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T22:03:17.714022] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-25T22:03:18.959630] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T22:03:18.966113] [INFO ] [REMOTE ] GRNT: Full fetch complete (48380 records). [2025-10-25T22:03:18.966292] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-25T22:03:19.367049] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-25T22:03:19.367157] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-25T22:03:19.367924] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-25T22:03:19.368002] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-25T22:03:19.369021] [DEBUG] [LOCAL ] GRNT: Trimmed 48380 records to 34437 (keeping 200 days of data) [2025-10-25T22:03:19.559350] [DEBUG] [LOCAL ] GRNT: Primary data saved (34437 records). [2025-10-25T22:03:19.559513] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-25T22:03:19.559681] [INFO ] [MAIN ] Update Progress: 971/2366 symbols. GRNT took 14.0s. Estimated remaining time: 4h 26m 32s [2025-10-25T22:03:19.739034] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:03:19.739241] [DEBUG] [LOCAL ] GROV: No existing data file found in primary storage. [2025-10-25T22:03:19.739315] [WARN ] [MAIN ] GROV: No existing data found, performing full refresh instead. [2025-10-25T22:03:19.739426] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-25T22:03:19.739500] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-25T22:03:19.739580] [DEBUG] [LOCAL ] GROV: No primary data file found to delete. [2025-10-25T22:03:19.739673] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-25T22:03:20.109187] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:03:20.109532] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-25T22:03:20.927267] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T22:03:20.930488] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-25T22:03:21.743788] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-25T22:03:21.746368] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-25T22:03:22.519459] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T22:03:22.522207] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-25T22:03:23.240109] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-25T22:03:23.242446] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-25T22:03:23.999871] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T22:03:24.003684] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-25T22:03:24.716369] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-25T22:03:24.720141] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-25T22:03:25.752638] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T22:03:25.756199] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-25T22:03:26.546565] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T22:03:26.549463] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-25T22:03:27.160684] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T22:03:27.162521] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-25T22:03:27.942981] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T22:03:27.944859] [INFO ] [REMOTE ] GROV: Full fetch complete (13547 records). [2025-10-25T22:03:27.944952] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-25T22:03:28.334016] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-25T22:03:28.334134] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-25T22:03:28.334493] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-25T22:03:28.334569] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-25T22:03:28.335174] [DEBUG] [LOCAL ] GROV: Trimmed 13547 records to 8708 (keeping 200 days of data) [2025-10-25T22:03:28.387617] [DEBUG] [LOCAL ] GROV: Primary data saved (8708 records). [2025-10-25T22:03:28.387817] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-25T22:03:28.388002] [INFO ] [MAIN ] Update Progress: 972/2366 symbols. GROV took 8.8s. Estimated remaining time: 4h 26m 17s [2025-10-25T22:03:28.598659] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:03:28.598912] [DEBUG] [LOCAL ] GRX: No existing data file found in primary storage. [2025-10-25T22:03:28.599013] [WARN ] [MAIN ] GRX: No existing data found, performing full refresh instead. [2025-10-25T22:03:28.599185] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-25T22:03:28.599265] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-25T22:03:28.599360] [DEBUG] [LOCAL ] GRX: No primary data file found to delete. [2025-10-25T22:03:28.599433] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-25T22:03:29.001139] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:03:29.001516] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-25T22:03:29.617239] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T22:03:29.619213] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-25T22:03:29.941357] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-25T22:03:29.942759] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-25T22:03:30.391602] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-25T22:03:30.393074] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-25T22:03:31.033956] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-25T22:03:31.035547] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-25T22:03:31.620066] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-25T22:03:31.621597] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-25T22:03:32.167217] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T22:03:32.168703] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-25T22:03:32.614073] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-25T22:03:32.615809] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-25T22:03:33.133790] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-25T22:03:33.135565] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-25T22:03:33.850507] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T22:03:33.852859] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-25T22:03:34.533470] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-25T22:03:34.534966] [INFO ] [REMOTE ] GRX: Full fetch complete (6561 records). [2025-10-25T22:03:34.535054] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-25T22:03:34.903369] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-25T22:03:34.903480] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-25T22:03:34.903711] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-25T22:03:34.903808] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-25T22:03:34.904275] [DEBUG] [LOCAL ] GRX: Trimmed 6561 records to 4905 (keeping 200 days of data) [2025-10-25T22:03:34.933633] [DEBUG] [LOCAL ] GRX: Primary data saved (4905 records). [2025-10-25T22:03:34.933783] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-25T22:03:34.933926] [INFO ] [MAIN ] Update Progress: 973/2366 symbols. GRX took 6.5s. Estimated remaining time: 4h 25m 58s [2025-10-25T22:03:35.105868] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:03:35.106074] [DEBUG] [LOCAL ] GS: No existing data file found in primary storage. [2025-10-25T22:03:35.106146] [WARN ] [MAIN ] GS: No existing data found, performing full refresh instead. [2025-10-25T22:03:35.106259] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-25T22:03:35.106330] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-25T22:03:35.106410] [DEBUG] [LOCAL ] GS: No primary data file found to delete. [2025-10-25T22:03:35.106481] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-25T22:03:35.461962] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:03:35.462311] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-25T22:03:38.027764] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-25T22:03:38.038071] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-25T22:03:39.932236] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-25T22:03:39.943823] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-25T22:03:41.937106] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T22:03:41.948440] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-25T22:03:44.292185] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-25T22:03:44.303884] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-25T22:03:46.603082] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-25T22:03:46.614504] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-25T22:03:48.569161] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-25T22:03:48.579522] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-25T22:03:50.619216] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-25T22:03:50.631100] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-25T22:03:52.481111] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-25T22:03:52.491502] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-25T22:03:54.569688] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-25T22:03:54.580755] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-25T22:03:55.355998] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T22:03:55.365439] [INFO ] [REMOTE ] GS: Full fetch complete (75838 records). [2025-10-25T22:03:55.365586] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-25T22:03:55.758785] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-25T22:03:55.758923] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-25T22:03:55.759953] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-25T22:03:55.760037] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-25T22:03:55.761554] [DEBUG] [LOCAL ] GS: Trimmed 75838 records to 52539 (keeping 200 days of data) [2025-10-25T22:03:56.101398] [DEBUG] [LOCAL ] GS: Primary data saved (52539 records). [2025-10-25T22:03:56.101568] [INFO ] [MAIN ] GS: Full history saved. [2025-10-25T22:03:56.101731] [INFO ] [MAIN ] Update Progress: 974/2366 symbols. GS took 21.2s. Estimated remaining time: 4h 26m 1s [2025-10-25T22:03:56.267663] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:03:56.267868] [DEBUG] [LOCAL ] GSBD: No existing data file found in primary storage. [2025-10-25T22:03:56.267940] [WARN ] [MAIN ] GSBD: No existing data found, performing full refresh instead. [2025-10-25T22:03:56.268033] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-25T22:03:56.268101] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-25T22:03:56.268165] [DEBUG] [LOCAL ] GSBD: No primary data file found to delete. [2025-10-25T22:03:56.268206] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-25T22:03:56.623596] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:03:56.623991] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-25T22:03:58.045879] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T22:03:58.054541] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-25T22:03:59.445142] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T22:03:59.452844] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-25T22:04:01.265184] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T22:04:01.274006] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-25T22:04:03.231372] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-25T22:04:03.240792] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-25T22:04:04.724366] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T22:04:04.732788] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-25T22:04:06.163581] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T22:04:06.171742] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-25T22:04:07.355140] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T22:04:07.363939] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-25T22:04:08.785992] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T22:04:08.793905] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-25T22:04:10.313685] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T22:04:10.322555] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-25T22:04:11.651191] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T22:04:11.661076] [INFO ] [REMOTE ] GSBD: Full fetch complete (58439 records). [2025-10-25T22:04:11.661305] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-25T22:04:12.067304] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-25T22:04:12.067455] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-25T22:04:12.068740] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-25T22:04:12.068840] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-25T22:04:12.070342] [DEBUG] [LOCAL ] GSBD: Trimmed 58439 records to 40094 (keeping 200 days of data) [2025-10-25T22:04:12.311291] [DEBUG] [LOCAL ] GSBD: Primary data saved (40094 records). [2025-10-25T22:04:12.311453] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-25T22:04:12.311636] [INFO ] [MAIN ] Update Progress: 975/2366 symbols. GSBD took 16.2s. Estimated remaining time: 4h 25m 56s [2025-10-25T22:04:12.483459] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:04:12.483693] [DEBUG] [LOCAL ] GSK: No existing data file found in primary storage. [2025-10-25T22:04:12.483787] [WARN ] [MAIN ] GSK: No existing data found, performing full refresh instead. [2025-10-25T22:04:12.483935] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-25T22:04:12.484017] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-25T22:04:12.484120] [DEBUG] [LOCAL ] GSK: No primary data file found to delete. [2025-10-25T22:04:12.484203] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-25T22:04:12.869842] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:04:12.870230] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-25T22:04:14.645632] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T22:04:14.656439] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-25T22:04:16.370954] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T22:04:16.381108] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-25T22:04:18.232848] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T22:04:18.245374] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-25T22:04:20.026113] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T22:04:20.041373] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-25T22:04:22.026768] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T22:04:22.039002] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-25T22:04:23.818127] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-25T22:04:23.830282] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-25T22:04:25.308905] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T22:04:25.320825] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-25T22:04:26.728993] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T22:04:26.740759] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-25T22:04:28.590351] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-25T22:04:28.601951] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-25T22:04:30.544783] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-25T22:04:30.555300] [INFO ] [REMOTE ] GSK: Full fetch complete (77635 records). [2025-10-25T22:04:30.555466] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-25T22:04:30.957889] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-25T22:04:30.958030] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-25T22:04:30.959108] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-25T22:04:30.959194] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-25T22:04:30.960768] [DEBUG] [LOCAL ] GSK: Trimmed 77635 records to 54290 (keeping 200 days of data) [2025-10-25T22:04:31.279206] [DEBUG] [LOCAL ] GSK: Primary data saved (54290 records). [2025-10-25T22:04:31.279392] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-25T22:04:31.279537] [INFO ] [MAIN ] Update Progress: 976/2366 symbols. GSK took 19.0s. Estimated remaining time: 4h 25m 55s [2025-10-25T22:04:31.455037] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:04:31.455264] [DEBUG] [LOCAL ] GSL: No existing data file found in primary storage. [2025-10-25T22:04:31.455339] [WARN ] [MAIN ] GSL: No existing data found, performing full refresh instead. [2025-10-25T22:04:31.455473] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-25T22:04:31.455547] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-25T22:04:31.455630] [DEBUG] [LOCAL ] GSL: No primary data file found to delete. [2025-10-25T22:04:31.455723] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-25T22:04:31.809372] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:04:31.809742] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-25T22:04:32.839259] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T22:04:32.849556] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-25T22:04:34.137635] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T22:04:34.144369] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-25T22:04:35.599836] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T22:04:35.607848] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-25T22:04:36.851248] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T22:04:36.859223] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-25T22:04:38.195967] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T22:04:38.203497] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-25T22:04:39.449227] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T22:04:39.456632] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-25T22:04:40.832206] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T22:04:40.839949] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-25T22:04:42.219139] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T22:04:42.227073] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-25T22:04:43.525939] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T22:04:43.533376] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-25T22:04:44.746328] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T22:04:44.752545] [INFO ] [REMOTE ] GSL: Full fetch complete (48211 records). [2025-10-25T22:04:44.752724] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-25T22:04:45.147527] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-25T22:04:45.147682] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-25T22:04:45.148549] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-25T22:04:45.148635] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-25T22:04:45.149778] [DEBUG] [LOCAL ] GSL: Trimmed 48211 records to 33315 (keeping 200 days of data) [2025-10-25T22:04:45.346267] [DEBUG] [LOCAL ] GSL: Primary data saved (33315 records). [2025-10-25T22:04:45.346434] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-25T22:04:45.346576] [INFO ] [MAIN ] Update Progress: 977/2366 symbols. GSL took 14.1s. Estimated remaining time: 4h 25m 48s [2025-10-25T22:04:45.521533] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:04:45.521761] [DEBUG] [LOCAL ] GTES: No existing data file found in primary storage. [2025-10-25T22:04:45.521835] [WARN ] [MAIN ] GTES: No existing data found, performing full refresh instead. [2025-10-25T22:04:45.521958] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-25T22:04:45.522030] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-25T22:04:45.522111] [DEBUG] [LOCAL ] GTES: No primary data file found to delete. [2025-10-25T22:04:45.522183] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-25T22:04:45.876543] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:04:45.876960] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-25T22:04:47.409854] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T22:04:47.420992] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-25T22:04:49.052519] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T22:04:49.063178] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-25T22:04:50.585019] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T22:04:50.596497] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-25T22:04:52.164342] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T22:04:52.176038] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-25T22:04:53.817075] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T22:04:53.827986] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-25T22:04:55.326860] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T22:04:55.336774] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-25T22:04:56.813031] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T22:04:56.825449] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-25T22:04:58.270973] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T22:04:58.283417] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-25T22:04:59.958626] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-25T22:04:59.969697] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-25T22:05:01.645872] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T22:05:01.656127] [INFO ] [REMOTE ] GTES: Full fetch complete (73849 records). [2025-10-25T22:05:01.656344] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-25T22:05:02.063758] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-25T22:05:02.063907] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-25T22:05:02.064982] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-25T22:05:02.065084] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-25T22:05:02.066627] [DEBUG] [LOCAL ] GTES: Trimmed 73849 records to 51018 (keeping 200 days of data) [2025-10-25T22:05:02.387220] [DEBUG] [LOCAL ] GTES: Primary data saved (51018 records). [2025-10-25T22:05:02.387463] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-25T22:05:02.387665] [INFO ] [MAIN ] Update Progress: 978/2366 symbols. GTES took 17.0s. Estimated remaining time: 4h 25m 44s [2025-10-25T22:05:02.593620] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:05:02.593945] [DEBUG] [LOCAL ] GTLS: No existing data file found in primary storage. [2025-10-25T22:05:02.594030] [WARN ] [MAIN ] GTLS: No existing data found, performing full refresh instead. [2025-10-25T22:05:02.594175] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-25T22:05:02.594252] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-25T22:05:02.594344] [DEBUG] [LOCAL ] GTLS: No primary data file found to delete. [2025-10-25T22:05:02.594426] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-25T22:05:02.993048] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:05:02.993572] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-25T22:05:04.645038] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T22:05:04.653378] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-25T22:05:06.198358] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:05:06.206062] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-25T22:05:07.259813] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-25T22:05:07.268413] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-25T22:05:08.938427] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T22:05:08.947427] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-25T22:05:10.077215] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T22:05:10.085389] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-25T22:05:11.704095] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T22:05:11.713974] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-25T22:05:13.200074] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T22:05:13.210135] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-25T22:05:14.734376] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T22:05:14.745414] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-25T22:05:16.459176] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T22:05:16.468775] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-25T22:05:17.968351] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T22:05:17.976109] [INFO ] [REMOTE ] GTLS: Full fetch complete (61484 records). [2025-10-25T22:05:17.976257] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-25T22:05:18.359898] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-25T22:05:18.360011] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-25T22:05:18.360910] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-25T22:05:18.360989] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-25T22:05:18.362193] [DEBUG] [LOCAL ] GTLS: Trimmed 61484 records to 43732 (keeping 200 days of data) [2025-10-25T22:05:18.614865] [DEBUG] [LOCAL ] GTLS: Primary data saved (43732 records). [2025-10-25T22:05:18.615048] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-25T22:05:18.615207] [INFO ] [MAIN ] Update Progress: 979/2366 symbols. GTLS took 16.2s. Estimated remaining time: 4h 25m 39s [2025-10-25T22:05:18.782531] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:05:18.782753] [DEBUG] [LOCAL ] GTN: No existing data file found in primary storage. [2025-10-25T22:05:18.782843] [WARN ] [MAIN ] GTN: No existing data found, performing full refresh instead. [2025-10-25T22:05:18.782982] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-25T22:05:18.783071] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-25T22:05:18.783175] [DEBUG] [LOCAL ] GTN: No primary data file found to delete. [2025-10-25T22:05:18.783263] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-25T22:05:19.130132] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:05:19.130495] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-25T22:05:20.641467] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T22:05:20.650595] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-25T22:05:22.269893] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T22:05:22.283415] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-25T22:05:23.984479] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T22:05:23.995345] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-25T22:05:25.549247] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T22:05:25.559195] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-25T22:05:27.127550] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T22:05:27.137534] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-25T22:05:28.619800] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T22:05:28.631361] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-25T22:05:30.428199] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T22:05:30.438258] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-25T22:05:32.037210] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T22:05:32.047069] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-25T22:05:33.448883] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T22:05:33.464397] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-25T22:05:35.052444] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-25T22:05:35.060351] [INFO ] [REMOTE ] GTN: Full fetch complete (65624 records). [2025-10-25T22:05:35.060537] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-25T22:05:35.479325] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-25T22:05:35.479512] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-25T22:05:35.480450] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-25T22:05:35.480532] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-25T22:05:35.481829] [DEBUG] [LOCAL ] GTN: Trimmed 65624 records to 45322 (keeping 200 days of data) [2025-10-25T22:05:35.753558] [DEBUG] [LOCAL ] GTN: Primary data saved (45322 records). [2025-10-25T22:05:35.753732] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-25T22:05:35.753875] [INFO ] [MAIN ] Update Progress: 980/2366 symbols. GTN took 17.1s. Estimated remaining time: 4h 25m 36s [2025-10-25T22:05:35.925809] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:05:35.925993] [DEBUG] [LOCAL ] GTY: No existing data file found in primary storage. [2025-10-25T22:05:35.926065] [WARN ] [MAIN ] GTY: No existing data found, performing full refresh instead. [2025-10-25T22:05:35.926201] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-25T22:05:35.926275] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-25T22:05:35.926357] [DEBUG] [LOCAL ] GTY: No primary data file found to delete. [2025-10-25T22:05:35.926425] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-25T22:05:36.295946] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:05:36.296297] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-25T22:05:37.470438] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T22:05:37.476691] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-25T22:05:38.613271] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T22:05:38.618989] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-25T22:05:39.906384] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T22:05:39.913185] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-25T22:05:41.398371] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T22:05:41.406088] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-25T22:05:42.750882] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T22:05:42.757498] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-25T22:05:43.917017] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T22:05:43.923392] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-25T22:05:45.143757] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T22:05:45.151401] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-25T22:05:46.395495] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T22:05:46.401819] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-25T22:05:47.732509] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T22:05:47.739176] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-25T22:05:49.032257] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T22:05:49.039378] [INFO ] [REMOTE ] GTY: Full fetch complete (43890 records). [2025-10-25T22:05:49.039596] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-25T22:05:49.417503] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-25T22:05:49.417635] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-25T22:05:49.418493] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-25T22:05:49.418574] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-25T22:05:49.419487] [DEBUG] [LOCAL ] GTY: Trimmed 43890 records to 30496 (keeping 200 days of data) [2025-10-25T22:05:49.597554] [DEBUG] [LOCAL ] GTY: Primary data saved (30496 records). [2025-10-25T22:05:49.597774] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-25T22:05:49.597986] [INFO ] [MAIN ] Update Progress: 981/2366 symbols. GTY took 13.8s. Estimated remaining time: 4h 25m 28s [2025-10-25T22:05:49.766527] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:05:49.766751] [DEBUG] [LOCAL ] GUG: No existing data file found in primary storage. [2025-10-25T22:05:49.766848] [WARN ] [MAIN ] GUG: No existing data found, performing full refresh instead. [2025-10-25T22:05:49.766992] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-25T22:05:49.767082] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-25T22:05:49.767182] [DEBUG] [LOCAL ] GUG: No primary data file found to delete. [2025-10-25T22:05:49.767266] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-25T22:05:50.124101] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:05:50.124456] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-25T22:05:51.266278] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T22:05:51.271269] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-25T22:05:52.065352] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T22:05:52.068501] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-25T22:05:52.656089] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-25T22:05:52.659294] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-25T22:05:53.513973] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T22:05:53.517970] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-25T22:05:54.343020] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T22:05:54.345631] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-25T22:05:55.228072] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T22:05:55.231563] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-25T22:05:56.101730] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T22:05:56.105538] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-25T22:05:56.750672] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-25T22:05:56.753825] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-25T22:05:57.515277] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T22:05:57.518754] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-25T22:05:58.281925] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T22:05:58.284469] [INFO ] [REMOTE ] GUG: Full fetch complete (18717 records). [2025-10-25T22:05:58.284590] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-25T22:05:58.655616] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-25T22:05:58.655779] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-25T22:05:58.656249] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-25T22:05:58.656337] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-25T22:05:58.657056] [DEBUG] [LOCAL ] GUG: Trimmed 18717 records to 12261 (keeping 200 days of data) [2025-10-25T22:05:58.729911] [DEBUG] [LOCAL ] GUG: Primary data saved (12261 records). [2025-10-25T22:05:58.730093] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-25T22:05:58.730250] [INFO ] [MAIN ] Update Progress: 982/2366 symbols. GUG took 9.1s. Estimated remaining time: 4h 25m 13s [2025-10-25T22:05:58.900601] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:05:58.901579] [DEBUG] [LOCAL ] GUT: No existing data file found in primary storage. [2025-10-25T22:05:58.901691] [WARN ] [MAIN ] GUT: No existing data found, performing full refresh instead. [2025-10-25T22:05:58.902003] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-25T22:05:58.902094] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-25T22:05:58.902198] [DEBUG] [LOCAL ] GUT: No primary data file found to delete. [2025-10-25T22:05:58.902287] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-25T22:05:59.250912] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:05:59.251304] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-25T22:05:59.997031] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T22:06:00.001200] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-25T22:06:00.960384] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T22:06:00.963800] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-25T22:06:02.306375] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T22:06:02.310275] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-25T22:06:03.290911] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T22:06:03.295032] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-25T22:06:04.257297] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T22:06:04.260874] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-25T22:06:05.158022] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T22:06:05.162051] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-25T22:06:06.262053] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T22:06:06.266786] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-25T22:06:07.292212] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T22:06:07.296181] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-25T22:06:07.996032] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T22:06:07.999925] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-25T22:06:08.750683] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T22:06:08.754690] [INFO ] [REMOTE ] GUT: Full fetch complete (22538 records). [2025-10-25T22:06:08.754813] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-25T22:06:09.119348] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-25T22:06:09.119466] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-25T22:06:09.120027] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-25T22:06:09.120108] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-25T22:06:09.120776] [DEBUG] [LOCAL ] GUT: Trimmed 22538 records to 15855 (keeping 200 days of data) [2025-10-25T22:06:09.209878] [DEBUG] [LOCAL ] GUT: Primary data saved (15855 records). [2025-10-25T22:06:09.210042] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-25T22:06:09.210184] [INFO ] [MAIN ] Update Progress: 983/2366 symbols. GUT took 10.5s. Estimated remaining time: 4h 24m 60s [2025-10-25T22:06:09.379079] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:06:09.379266] [DEBUG] [LOCAL ] GVA: No existing data file found in primary storage. [2025-10-25T22:06:09.379336] [WARN ] [MAIN ] GVA: No existing data found, performing full refresh instead. [2025-10-25T22:06:09.379446] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-25T22:06:09.379516] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-25T22:06:09.379597] [DEBUG] [LOCAL ] GVA: No primary data file found to delete. [2025-10-25T22:06:09.379712] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-25T22:06:09.785940] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:06:09.786296] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-25T22:06:10.755773] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T22:06:10.762488] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-25T22:06:12.148558] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T22:06:12.155339] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-25T22:06:13.715322] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T22:06:13.724733] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-25T22:06:15.269581] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T22:06:15.278520] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-25T22:06:16.741568] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T22:06:16.749321] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-25T22:06:18.070424] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T22:06:18.077522] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-25T22:06:19.577468] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T22:06:19.585491] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-25T22:06:21.145432] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T22:06:21.153594] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-25T22:06:22.451269] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T22:06:22.458611] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-25T22:06:23.772575] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-25T22:06:23.779791] [INFO ] [REMOTE ] GVA: Full fetch complete (48465 records). [2025-10-25T22:06:23.780013] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-25T22:06:24.165970] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-25T22:06:24.166085] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-25T22:06:24.166827] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-25T22:06:24.166905] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-25T22:06:24.167937] [DEBUG] [LOCAL ] GVA: Trimmed 48465 records to 33038 (keeping 200 days of data) [2025-10-25T22:06:24.366443] [DEBUG] [LOCAL ] GVA: Primary data saved (33038 records). [2025-10-25T22:06:24.366624] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-25T22:06:24.366799] [INFO ] [MAIN ] Update Progress: 984/2366 symbols. GVA took 15.2s. Estimated remaining time: 4h 24m 53s [2025-10-25T22:06:24.556264] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:06:24.556486] [DEBUG] [LOCAL ] GWH: No existing data file found in primary storage. [2025-10-25T22:06:24.556558] [WARN ] [MAIN ] GWH: No existing data found, performing full refresh instead. [2025-10-25T22:06:24.556699] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-25T22:06:24.556773] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-25T22:06:24.556834] [DEBUG] [LOCAL ] GWH: No primary data file found to delete. [2025-10-25T22:06:24.556898] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-25T22:06:24.907226] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:06:24.907581] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-25T22:06:25.680714] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-25T22:06:25.683575] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-25T22:06:26.492633] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-25T22:06:26.495855] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-25T22:06:27.232305] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-25T22:06:27.234772] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-25T22:06:27.996042] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T22:06:27.999087] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-25T22:06:29.078628] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T22:06:29.083492] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-25T22:06:30.148028] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T22:06:30.154594] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-25T22:06:31.278574] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T22:06:31.284774] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-25T22:06:32.297130] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-25T22:06:32.301146] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-25T22:06:33.366934] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T22:06:33.371885] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-25T22:06:35.469249] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-25T22:06:35.477126] [INFO ] [REMOTE ] GWH: Full fetch complete (25097 records). [2025-10-25T22:06:35.477258] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-25T22:06:35.839201] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-25T22:06:35.839337] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-25T22:06:35.839954] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-25T22:06:35.840037] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-25T22:06:35.840922] [DEBUG] [LOCAL ] GWH: Trimmed 25097 records to 20766 (keeping 200 days of data) [2025-10-25T22:06:35.953208] [DEBUG] [LOCAL ] GWH: Primary data saved (20766 records). [2025-10-25T22:06:35.953367] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-25T22:06:35.953484] [INFO ] [MAIN ] Update Progress: 985/2366 symbols. GWH took 11.6s. Estimated remaining time: 4h 24m 42s [2025-10-25T22:06:36.129034] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:06:36.129240] [DEBUG] [LOCAL ] GWRE: No existing data file found in primary storage. [2025-10-25T22:06:36.129315] [WARN ] [MAIN ] GWRE: No existing data found, performing full refresh instead. [2025-10-25T22:06:36.129447] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-25T22:06:36.129524] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-25T22:06:36.129607] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-25T22:06:36.129702] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-25T22:06:36.478511] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:06:36.478878] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-25T22:06:38.183309] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T22:06:38.192727] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-25T22:06:39.731695] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:06:39.740289] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-25T22:06:41.313198] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T22:06:41.322920] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-25T22:06:42.817775] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T22:06:42.826933] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-25T22:06:44.046164] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-25T22:06:44.054497] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-25T22:06:45.634889] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T22:06:45.644127] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-25T22:06:46.939147] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T22:06:46.947855] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-25T22:06:48.297821] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T22:06:48.306431] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-25T22:06:49.956779] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T22:06:49.966258] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-25T22:06:51.427753] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T22:06:51.436195] [INFO ] [REMOTE ] GWRE: Full fetch complete (59884 records). [2025-10-25T22:06:51.436362] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-25T22:06:51.851385] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-25T22:06:51.851500] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-25T22:06:51.852383] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-25T22:06:51.852466] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-25T22:06:51.853721] [DEBUG] [LOCAL ] GWRE: Trimmed 59884 records to 39996 (keeping 200 days of data) [2025-10-25T22:06:52.088273] [DEBUG] [LOCAL ] GWRE: Primary data saved (39996 records). [2025-10-25T22:06:52.088447] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-25T22:06:52.088593] [INFO ] [MAIN ] Update Progress: 986/2366 symbols. GWRE took 16.1s. Estimated remaining time: 4h 24m 37s [2025-10-25T22:06:52.270556] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:06:52.270773] [DEBUG] [LOCAL ] GWW: No existing data file found in primary storage. [2025-10-25T22:06:52.270853] [WARN ] [MAIN ] GWW: No existing data found, performing full refresh instead. [2025-10-25T22:06:52.270963] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-25T22:06:52.271043] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-25T22:06:52.271125] [DEBUG] [LOCAL ] GWW: No primary data file found to delete. [2025-10-25T22:06:52.271193] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-25T22:06:52.653864] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:06:52.654248] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-25T22:06:53.876694] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T22:06:53.881371] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-25T22:06:54.894695] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T22:06:54.899035] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-25T22:06:56.088564] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T22:06:56.093856] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-25T22:06:57.307622] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T22:06:57.313482] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-25T22:06:58.192268] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T22:06:58.198569] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-25T22:06:59.165741] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T22:06:59.169801] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-25T22:07:00.296025] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T22:07:00.301872] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-25T22:07:01.225973] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T22:07:01.231630] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-25T22:07:02.571831] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T22:07:02.577090] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-25T22:07:03.171290] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T22:07:03.175576] [INFO ] [REMOTE ] GWW: Full fetch complete (29074 records). [2025-10-25T22:07:03.175741] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-25T22:07:03.569952] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-25T22:07:03.570127] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-25T22:07:03.571293] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-25T22:07:03.571374] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-25T22:07:03.572450] [DEBUG] [LOCAL ] GWW: Trimmed 29074 records to 19526 (keeping 200 days of data) [2025-10-25T22:07:03.702099] [DEBUG] [LOCAL ] GWW: Primary data saved (19526 records). [2025-10-25T22:07:03.702348] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-25T22:07:03.702527] [INFO ] [MAIN ] Update Progress: 987/2366 symbols. GWW took 11.6s. Estimated remaining time: 4h 24m 26s [2025-10-25T22:07:03.893711] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:07:03.893971] [DEBUG] [LOCAL ] GXO: No existing data file found in primary storage. [2025-10-25T22:07:03.894043] [WARN ] [MAIN ] GXO: No existing data found, performing full refresh instead. [2025-10-25T22:07:03.894167] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-25T22:07:03.894239] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-25T22:07:03.894318] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-25T22:07:03.894390] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-25T22:07:04.272283] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:07:04.272745] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-25T22:07:05.816681] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-25T22:07:05.826701] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-25T22:07:07.528453] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T22:07:07.539338] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-25T22:07:09.256986] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T22:07:09.269242] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-25T22:07:10.909944] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T22:07:10.921514] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-25T22:07:12.343540] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T22:07:12.356186] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-25T22:07:13.761352] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T22:07:13.773622] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-25T22:07:15.334133] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-25T22:07:15.343924] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-25T22:07:16.876678] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T22:07:16.886339] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-25T22:07:18.221872] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T22:07:18.232944] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-25T22:07:19.807283] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T22:07:19.815610] [INFO ] [REMOTE ] GXO: Full fetch complete (69246 records). [2025-10-25T22:07:19.815834] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-25T22:07:20.251215] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-25T22:07:20.251344] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-25T22:07:20.252339] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-25T22:07:20.252421] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-25T22:07:20.253810] [DEBUG] [LOCAL ] GXO: Trimmed 69246 records to 47037 (keeping 200 days of data) [2025-10-25T22:07:20.514173] [DEBUG] [LOCAL ] GXO: Primary data saved (47037 records). [2025-10-25T22:07:20.514349] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-25T22:07:20.514487] [INFO ] [MAIN ] Update Progress: 988/2366 symbols. GXO took 16.8s. Estimated remaining time: 4h 24m 22s [2025-10-25T22:07:20.687578] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:07:20.687836] [DEBUG] [LOCAL ] GYLD: No existing data file found in primary storage. [2025-10-25T22:07:20.687915] [WARN ] [MAIN ] GYLD: No existing data found, performing full refresh instead. [2025-10-25T22:07:20.688032] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-25T22:07:20.688105] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-25T22:07:20.688197] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-25T22:07:20.688277] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-25T22:07:21.045045] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:07:21.045364] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-25T22:07:21.362817] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-25T22:07:21.363750] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-25T22:07:21.681251] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-25T22:07:21.682290] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-25T22:07:22.123672] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-25T22:07:22.124915] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-25T22:07:22.570270] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-25T22:07:22.571414] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-25T22:07:23.051788] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T22:07:23.053427] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-25T22:07:23.526577] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T22:07:23.527919] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-25T22:07:23.985972] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-25T22:07:23.987167] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-25T22:07:24.438264] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-25T22:07:24.439358] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-25T22:07:24.888172] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-25T22:07:24.889370] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-25T22:07:25.253587] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-25T22:07:25.254478] [INFO ] [REMOTE ] GYLD: Full fetch complete (2090 records). [2025-10-25T22:07:25.254569] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-25T22:07:25.620482] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-25T22:07:25.620616] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-25T22:07:25.620770] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-25T22:07:25.620849] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-25T22:07:25.621460] [DEBUG] [LOCAL ] GYLD: Trimmed 2090 records to 1542 (keeping 200 days of data) [2025-10-25T22:07:25.632587] [DEBUG] [LOCAL ] GYLD: Primary data saved (1542 records). [2025-10-25T22:07:25.632840] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-25T22:07:25.632994] [INFO ] [MAIN ] Update Progress: 989/2366 symbols. GYLD took 5.1s. Estimated remaining time: 4h 24m 1s [2025-10-25T22:07:25.823038] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:07:25.823298] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-25T22:07:25.823383] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-25T22:07:25.823520] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-25T22:07:25.823601] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-25T22:07:25.823710] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-25T22:07:25.823782] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-25T22:07:26.191786] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:07:26.192140] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-25T22:07:27.642793] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T22:07:27.650250] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-25T22:07:29.252831] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T22:07:29.261380] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-25T22:07:30.867364] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T22:07:30.877424] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-25T22:07:32.301907] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T22:07:32.311823] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-25T22:07:33.871263] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T22:07:33.881117] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-25T22:07:35.324859] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T22:07:35.333840] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-25T22:07:36.814618] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T22:07:36.824234] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-25T22:07:38.553555] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-25T22:07:38.563525] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-25T22:07:40.001556] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T22:07:40.010831] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-25T22:07:41.444424] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T22:07:41.452534] [INFO ] [REMOTE ] H: Full fetch complete (63540 records). [2025-10-25T22:07:41.452761] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-25T22:07:41.850833] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-25T22:07:41.850974] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-25T22:07:41.851886] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-25T22:07:41.851967] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-25T22:07:41.853279] [DEBUG] [LOCAL ] H: Trimmed 63540 records to 45005 (keeping 200 days of data) [2025-10-25T22:07:42.130790] [DEBUG] [LOCAL ] H: Primary data saved (45005 records). [2025-10-25T22:07:42.131014] [INFO ] [MAIN ] H: Full history saved. [2025-10-25T22:07:42.131159] [INFO ] [MAIN ] Update Progress: 990/2366 symbols. H took 16.5s. Estimated remaining time: 4h 23m 57s [2025-10-25T22:07:42.301824] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:07:42.302019] [DEBUG] [LOCAL ] HAE: No existing data file found in primary storage. [2025-10-25T22:07:42.302093] [WARN ] [MAIN ] HAE: No existing data found, performing full refresh instead. [2025-10-25T22:07:42.302207] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-25T22:07:42.302279] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-25T22:07:42.302362] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-25T22:07:42.302434] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-25T22:07:42.661854] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:07:42.662192] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-25T22:07:44.006185] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T22:07:44.013860] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-25T22:07:45.391339] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T22:07:45.400843] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-25T22:07:46.958146] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T22:07:46.967588] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-25T22:07:48.395754] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T22:07:48.404420] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-25T22:07:49.951293] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-25T22:07:49.959233] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-25T22:07:51.344876] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T22:07:51.356576] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-25T22:07:52.828817] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T22:07:52.836821] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-25T22:07:54.437744] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T22:07:54.447297] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-25T22:07:55.934834] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T22:07:55.944913] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-25T22:07:57.314484] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T22:07:57.322182] [INFO ] [REMOTE ] HAE: Full fetch complete (59293 records). [2025-10-25T22:07:57.322309] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-25T22:07:57.706351] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-25T22:07:57.706460] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-25T22:07:57.707387] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-25T22:07:57.707470] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-25T22:07:57.708702] [DEBUG] [LOCAL ] HAE: Trimmed 59293 records to 39807 (keeping 200 days of data) [2025-10-25T22:07:57.927633] [DEBUG] [LOCAL ] HAE: Primary data saved (39807 records). [2025-10-25T22:07:57.927831] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-25T22:07:57.927973] [INFO ] [MAIN ] Update Progress: 991/2366 symbols. HAE took 15.8s. Estimated remaining time: 4h 23m 51s [2025-10-25T22:07:58.109661] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:07:58.109923] [DEBUG] [LOCAL ] HAFN: No existing data file found in primary storage. [2025-10-25T22:07:58.109998] [WARN ] [MAIN ] HAFN: No existing data found, performing full refresh instead. [2025-10-25T22:07:58.110136] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-25T22:07:58.110221] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-25T22:07:58.110311] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-25T22:07:58.110383] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-25T22:07:58.460451] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:07:58.460868] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-25T22:08:00.413109] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-25T22:08:00.423073] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-25T22:08:02.308282] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-25T22:08:02.317590] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-25T22:08:04.180796] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T22:08:04.191279] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-25T22:08:05.764826] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T22:08:05.774843] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-25T22:08:07.407326] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T22:08:07.417284] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-25T22:08:09.011158] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T22:08:09.020545] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-25T22:08:10.772714] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T22:08:10.782035] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-25T22:08:12.382899] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T22:08:12.391848] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-25T22:08:13.805087] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T22:08:13.814131] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-25T22:08:15.345430] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-25T22:08:15.353187] [INFO ] [REMOTE ] HAFN: Full fetch complete (64597 records). [2025-10-25T22:08:15.353375] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-25T22:08:15.751237] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-25T22:08:15.751351] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-25T22:08:15.752318] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-25T22:08:15.752404] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-25T22:08:15.753695] [DEBUG] [LOCAL ] HAFN: Trimmed 64597 records to 43254 (keeping 200 days of data) [2025-10-25T22:08:15.997677] [DEBUG] [LOCAL ] HAFN: Primary data saved (43254 records). [2025-10-25T22:08:15.997866] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-25T22:08:15.998013] [INFO ] [MAIN ] Update Progress: 992/2366 symbols. HAFN took 18.1s. Estimated remaining time: 4h 23m 49s [2025-10-25T22:08:16.167706] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:08:16.167904] [DEBUG] [LOCAL ] HAL: No existing data file found in primary storage. [2025-10-25T22:08:16.167977] [WARN ] [MAIN ] HAL: No existing data found, performing full refresh instead. [2025-10-25T22:08:16.168087] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-25T22:08:16.168158] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-25T22:08:16.168240] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-25T22:08:16.168311] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-25T22:08:16.513090] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:08:16.513413] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-25T22:08:18.431712] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T22:08:18.442935] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-25T22:08:20.370186] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T22:08:20.383318] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-25T22:08:22.416638] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-25T22:08:22.427617] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-25T22:08:24.615931] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-25T22:08:24.627065] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-25T22:08:26.787392] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-25T22:08:26.798785] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-25T22:08:28.985058] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-25T22:08:28.996157] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-25T22:08:31.238030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-25T22:08:31.249854] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-25T22:08:33.193728] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-25T22:08:33.205390] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-25T22:08:34.979928] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T22:08:34.991566] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-25T22:08:35.722080] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T22:08:35.731764] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-25T22:08:35.731923] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-25T22:08:36.123554] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-25T22:08:36.123723] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-25T22:08:36.124724] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-25T22:08:36.124805] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-25T22:08:36.126270] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54498 (keeping 200 days of data) [2025-10-25T22:08:36.445579] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-25T22:08:36.445759] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-25T22:08:36.445898] [INFO ] [MAIN ] Update Progress: 993/2366 symbols. HAL took 20.4s. Estimated remaining time: 4h 23m 49s [2025-10-25T22:08:36.619777] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:08:36.620049] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-10-25T22:08:36.620145] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-10-25T22:08:36.620291] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-25T22:08:36.620394] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-25T22:08:36.620477] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-25T22:08:36.620546] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-25T22:08:36.976397] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:08:36.976781] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-25T22:08:38.581264] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T22:08:38.590356] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-25T22:08:40.180444] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T22:08:40.189456] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-25T22:08:41.770138] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T22:08:41.779610] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-25T22:08:43.419590] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T22:08:43.429850] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-25T22:08:45.053520] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T22:08:45.065713] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-25T22:08:46.598280] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T22:08:46.608455] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-25T22:08:48.166946] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-25T22:08:48.177519] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-25T22:08:49.647156] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T22:08:49.657327] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-25T22:08:51.182826] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T22:08:51.194050] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-25T22:08:52.471332] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T22:08:52.480035] [INFO ] [REMOTE ] HASI: Full fetch complete (68322 records). [2025-10-25T22:08:52.480214] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-25T22:08:52.867977] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-25T22:08:52.868093] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-25T22:08:52.869384] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-25T22:08:52.869467] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-25T22:08:52.870852] [DEBUG] [LOCAL ] HASI: Trimmed 68322 records to 48367 (keeping 200 days of data) [2025-10-25T22:08:53.157917] [DEBUG] [LOCAL ] HASI: Primary data saved (48367 records). [2025-10-25T22:08:53.158079] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-25T22:08:53.158293] [INFO ] [MAIN ] Update Progress: 994/2366 symbols. HASI took 16.7s. Estimated remaining time: 4h 23m 45s [2025-10-25T22:08:53.328425] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:08:53.328617] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-10-25T22:08:53.328710] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-10-25T22:08:53.328823] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-25T22:08:53.328894] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-25T22:08:53.328956] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-25T22:08:53.329020] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-25T22:08:53.681939] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:08:53.682271] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-25T22:08:55.233889] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T22:08:55.243877] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-25T22:08:56.830458] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T22:08:56.839686] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-25T22:08:58.477298] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T22:08:58.487419] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-25T22:09:00.082830] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T22:09:00.093272] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-25T22:09:02.152370] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-25T22:09:02.162783] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-25T22:09:04.152336] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-25T22:09:04.162065] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-25T22:09:05.768574] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T22:09:05.779928] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-25T22:09:07.388392] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T22:09:07.400133] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-25T22:09:09.053845] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T22:09:09.067201] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-25T22:09:10.470245] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-25T22:09:10.479392] [INFO ] [REMOTE ] HAYW: Full fetch complete (70919 records). [2025-10-25T22:09:10.479548] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-25T22:09:10.880775] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-25T22:09:10.880912] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-25T22:09:10.882021] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-25T22:09:10.882104] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-25T22:09:10.883467] [DEBUG] [LOCAL ] HAYW: Trimmed 70919 records to 49525 (keeping 200 days of data) [2025-10-25T22:09:11.170911] [DEBUG] [LOCAL ] HAYW: Primary data saved (49525 records). [2025-10-25T22:09:11.171109] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-25T22:09:11.171259] [INFO ] [MAIN ] Update Progress: 995/2366 symbols. HAYW took 18.0s. Estimated remaining time: 4h 23m 42s [2025-10-25T22:09:11.344569] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:09:11.344808] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-25T22:09:11.344888] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-25T22:09:11.345033] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-25T22:09:11.345111] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-25T22:09:11.345197] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-25T22:09:11.345275] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-25T22:09:11.700424] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:09:11.700797] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-25T22:09:12.377288] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-25T22:09:12.379176] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-25T22:09:12.996516] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T22:09:12.999139] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-25T22:09:13.820973] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-25T22:09:13.823146] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-25T22:09:14.740712] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T22:09:14.745147] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-25T22:09:15.505819] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T22:09:15.508232] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-25T22:09:16.064194] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T22:09:16.065845] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-25T22:09:16.755890] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-25T22:09:16.758074] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-25T22:09:17.490066] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T22:09:17.492325] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-25T22:09:17.917247] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-25T22:09:17.919080] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-25T22:09:18.468013] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-25T22:09:18.469408] [INFO ] [REMOTE ] HBB: Full fetch complete (9176 records). [2025-10-25T22:09:18.469508] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-25T22:09:18.836093] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-25T22:09:18.836211] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-25T22:09:18.836473] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-25T22:09:18.836549] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-25T22:09:18.837041] [DEBUG] [LOCAL ] HBB: Trimmed 9176 records to 6337 (keeping 200 days of data) [2025-10-25T22:09:18.878485] [DEBUG] [LOCAL ] HBB: Primary data saved (6337 records). [2025-10-25T22:09:18.878792] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-25T22:09:18.878939] [INFO ] [MAIN ] Update Progress: 996/2366 symbols. HBB took 7.7s. Estimated remaining time: 4h 23m 26s [2025-10-25T22:09:19.057895] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:09:19.058182] [DEBUG] [LOCAL ] HBI: No existing data file found in primary storage. [2025-10-25T22:09:19.058274] [WARN ] [MAIN ] HBI: No existing data found, performing full refresh instead. [2025-10-25T22:09:19.058413] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-25T22:09:19.058504] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-25T22:09:19.058610] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-25T22:09:19.058714] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-25T22:09:19.410366] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:09:19.410706] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-25T22:09:21.057865] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-25T22:09:21.068098] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-25T22:09:22.645679] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T22:09:22.658281] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-25T22:09:24.519157] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T22:09:24.530416] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-25T22:09:26.149280] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T22:09:26.160845] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-25T22:09:27.858627] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T22:09:27.869924] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-25T22:09:29.513014] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T22:09:29.523821] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-25T22:09:31.245682] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-25T22:09:31.257249] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-25T22:09:33.315067] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-25T22:09:33.326493] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-25T22:09:35.054066] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T22:09:35.065267] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-25T22:09:36.679624] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T22:09:36.689461] [INFO ] [REMOTE ] HBI: Full fetch complete (76967 records). [2025-10-25T22:09:36.689621] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-25T22:09:37.083164] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-25T22:09:37.083280] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-25T22:09:37.084233] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-25T22:09:37.084316] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-25T22:09:37.085805] [DEBUG] [LOCAL ] HBI: Trimmed 76967 records to 53680 (keeping 200 days of data) [2025-10-25T22:09:37.379457] [DEBUG] [LOCAL ] HBI: Primary data saved (53680 records). [2025-10-25T22:09:37.379633] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-25T22:09:37.379799] [INFO ] [MAIN ] Update Progress: 997/2366 symbols. HBI took 18.5s. Estimated remaining time: 4h 23m 24s [2025-10-25T22:09:37.548042] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:09:37.548255] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-25T22:09:37.548326] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-25T22:09:37.548470] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-25T22:09:37.548547] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-25T22:09:37.548629] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-25T22:09:37.548721] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-25T22:09:37.907266] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:09:37.908619] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-25T22:09:39.507567] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T22:09:39.517947] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-25T22:09:41.130359] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T22:09:41.140468] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-25T22:09:42.840388] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T22:09:42.851385] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-25T22:09:44.621919] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T22:09:44.632704] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-25T22:09:46.449126] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T22:09:46.460514] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-25T22:09:47.802686] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T22:09:47.813266] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-25T22:09:49.271022] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T22:09:49.282908] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-25T22:09:51.057115] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T22:09:51.068270] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-25T22:09:52.651639] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T22:09:52.663047] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-25T22:09:54.424513] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-25T22:09:54.434200] [INFO ] [REMOTE ] HBM: Full fetch complete (76752 records). [2025-10-25T22:09:54.434338] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-25T22:09:54.821831] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-25T22:09:54.821941] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-25T22:09:54.822830] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-25T22:09:54.822924] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-25T22:09:54.824328] [DEBUG] [LOCAL ] HBM: Trimmed 76752 records to 53759 (keeping 200 days of data) [2025-10-25T22:09:55.129587] [DEBUG] [LOCAL ] HBM: Primary data saved (53759 records). [2025-10-25T22:09:55.129757] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-25T22:09:55.129901] [INFO ] [MAIN ] Update Progress: 998/2366 symbols. HBM took 17.7s. Estimated remaining time: 4h 23m 21s [2025-10-25T22:09:55.294480] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:09:55.294664] [DEBUG] [LOCAL ] HCA: No existing data file found in primary storage. [2025-10-25T22:09:55.294726] [WARN ] [MAIN ] HCA: No existing data found, performing full refresh instead. [2025-10-25T22:09:55.294834] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-25T22:09:55.294906] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-25T22:09:55.294986] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-25T22:09:55.295069] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-25T22:09:55.641696] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:09:55.642021] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-25T22:09:57.390755] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T22:09:57.400504] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-25T22:09:59.017576] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T22:09:59.028167] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-25T22:10:01.136463] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-25T22:10:01.146798] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-25T22:10:03.512143] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-25T22:10:03.523105] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-25T22:10:05.416764] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-25T22:10:05.427412] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-25T22:10:07.005031] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T22:10:07.021141] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-25T22:10:08.878540] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T22:10:08.894354] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-25T22:10:10.448871] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T22:10:10.460431] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-25T22:10:12.180853] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T22:10:12.190259] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-25T22:10:12.951770] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T22:10:12.960316] [INFO ] [REMOTE ] HCA: Full fetch complete (68942 records). [2025-10-25T22:10:12.960494] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-25T22:10:13.359496] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-25T22:10:13.359684] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-25T22:10:13.361143] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-25T22:10:13.361230] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-25T22:10:13.363056] [DEBUG] [LOCAL ] HCA: Trimmed 68942 records to 47631 (keeping 200 days of data) [2025-10-25T22:10:13.679759] [DEBUG] [LOCAL ] HCA: Primary data saved (47631 records). [2025-10-25T22:10:13.680002] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-25T22:10:13.680195] [INFO ] [MAIN ] Update Progress: 999/2366 symbols. HCA took 18.6s. Estimated remaining time: 4h 23m 19s [2025-10-25T22:10:13.850956] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:10:13.851265] [DEBUG] [LOCAL ] HCC: No existing data file found in primary storage. [2025-10-25T22:10:13.851341] [WARN ] [MAIN ] HCC: No existing data found, performing full refresh instead. [2025-10-25T22:10:13.851468] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-25T22:10:13.851540] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-25T22:10:13.851625] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-25T22:10:13.851724] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-25T22:10:14.249240] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:10:14.249800] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-25T22:10:15.704736] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T22:10:15.713044] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-25T22:10:17.149615] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T22:10:17.158312] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-25T22:10:18.839165] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T22:10:18.849687] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-25T22:10:20.664212] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T22:10:20.674211] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-25T22:10:22.445412] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-25T22:10:22.455084] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-25T22:10:23.919195] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T22:10:23.928765] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-25T22:10:25.664127] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T22:10:25.674164] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-25T22:10:27.258069] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T22:10:27.267551] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-25T22:10:28.689806] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T22:10:28.699352] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-25T22:10:30.277934] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T22:10:30.285618] [INFO ] [REMOTE ] HCC: Full fetch complete (64820 records). [2025-10-25T22:10:30.285784] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-25T22:10:30.666766] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-25T22:10:30.666912] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-25T22:10:30.667826] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-25T22:10:30.667907] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-25T22:10:30.669279] [DEBUG] [LOCAL ] HCC: Trimmed 64820 records to 45578 (keeping 200 days of data) [2025-10-25T22:10:30.932319] [DEBUG] [LOCAL ] HCC: Primary data saved (45578 records). [2025-10-25T22:10:30.932481] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-25T22:10:30.932620] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols. HCC took 17.3s. Estimated remaining time: 4h 23m 15s [2025-10-25T22:10:31.099312] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:10:31.099501] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-10-25T22:10:31.099583] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-10-25T22:10:31.099747] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-25T22:10:31.099823] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-25T22:10:31.099907] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-25T22:10:31.099979] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-25T22:10:31.455542] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:10:31.455925] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-25T22:10:32.370049] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T22:10:32.373058] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-25T22:10:33.260278] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T22:10:33.263127] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-25T22:10:34.096373] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-25T22:10:34.099757] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-25T22:10:35.095378] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T22:10:35.099067] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-25T22:10:36.077172] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T22:10:36.080588] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-25T22:10:37.083302] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T22:10:37.087268] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-25T22:10:38.191534] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T22:10:38.195572] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-25T22:10:39.213505] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T22:10:39.216997] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-25T22:10:40.164891] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T22:10:40.168436] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-25T22:10:41.056298] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T22:10:41.059477] [INFO ] [REMOTE ] HCI: Full fetch complete (19538 records). [2025-10-25T22:10:41.059577] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-25T22:10:41.426077] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-25T22:10:41.426213] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-25T22:10:41.426727] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-25T22:10:41.426805] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-25T22:10:41.427463] [DEBUG] [LOCAL ] HCI: Trimmed 19538 records to 14235 (keeping 200 days of data) [2025-10-25T22:10:41.512835] [DEBUG] [LOCAL ] HCI: Primary data saved (14235 records). [2025-10-25T22:10:41.513005] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-25T22:10:41.513163] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols. HCI took 10.6s. Estimated remaining time: 4h 23m 2s [2025-10-25T22:10:41.679597] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:10:41.679813] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-25T22:10:41.679905] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-25T22:10:41.680043] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-25T22:10:41.680133] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-25T22:10:41.680245] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-25T22:10:41.680332] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-25T22:10:42.033243] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:10:42.033574] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-25T22:10:42.272125] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-25T22:10:42.273059] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-25T22:10:42.603568] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-25T22:10:42.604457] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-25T22:10:42.918854] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-25T22:10:42.919873] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-25T22:10:43.158694] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-25T22:10:43.159628] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-25T22:10:43.389113] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-25T22:10:43.390020] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-25T22:10:43.709884] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-25T22:10:43.710832] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-25T22:10:44.183793] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-25T22:10:44.184967] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-25T22:10:44.527395] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-25T22:10:44.528609] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-25T22:10:44.782999] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-25T22:10:44.784180] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-25T22:10:45.018714] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-25T22:10:45.019438] [INFO ] [REMOTE ] HCXY: Full fetch complete (514 records). [2025-10-25T22:10:45.019529] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-25T22:10:45.210224] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-25T22:10:45.210443] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:10:45.210526] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:10:45.210603] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-25T22:10:45.210722] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-25T22:10:45.210797] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-25T22:10:45.210880] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-25T22:10:45.211021] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols. HCXY took 3.7s. Estimated remaining time: 4h 22m 40s [2025-10-25T22:10:45.385379] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:10:45.385572] [DEBUG] [LOCAL ] HD: No existing data file found in primary storage. [2025-10-25T22:10:45.385663] [WARN ] [MAIN ] HD: No existing data found, performing full refresh instead. [2025-10-25T22:10:45.385770] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-25T22:10:45.385839] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-25T22:10:45.385925] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-25T22:10:45.385998] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-25T22:10:45.745134] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:10:45.745515] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-25T22:10:47.981837] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-25T22:10:47.992368] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-25T22:10:50.090440] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-25T22:10:50.100849] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-25T22:10:52.280471] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-25T22:10:52.291412] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-25T22:10:54.541071] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-25T22:10:54.552808] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-25T22:10:56.758130] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-25T22:10:56.769130] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-25T22:10:58.934456] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-25T22:10:58.945327] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-25T22:11:01.390429] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-25T22:11:01.403306] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-25T22:11:03.576680] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-25T22:11:03.589302] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-25T22:11:05.782967] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-25T22:11:05.794402] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-25T22:11:06.538247] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T22:11:06.548486] [INFO ] [REMOTE ] HD: Full fetch complete (77544 records). [2025-10-25T22:11:06.548727] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-25T22:11:06.963063] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-25T22:11:06.963175] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-25T22:11:06.964254] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-25T22:11:06.964354] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-25T22:11:06.965844] [DEBUG] [LOCAL ] HD: Trimmed 77544 records to 54239 (keeping 200 days of data) [2025-10-25T22:11:07.302251] [DEBUG] [LOCAL ] HD: Primary data saved (54239 records). [2025-10-25T22:11:07.302418] [INFO ] [MAIN ] HD: Full history saved. [2025-10-25T22:11:07.302572] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols. HD took 22.1s. Estimated remaining time: 4h 22m 42s [2025-10-25T22:11:07.484720] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:11:07.484936] [DEBUG] [LOCAL ] HDB: No existing data file found in primary storage. [2025-10-25T22:11:07.485011] [WARN ] [MAIN ] HDB: No existing data found, performing full refresh instead. [2025-10-25T22:11:07.485129] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-25T22:11:07.485203] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-25T22:11:07.485286] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-25T22:11:07.485370] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-25T22:11:07.854495] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:11:07.854872] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-25T22:11:09.555186] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T22:11:09.565598] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-25T22:11:11.188180] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T22:11:11.198036] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-25T22:11:13.076134] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T22:11:13.087045] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-25T22:11:14.917315] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T22:11:14.928315] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-25T22:11:16.764239] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-25T22:11:16.775294] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-25T22:11:18.538487] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T22:11:18.548917] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-25T22:11:20.473397] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-25T22:11:20.484743] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-25T22:11:22.235587] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-25T22:11:22.246404] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-25T22:11:24.000245] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-25T22:11:24.011809] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-25T22:11:25.764290] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T22:11:25.774117] [INFO ] [REMOTE ] HDB: Full fetch complete (75661 records). [2025-10-25T22:11:25.774312] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-25T22:11:26.172448] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-25T22:11:26.172559] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-25T22:11:26.173527] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-25T22:11:26.173608] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-25T22:11:26.175006] [DEBUG] [LOCAL ] HDB: Trimmed 75661 records to 52684 (keeping 200 days of data) [2025-10-25T22:11:26.502967] [DEBUG] [LOCAL ] HDB: Primary data saved (52684 records). [2025-10-25T22:11:26.503159] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-25T22:11:26.503320] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols. HDB took 19.2s. Estimated remaining time: 4h 22m 41s [2025-10-25T22:11:26.677278] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:11:26.677506] [DEBUG] [LOCAL ] HE: No existing data file found in primary storage. [2025-10-25T22:11:26.677581] [WARN ] [MAIN ] HE: No existing data found, performing full refresh instead. [2025-10-25T22:11:26.677748] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-25T22:11:26.677825] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-25T22:11:26.677887] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-25T22:11:26.677952] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-25T22:11:27.032776] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:11:27.033190] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-25T22:11:28.885885] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-25T22:11:28.896139] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-25T22:11:30.944307] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-25T22:11:30.954132] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-25T22:11:32.365923] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T22:11:32.376599] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-25T22:11:34.166609] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T22:11:34.177345] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-25T22:11:35.942393] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-25T22:11:35.952725] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-25T22:11:37.585422] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-25T22:11:37.595359] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-25T22:11:39.459617] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T22:11:39.470355] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-25T22:11:41.351835] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-25T22:11:41.362538] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-25T22:11:42.966548] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T22:11:42.977281] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-25T22:11:44.861007] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T22:11:44.869848] [INFO ] [REMOTE ] HE: Full fetch complete (71961 records). [2025-10-25T22:11:44.870038] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-25T22:11:45.277778] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-25T22:11:45.277904] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-25T22:11:45.278967] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-25T22:11:45.279050] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-25T22:11:45.280402] [DEBUG] [LOCAL ] HE: Trimmed 71961 records to 49431 (keeping 200 days of data) [2025-10-25T22:11:45.555451] [DEBUG] [LOCAL ] HE: Primary data saved (49431 records). [2025-10-25T22:11:45.555604] [INFO ] [MAIN ] HE: Full history saved. [2025-10-25T22:11:45.555765] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols. HE took 19.1s. Estimated remaining time: 4h 22m 40s [2025-10-25T22:11:45.720866] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:11:45.721027] [DEBUG] [LOCAL ] HEI: No existing data file found in primary storage. [2025-10-25T22:11:45.721114] [WARN ] [MAIN ] HEI: No existing data found, performing full refresh instead. [2025-10-25T22:11:45.721199] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-25T22:11:45.721266] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-25T22:11:45.721325] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-25T22:11:45.721390] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-25T22:11:46.140126] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:11:46.140663] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-25T22:11:47.797530] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T22:11:47.805220] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-25T22:11:49.283524] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T22:11:49.290709] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-25T22:11:50.819748] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T22:11:50.827350] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-25T22:11:52.464736] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T22:11:52.472612] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-25T22:11:54.007866] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T22:11:54.015569] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-25T22:11:55.397486] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T22:11:55.404709] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-25T22:11:56.475708] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T22:11:56.482230] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-25T22:11:57.996567] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T22:11:58.003944] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-25T22:11:59.249993] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T22:11:59.255950] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-25T22:12:00.510132] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T22:12:00.514522] [INFO ] [REMOTE ] HEI: Full fetch complete (46973 records). [2025-10-25T22:12:00.514680] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-25T22:12:00.910535] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-25T22:12:00.910683] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-25T22:12:00.911419] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-25T22:12:00.911495] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-25T22:12:00.912613] [DEBUG] [LOCAL ] HEI: Trimmed 46973 records to 30813 (keeping 200 days of data) [2025-10-25T22:12:01.114537] [DEBUG] [LOCAL ] HEI: Primary data saved (30813 records). [2025-10-25T22:12:01.114744] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-25T22:12:01.114897] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols. HEI took 15.6s. Estimated remaining time: 4h 22m 34s [2025-10-25T22:12:01.282962] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:01.283159] [DEBUG] [LOCAL ] HEQ: No existing data file found in primary storage. [2025-10-25T22:12:01.283228] [WARN ] [MAIN ] HEQ: No existing data found, performing full refresh instead. [2025-10-25T22:12:01.283339] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-25T22:12:01.283410] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-25T22:12:01.283490] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-25T22:12:01.283559] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-25T22:12:01.648418] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:01.648961] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-25T22:12:02.657096] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T22:12:02.659105] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-25T22:12:03.278492] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-25T22:12:03.280433] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-25T22:12:03.978237] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-25T22:12:03.980071] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-25T22:12:04.753145] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-25T22:12:04.755667] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-25T22:12:05.390277] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T22:12:05.392104] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-25T22:12:05.980258] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T22:12:05.982000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-25T22:12:06.733470] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T22:12:06.735842] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-25T22:12:07.349292] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T22:12:07.351115] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-25T22:12:08.115066] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T22:12:08.117523] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-25T22:12:08.956989] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T22:12:08.959220] [INFO ] [REMOTE ] HEQ: Full fetch complete (9605 records). [2025-10-25T22:12:08.959309] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-25T22:12:09.316610] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-25T22:12:09.316747] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-25T22:12:09.316972] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-25T22:12:09.317043] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-25T22:12:09.317482] [DEBUG] [LOCAL ] HEQ: Trimmed 9605 records to 6878 (keeping 200 days of data) [2025-10-25T22:12:09.356627] [DEBUG] [LOCAL ] HEQ: Primary data saved (6878 records). [2025-10-25T22:12:09.356799] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-25T22:12:09.356940] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols. HEQ took 8.2s. Estimated remaining time: 4h 22m 18s [2025-10-25T22:12:09.522866] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:09.523081] [DEBUG] [LOCAL ] HESM: No existing data file found in primary storage. [2025-10-25T22:12:09.523152] [WARN ] [MAIN ] HESM: No existing data found, performing full refresh instead. [2025-10-25T22:12:09.523264] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-25T22:12:09.523334] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-25T22:12:09.523413] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-25T22:12:09.523482] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-25T22:12:09.871684] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:09.872066] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-25T22:12:11.508566] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T22:12:11.517765] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-25T22:12:13.177510] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T22:12:13.186904] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-25T22:12:14.844864] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T22:12:14.855400] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-25T22:12:16.594624] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T22:12:16.604788] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-25T22:12:18.229880] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T22:12:18.239822] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-25T22:12:19.881400] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T22:12:19.891492] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-25T22:12:21.584428] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-25T22:12:21.595698] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-25T22:12:23.378536] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T22:12:23.389331] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-25T22:12:25.087009] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-25T22:12:25.097925] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-25T22:12:26.941590] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-25T22:12:26.952792] [INFO ] [REMOTE ] HESM: Full fetch complete (70000 records). [2025-10-25T22:12:26.952992] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-25T22:12:27.341394] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-25T22:12:27.341531] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-25T22:12:27.342485] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-25T22:12:27.342566] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-25T22:12:27.343927] [DEBUG] [LOCAL ] HESM: Trimmed 70000 records to 49331 (keeping 200 days of data) [2025-10-25T22:12:27.633237] [DEBUG] [LOCAL ] HESM: Primary data saved (49331 records). [2025-10-25T22:12:27.633397] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-25T22:12:27.633542] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols. HESM took 18.3s. Estimated remaining time: 4h 22m 15s [2025-10-25T22:12:27.798079] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:27.798283] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-25T22:12:27.798357] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-25T22:12:27.798442] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-25T22:12:27.798509] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-25T22:12:27.798570] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-25T22:12:27.798636] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-25T22:12:28.145571] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:28.145918] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-25T22:12:28.494892] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-25T22:12:28.495710] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-25T22:12:28.814210] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-25T22:12:28.815171] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-25T22:12:29.073404] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-25T22:12:29.074350] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-25T22:12:29.320407] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-25T22:12:29.321259] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-25T22:12:29.573236] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-25T22:12:29.574102] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-25T22:12:29.913502] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-25T22:12:29.914474] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-25T22:12:30.178584] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-25T22:12:30.179519] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-25T22:12:30.428554] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-25T22:12:30.429401] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-25T22:12:30.665617] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-25T22:12:30.666467] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-25T22:12:30.917616] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-25T22:12:30.918333] [INFO ] [REMOTE ] HF: Full fetch complete (421 records). [2025-10-25T22:12:30.918429] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-25T22:12:31.097050] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-25T22:12:31.097224] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:12:31.097293] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:12:31.097386] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-25T22:12:31.097500] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-25T22:12:31.097575] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-25T22:12:31.097683] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-25T22:12:31.097822] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols. HF took 3.5s. Estimated remaining time: 4h 21m 52s [2025-10-25T22:12:31.264616] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:31.264850] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-25T22:12:31.264920] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-25T22:12:31.265007] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-25T22:12:31.265073] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-25T22:12:31.265131] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-25T22:12:31.265169] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-25T22:12:31.621431] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:31.621810] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-25T22:12:32.035896] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-25T22:12:32.036897] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-25T22:12:32.466498] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-25T22:12:32.467600] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-25T22:12:32.884300] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-25T22:12:32.885391] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-25T22:12:33.321106] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-25T22:12:33.322807] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-25T22:12:33.666802] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-25T22:12:33.668237] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-25T22:12:34.084768] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-25T22:12:34.085889] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-25T22:12:34.575121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-25T22:12:34.576215] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-25T22:12:35.039576] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T22:12:35.040756] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-25T22:12:35.404378] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-25T22:12:35.405493] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-25T22:12:35.763148] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-25T22:12:35.763988] [INFO ] [REMOTE ] HFND: Full fetch complete (1767 records). [2025-10-25T22:12:35.764075] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-25T22:12:35.942213] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-25T22:12:35.942350] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:12:35.942420] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:12:35.942494] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-25T22:12:35.942600] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-25T22:12:35.942693] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-25T22:12:35.942775] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-25T22:12:35.942897] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols. HFND took 4.8s. Estimated remaining time: 4h 21m 32s [2025-10-25T22:12:36.112697] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:36.112882] [DEBUG] [LOCAL ] HFRO: No existing data file found in primary storage. [2025-10-25T22:12:36.112954] [WARN ] [MAIN ] HFRO: No existing data found, performing full refresh instead. [2025-10-25T22:12:36.113066] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-25T22:12:36.113138] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-25T22:12:36.113219] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-25T22:12:36.113287] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-25T22:12:36.467922] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:36.468282] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-25T22:12:37.630564] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T22:12:37.636061] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-25T22:12:38.737735] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T22:12:38.742432] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-25T22:12:39.676505] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T22:12:39.681877] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-25T22:12:40.689969] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T22:12:40.694303] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-25T22:12:41.597255] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T22:12:41.600431] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-25T22:12:42.617956] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T22:12:42.621851] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-25T22:12:43.556942] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T22:12:43.561117] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-25T22:12:44.622348] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T22:12:44.627202] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-25T22:12:45.706381] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T22:12:45.713321] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-25T22:12:46.570868] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T22:12:46.573536] [INFO ] [REMOTE ] HFRO: Full fetch complete (26592 records). [2025-10-25T22:12:46.573639] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-25T22:12:46.953220] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-25T22:12:46.953338] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-25T22:12:46.953960] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-25T22:12:46.954056] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-25T22:12:46.954789] [DEBUG] [LOCAL ] HFRO: Trimmed 26592 records to 16453 (keeping 200 days of data) [2025-10-25T22:12:47.060028] [DEBUG] [LOCAL ] HFRO: Primary data saved (16453 records). [2025-10-25T22:12:47.060207] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-25T22:12:47.060375] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols. HFRO took 11.1s. Estimated remaining time: 4h 21m 20s [2025-10-25T22:12:47.226633] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:47.226819] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-25T22:12:47.226889] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-25T22:12:47.226998] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-25T22:12:47.227067] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-25T22:12:47.227146] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-25T22:12:47.227214] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-25T22:12:47.580983] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:47.581340] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-25T22:12:48.361477] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T22:12:48.363692] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-25T22:12:49.015780] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-25T22:12:49.017639] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-25T22:12:49.731796] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T22:12:49.734155] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-25T22:12:50.566684] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-25T22:12:50.569847] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-25T22:12:51.459989] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T22:12:51.463002] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-25T22:12:52.227356] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T22:12:52.230532] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-25T22:12:53.258974] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T22:12:53.262898] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-25T22:12:54.241629] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T22:12:54.245285] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-25T22:12:55.262534] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T22:12:55.267413] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-25T22:12:56.407582] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-25T22:12:56.412942] [INFO ] [REMOTE ] HGER: Full fetch complete (19323 records). [2025-10-25T22:12:56.413036] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-25T22:12:56.775075] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-25T22:12:56.775247] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-25T22:12:56.775725] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-25T22:12:56.775804] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-25T22:12:56.776421] [DEBUG] [LOCAL ] HGER: Trimmed 19323 records to 15921 (keeping 200 days of data) [2025-10-25T22:12:56.865794] [DEBUG] [LOCAL ] HGER: Primary data saved (15921 records). [2025-10-25T22:12:56.865951] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-25T22:12:56.866100] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols. HGER took 9.8s. Estimated remaining time: 4h 21m 6s [2025-10-25T22:12:57.031494] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:12:57.031729] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-10-25T22:12:57.031801] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-10-25T22:12:57.031909] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-25T22:12:57.031979] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-25T22:12:57.032060] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-25T22:12:57.032130] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-25T22:12:57.422082] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:12:57.422398] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-25T22:12:58.157921] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-25T22:12:58.160260] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-25T22:12:58.950109] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T22:12:58.952981] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-25T22:12:59.759429] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T22:12:59.762712] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-25T22:13:00.599227] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-25T22:13:00.604037] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-25T22:13:02.170308] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T22:13:02.172614] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-25T22:13:02.939152] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T22:13:02.941636] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-25T22:13:03.715042] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T22:13:03.717984] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-25T22:13:04.548303] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-25T22:13:04.552141] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-25T22:13:05.385530] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-25T22:13:05.389070] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-25T22:13:06.323505] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T22:13:06.326093] [INFO ] [REMOTE ] HGLB: Full fetch complete (14368 records). [2025-10-25T22:13:06.326193] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-25T22:13:06.705781] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-25T22:13:06.705897] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-25T22:13:06.706344] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-25T22:13:06.706452] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-25T22:13:06.707109] [DEBUG] [LOCAL ] HGLB: Trimmed 14368 records to 9712 (keeping 200 days of data) [2025-10-25T22:13:06.764250] [DEBUG] [LOCAL ] HGLB: Primary data saved (9712 records). [2025-10-25T22:13:06.764422] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-25T22:13:06.764627] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols. HGLB took 9.9s. Estimated remaining time: 4h 20m 52s [2025-10-25T22:13:06.936170] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:13:06.936549] [DEBUG] [LOCAL ] HGTY: No existing data file found in primary storage. [2025-10-25T22:13:06.936847] [WARN ] [MAIN ] HGTY: No existing data found, performing full refresh instead. [2025-10-25T22:13:06.937007] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-25T22:13:06.937102] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-25T22:13:06.937221] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-25T22:13:06.937310] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-25T22:13:07.285886] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:13:07.286297] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-25T22:13:08.051323] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-25T22:13:08.055227] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-25T22:13:08.758334] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T22:13:08.761294] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-25T22:13:09.562550] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T22:13:09.565982] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-25T22:13:10.422303] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-25T22:13:10.425361] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-25T22:13:11.217586] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T22:13:11.220585] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-25T22:13:12.054210] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T22:13:12.057464] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-25T22:13:12.932168] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T22:13:12.935532] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-25T22:13:13.975890] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T22:13:13.981161] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-25T22:13:15.055487] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T22:13:15.060962] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-25T22:13:16.008598] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-25T22:13:16.011919] [INFO ] [REMOTE ] HGTY: Full fetch complete (17609 records). [2025-10-25T22:13:16.012035] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-25T22:13:16.388443] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-25T22:13:16.388598] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-25T22:13:16.389394] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-25T22:13:16.389476] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-25T22:13:16.390209] [DEBUG] [LOCAL ] HGTY: Trimmed 17609 records to 13518 (keeping 200 days of data) [2025-10-25T22:13:16.469895] [DEBUG] [LOCAL ] HGTY: Primary data saved (13518 records). [2025-10-25T22:13:16.470127] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-25T22:13:16.470306] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols. HGTY took 9.7s. Estimated remaining time: 4h 20m 38s [2025-10-25T22:13:16.639281] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:13:16.639592] [DEBUG] [LOCAL ] HGV: No existing data file found in primary storage. [2025-10-25T22:13:16.639686] [WARN ] [MAIN ] HGV: No existing data found, performing full refresh instead. [2025-10-25T22:13:16.639816] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-25T22:13:16.639890] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-25T22:13:16.639972] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-25T22:13:16.640098] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-25T22:13:16.999857] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:13:17.000204] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-25T22:13:18.625497] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T22:13:18.634940] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-25T22:13:20.166716] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T22:13:20.175112] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-25T22:13:21.744601] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T22:13:21.754711] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-25T22:13:23.501120] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T22:13:23.511464] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-25T22:13:25.099457] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T22:13:25.112290] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-25T22:13:26.673104] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-25T22:13:26.682581] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-25T22:13:28.329880] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T22:13:28.341010] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-25T22:13:29.963725] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T22:13:29.974831] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-25T22:13:31.591903] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T22:13:31.601632] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-25T22:13:33.118631] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-25T22:13:33.126468] [INFO ] [REMOTE ] HGV: Full fetch complete (65895 records). [2025-10-25T22:13:33.126609] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-25T22:13:33.506336] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-25T22:13:33.506440] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-25T22:13:33.507348] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-25T22:13:33.507428] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-25T22:13:33.508765] [DEBUG] [LOCAL ] HGV: Trimmed 65895 records to 46712 (keeping 200 days of data) [2025-10-25T22:13:33.772365] [DEBUG] [LOCAL ] HGV: Primary data saved (46712 records). [2025-10-25T22:13:33.772561] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-25T22:13:33.772720] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols. HGV took 17.3s. Estimated remaining time: 4h 20m 34s [2025-10-25T22:13:33.940703] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:13:33.940886] [DEBUG] [LOCAL ] HHH: No existing data file found in primary storage. [2025-10-25T22:13:33.940963] [WARN ] [MAIN ] HHH: No existing data found, performing full refresh instead. [2025-10-25T22:13:33.941083] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-25T22:13:33.941153] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-25T22:13:33.941233] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-25T22:13:33.941304] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-25T22:13:34.324989] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:13:34.325350] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-25T22:13:35.612358] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-25T22:13:35.618849] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-25T22:13:36.958634] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T22:13:36.965015] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-25T22:13:38.212348] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T22:13:38.218533] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-25T22:13:39.488696] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T22:13:39.494848] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-25T22:13:41.121794] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T22:13:41.133682] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-25T22:13:42.643932] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T22:13:42.653083] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-25T22:13:44.110167] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T22:13:44.117969] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-25T22:13:45.612102] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-25T22:13:45.619612] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-25T22:13:47.006509] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T22:13:47.013524] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-25T22:13:48.212774] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T22:13:48.218191] [INFO ] [REMOTE ] HHH: Full fetch complete (46205 records). [2025-10-25T22:13:48.218304] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-25T22:13:48.602309] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-25T22:13:48.602421] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-25T22:13:48.603187] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-25T22:13:48.603268] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-25T22:13:48.604248] [DEBUG] [LOCAL ] HHH: Trimmed 46205 records to 33416 (keeping 200 days of data) [2025-10-25T22:13:48.804765] [DEBUG] [LOCAL ] HHH: Primary data saved (33416 records). [2025-10-25T22:13:48.804930] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-25T22:13:48.805071] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols. HHH took 15.0s. Estimated remaining time: 4h 20m 27s [2025-10-25T22:13:48.988092] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:13:48.988286] [DEBUG] [LOCAL ] HI: No existing data file found in primary storage. [2025-10-25T22:13:48.988361] [WARN ] [MAIN ] HI: No existing data found, performing full refresh instead. [2025-10-25T22:13:48.988480] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-25T22:13:48.988555] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-25T22:13:48.988661] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-25T22:13:48.988740] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-25T22:13:49.352018] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:13:49.352375] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-25T22:13:50.610531] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T22:13:50.616892] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-25T22:13:51.931929] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-25T22:13:51.938687] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-25T22:13:53.319799] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T22:13:53.327052] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-25T22:13:54.869368] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T22:13:54.877830] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-25T22:13:56.311167] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T22:13:56.319268] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-25T22:13:57.674909] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T22:13:57.682971] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-25T22:13:59.129208] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T22:13:59.136827] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-25T22:14:00.670403] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T22:14:00.678509] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-25T22:14:02.465214] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T22:14:02.473072] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-25T22:14:04.389610] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-25T22:14:04.397229] [INFO ] [REMOTE ] HI: Full fetch complete (51475 records). [2025-10-25T22:14:04.397346] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-25T22:14:04.788494] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-25T22:14:04.788611] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-25T22:14:04.789531] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-25T22:14:04.789627] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-25T22:14:04.790774] [DEBUG] [LOCAL ] HI: Trimmed 51475 records to 36789 (keeping 200 days of data) [2025-10-25T22:14:05.017464] [DEBUG] [LOCAL ] HI: Primary data saved (36789 records). [2025-10-25T22:14:05.017680] [INFO ] [MAIN ] HI: Full history saved. [2025-10-25T22:14:05.017856] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols. HI took 16.2s. Estimated remaining time: 4h 20m 22s [2025-10-25T22:14:05.184965] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:14:05.185154] [DEBUG] [LOCAL ] HIG: No existing data file found in primary storage. [2025-10-25T22:14:05.185229] [WARN ] [MAIN ] HIG: No existing data found, performing full refresh instead. [2025-10-25T22:14:05.185349] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-25T22:14:05.185422] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-25T22:14:05.185506] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-25T22:14:05.185578] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-25T22:14:05.538857] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:14:05.539194] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-25T22:14:07.365942] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T22:14:07.376897] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-25T22:14:09.047689] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T22:14:09.058221] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-25T22:14:10.989800] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T22:14:11.000246] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-25T22:14:12.971324] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-25T22:14:12.982682] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-25T22:14:14.721217] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T22:14:14.732267] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-25T22:14:16.448382] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-25T22:14:16.458787] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-25T22:14:18.443366] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-25T22:14:18.459134] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-25T22:14:20.258488] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-25T22:14:20.269257] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-25T22:14:22.040584] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T22:14:22.052108] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-25T22:14:22.774118] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T22:14:22.783499] [INFO ] [REMOTE ] HIG: Full fetch complete (73695 records). [2025-10-25T22:14:22.783700] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-25T22:14:23.175992] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-25T22:14:23.176106] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-25T22:14:23.177126] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-25T22:14:23.177211] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-25T22:14:23.178879] [DEBUG] [LOCAL ] HIG: Trimmed 73695 records to 51830 (keeping 200 days of data) [2025-10-25T22:14:23.486230] [DEBUG] [LOCAL ] HIG: Primary data saved (51830 records). [2025-10-25T22:14:23.486394] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-25T22:14:23.486537] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols. HIG took 18.5s. Estimated remaining time: 4h 20m 19s [2025-10-25T22:14:23.652913] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:14:23.653128] [DEBUG] [LOCAL ] HII: No existing data file found in primary storage. [2025-10-25T22:14:23.653204] [WARN ] [MAIN ] HII: No existing data found, performing full refresh instead. [2025-10-25T22:14:23.653317] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-25T22:14:23.653562] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-25T22:14:23.653664] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-25T22:14:23.653741] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-25T22:14:24.008742] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:14:24.009129] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-25T22:14:25.451332] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T22:14:25.458608] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-25T22:14:27.146503] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-25T22:14:27.155292] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-25T22:14:28.978498] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T22:14:28.987891] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-25T22:14:30.823188] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T22:14:30.833018] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-25T22:14:32.444471] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T22:14:32.452552] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-25T22:14:33.971892] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T22:14:33.979621] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-25T22:14:35.141315] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T22:14:35.149269] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-25T22:14:36.730879] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T22:14:36.738844] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-25T22:14:37.038460] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-25T22:14:37.047945] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-25T22:14:37.658150] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-25T22:14:37.664487] [INFO ] [REMOTE ] HII: Full fetch complete (52230 records). [2025-10-25T22:14:37.664678] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-25T22:14:38.095910] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-25T22:14:38.096080] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-25T22:14:38.097356] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-25T22:14:38.097459] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-25T22:14:38.099384] [DEBUG] [LOCAL ] HII: Trimmed 52230 records to 33817 (keeping 200 days of data) [2025-10-25T22:14:38.328549] [DEBUG] [LOCAL ] HII: Primary data saved (33817 records). [2025-10-25T22:14:38.328828] [INFO ] [MAIN ] HII: Full history saved. [2025-10-25T22:14:38.329031] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols. HII took 14.8s. Estimated remaining time: 4h 20m 12s [2025-10-25T22:14:38.517729] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:14:38.518017] [DEBUG] [LOCAL ] HIMS: No existing data file found in primary storage. [2025-10-25T22:14:38.518090] [WARN ] [MAIN ] HIMS: No existing data found, performing full refresh instead. [2025-10-25T22:14:38.518216] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-25T22:14:38.518288] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-25T22:14:38.518368] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-25T22:14:38.518438] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-25T22:14:38.899605] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:14:38.900068] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-25T22:14:41.104666] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-25T22:14:41.116026] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-25T22:14:43.591467] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-25T22:14:43.602600] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-25T22:14:46.397165] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-25T22:14:46.409031] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-25T22:14:49.055322] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-25T22:14:49.068162] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-25T22:14:51.792001] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-25T22:14:51.803332] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-25T22:14:54.390381] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-25T22:14:54.402496] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-25T22:14:56.925806] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-25T22:14:56.938726] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-25T22:14:59.800979] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-10-25T22:14:59.813261] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-25T22:15:02.671250] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-25T22:15:02.684504] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-25T22:15:05.468383] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-25T22:15:05.479141] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-25T22:15:05.479400] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-25T22:15:05.897883] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-25T22:15:05.898074] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-25T22:15:05.900711] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-25T22:15:05.900802] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-25T22:15:05.902987] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54597 (keeping 200 days of data) [2025-10-25T22:15:06.252765] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-25T22:15:06.253095] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-25T22:15:06.253337] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols. HIMS took 27.9s. Estimated remaining time: 4h 20m 22s [2025-10-25T22:15:06.436637] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:15:06.436937] [DEBUG] [LOCAL ] HIO: No existing data file found in primary storage. [2025-10-25T22:15:06.437012] [WARN ] [MAIN ] HIO: No existing data found, performing full refresh instead. [2025-10-25T22:15:06.437139] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-25T22:15:06.437212] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-25T22:15:06.437298] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-25T22:15:06.437374] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-25T22:15:06.817295] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:15:06.817823] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-25T22:15:08.087192] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T22:15:08.097475] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-25T22:15:09.424876] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T22:15:09.431575] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-25T22:15:10.919933] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T22:15:10.928219] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-25T22:15:12.177789] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T22:15:12.185017] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-25T22:15:13.319591] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T22:15:13.324990] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-25T22:15:14.447535] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T22:15:14.454962] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-25T22:15:15.591847] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T22:15:15.597462] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-25T22:15:16.903241] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T22:15:16.909787] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-25T22:15:18.303965] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T22:15:18.311209] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-25T22:15:19.660252] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T22:15:19.671103] [INFO ] [REMOTE ] HIO: Full fetch complete (38251 records). [2025-10-25T22:15:19.671420] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-25T22:15:20.069134] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-25T22:15:20.069257] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-25T22:15:20.069987] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-25T22:15:20.070068] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-25T22:15:20.071056] [DEBUG] [LOCAL ] HIO: Trimmed 38251 records to 24328 (keeping 200 days of data) [2025-10-25T22:15:20.206053] [DEBUG] [LOCAL ] HIO: Primary data saved (24328 records). [2025-10-25T22:15:20.206227] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-25T22:15:20.206417] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols. HIO took 14.0s. Estimated remaining time: 4h 20m 13s [2025-10-25T22:15:20.372687] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:15:20.372910] [DEBUG] [LOCAL ] HIPO: No existing data file found in primary storage. [2025-10-25T22:15:20.372980] [WARN ] [MAIN ] HIPO: No existing data found, performing full refresh instead. [2025-10-25T22:15:20.373088] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-25T22:15:20.373165] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-25T22:15:20.373243] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-25T22:15:20.373308] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-25T22:15:20.726007] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:15:20.726343] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-25T22:15:21.716921] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T22:15:21.721286] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-25T22:15:22.722532] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-25T22:15:22.728783] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-25T22:15:23.888280] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-25T22:15:23.895408] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-25T22:15:24.980157] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-25T22:15:24.985505] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-25T22:15:26.077340] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T22:15:26.085395] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-25T22:15:27.189222] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T22:15:27.195874] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-25T22:15:28.292827] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T22:15:28.297901] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-25T22:15:29.373119] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T22:15:29.377943] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-25T22:15:30.123282] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T22:15:30.128233] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-25T22:15:31.161083] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T22:15:31.164374] [INFO ] [REMOTE ] HIPO: Full fetch complete (30985 records). [2025-10-25T22:15:31.164468] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-25T22:15:31.526733] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-25T22:15:31.526845] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-25T22:15:31.527447] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-25T22:15:31.527521] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-25T22:15:31.528330] [DEBUG] [LOCAL ] HIPO: Trimmed 30985 records to 21635 (keeping 200 days of data) [2025-10-25T22:15:31.647197] [DEBUG] [LOCAL ] HIPO: Primary data saved (21635 records). [2025-10-25T22:15:31.647370] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-25T22:15:31.647508] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols. HIPO took 11.4s. Estimated remaining time: 4h 20m 1s [2025-10-25T22:15:31.813751] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:15:31.813943] [DEBUG] [LOCAL ] HIW: No existing data file found in primary storage. [2025-10-25T22:15:31.814012] [WARN ] [MAIN ] HIW: No existing data found, performing full refresh instead. [2025-10-25T22:15:31.814124] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-25T22:15:31.814193] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-25T22:15:31.814271] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-25T22:15:31.814339] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-25T22:15:32.161283] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:15:32.161607] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-25T22:15:34.227600] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-25T22:15:34.236091] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-25T22:15:36.607347] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-25T22:15:36.616312] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-25T22:15:38.113049] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T22:15:38.123183] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-25T22:15:39.683863] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T22:15:39.695529] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-25T22:15:41.184620] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-25T22:15:41.194931] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-25T22:15:42.645715] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T22:15:42.654437] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-25T22:15:44.167884] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T22:15:44.177900] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-25T22:15:45.719760] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T22:15:45.729954] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-25T22:15:47.231871] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T22:15:47.241740] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-25T22:15:48.887916] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T22:15:48.896113] [INFO ] [REMOTE ] HIW: Full fetch complete (64914 records). [2025-10-25T22:15:48.896267] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-25T22:15:49.282353] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-25T22:15:49.282468] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-25T22:15:49.283359] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-25T22:15:49.283438] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-25T22:15:49.284698] [DEBUG] [LOCAL ] HIW: Trimmed 64914 records to 45049 (keeping 200 days of data) [2025-10-25T22:15:49.544615] [DEBUG] [LOCAL ] HIW: Primary data saved (45049 records). [2025-10-25T22:15:49.544789] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-25T22:15:49.544923] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols. HIW took 17.9s. Estimated remaining time: 4h 19m 58s [2025-10-25T22:15:49.710816] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:15:49.711043] [DEBUG] [LOCAL ] HIX: No existing data file found in primary storage. [2025-10-25T22:15:49.711112] [WARN ] [MAIN ] HIX: No existing data found, performing full refresh instead. [2025-10-25T22:15:49.711202] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-25T22:15:49.711272] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-25T22:15:49.711357] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-25T22:15:49.711426] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-25T22:15:50.058698] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:15:50.059027] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-25T22:15:51.254395] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-25T22:15:51.260062] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-25T22:15:52.191607] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T22:15:52.197526] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-25T22:15:53.333436] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T22:15:53.339400] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-25T22:15:54.545443] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-25T22:15:54.550971] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-25T22:15:55.637880] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T22:15:55.642842] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-25T22:15:56.616970] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T22:15:56.621176] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-25T22:15:57.720346] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T22:15:57.725873] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-25T22:15:58.760189] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T22:15:58.765229] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-25T22:15:59.862562] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T22:15:59.867330] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-25T22:16:01.061624] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T22:16:01.066848] [INFO ] [REMOTE ] HIX: Full fetch complete (30074 records). [2025-10-25T22:16:01.067065] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-25T22:16:01.456874] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-25T22:16:01.457023] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-25T22:16:01.457767] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-25T22:16:01.457850] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-25T22:16:01.458731] [DEBUG] [LOCAL ] HIX: Trimmed 30074 records to 20759 (keeping 200 days of data) [2025-10-25T22:16:01.574495] [DEBUG] [LOCAL ] HIX: Primary data saved (20759 records). [2025-10-25T22:16:01.574691] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-25T22:16:01.574829] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols. HIX took 12.0s. Estimated remaining time: 4h 19m 47s [2025-10-25T22:16:01.749154] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:16:01.749378] [DEBUG] [LOCAL ] HKD: No existing data file found in primary storage. [2025-10-25T22:16:01.749454] [WARN ] [MAIN ] HKD: No existing data found, performing full refresh instead. [2025-10-25T22:16:01.749571] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-25T22:16:01.749664] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-25T22:16:01.749772] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-25T22:16:01.749858] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-25T22:16:02.139771] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:16:02.140175] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-25T22:16:03.245964] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T22:16:03.250812] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-25T22:16:04.368566] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T22:16:04.376594] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-25T22:16:05.505215] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-25T22:16:05.511280] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-25T22:16:06.572968] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T22:16:06.576996] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-25T22:16:07.589544] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T22:16:07.593257] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-25T22:16:08.986267] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T22:16:08.992059] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-25T22:16:10.113826] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T22:16:10.119142] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-25T22:16:11.147214] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T22:16:11.151177] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-25T22:16:12.376354] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T22:16:12.382181] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-25T22:16:13.650826] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T22:16:13.654877] [INFO ] [REMOTE ] HKD: Full fetch complete (27819 records). [2025-10-25T22:16:13.654981] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-25T22:16:14.030737] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-25T22:16:14.030869] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-25T22:16:14.031556] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-25T22:16:14.031671] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-25T22:16:14.032543] [DEBUG] [LOCAL ] HKD: Trimmed 27819 records to 18983 (keeping 200 days of data) [2025-10-25T22:16:14.136597] [DEBUG] [LOCAL ] HKD: Primary data saved (18983 records). [2025-10-25T22:16:14.136929] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-25T22:16:14.137072] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols. HKD took 12.6s. Estimated remaining time: 4h 19m 37s [2025-10-25T22:16:14.312495] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:16:14.312727] [DEBUG] [LOCAL ] HL: No existing data file found in primary storage. [2025-10-25T22:16:14.312801] [WARN ] [MAIN ] HL: No existing data found, performing full refresh instead. [2025-10-25T22:16:14.312916] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-25T22:16:14.312989] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-25T22:16:14.313071] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-25T22:16:14.313121] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-25T22:16:14.670387] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:16:14.670759] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-25T22:16:16.415364] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T22:16:16.426043] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-25T22:16:18.426596] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T22:16:18.437167] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-25T22:16:20.552496] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-25T22:16:20.563571] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-25T22:16:22.544191] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-25T22:16:22.556343] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-25T22:16:24.635391] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-25T22:16:24.647879] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-25T22:16:26.637043] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-25T22:16:26.649148] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-25T22:16:28.794733] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-25T22:16:28.807981] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-25T22:16:30.626537] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-25T22:16:30.639390] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-25T22:16:32.747950] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-25T22:16:32.760680] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-25T22:16:34.855520] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-25T22:16:34.871447] [INFO ] [REMOTE ] HL: Full fetch complete (77827 records). [2025-10-25T22:16:34.871725] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-25T22:16:35.306884] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-25T22:16:35.307055] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-25T22:16:35.309506] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-25T22:16:35.309777] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-25T22:16:35.313223] [DEBUG] [LOCAL ] HL: Trimmed 77827 records to 54456 (keeping 200 days of data) [2025-10-25T22:16:35.652150] [DEBUG] [LOCAL ] HL: Primary data saved (54456 records). [2025-10-25T22:16:35.652435] [INFO ] [MAIN ] HL: Full history saved. [2025-10-25T22:16:35.652630] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols. HL took 21.5s. Estimated remaining time: 4h 19m 38s [2025-10-25T22:16:35.840008] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:16:35.840277] [DEBUG] [LOCAL ] HLF: No existing data file found in primary storage. [2025-10-25T22:16:35.840350] [WARN ] [MAIN ] HLF: No existing data found, performing full refresh instead. [2025-10-25T22:16:35.840478] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-25T22:16:35.840550] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-25T22:16:35.840634] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-25T22:16:35.840732] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-25T22:16:36.224126] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:16:36.224556] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-25T22:16:37.884625] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T22:16:37.894557] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-25T22:16:39.660210] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-25T22:16:39.670006] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-25T22:16:41.397684] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T22:16:41.410204] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-25T22:16:42.998697] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T22:16:43.009450] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-25T22:16:44.831959] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T22:16:44.842335] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-25T22:16:46.503331] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T22:16:46.514250] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-25T22:16:48.300171] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-25T22:16:48.311015] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-25T22:16:49.781981] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T22:16:49.794449] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-25T22:16:51.249483] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T22:16:51.259686] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-25T22:16:53.019811] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-25T22:16:53.028201] [INFO ] [REMOTE ] HLF: Full fetch complete (70748 records). [2025-10-25T22:16:53.028343] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-25T22:16:53.411927] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-25T22:16:53.412038] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-25T22:16:53.412964] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-25T22:16:53.413043] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-25T22:16:53.414347] [DEBUG] [LOCAL ] HLF: Trimmed 70748 records to 49053 (keeping 200 days of data) [2025-10-25T22:16:53.679233] [DEBUG] [LOCAL ] HLF: Primary data saved (49053 records). [2025-10-25T22:16:53.679407] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-25T22:16:53.679549] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols. HLF took 18.0s. Estimated remaining time: 4h 19m 35s [2025-10-25T22:16:53.846867] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:16:53.847110] [DEBUG] [LOCAL ] HLI: No existing data file found in primary storage. [2025-10-25T22:16:53.847220] [WARN ] [MAIN ] HLI: No existing data found, performing full refresh instead. [2025-10-25T22:16:53.847332] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-25T22:16:53.847400] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-25T22:16:53.847479] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-25T22:16:53.847552] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-25T22:16:54.195610] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:16:54.195971] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-25T22:16:55.647386] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T22:16:55.654339] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-25T22:16:56.834636] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-25T22:16:56.840462] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-25T22:16:58.261440] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T22:16:58.268602] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-25T22:16:59.735896] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T22:16:59.743457] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-25T22:17:01.434446] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T22:17:01.442083] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-25T22:17:03.022531] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T22:17:03.030261] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-25T22:17:04.389125] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T22:17:04.396883] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-25T22:17:05.852909] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T22:17:05.859759] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-25T22:17:07.114131] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-25T22:17:07.120766] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-25T22:17:08.336605] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T22:17:08.342443] [INFO ] [REMOTE ] HLI: Full fetch complete (45483 records). [2025-10-25T22:17:08.342549] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-25T22:17:08.728009] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-25T22:17:08.728143] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-25T22:17:08.728988] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-25T22:17:08.729075] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-25T22:17:08.730208] [DEBUG] [LOCAL ] HLI: Trimmed 45483 records to 31042 (keeping 200 days of data) [2025-10-25T22:17:08.942426] [DEBUG] [LOCAL ] HLI: Primary data saved (31042 records). [2025-10-25T22:17:08.942612] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-25T22:17:08.942783] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols. HLI took 15.3s. Estimated remaining time: 4h 19m 28s [2025-10-25T22:17:09.111454] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:17:09.111634] [DEBUG] [LOCAL ] HLIO: No existing data file found in primary storage. [2025-10-25T22:17:09.111719] [WARN ] [MAIN ] HLIO: No existing data found, performing full refresh instead. [2025-10-25T22:17:09.111801] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-25T22:17:09.111885] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-25T22:17:09.111968] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-25T22:17:09.112039] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-25T22:17:09.462597] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:17:09.462965] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-25T22:17:10.430537] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T22:17:10.434781] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-25T22:17:11.377413] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-25T22:17:11.381233] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-25T22:17:12.478165] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T22:17:12.483815] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-25T22:17:13.720506] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T22:17:13.726484] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-25T22:17:15.068098] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T22:17:15.076980] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-25T22:17:16.436811] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T22:17:16.443472] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-25T22:17:17.841274] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-25T22:17:17.848508] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-25T22:17:19.121893] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T22:17:19.128511] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-25T22:17:20.170020] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T22:17:20.177608] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-25T22:17:21.325154] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T22:17:21.330794] [INFO ] [REMOTE ] HLIO: Full fetch complete (37200 records). [2025-10-25T22:17:21.330990] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-25T22:17:21.737436] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-25T22:17:21.737601] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-25T22:17:21.738517] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-25T22:17:21.738623] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-25T22:17:21.740027] [DEBUG] [LOCAL ] HLIO: Trimmed 37200 records to 28394 (keeping 200 days of data) [2025-10-25T22:17:21.907461] [DEBUG] [LOCAL ] HLIO: Primary data saved (28394 records). [2025-10-25T22:17:21.907627] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-25T22:17:21.907813] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols. HLIO took 13.0s. Estimated remaining time: 4h 19m 18s [2025-10-25T22:17:22.072998] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:17:22.073216] [DEBUG] [LOCAL ] HLLY: No existing data file found in primary storage. [2025-10-25T22:17:22.073287] [WARN ] [MAIN ] HLLY: No existing data found, performing full refresh instead. [2025-10-25T22:17:22.073374] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-25T22:17:22.073440] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-25T22:17:22.073498] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-25T22:17:22.073535] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-25T22:17:22.423226] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:17:22.423688] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-25T22:17:23.579181] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-25T22:17:23.585130] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-25T22:17:24.739255] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T22:17:24.744526] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-25T22:17:26.010254] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T22:17:26.017980] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-25T22:17:27.396933] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T22:17:27.404480] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-25T22:17:28.851045] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T22:17:28.858311] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-25T22:17:29.600952] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T22:17:29.606941] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-25T22:17:30.885482] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T22:17:30.896169] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-25T22:17:32.380607] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T22:17:32.389409] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-25T22:17:33.703526] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T22:17:33.711759] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-25T22:17:34.918386] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-25T22:17:34.924356] [INFO ] [REMOTE ] HLLY: Full fetch complete (46071 records). [2025-10-25T22:17:34.924488] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-25T22:17:35.303219] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-25T22:17:35.303354] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-25T22:17:35.304171] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-25T22:17:35.304258] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-25T22:17:35.305400] [DEBUG] [LOCAL ] HLLY: Trimmed 46071 records to 33731 (keeping 200 days of data) [2025-10-25T22:17:35.485607] [DEBUG] [LOCAL ] HLLY: Primary data saved (33731 records). [2025-10-25T22:17:35.485812] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-25T22:17:35.485954] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols. HLLY took 13.6s. Estimated remaining time: 4h 19m 9s [2025-10-25T22:17:35.654524] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:17:35.654747] [DEBUG] [LOCAL ] HLN: No existing data file found in primary storage. [2025-10-25T22:17:35.654819] [WARN ] [MAIN ] HLN: No existing data found, performing full refresh instead. [2025-10-25T22:17:35.654943] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-25T22:17:35.655013] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-25T22:17:35.655092] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-25T22:17:35.655161] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-25T22:17:36.003916] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:17:36.004305] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-25T22:17:37.699517] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T22:17:37.709846] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-25T22:17:39.250836] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:17:39.261195] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-25T22:17:41.190239] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T22:17:41.202884] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-25T22:17:42.954869] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T22:17:42.966049] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-25T22:17:44.740147] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-25T22:17:44.751455] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-25T22:17:46.318578] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T22:17:46.329397] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-25T22:17:47.960166] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T22:17:47.971617] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-25T22:17:49.591230] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T22:17:49.602194] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-25T22:17:51.498720] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-25T22:17:51.510162] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-25T22:17:53.711852] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-25T22:17:53.721789] [INFO ] [REMOTE ] HLN: Full fetch complete (77035 records). [2025-10-25T22:17:53.722014] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-25T22:17:54.120957] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-25T22:17:54.121086] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-25T22:17:54.122181] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-25T22:17:54.122267] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-25T22:17:54.123790] [DEBUG] [LOCAL ] HLN: Trimmed 77035 records to 53891 (keeping 200 days of data) [2025-10-25T22:17:54.461251] [DEBUG] [LOCAL ] HLN: Primary data saved (53891 records). [2025-10-25T22:17:54.461435] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-25T22:17:54.461580] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols. HLN took 19.0s. Estimated remaining time: 4h 19m 7s [2025-10-25T22:17:54.629437] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:17:54.629634] [DEBUG] [LOCAL ] HLT: No existing data file found in primary storage. [2025-10-25T22:17:54.629720] [WARN ] [MAIN ] HLT: No existing data found, performing full refresh instead. [2025-10-25T22:17:54.629830] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-25T22:17:54.629922] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-25T22:17:54.630003] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-25T22:17:54.630071] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-25T22:17:54.986049] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:17:54.986423] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-25T22:17:56.834038] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-25T22:17:56.844151] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-25T22:17:58.125372] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-25T22:17:58.136177] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-25T22:17:59.935862] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T22:17:59.946883] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-25T22:18:02.019787] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-25T22:18:02.030801] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-25T22:18:03.790999] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T22:18:03.803235] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-25T22:18:05.186222] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T22:18:05.196425] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-25T22:18:07.060813] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T22:18:07.073332] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-25T22:18:08.803431] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-25T22:18:08.814200] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-25T22:18:10.542235] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-25T22:18:10.552962] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-25T22:18:11.273627] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T22:18:11.283538] [INFO ] [REMOTE ] HLT: Full fetch complete (73656 records). [2025-10-25T22:18:11.283747] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-25T22:18:11.684518] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-25T22:18:11.684677] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-25T22:18:11.685691] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-25T22:18:11.685779] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-25T22:18:11.687236] [DEBUG] [LOCAL ] HLT: Trimmed 73656 records to 51202 (keeping 200 days of data) [2025-10-25T22:18:11.997130] [DEBUG] [LOCAL ] HLT: Primary data saved (51202 records). [2025-10-25T22:18:11.997317] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-25T22:18:11.997463] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols. HLT took 17.5s. Estimated remaining time: 4h 19m 3s [2025-10-25T22:18:12.171486] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:18:12.171738] [DEBUG] [LOCAL ] HLX: No existing data file found in primary storage. [2025-10-25T22:18:12.171808] [WARN ] [MAIN ] HLX: No existing data found, performing full refresh instead. [2025-10-25T22:18:12.171921] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-25T22:18:12.171990] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-25T22:18:12.172069] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-25T22:18:12.172136] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-25T22:18:12.527882] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:18:12.528253] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-25T22:18:14.245356] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T22:18:14.254949] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-25T22:18:15.929986] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T22:18:15.938911] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-25T22:18:17.355919] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T22:18:17.367165] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-25T22:18:19.016959] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T22:18:19.032910] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-25T22:18:20.734996] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T22:18:20.745280] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-25T22:18:22.322494] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T22:18:22.332019] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-25T22:18:23.926538] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T22:18:23.937606] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-25T22:18:25.636620] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T22:18:25.647063] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-25T22:18:27.255859] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T22:18:27.265442] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-25T22:18:28.831514] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T22:18:28.840051] [INFO ] [REMOTE ] HLX: Full fetch complete (69000 records). [2025-10-25T22:18:28.840239] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-25T22:18:29.239518] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-25T22:18:29.239685] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-25T22:18:29.240713] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-25T22:18:29.240806] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-25T22:18:29.242280] [DEBUG] [LOCAL ] HLX: Trimmed 69000 records to 48034 (keeping 200 days of data) [2025-10-25T22:18:29.505411] [DEBUG] [LOCAL ] HLX: Primary data saved (48034 records). [2025-10-25T22:18:29.505574] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-25T22:18:29.505784] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols. HLX took 17.5s. Estimated remaining time: 4h 18m 58s [2025-10-25T22:18:29.672809] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:18:29.673027] [DEBUG] [LOCAL ] HMC: No existing data file found in primary storage. [2025-10-25T22:18:29.673100] [WARN ] [MAIN ] HMC: No existing data found, performing full refresh instead. [2025-10-25T22:18:29.673188] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-25T22:18:29.673255] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-25T22:18:29.673315] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-25T22:18:29.673381] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-25T22:18:30.029555] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:18:30.029936] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-25T22:18:31.775558] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T22:18:31.786036] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-25T22:18:33.457199] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T22:18:33.466599] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-25T22:18:35.285789] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T22:18:35.296003] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-25T22:18:37.132939] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T22:18:37.143049] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-25T22:18:38.705386] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T22:18:38.714921] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-25T22:18:40.319431] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T22:18:40.330151] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-25T22:18:42.163815] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T22:18:42.174443] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-25T22:18:43.700637] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T22:18:43.711003] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-25T22:18:45.394512] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-25T22:18:45.404390] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-25T22:18:46.981025] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T22:18:46.990290] [INFO ] [REMOTE ] HMC: Full fetch complete (68484 records). [2025-10-25T22:18:46.990595] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-25T22:18:47.381600] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-25T22:18:47.381731] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-25T22:18:47.382726] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-25T22:18:47.382806] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-25T22:18:47.384122] [DEBUG] [LOCAL ] HMC: Trimmed 68484 records to 46860 (keeping 200 days of data) [2025-10-25T22:18:47.659064] [DEBUG] [LOCAL ] HMC: Primary data saved (46860 records). [2025-10-25T22:18:47.659266] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-25T22:18:47.659417] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols. HMC took 18.2s. Estimated remaining time: 4h 18m 55s [2025-10-25T22:18:47.824437] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:18:47.824627] [DEBUG] [LOCAL ] HMN: No existing data file found in primary storage. [2025-10-25T22:18:47.824723] [WARN ] [MAIN ] HMN: No existing data found, performing full refresh instead. [2025-10-25T22:18:47.824842] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-25T22:18:47.824912] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-25T22:18:47.824993] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-25T22:18:47.825061] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-25T22:18:48.193865] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:18:48.194192] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-25T22:18:49.180943] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T22:18:49.184683] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-25T22:18:50.172095] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-25T22:18:50.176841] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-25T22:18:51.134695] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T22:18:51.139063] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-25T22:18:52.035725] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-25T22:18:52.042118] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-25T22:18:53.276396] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T22:18:53.282887] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-25T22:18:54.459479] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T22:18:54.464693] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-25T22:18:55.689477] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T22:18:55.695663] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-25T22:18:56.790282] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T22:18:56.795237] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-25T22:18:57.837998] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T22:18:57.844729] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-25T22:18:58.849066] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-25T22:18:58.853077] [INFO ] [REMOTE ] HMN: Full fetch complete (31616 records). [2025-10-25T22:18:58.853192] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-25T22:18:59.290715] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-25T22:18:59.290915] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-25T22:18:59.293136] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-25T22:18:59.293288] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-25T22:18:59.295030] [DEBUG] [LOCAL ] HMN: Trimmed 31616 records to 23520 (keeping 200 days of data) [2025-10-25T22:18:59.502681] [DEBUG] [LOCAL ] HMN: Primary data saved (23520 records). [2025-10-25T22:18:59.502905] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-25T22:18:59.503113] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols. HMN took 11.8s. Estimated remaining time: 4h 18m 44s [2025-10-25T22:18:59.745328] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:18:59.745630] [DEBUG] [LOCAL ] HMY: No existing data file found in primary storage. [2025-10-25T22:18:59.745737] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-10-25T22:18:59.745862] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-25T22:18:59.745953] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-25T22:18:59.746057] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-25T22:18:59.746162] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-25T22:19:00.240253] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:19:00.240620] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-25T22:19:02.074187] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T22:19:02.084975] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-25T22:19:04.106516] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-25T22:19:04.116482] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-25T22:19:06.343883] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-25T22:19:06.355329] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-25T22:19:08.498309] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-25T22:19:08.509557] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-25T22:19:10.260735] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-25T22:19:10.272354] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-25T22:19:12.328748] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-25T22:19:12.339532] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-25T22:19:14.266316] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-25T22:19:14.278023] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-25T22:19:16.415374] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-25T22:19:16.426508] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-25T22:19:18.660421] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-25T22:19:18.672457] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-25T22:19:20.586460] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-25T22:19:20.596311] [INFO ] [REMOTE ] HMY: Full fetch complete (77158 records). [2025-10-25T22:19:20.596504] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-25T22:19:21.064810] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-25T22:19:21.064936] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-25T22:19:21.065959] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-25T22:19:21.066043] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-25T22:19:21.067489] [DEBUG] [LOCAL ] HMY: Trimmed 77158 records to 53946 (keeping 200 days of data) [2025-10-25T22:19:21.382765] [DEBUG] [LOCAL ] HMY: Primary data saved (53946 records). [2025-10-25T22:19:21.382924] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-25T22:19:21.383065] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols. HMY took 21.9s. Estimated remaining time: 4h 18m 45s [2025-10-25T22:19:21.550002] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:19:21.550191] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-25T22:19:21.550264] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-25T22:19:21.550378] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-25T22:19:21.550450] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-25T22:19:21.550533] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-25T22:19:21.550618] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-25T22:19:21.903574] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:19:21.904008] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-25T22:19:22.119456] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T22:19:22.119771] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-25T22:19:22.119863] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T22:19:22.119934] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-25T22:19:22.119981] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T22:19:22.120045] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-25T22:19:22.120140] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-25T22:19:22.120210] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-25T22:19:22.120289] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-25T22:19:22.120407] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols. HNGE took 0.7s. Estimated remaining time: 4h 18m 20s [2025-10-25T22:19:22.289607] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:19:22.289823] [DEBUG] [LOCAL ] HNI: No existing data file found in primary storage. [2025-10-25T22:19:22.289893] [WARN ] [MAIN ] HNI: No existing data found, performing full refresh instead. [2025-10-25T22:19:22.290006] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-25T22:19:22.290076] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-25T22:19:22.290202] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-25T22:19:22.290273] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-25T22:19:22.649951] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:19:22.650330] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-25T22:19:23.688768] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-25T22:19:23.694129] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-25T22:19:24.900877] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T22:19:24.906600] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-25T22:19:26.240822] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-25T22:19:26.247548] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-25T22:19:27.432054] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T22:19:27.437930] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-25T22:19:28.605509] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T22:19:28.611354] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-25T22:19:29.765773] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T22:19:29.771296] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-25T22:19:30.859296] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T22:19:30.864761] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-25T22:19:32.410733] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T22:19:32.419462] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-25T22:19:33.593071] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T22:19:33.601290] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-25T22:19:34.951469] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T22:19:34.957623] [INFO ] [REMOTE ] HNI: Full fetch complete (42230 records). [2025-10-25T22:19:34.957803] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-25T22:19:35.375752] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-25T22:19:35.375871] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-25T22:19:35.376670] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-25T22:19:35.376751] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-25T22:19:35.377783] [DEBUG] [LOCAL ] HNI: Trimmed 42230 records to 30187 (keeping 200 days of data) [2025-10-25T22:19:35.556074] [DEBUG] [LOCAL ] HNI: Primary data saved (30187 records). [2025-10-25T22:19:35.556255] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-25T22:19:35.556400] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols. HNI took 13.4s. Estimated remaining time: 4h 18m 10s [2025-10-25T22:19:35.721246] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:19:35.721448] [DEBUG] [LOCAL ] HOG: No existing data file found in primary storage. [2025-10-25T22:19:35.721519] [WARN ] [MAIN ] HOG: No existing data found, performing full refresh instead. [2025-10-25T22:19:35.721632] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-25T22:19:35.721725] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-25T22:19:35.721807] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-25T22:19:35.721877] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-25T22:19:36.066211] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:19:36.066585] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-25T22:19:37.762963] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T22:19:37.773448] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-25T22:19:39.375418] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T22:19:39.385709] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-25T22:19:41.168530] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T22:19:41.179675] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-25T22:19:42.958199] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T22:19:42.969443] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-25T22:19:44.926450] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-25T22:19:44.937402] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-25T22:19:46.516378] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T22:19:46.526732] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-25T22:19:48.607178] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-25T22:19:48.618049] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-25T22:19:50.028617] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T22:19:50.039485] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-25T22:19:51.863665] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T22:19:51.874732] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-25T22:19:53.585301] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-25T22:19:53.594947] [INFO ] [REMOTE ] HOG: Full fetch complete (74235 records). [2025-10-25T22:19:53.595182] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-25T22:19:53.990555] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-25T22:19:53.990732] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-25T22:19:53.992014] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-25T22:19:53.992099] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-25T22:19:53.994256] [DEBUG] [LOCAL ] HOG: Trimmed 74235 records to 51314 (keeping 200 days of data) [2025-10-25T22:19:54.301717] [DEBUG] [LOCAL ] HOG: Primary data saved (51314 records). [2025-10-25T22:19:54.301909] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-25T22:19:54.302062] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols. HOG took 18.7s. Estimated remaining time: 4h 18m 7s [2025-10-25T22:19:54.477107] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:19:54.477336] [DEBUG] [LOCAL ] HOMB: No existing data file found in primary storage. [2025-10-25T22:19:54.477409] [WARN ] [MAIN ] HOMB: No existing data found, performing full refresh instead. [2025-10-25T22:19:54.477522] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-25T22:19:54.477593] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-25T22:19:54.477694] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-25T22:19:54.477783] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-25T22:19:54.841313] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:19:54.841666] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-25T22:19:56.375591] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T22:19:56.385752] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-25T22:19:57.853982] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T22:19:57.866451] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-25T22:19:59.495334] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T22:19:59.505018] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-25T22:20:01.339500] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T22:20:01.349972] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-25T22:20:03.018405] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T22:20:03.026749] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-25T22:20:04.748472] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-25T22:20:04.757973] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-25T22:20:06.407262] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T22:20:06.418507] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-25T22:20:07.929437] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T22:20:07.938866] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-25T22:20:09.456415] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T22:20:09.466087] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-25T22:20:11.040137] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T22:20:11.048752] [INFO ] [REMOTE ] HOMB: Full fetch complete (64493 records). [2025-10-25T22:20:11.048895] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-25T22:20:11.433532] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-25T22:20:11.433691] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-25T22:20:11.434571] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-25T22:20:11.434667] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-25T22:20:11.435941] [DEBUG] [LOCAL ] HOMB: Trimmed 64493 records to 44356 (keeping 200 days of data) [2025-10-25T22:20:11.693836] [DEBUG] [LOCAL ] HOMB: Primary data saved (44356 records). [2025-10-25T22:20:11.694023] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-25T22:20:11.694171] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols. HOMB took 17.4s. Estimated remaining time: 4h 18m 3s [2025-10-25T22:20:11.860626] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:20:11.860853] [DEBUG] [LOCAL ] HOUS: No existing data file found in primary storage. [2025-10-25T22:20:11.860925] [WARN ] [MAIN ] HOUS: No existing data found, performing full refresh instead. [2025-10-25T22:20:11.861034] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-25T22:20:11.861105] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-25T22:20:11.861184] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-25T22:20:11.861254] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-25T22:20:12.207225] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:20:12.207550] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-25T22:20:13.798985] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T22:20:13.807556] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-25T22:20:15.291957] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T22:20:15.300045] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-25T22:20:16.854714] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T22:20:16.864219] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-25T22:20:18.419410] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T22:20:18.429793] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-25T22:20:19.863599] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T22:20:19.872836] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-25T22:20:21.395171] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T22:20:21.404264] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-25T22:20:22.966364] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-25T22:20:22.978576] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-25T22:20:24.426193] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T22:20:24.436026] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-25T22:20:26.109832] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T22:20:26.120874] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-25T22:20:27.769615] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-25T22:20:27.778972] [INFO ] [REMOTE ] HOUS: Full fetch complete (64803 records). [2025-10-25T22:20:27.779110] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-25T22:20:28.163997] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-25T22:20:28.164107] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-25T22:20:28.164989] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-25T22:20:28.165068] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-25T22:20:28.166302] [DEBUG] [LOCAL ] HOUS: Trimmed 64803 records to 46499 (keeping 200 days of data) [2025-10-25T22:20:28.414037] [DEBUG] [LOCAL ] HOUS: Primary data saved (46499 records). [2025-10-25T22:20:28.414185] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-25T22:20:28.414324] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols. HOUS took 16.7s. Estimated remaining time: 4h 17m 58s [2025-10-25T22:20:28.580069] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:20:28.580240] [DEBUG] [LOCAL ] HOV: No existing data file found in primary storage. [2025-10-25T22:20:28.580308] [WARN ] [MAIN ] HOV: No existing data found, performing full refresh instead. [2025-10-25T22:20:28.580415] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-25T22:20:28.580493] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-25T22:20:28.580576] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-25T22:20:28.580661] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-25T22:20:28.938584] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:20:28.939091] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-25T22:20:29.872758] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T22:20:29.875539] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-25T22:20:30.670529] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T22:20:30.673333] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-25T22:20:31.638576] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T22:20:31.642211] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-25T22:20:33.147201] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T22:20:33.150508] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-25T22:20:33.937741] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T22:20:33.940465] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-25T22:20:34.918455] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T22:20:34.922623] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-25T22:20:35.903135] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-25T22:20:35.907276] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-25T22:20:36.823237] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T22:20:36.827175] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-25T22:20:37.786229] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T22:20:37.791619] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-25T22:20:38.601369] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T22:20:38.603878] [INFO ] [REMOTE ] HOV: Full fetch complete (18887 records). [2025-10-25T22:20:38.603993] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-25T22:20:38.998373] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-25T22:20:38.998512] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-25T22:20:38.999012] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-25T22:20:38.999094] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-25T22:20:38.999752] [DEBUG] [LOCAL ] HOV: Trimmed 18887 records to 13910 (keeping 200 days of data) [2025-10-25T22:20:39.085139] [DEBUG] [LOCAL ] HOV: Primary data saved (13910 records). [2025-10-25T22:20:39.085326] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-25T22:20:39.085474] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols. HOV took 10.7s. Estimated remaining time: 4h 17m 45s [2025-10-25T22:20:39.264256] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:20:39.264464] [DEBUG] [LOCAL ] HP: No existing data file found in primary storage. [2025-10-25T22:20:39.264539] [WARN ] [MAIN ] HP: No existing data found, performing full refresh instead. [2025-10-25T22:20:39.264630] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-25T22:20:39.264725] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-25T22:20:39.264787] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-25T22:20:39.264852] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-25T22:20:39.646825] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:20:39.647203] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-25T22:20:41.155222] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T22:20:41.164472] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-25T22:20:42.700257] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:20:42.709964] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-25T22:20:44.376757] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T22:20:44.387173] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-25T22:20:46.054906] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T22:20:46.065867] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-25T22:20:47.716368] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T22:20:47.727500] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-25T22:20:49.369382] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T22:20:49.379937] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-25T22:20:51.058777] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T22:20:51.070093] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-25T22:20:52.731409] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T22:20:52.742491] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-25T22:20:54.371826] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T22:20:54.383050] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-25T22:20:55.880825] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T22:20:55.889856] [INFO ] [REMOTE ] HP: Full fetch complete (74189 records). [2025-10-25T22:20:55.890005] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-25T22:20:56.303244] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-25T22:20:56.303379] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-25T22:20:56.304958] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-25T22:20:56.305061] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-25T22:20:56.306553] [DEBUG] [LOCAL ] HP: Trimmed 74189 records to 52118 (keeping 200 days of data) [2025-10-25T22:20:56.626445] [DEBUG] [LOCAL ] HP: Primary data saved (52118 records). [2025-10-25T22:20:56.626674] [INFO ] [MAIN ] HP: Full history saved. [2025-10-25T22:20:56.626825] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols. HP took 17.5s. Estimated remaining time: 4h 17m 41s [2025-10-25T22:20:56.856370] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:20:56.856589] [DEBUG] [LOCAL ] HPE: No existing data file found in primary storage. [2025-10-25T22:20:56.856636] [WARN ] [MAIN ] HPE: No existing data found, performing full refresh instead. [2025-10-25T22:20:56.856771] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-25T22:20:56.856816] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-25T22:20:56.856866] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-25T22:20:56.856936] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-25T22:20:57.322040] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:20:57.322481] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-25T22:20:59.097207] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T22:20:59.107840] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-25T22:21:01.108053] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T22:21:01.119516] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-25T22:21:03.832999] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-25T22:21:03.844307] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-25T22:21:06.105515] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-25T22:21:06.116895] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-25T22:21:07.932057] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T22:21:07.943378] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-25T22:21:09.713233] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-25T22:21:09.724172] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-25T22:21:11.963034] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-25T22:21:11.975663] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-25T22:21:14.143872] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-25T22:21:14.156330] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-25T22:21:16.406358] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-25T22:21:16.419084] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-25T22:21:17.190005] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T22:21:17.201816] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-25T22:21:17.202109] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-25T22:21:17.610092] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-25T22:21:17.610224] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-25T22:21:17.611282] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-25T22:21:17.611365] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-25T22:21:17.612879] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 54477 (keeping 200 days of data) [2025-10-25T22:21:17.943132] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-25T22:21:17.943319] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-25T22:21:17.943469] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols. HPE took 21.3s. Estimated remaining time: 4h 17m 41s [2025-10-25T22:21:18.108336] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:21:18.108497] [DEBUG] [LOCAL ] HPF: No existing data file found in primary storage. [2025-10-25T22:21:18.108572] [WARN ] [MAIN ] HPF: No existing data found, performing full refresh instead. [2025-10-25T22:21:18.108707] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-25T22:21:18.108779] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-25T22:21:18.108844] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-25T22:21:18.108909] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-25T22:21:18.455619] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:21:18.455938] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-25T22:21:19.236198] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T22:21:19.238704] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-25T22:21:19.924579] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-25T22:21:19.926862] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-25T22:21:20.567210] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-25T22:21:20.569445] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-25T22:21:21.065544] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-25T22:21:21.067849] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-25T22:21:21.852963] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T22:21:21.855372] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-25T22:21:22.609200] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T22:21:22.611609] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-25T22:21:23.197377] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-25T22:21:23.200336] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-25T22:21:23.758228] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-25T22:21:23.761065] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-25T22:21:24.521669] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T22:21:24.524580] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-25T22:21:25.157581] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-25T22:21:25.159338] [INFO ] [REMOTE ] HPF: Full fetch complete (10477 records). [2025-10-25T22:21:25.159432] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-25T22:21:25.557045] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-25T22:21:25.557198] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-25T22:21:25.557587] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-25T22:21:25.557694] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-25T22:21:25.558205] [DEBUG] [LOCAL ] HPF: Trimmed 10477 records to 7554 (keeping 200 days of data) [2025-10-25T22:21:25.608123] [DEBUG] [LOCAL ] HPF: Primary data saved (7554 records). [2025-10-25T22:21:25.608311] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-25T22:21:25.608494] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols. HPF took 7.7s. Estimated remaining time: 4h 17m 24s [2025-10-25T22:21:25.782061] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:21:25.782274] [DEBUG] [LOCAL ] HPI: No existing data file found in primary storage. [2025-10-25T22:21:25.782347] [WARN ] [MAIN ] HPI: No existing data found, performing full refresh instead. [2025-10-25T22:21:25.782464] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-25T22:21:25.782536] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-25T22:21:25.782619] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-25T22:21:25.782711] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-25T22:21:26.133099] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:21:26.133481] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-25T22:21:26.857224] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T22:21:26.859450] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-25T22:21:27.324878] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T22:21:27.327037] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-25T22:21:28.128534] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T22:21:28.131908] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-25T22:21:28.946841] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T22:21:28.949738] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-25T22:21:29.726538] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-25T22:21:29.728966] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-25T22:21:30.481742] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T22:21:30.484080] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-25T22:21:31.319843] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T22:21:31.323571] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-25T22:21:32.246743] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T22:21:32.250071] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-25T22:21:33.201963] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T22:21:33.206121] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-25T22:21:34.009812] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T22:21:34.012123] [INFO ] [REMOTE ] HPI: Full fetch complete (13849 records). [2025-10-25T22:21:34.012213] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-25T22:21:34.391389] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-25T22:21:34.391503] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-25T22:21:34.391888] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-25T22:21:34.391968] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-25T22:21:34.392493] [DEBUG] [LOCAL ] HPI: Trimmed 13849 records to 10818 (keeping 200 days of data) [2025-10-25T22:21:34.456983] [DEBUG] [LOCAL ] HPI: Primary data saved (10818 records). [2025-10-25T22:21:34.457128] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-25T22:21:34.457265] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols. HPI took 8.8s. Estimated remaining time: 4h 17m 9s [2025-10-25T22:21:34.631384] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:21:34.631568] [DEBUG] [LOCAL ] HPP: No existing data file found in primary storage. [2025-10-25T22:21:34.631638] [WARN ] [MAIN ] HPP: No existing data found, performing full refresh instead. [2025-10-25T22:21:34.631763] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-25T22:21:34.631838] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-25T22:21:34.631902] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-25T22:21:34.631971] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-25T22:21:35.007220] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:21:35.007584] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-25T22:21:36.691419] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T22:21:36.701417] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-25T22:21:38.267492] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T22:21:38.276615] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-25T22:21:39.850005] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T22:21:39.860350] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-25T22:21:41.549593] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-25T22:21:41.560965] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-25T22:21:43.108448] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-25T22:21:43.118795] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-25T22:21:44.886224] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-25T22:21:44.896945] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-25T22:21:46.566355] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-25T22:21:46.577438] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-25T22:21:48.260913] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T22:21:48.272055] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-25T22:21:49.859724] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T22:21:49.870964] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-25T22:21:51.547923] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T22:21:51.557239] [INFO ] [REMOTE ] HPP: Full fetch complete (73314 records). [2025-10-25T22:21:51.557409] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-25T22:21:51.944904] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-25T22:21:51.945018] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-25T22:21:51.946018] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-25T22:21:51.946111] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-25T22:21:51.947569] [DEBUG] [LOCAL ] HPP: Trimmed 73314 records to 51926 (keeping 200 days of data) [2025-10-25T22:21:52.231490] [DEBUG] [LOCAL ] HPP: Primary data saved (51926 records). [2025-10-25T22:21:52.231700] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-25T22:21:52.231912] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols. HPP took 17.8s. Estimated remaining time: 4h 17m 5s [2025-10-25T22:21:52.401542] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:21:52.401735] [DEBUG] [LOCAL ] HPQ: No existing data file found in primary storage. [2025-10-25T22:21:52.401829] [WARN ] [MAIN ] HPQ: No existing data found, performing full refresh instead. [2025-10-25T22:21:52.401983] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-25T22:21:52.402069] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-25T22:21:52.402170] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-25T22:21:52.402246] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-25T22:21:52.763638] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:21:52.764264] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-25T22:21:54.446788] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T22:21:54.457341] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-25T22:21:56.326778] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-25T22:21:56.337038] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-25T22:21:58.186758] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T22:21:58.198496] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-25T22:22:00.060600] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-25T22:22:00.071801] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-25T22:22:01.885429] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T22:22:01.896867] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-25T22:22:03.789160] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-25T22:22:03.799933] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-25T22:22:05.840352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-25T22:22:05.852032] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-25T22:22:07.727885] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-25T22:22:07.739286] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-25T22:22:09.505118] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T22:22:09.516803] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-25T22:22:10.261015] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T22:22:10.271124] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-25T22:22:10.271286] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-25T22:22:10.665809] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-25T22:22:10.665940] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-25T22:22:10.666950] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-25T22:22:10.667070] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-25T22:22:10.668728] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 54449 (keeping 200 days of data) [2025-10-25T22:22:10.989883] [DEBUG] [LOCAL ] HPQ: Primary data saved (54449 records). [2025-10-25T22:22:10.990041] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-25T22:22:10.990184] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols. HPQ took 18.8s. Estimated remaining time: 4h 17m 2s [2025-10-25T22:22:11.160636] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:22:11.160867] [DEBUG] [LOCAL ] HPS: No existing data file found in primary storage. [2025-10-25T22:22:11.160939] [WARN ] [MAIN ] HPS: No existing data found, performing full refresh instead. [2025-10-25T22:22:11.161027] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-25T22:22:11.161096] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-25T22:22:11.161177] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-25T22:22:11.161245] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-25T22:22:11.534669] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:22:11.535008] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-25T22:22:12.468387] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T22:22:12.471124] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-25T22:22:13.227450] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T22:22:13.230671] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-25T22:22:14.047820] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-25T22:22:14.050722] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-25T22:22:14.802678] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T22:22:14.805335] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-25T22:22:15.634153] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T22:22:15.636768] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-25T22:22:16.403410] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T22:22:16.406622] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-25T22:22:17.263446] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T22:22:17.267164] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-25T22:22:18.030892] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T22:22:18.033560] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-25T22:22:18.678629] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-25T22:22:18.681435] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-25T22:22:19.400948] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T22:22:19.403222] [INFO ] [REMOTE ] HPS: Full fetch complete (15037 records). [2025-10-25T22:22:19.403321] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-25T22:22:19.781702] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-25T22:22:19.781843] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-25T22:22:19.782256] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-25T22:22:19.782353] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-25T22:22:19.782943] [DEBUG] [LOCAL ] HPS: Trimmed 15037 records to 10420 (keeping 200 days of data) [2025-10-25T22:22:19.845377] [DEBUG] [LOCAL ] HPS: Primary data saved (10420 records). [2025-10-25T22:22:19.845566] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-25T22:22:19.845754] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols. HPS took 8.9s. Estimated remaining time: 4h 16m 47s [2025-10-25T22:22:20.017025] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:22:20.017252] [DEBUG] [LOCAL ] HQH: No existing data file found in primary storage. [2025-10-25T22:22:20.017345] [WARN ] [MAIN ] HQH: No existing data found, performing full refresh instead. [2025-10-25T22:22:20.017482] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-25T22:22:20.017571] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-25T22:22:20.017698] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-25T22:22:20.017815] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-25T22:22:20.377844] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:22:20.378217] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-25T22:22:21.544386] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T22:22:21.550388] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-25T22:22:22.640362] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T22:22:22.645617] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-25T22:22:23.430078] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-25T22:22:23.435306] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-25T22:22:24.311091] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T22:22:24.316725] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-25T22:22:25.456398] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T22:22:25.463108] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-25T22:22:26.524384] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T22:22:26.529583] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-25T22:22:27.745146] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T22:22:27.751457] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-25T22:22:28.846102] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-25T22:22:28.852197] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-25T22:22:29.918126] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T22:22:29.923925] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-25T22:22:31.098342] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T22:22:31.103608] [INFO ] [REMOTE ] HQH: Full fetch complete (36898 records). [2025-10-25T22:22:31.103744] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-25T22:22:31.482721] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-25T22:22:31.482834] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-25T22:22:31.483487] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-25T22:22:31.483573] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-25T22:22:31.484414] [DEBUG] [LOCAL ] HQH: Trimmed 36898 records to 26090 (keeping 200 days of data) [2025-10-25T22:22:31.632771] [DEBUG] [LOCAL ] HQH: Primary data saved (26090 records). [2025-10-25T22:22:31.632924] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-25T22:22:31.633064] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols. HQH took 11.8s. Estimated remaining time: 4h 16m 35s [2025-10-25T22:22:31.798567] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:22:31.798797] [DEBUG] [LOCAL ] HQL: No existing data file found in primary storage. [2025-10-25T22:22:31.798867] [WARN ] [MAIN ] HQL: No existing data found, performing full refresh instead. [2025-10-25T22:22:31.798980] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-25T22:22:31.799049] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-25T22:22:31.799128] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-25T22:22:31.799196] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-25T22:22:32.149150] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:22:32.149511] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-25T22:22:33.122561] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T22:22:33.126732] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-25T22:22:34.157874] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T22:22:34.162077] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-25T22:22:35.229374] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T22:22:35.233604] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-25T22:22:36.156814] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T22:22:36.160768] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-25T22:22:37.096307] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T22:22:37.100241] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-25T22:22:38.036294] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T22:22:38.043984] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-25T22:22:39.087128] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T22:22:39.091899] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-25T22:22:40.007494] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T22:22:40.012859] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-25T22:22:40.889524] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-25T22:22:40.893591] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-25T22:22:41.788086] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T22:22:41.792614] [INFO ] [REMOTE ] HQL: Full fetch complete (25328 records). [2025-10-25T22:22:41.792734] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-25T22:22:42.157259] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-25T22:22:42.157372] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-25T22:22:42.158007] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-25T22:22:42.158086] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-25T22:22:42.158816] [DEBUG] [LOCAL ] HQL: Trimmed 25328 records to 17318 (keeping 200 days of data) [2025-10-25T22:22:42.258711] [DEBUG] [LOCAL ] HQL: Primary data saved (17318 records). [2025-10-25T22:22:42.258892] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-25T22:22:42.259068] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols. HQL took 10.6s. Estimated remaining time: 4h 16m 22s [2025-10-25T22:22:42.423165] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:22:42.423384] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-10-25T22:22:42.423457] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-10-25T22:22:42.423606] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-25T22:22:42.423701] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-25T22:22:42.423790] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-25T22:22:42.423861] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-25T22:22:42.768001] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:22:42.768361] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-25T22:22:44.282716] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T22:22:44.293115] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-25T22:22:45.798239] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T22:22:45.811146] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-25T22:22:47.377351] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T22:22:47.388104] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-25T22:22:49.077665] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-25T22:22:49.089009] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-25T22:22:50.677409] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T22:22:50.688141] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-25T22:22:52.384617] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T22:22:52.395048] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-25T22:22:54.094590] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-25T22:22:54.105862] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-25T22:22:55.616884] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T22:22:55.627899] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-25T22:22:57.445540] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T22:22:57.456572] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-25T22:23:04.944048] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (7.49 seconds). [2025-10-25T22:23:04.953543] [INFO ] [REMOTE ] HR: Full fetch complete (75083 records). [2025-10-25T22:23:04.953735] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-25T22:23:05.343260] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-25T22:23:05.343413] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-25T22:23:05.344521] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-25T22:23:05.344603] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-25T22:23:05.346197] [DEBUG] [LOCAL ] HR: Trimmed 75083 records to 52883 (keeping 200 days of data) [2025-10-25T22:23:05.651877] [DEBUG] [LOCAL ] HR: Primary data saved (52883 records). [2025-10-25T22:23:05.652056] [INFO ] [MAIN ] HR: Full history saved. [2025-10-25T22:23:05.652199] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols. HR took 23.4s. Estimated remaining time: 4h 16m 25s [2025-10-25T22:23:05.822830] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:23:05.823025] [DEBUG] [LOCAL ] HRB: No existing data file found in primary storage. [2025-10-25T22:23:05.823115] [WARN ] [MAIN ] HRB: No existing data found, performing full refresh instead. [2025-10-25T22:23:05.823230] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-25T22:23:05.823301] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-25T22:23:05.823380] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-25T22:23:05.823450] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-25T22:23:06.172948] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:23:06.173328] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-25T22:23:07.779177] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-25T22:23:07.788235] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-25T22:23:09.422761] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T22:23:09.431935] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-25T22:23:10.985294] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T22:23:10.995936] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-25T22:23:12.533755] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T22:23:12.544377] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-25T22:23:14.050530] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T22:23:14.060587] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-25T22:23:15.538472] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T22:23:15.548340] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-25T22:23:17.195828] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T22:23:17.205803] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-25T22:23:18.842251] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T22:23:18.852781] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-25T22:23:20.295217] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T22:23:20.306587] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-25T22:23:21.850713] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T22:23:21.859172] [INFO ] [REMOTE ] HRB: Full fetch complete (69904 records). [2025-10-25T22:23:21.859323] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-25T22:23:22.236984] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-25T22:23:22.237124] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-25T22:23:22.238068] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-25T22:23:22.238147] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-25T22:23:22.239498] [DEBUG] [LOCAL ] HRB: Trimmed 69904 records to 48840 (keeping 200 days of data) [2025-10-25T22:23:22.519884] [DEBUG] [LOCAL ] HRB: Primary data saved (48840 records). [2025-10-25T22:23:22.520044] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-25T22:23:22.520185] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols. HRB took 16.9s. Estimated remaining time: 4h 16m 20s [2025-10-25T22:23:22.683795] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:23:22.684002] [DEBUG] [LOCAL ] HRI: No existing data file found in primary storage. [2025-10-25T22:23:22.684074] [WARN ] [MAIN ] HRI: No existing data found, performing full refresh instead. [2025-10-25T22:23:22.684191] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-25T22:23:22.684265] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-25T22:23:22.684345] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-25T22:23:22.684415] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-25T22:23:23.031224] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:23:23.031544] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-25T22:23:24.241616] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T22:23:24.247195] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-25T22:23:25.573566] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T22:23:25.584699] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-25T22:23:26.971773] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T22:23:26.979707] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-25T22:23:28.419349] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T22:23:28.427192] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-25T22:23:29.799856] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T22:23:29.807172] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-25T22:23:31.014580] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T22:23:31.021424] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-25T22:23:32.470089] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T22:23:32.477951] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-25T22:23:33.801752] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-25T22:23:33.808305] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-25T22:23:35.126016] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T22:23:35.132955] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-25T22:23:36.423154] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T22:23:36.428795] [INFO ] [REMOTE ] HRI: Full fetch complete (46793 records). [2025-10-25T22:23:36.428944] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-25T22:23:36.800923] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-25T22:23:36.801075] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-25T22:23:36.801834] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-25T22:23:36.801912] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-25T22:23:36.803099] [DEBUG] [LOCAL ] HRI: Trimmed 46793 records to 32615 (keeping 200 days of data) [2025-10-25T22:23:37.016953] [DEBUG] [LOCAL ] HRI: Primary data saved (32615 records). [2025-10-25T22:23:37.017131] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-25T22:23:37.017253] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols. HRI took 14.5s. Estimated remaining time: 4h 16m 12s [2025-10-25T22:23:37.185017] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:23:37.185195] [DEBUG] [LOCAL ] HRL: No existing data file found in primary storage. [2025-10-25T22:23:37.185265] [WARN ] [MAIN ] HRL: No existing data found, performing full refresh instead. [2025-10-25T22:23:37.185354] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-25T22:23:37.185419] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-25T22:23:37.185499] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-25T22:23:37.185573] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-25T22:23:37.537173] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:23:37.537528] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-25T22:23:39.138209] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T22:23:39.148413] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-25T22:23:41.127497] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-25T22:23:41.137568] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-25T22:23:42.832475] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T22:23:42.843271] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-25T22:23:44.683277] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T22:23:44.694256] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-25T22:23:46.301855] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T22:23:46.313211] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-25T22:23:48.055504] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-25T22:23:48.066973] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-25T22:23:49.778203] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-25T22:23:49.789953] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-25T22:23:51.582566] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T22:23:51.594047] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-25T22:23:52.375963] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T22:23:52.387437] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-25T22:23:53.134882] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T22:23:53.144534] [INFO ] [REMOTE ] HRL: Full fetch complete (77029 records). [2025-10-25T22:23:53.144723] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-25T22:23:53.531163] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-25T22:23:53.531280] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-25T22:23:53.532293] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-25T22:23:53.532374] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-25T22:23:53.533861] [DEBUG] [LOCAL ] HRL: Trimmed 77029 records to 53895 (keeping 200 days of data) [2025-10-25T22:23:53.851233] [DEBUG] [LOCAL ] HRL: Primary data saved (53895 records). [2025-10-25T22:23:53.851386] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-25T22:23:53.851583] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols. HRL took 16.8s. Estimated remaining time: 4h 16m 6s [2025-10-25T22:23:54.020852] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:23:54.021082] [DEBUG] [LOCAL ] HRTG: No existing data file found in primary storage. [2025-10-25T22:23:54.021172] [WARN ] [MAIN ] HRTG: No existing data found, performing full refresh instead. [2025-10-25T22:23:54.021330] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-25T22:23:54.021413] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-25T22:23:54.021519] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-25T22:23:54.021602] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-25T22:23:54.401721] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:23:54.402133] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-25T22:23:55.370398] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T22:23:55.374934] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-25T22:23:56.387236] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T22:23:56.391618] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-25T22:23:57.733233] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T22:23:57.740383] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-25T22:23:59.104267] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-25T22:23:59.111710] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-25T22:24:00.624235] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T22:24:00.633390] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-25T22:24:02.247064] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T22:24:02.254544] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-25T22:24:03.631772] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T22:24:03.638972] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-25T22:24:05.137912] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T22:24:05.145207] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-25T22:24:06.647791] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T22:24:06.655406] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-25T22:24:07.935389] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T22:24:07.941885] [INFO ] [REMOTE ] HRTG: Full fetch complete (44501 records). [2025-10-25T22:24:07.941996] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-25T22:24:08.315942] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-25T22:24:08.316054] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-25T22:24:08.316910] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-25T22:24:08.317007] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-25T22:24:08.318073] [DEBUG] [LOCAL ] HRTG: Trimmed 44501 records to 34934 (keeping 200 days of data) [2025-10-25T22:24:08.516268] [DEBUG] [LOCAL ] HRTG: Primary data saved (34934 records). [2025-10-25T22:24:08.516549] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-25T22:24:08.516747] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols. HRTG took 14.7s. Estimated remaining time: 4h 15m 58s [2025-10-25T22:24:08.687697] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:24:08.687906] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-25T22:24:08.687975] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-25T22:24:08.688124] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-25T22:24:08.688216] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-25T22:24:08.688331] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-25T22:24:08.688422] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-25T22:24:09.040988] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:24:09.041302] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-25T22:24:11.017202] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-25T22:24:11.027212] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-25T22:24:12.975158] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-25T22:24:12.984730] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-25T22:24:14.810361] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T22:24:14.821176] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-25T22:24:16.770159] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-25T22:24:16.781203] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-25T22:24:18.514267] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T22:24:18.525025] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-25T22:24:20.418010] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-25T22:24:20.428677] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-25T22:24:22.212184] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T22:24:22.223358] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-25T22:24:23.880440] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T22:24:23.891563] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-25T22:24:25.778835] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T22:24:25.789476] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-25T22:24:27.779914] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-25T22:24:27.789273] [INFO ] [REMOTE ] HSBC: Full fetch complete (74245 records). [2025-10-25T22:24:27.789453] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-25T22:24:28.175668] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-25T22:24:28.175785] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-25T22:24:28.176801] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-25T22:24:28.176882] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-25T22:24:28.178365] [DEBUG] [LOCAL ] HSBC: Trimmed 74245 records to 51741 (keeping 200 days of data) [2025-10-25T22:24:28.478960] [DEBUG] [LOCAL ] HSBC: Primary data saved (51741 records). [2025-10-25T22:24:28.479117] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-25T22:24:28.479256] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols. HSBC took 20.0s. Estimated remaining time: 4h 15m 57s [2025-10-25T22:24:28.659736] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:24:28.660774] [DEBUG] [LOCAL ] HSHP: No existing data file found in primary storage. [2025-10-25T22:24:28.660848] [WARN ] [MAIN ] HSHP: No existing data found, performing full refresh instead. [2025-10-25T22:24:28.661009] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-25T22:24:28.661084] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-25T22:24:28.661167] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-25T22:24:28.661237] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-25T22:24:29.009529] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:24:29.009881] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-25T22:24:30.118623] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T22:24:30.122380] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-25T22:24:31.134714] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T22:24:31.138922] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-25T22:24:32.279335] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T22:24:32.284142] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-25T22:24:33.268698] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-25T22:24:33.273457] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-25T22:24:34.058377] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-25T22:24:34.061271] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-25T22:24:35.055060] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T22:24:35.059617] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-25T22:24:36.047630] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T22:24:36.052134] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-25T22:24:36.887179] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T22:24:36.892283] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-25T22:24:37.856013] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T22:24:37.860199] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-25T22:24:38.641287] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T22:24:38.644055] [INFO ] [REMOTE ] HSHP: Full fetch complete (23058 records). [2025-10-25T22:24:38.644153] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-25T22:24:39.027074] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-25T22:24:39.027189] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-25T22:24:39.027788] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-25T22:24:39.027869] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-25T22:24:39.028541] [DEBUG] [LOCAL ] HSHP: Trimmed 23058 records to 14591 (keeping 200 days of data) [2025-10-25T22:24:39.109258] [DEBUG] [LOCAL ] HSHP: Primary data saved (14591 records). [2025-10-25T22:24:39.109420] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-25T22:24:39.109574] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols. HSHP took 10.6s. Estimated remaining time: 4h 15m 44s [2025-10-25T22:24:39.283820] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:24:39.284009] [DEBUG] [LOCAL ] HSY: No existing data file found in primary storage. [2025-10-25T22:24:39.284086] [WARN ] [MAIN ] HSY: No existing data found, performing full refresh instead. [2025-10-25T22:24:39.284201] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-25T22:24:39.284271] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-25T22:24:39.284354] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-25T22:24:39.284424] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-25T22:24:39.655423] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:24:39.655814] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-25T22:24:41.584877] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-25T22:24:41.595047] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-25T22:24:43.740748] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-25T22:24:43.750490] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-25T22:24:45.603584] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T22:24:45.614071] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-25T22:24:47.674211] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-25T22:24:47.684661] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-25T22:24:49.493295] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T22:24:49.504311] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-25T22:24:51.074271] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T22:24:51.084470] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-25T22:24:53.123621] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-25T22:24:53.134843] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-25T22:24:54.874974] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T22:24:54.885802] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-25T22:24:56.660504] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T22:24:56.670984] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-25T22:24:57.383385] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T22:24:57.392333] [INFO ] [REMOTE ] HSY: Full fetch complete (73593 records). [2025-10-25T22:24:57.392477] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-25T22:24:57.772876] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-25T22:24:57.773005] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-25T22:24:57.774003] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-25T22:24:57.774085] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-25T22:24:57.775558] [DEBUG] [LOCAL ] HSY: Trimmed 73593 records to 51078 (keeping 200 days of data) [2025-10-25T22:24:58.084684] [DEBUG] [LOCAL ] HSY: Primary data saved (51078 records). [2025-10-25T22:24:58.084859] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-25T22:24:58.085033] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols. HSY took 19.0s. Estimated remaining time: 4h 15m 41s [2025-10-25T22:24:58.250287] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:24:58.250473] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-25T22:24:58.250559] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-25T22:24:58.250695] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-25T22:24:58.250766] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-25T22:24:58.250845] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-25T22:24:58.250911] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-25T22:24:58.596621] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:24:58.597036] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-25T22:24:58.806796] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T22:24:58.807139] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-25T22:24:58.807222] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T22:24:58.807295] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-25T22:24:58.807361] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T22:24:58.807432] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-25T22:24:58.807531] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-25T22:24:58.807600] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-25T22:24:58.807705] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-25T22:24:58.807872] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols. HTB took 0.7s. Estimated remaining time: 4h 15m 16s [2025-10-25T22:24:58.976927] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:24:58.977136] [DEBUG] [LOCAL ] HTD: No existing data file found in primary storage. [2025-10-25T22:24:58.977205] [WARN ] [MAIN ] HTD: No existing data found, performing full refresh instead. [2025-10-25T22:24:58.977316] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-25T22:24:58.977426] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-25T22:24:58.977511] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-25T22:24:58.977577] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-25T22:24:59.325118] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:24:59.325504] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-25T22:25:00.132771] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-25T22:25:00.136031] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-25T22:25:00.715451] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T22:25:00.718004] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-25T22:25:01.768225] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-25T22:25:01.771636] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-25T22:25:02.881738] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T22:25:02.887238] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-25T22:25:03.750355] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T22:25:03.753890] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-25T22:25:04.609947] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T22:25:04.613418] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-25T22:25:05.644218] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T22:25:05.648259] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-25T22:25:06.509128] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T22:25:06.512397] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-25T22:25:07.480109] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T22:25:07.484149] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-25T22:25:08.475005] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T22:25:08.478736] [INFO ] [REMOTE ] HTD: Full fetch complete (19583 records). [2025-10-25T22:25:08.478894] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-25T22:25:08.835106] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-25T22:25:08.835237] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-25T22:25:08.835692] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-25T22:25:08.835790] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-25T22:25:08.836395] [DEBUG] [LOCAL ] HTD: Trimmed 19583 records to 14394 (keeping 200 days of data) [2025-10-25T22:25:08.920338] [DEBUG] [LOCAL ] HTD: Primary data saved (14394 records). [2025-10-25T22:25:08.920492] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-25T22:25:08.920671] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols. HTD took 10.1s. Estimated remaining time: 4h 15m 2s [2025-10-25T22:25:09.088144] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:25:09.088384] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-25T22:25:09.088459] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-25T22:25:09.088577] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-25T22:25:09.088675] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-25T22:25:09.088759] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-25T22:25:09.088830] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-25T22:25:09.462385] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:25:09.462762] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-25T22:25:09.792162] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-25T22:25:09.793066] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-25T22:25:10.139244] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-25T22:25:10.140210] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-25T22:25:10.464187] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-25T22:25:10.465119] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-25T22:25:10.881177] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-25T22:25:10.882231] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-25T22:25:11.217050] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-25T22:25:11.217992] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-25T22:25:11.577404] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-25T22:25:11.578367] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-25T22:25:11.881568] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-25T22:25:11.882470] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-25T22:25:12.169133] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-25T22:25:12.170033] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-25T22:25:12.511935] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-25T22:25:12.512865] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-25T22:25:12.865925] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-25T22:25:12.866697] [INFO ] [REMOTE ] HTFC: Full fetch complete (815 records). [2025-10-25T22:25:12.866806] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-25T22:25:13.043359] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-25T22:25:13.043558] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:25:13.043668] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:25:13.043808] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-25T22:25:13.043924] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-25T22:25:13.044013] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-25T22:25:13.044147] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-25T22:25:13.044325] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols. HTFC took 4.1s. Estimated remaining time: 4h 14m 41s [2025-10-25T22:25:13.208321] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:25:13.208564] [DEBUG] [LOCAL ] HTGC: No existing data file found in primary storage. [2025-10-25T22:25:13.208674] [WARN ] [MAIN ] HTGC: No existing data found, performing full refresh instead. [2025-10-25T22:25:13.208859] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-25T22:25:13.208949] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-25T22:25:13.209053] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-25T22:25:13.209167] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-25T22:25:13.567173] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:25:13.567616] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-25T22:25:14.987586] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T22:25:14.996677] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-25T22:25:16.483437] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T22:25:16.492091] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-25T22:25:18.261384] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T22:25:18.271805] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-25T22:25:19.946140] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T22:25:19.956375] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-25T22:25:21.655556] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T22:25:21.666409] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-25T22:25:23.316325] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T22:25:23.325969] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-25T22:25:25.094724] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-25T22:25:25.105185] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-25T22:25:26.873355] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T22:25:26.883475] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-25T22:25:28.568564] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T22:25:28.583353] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-25T22:25:30.350925] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-25T22:25:30.364626] [INFO ] [REMOTE ] HTGC: Full fetch complete (68880 records). [2025-10-25T22:25:30.364890] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-25T22:25:30.740099] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-25T22:25:30.740210] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-25T22:25:30.740971] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-25T22:25:30.741050] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-25T22:25:30.742310] [DEBUG] [LOCAL ] HTGC: Trimmed 68880 records to 48352 (keeping 200 days of data) [2025-10-25T22:25:31.018189] [DEBUG] [LOCAL ] HTGC: Primary data saved (48352 records). [2025-10-25T22:25:31.018342] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-25T22:25:31.018482] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols. HTGC took 18.0s. Estimated remaining time: 4h 14m 37s [2025-10-25T22:25:31.188567] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:25:31.188772] [DEBUG] [LOCAL ] HTH: No existing data file found in primary storage. [2025-10-25T22:25:31.188830] [WARN ] [MAIN ] HTH: No existing data found, performing full refresh instead. [2025-10-25T22:25:31.188934] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-25T22:25:31.189004] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-25T22:25:31.189091] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-25T22:25:31.189160] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-25T22:25:31.532070] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:25:31.532345] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-25T22:25:32.616714] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-25T22:25:32.622546] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-25T22:25:34.000772] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T22:25:34.008448] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-25T22:25:35.380909] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T22:25:35.387196] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-25T22:25:36.484550] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T22:25:36.492148] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-25T22:25:37.911072] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T22:25:37.918794] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-25T22:25:39.104596] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T22:25:39.111145] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-25T22:25:40.392188] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T22:25:40.403220] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-25T22:25:41.868749] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T22:25:41.877731] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-25T22:25:43.118953] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T22:25:43.125768] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-25T22:25:44.368437] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T22:25:44.374554] [INFO ] [REMOTE ] HTH: Full fetch complete (46852 records). [2025-10-25T22:25:44.374727] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-25T22:25:44.769232] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-25T22:25:44.769360] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-25T22:25:44.770298] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-25T22:25:44.770384] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-25T22:25:44.771527] [DEBUG] [LOCAL ] HTH: Trimmed 46852 records to 32834 (keeping 200 days of data) [2025-10-25T22:25:44.961926] [DEBUG] [LOCAL ] HTH: Primary data saved (32834 records). [2025-10-25T22:25:44.962096] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-25T22:25:44.962242] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols. HTH took 13.9s. Estimated remaining time: 4h 14m 28s [2025-10-25T22:25:45.167539] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:25:45.167812] [DEBUG] [LOCAL ] HUBB: No existing data file found in primary storage. [2025-10-25T22:25:45.167887] [WARN ] [MAIN ] HUBB: No existing data found, performing full refresh instead. [2025-10-25T22:25:45.168001] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-25T22:25:45.168074] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-25T22:25:45.168158] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-25T22:25:45.168230] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-25T22:25:45.541804] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:25:45.542147] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-25T22:25:47.166990] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T22:25:47.174408] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-25T22:25:48.821591] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T22:25:48.830375] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-25T22:25:50.373674] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-25T22:25:50.382435] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-25T22:25:51.869724] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T22:25:51.878785] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-25T22:25:53.474953] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T22:25:53.483776] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-25T22:25:54.953607] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T22:25:54.961042] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-25T22:25:56.453178] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T22:25:56.461686] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-25T22:25:57.911082] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T22:25:57.918519] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-25T22:25:59.241617] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T22:25:59.249381] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-25T22:25:59.915417] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T22:25:59.921582] [INFO ] [REMOTE ] HUBB: Full fetch complete (54177 records). [2025-10-25T22:25:59.921740] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-25T22:26:00.310500] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-25T22:26:00.310640] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-25T22:26:00.311463] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-25T22:26:00.311541] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-25T22:26:00.312770] [DEBUG] [LOCAL ] HUBB: Trimmed 54177 records to 36419 (keeping 200 days of data) [2025-10-25T22:26:00.528588] [DEBUG] [LOCAL ] HUBB: Primary data saved (36419 records). [2025-10-25T22:26:00.528776] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-25T22:26:00.528916] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols. HUBB took 15.6s. Estimated remaining time: 4h 14m 21s [2025-10-25T22:26:00.698340] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:26:00.698566] [DEBUG] [LOCAL ] HUBS: No existing data file found in primary storage. [2025-10-25T22:26:00.698638] [WARN ] [MAIN ] HUBS: No existing data found, performing full refresh instead. [2025-10-25T22:26:00.698772] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-25T22:26:00.698842] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-25T22:26:00.698923] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-25T22:26:00.698992] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-25T22:26:01.043611] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:26:01.043963] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-25T22:26:02.443144] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T22:26:02.450419] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-25T22:26:03.942471] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T22:26:03.950101] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-25T22:26:05.571855] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T22:26:05.580343] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-25T22:26:07.120387] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T22:26:07.129533] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-25T22:26:08.630870] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T22:26:08.639180] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-25T22:26:10.158100] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T22:26:10.165965] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-25T22:26:11.759424] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T22:26:11.772525] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-25T22:26:13.308905] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T22:26:13.319255] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-25T22:26:14.736427] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T22:26:14.744850] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-25T22:26:16.410788] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-25T22:26:16.423503] [INFO ] [REMOTE ] HUBS: Full fetch complete (57063 records). [2025-10-25T22:26:16.423759] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-25T22:26:16.936400] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-25T22:26:16.936535] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-25T22:26:16.937514] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-25T22:26:16.937614] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-25T22:26:16.938953] [DEBUG] [LOCAL ] HUBS: Trimmed 57063 records to 40387 (keeping 200 days of data) [2025-10-25T22:26:17.193450] [DEBUG] [LOCAL ] HUBS: Primary data saved (40387 records). [2025-10-25T22:26:17.193672] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-25T22:26:17.193863] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols. HUBS took 16.7s. Estimated remaining time: 4h 14m 15s [2025-10-25T22:26:17.393755] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:26:17.393957] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-25T22:26:17.394028] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-25T22:26:17.394115] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-25T22:26:17.394183] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-25T22:26:17.394264] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-25T22:26:17.394333] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-25T22:26:17.748144] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:26:17.748521] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-25T22:26:19.442344] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T22:26:19.452396] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-25T22:26:21.576733] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-25T22:26:21.586365] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-25T22:26:23.144244] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T22:26:23.154262] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-25T22:26:24.938192] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T22:26:24.949450] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-25T22:26:27.021752] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-25T22:26:27.032308] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-25T22:26:28.725221] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-25T22:26:28.735059] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-25T22:26:30.531535] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T22:26:30.542619] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-25T22:26:32.409457] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-25T22:26:32.419908] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-25T22:26:34.083000] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-25T22:26:34.093548] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-25T22:26:34.830959] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T22:26:34.839898] [INFO ] [REMOTE ] HUM: Full fetch complete (71087 records). [2025-10-25T22:26:34.840038] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-25T22:26:35.223773] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-25T22:26:35.223883] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-25T22:26:35.224977] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-25T22:26:35.225062] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-25T22:26:35.226498] [DEBUG] [LOCAL ] HUM: Trimmed 71087 records to 49864 (keeping 200 days of data) [2025-10-25T22:26:35.526105] [DEBUG] [LOCAL ] HUM: Primary data saved (49864 records). [2025-10-25T22:26:35.526267] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-25T22:26:35.526478] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols. HUM took 18.3s. Estimated remaining time: 4h 14m 11s [2025-10-25T22:26:35.694886] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:26:35.695085] [DEBUG] [LOCAL ] HUN: No existing data file found in primary storage. [2025-10-25T22:26:35.695177] [WARN ] [MAIN ] HUN: No existing data found, performing full refresh instead. [2025-10-25T22:26:35.695329] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-25T22:26:35.695436] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-25T22:26:35.695547] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-25T22:26:35.695638] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-25T22:26:36.052502] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:26:36.052891] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-25T22:26:37.746266] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T22:26:37.756327] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-25T22:26:39.289578] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T22:26:39.299528] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-25T22:26:41.168727] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T22:26:41.179941] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-25T22:26:42.960384] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T22:26:42.971421] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-25T22:26:44.570489] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T22:26:44.581488] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-25T22:26:46.387394] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T22:26:46.398310] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-25T22:26:48.302942] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-25T22:26:48.314385] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-25T22:26:50.041566] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-25T22:26:50.053985] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-25T22:26:51.658492] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T22:26:51.669791] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-25T22:26:53.351628] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T22:26:53.361439] [INFO ] [REMOTE ] HUN: Full fetch complete (77034 records). [2025-10-25T22:26:53.361590] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-25T22:26:53.743356] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-25T22:26:53.743479] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-25T22:26:53.744478] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-25T22:26:53.744562] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-25T22:26:53.746044] [DEBUG] [LOCAL ] HUN: Trimmed 77034 records to 53990 (keeping 200 days of data) [2025-10-25T22:26:54.065523] [DEBUG] [LOCAL ] HUN: Primary data saved (53990 records). [2025-10-25T22:26:54.065729] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-25T22:26:54.065874] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols. HUN took 18.5s. Estimated remaining time: 4h 14m 8s [2025-10-25T22:26:54.242560] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:26:54.242804] [DEBUG] [LOCAL ] HUYA: No existing data file found in primary storage. [2025-10-25T22:26:54.242875] [WARN ] [MAIN ] HUYA: No existing data found, performing full refresh instead. [2025-10-25T22:26:54.242964] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-25T22:26:54.243033] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-25T22:26:54.243116] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-25T22:26:54.243186] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-25T22:26:54.612680] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:26:54.613048] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-25T22:26:56.160806] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T22:26:56.169883] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-25T22:26:57.540957] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T22:26:57.549029] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-25T22:26:59.120581] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T22:26:59.130698] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-25T22:27:00.651812] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T22:27:00.662915] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-25T22:27:02.653322] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T22:27:02.663065] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-25T22:27:04.156435] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T22:27:04.165413] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-25T22:27:05.910018] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T22:27:05.920462] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-25T22:27:07.492392] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T22:27:07.501983] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-25T22:27:09.223374] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T22:27:09.235896] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-25T22:27:10.869780] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T22:27:10.879224] [INFO ] [REMOTE ] HUYA: Full fetch complete (64003 records). [2025-10-25T22:27:10.879507] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-25T22:27:11.324288] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-25T22:27:11.324463] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-25T22:27:11.325835] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-25T22:27:11.325930] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-25T22:27:11.328141] [DEBUG] [LOCAL ] HUYA: Trimmed 64003 records to 44262 (keeping 200 days of data) [2025-10-25T22:27:11.576866] [DEBUG] [LOCAL ] HUYA: Primary data saved (44262 records). [2025-10-25T22:27:11.577028] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-25T22:27:11.577171] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols. HUYA took 17.5s. Estimated remaining time: 4h 14m 3s [2025-10-25T22:27:11.747293] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:27:11.747514] [DEBUG] [LOCAL ] HVT: No existing data file found in primary storage. [2025-10-25T22:27:11.747587] [WARN ] [MAIN ] HVT: No existing data found, performing full refresh instead. [2025-10-25T22:27:11.747771] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-25T22:27:11.747846] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-25T22:27:11.747926] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-25T22:27:11.747998] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-25T22:27:12.099396] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:27:12.099774] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-25T22:27:13.006708] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T22:27:13.010510] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-25T22:27:14.074487] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T22:27:14.078556] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-25T22:27:15.103172] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T22:27:15.108000] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-25T22:27:15.996728] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T22:27:16.001699] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-25T22:27:17.015882] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T22:27:17.020245] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-25T22:27:17.906904] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T22:27:17.910863] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-25T22:27:18.788465] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T22:27:18.792556] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-25T22:27:19.685455] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T22:27:19.688822] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-25T22:27:20.484707] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T22:27:20.488250] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-25T22:27:21.308764] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T22:27:21.311862] [INFO ] [REMOTE ] HVT: Full fetch complete (22988 records). [2025-10-25T22:27:21.311966] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-25T22:27:21.689740] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-25T22:27:21.689879] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-25T22:27:21.690427] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-25T22:27:21.690506] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-25T22:27:21.691378] [DEBUG] [LOCAL ] HVT: Trimmed 22988 records to 14893 (keeping 200 days of data) [2025-10-25T22:27:21.777913] [DEBUG] [LOCAL ] HVT: Primary data saved (14893 records). [2025-10-25T22:27:21.778071] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-25T22:27:21.778212] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols. HVT took 10.2s. Estimated remaining time: 4h 13m 49s [2025-10-25T22:27:21.949332] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:27:21.949535] [DEBUG] [LOCAL ] HWM: No existing data file found in primary storage. [2025-10-25T22:27:21.949606] [WARN ] [MAIN ] HWM: No existing data found, performing full refresh instead. [2025-10-25T22:27:21.949740] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-25T22:27:21.949834] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-25T22:27:21.949919] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-25T22:27:21.949985] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-25T22:27:22.300790] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:27:22.301146] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-25T22:27:24.248717] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-25T22:27:24.260537] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-25T22:27:25.963393] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T22:27:25.973572] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-25T22:27:27.793515] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T22:27:27.804599] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-25T22:27:29.833440] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-25T22:27:29.844707] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-25T22:27:31.953075] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-25T22:27:31.964272] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-25T22:27:33.933557] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-25T22:27:33.944442] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-25T22:27:35.856478] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-25T22:27:35.869142] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-25T22:27:37.729316] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-25T22:27:37.740469] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-25T22:27:39.585294] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-25T22:27:39.596798] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-25T22:27:40.310634] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T22:27:40.320847] [INFO ] [REMOTE ] HWM: Full fetch complete (76617 records). [2025-10-25T22:27:40.321154] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-25T22:27:40.749925] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-25T22:27:40.750151] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-25T22:27:40.752192] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-25T22:27:40.752335] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-25T22:27:40.754566] [DEBUG] [LOCAL ] HWM: Trimmed 76617 records to 53449 (keeping 200 days of data) [2025-10-25T22:27:41.102621] [DEBUG] [LOCAL ] HWM: Primary data saved (53449 records). [2025-10-25T22:27:41.102889] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-25T22:27:41.103077] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols. HWM took 19.3s. Estimated remaining time: 4h 13m 47s [2025-10-25T22:27:41.280578] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:27:41.280900] [DEBUG] [LOCAL ] HXL: No existing data file found in primary storage. [2025-10-25T22:27:41.280976] [WARN ] [MAIN ] HXL: No existing data found, performing full refresh instead. [2025-10-25T22:27:41.281104] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-25T22:27:41.281179] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-25T22:27:41.281266] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-25T22:27:41.281339] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-25T22:27:41.658111] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:27:41.658578] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-25T22:27:43.352571] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-25T22:27:43.362429] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-25T22:27:44.947695] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T22:27:44.956218] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-25T22:27:46.753192] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T22:27:46.763367] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-25T22:27:48.271015] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T22:27:48.281409] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-25T22:27:49.839792] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T22:27:49.850071] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-25T22:27:51.423898] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T22:27:51.433822] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-25T22:27:53.162752] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T22:27:53.175239] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-25T22:27:54.751395] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T22:27:54.760818] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-25T22:27:56.323227] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T22:27:56.335815] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-25T22:27:57.762184] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T22:27:57.770879] [INFO ] [REMOTE ] HXL: Full fetch complete (66740 records). [2025-10-25T22:27:57.771031] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-25T22:27:58.158970] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-25T22:27:58.159085] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-25T22:27:58.160137] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-25T22:27:58.160224] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-25T22:27:58.161526] [DEBUG] [LOCAL ] HXL: Trimmed 66740 records to 46545 (keeping 200 days of data) [2025-10-25T22:27:58.451041] [DEBUG] [LOCAL ] HXL: Primary data saved (46545 records). [2025-10-25T22:27:58.451196] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-25T22:27:58.451343] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols. HXL took 17.3s. Estimated remaining time: 4h 13m 42s [2025-10-25T22:27:58.627735] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:27:58.628325] [DEBUG] [LOCAL ] HY: No existing data file found in primary storage. [2025-10-25T22:27:58.628400] [WARN ] [MAIN ] HY: No existing data found, performing full refresh instead. [2025-10-25T22:27:58.628549] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-25T22:27:58.628623] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-25T22:27:58.628726] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-25T22:27:58.628795] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-25T22:27:58.979975] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:27:58.980303] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-25T22:27:59.782744] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T22:27:59.785433] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-25T22:28:00.663321] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-25T22:28:00.666058] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-25T22:28:01.617760] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T22:28:01.621593] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-25T22:28:02.504157] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T22:28:02.508220] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-25T22:28:03.314121] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T22:28:03.316924] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-25T22:28:04.039611] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T22:28:04.042087] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-25T22:28:04.880314] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T22:28:04.882876] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-25T22:28:05.706343] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T22:28:05.709444] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-25T22:28:06.534280] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-25T22:28:06.537709] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-25T22:28:07.309535] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T22:28:07.311626] [INFO ] [REMOTE ] HY: Full fetch complete (14825 records). [2025-10-25T22:28:07.311736] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-25T22:28:07.670968] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-25T22:28:07.671092] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-25T22:28:07.671580] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-25T22:28:07.671680] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-25T22:28:07.672208] [DEBUG] [LOCAL ] HY: Trimmed 14825 records to 9943 (keeping 200 days of data) [2025-10-25T22:28:07.732219] [DEBUG] [LOCAL ] HY: Primary data saved (9943 records). [2025-10-25T22:28:07.732411] [INFO ] [MAIN ] HY: Full history saved. [2025-10-25T22:28:07.732564] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols. HY took 9.3s. Estimated remaining time: 4h 13m 27s [2025-10-25T22:28:07.906627] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:28:07.906847] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-25T22:28:07.906901] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-25T22:28:07.907015] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-25T22:28:07.907107] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-25T22:28:07.907195] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-25T22:28:07.907267] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-25T22:28:08.260963] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:28:08.261345] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-25T22:28:08.581107] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-25T22:28:08.581935] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-25T22:28:08.909798] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-25T22:28:08.910772] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-25T22:28:09.160018] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-25T22:28:09.161139] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-25T22:28:09.481119] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-25T22:28:09.482250] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-25T22:28:09.806239] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-25T22:28:09.807409] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-25T22:28:10.141362] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-25T22:28:10.142370] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-25T22:28:10.592306] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-25T22:28:10.593508] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-25T22:28:10.816804] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-25T22:28:10.817769] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-25T22:28:11.053348] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-25T22:28:11.054458] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-25T22:28:12.374479] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-25T22:28:12.376072] [INFO ] [REMOTE ] HYAC: Full fetch complete (918 records). [2025-10-25T22:28:12.376252] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-25T22:28:12.589727] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-25T22:28:12.589996] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:28:12.590070] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:28:12.590151] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-25T22:28:12.590256] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-25T22:28:12.590339] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-25T22:28:12.590452] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-25T22:28:12.590747] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols. HYAC took 4.9s. Estimated remaining time: 4h 13m 7s [2025-10-25T22:28:12.783700] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:28:12.783913] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-25T22:28:12.783982] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-25T22:28:12.784096] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-25T22:28:12.784166] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-25T22:28:12.784245] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-25T22:28:12.784315] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-25T22:28:13.178693] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:28:13.179065] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-25T22:28:13.547692] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-25T22:28:13.548668] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-25T22:28:13.805547] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-25T22:28:13.806425] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-25T22:28:14.173265] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-25T22:28:14.174223] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-25T22:28:14.511041] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-25T22:28:14.512071] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-25T22:28:14.877271] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-25T22:28:14.878190] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-25T22:28:15.216971] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-25T22:28:15.217934] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-25T22:28:15.548077] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-25T22:28:15.548991] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-25T22:28:15.916348] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-25T22:28:15.917277] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-25T22:28:16.167979] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-25T22:28:16.168875] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-25T22:28:16.534902] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-25T22:28:16.535830] [INFO ] [REMOTE ] HYBX: Full fetch complete (698 records). [2025-10-25T22:28:16.535924] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-25T22:28:16.717214] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-25T22:28:16.717458] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:28:16.717532] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:28:16.717589] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-25T22:28:16.717735] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-25T22:28:16.717814] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-25T22:28:16.717899] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-25T22:28:16.718057] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols. HYBX took 4.1s. Estimated remaining time: 4h 12m 46s [2025-10-25T22:28:16.890833] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:28:16.891112] [DEBUG] [LOCAL ] HYI: No existing data file found in primary storage. [2025-10-25T22:28:16.891184] [WARN ] [MAIN ] HYI: No existing data found, performing full refresh instead. [2025-10-25T22:28:16.891310] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-25T22:28:16.891382] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-25T22:28:16.891464] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-25T22:28:16.891537] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-25T22:28:17.269817] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:28:17.270267] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-25T22:28:18.135634] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-25T22:28:18.139475] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-25T22:28:18.938200] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-25T22:28:18.940850] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-25T22:28:19.776223] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-25T22:28:19.778915] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-25T22:28:20.684852] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T22:28:20.688772] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-25T22:28:21.475431] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-25T22:28:21.477894] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-25T22:28:22.210053] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T22:28:22.212488] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-25T22:28:22.975256] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-25T22:28:22.979517] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-25T22:28:23.713166] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T22:28:23.715933] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-25T22:28:24.440160] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T22:28:24.442861] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-25T22:28:25.295062] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T22:28:25.297896] [INFO ] [REMOTE ] HYI: Full fetch complete (14028 records). [2025-10-25T22:28:25.298019] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-25T22:28:25.669542] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-25T22:28:25.669680] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-25T22:28:25.670011] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-25T22:28:25.670089] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-25T22:28:25.670612] [DEBUG] [LOCAL ] HYI: Trimmed 14028 records to 9716 (keeping 200 days of data) [2025-10-25T22:28:25.728286] [DEBUG] [LOCAL ] HYI: Primary data saved (9716 records). [2025-10-25T22:28:25.728463] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-25T22:28:25.728609] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols. HYI took 9.0s. Estimated remaining time: 4h 12m 31s [2025-10-25T22:28:25.900667] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:28:25.900865] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-25T22:28:25.900936] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-25T22:28:25.901082] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-25T22:28:25.901153] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-25T22:28:25.901234] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-25T22:28:25.901303] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-25T22:28:26.247817] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:28:26.248159] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-25T22:28:27.621114] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T22:28:27.627782] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-25T22:28:28.893546] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T22:28:28.899815] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-25T22:28:30.323535] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T22:28:30.330385] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-25T22:28:31.788202] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T22:28:31.796398] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-25T22:28:33.153331] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T22:28:33.160253] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-25T22:28:34.574299] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T22:28:34.580845] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-25T22:28:35.929918] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T22:28:35.937438] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-25T22:28:37.294621] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T22:28:37.302538] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-25T22:28:38.743750] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T22:28:38.751069] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-25T22:28:40.211254] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T22:28:40.219519] [INFO ] [REMOTE ] HYT: Full fetch complete (47836 records). [2025-10-25T22:28:40.219807] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-25T22:28:40.603541] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-25T22:28:40.603671] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-25T22:28:40.604412] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-25T22:28:40.604487] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-25T22:28:40.605473] [DEBUG] [LOCAL ] HYT: Trimmed 47836 records to 33993 (keeping 200 days of data) [2025-10-25T22:28:40.813242] [DEBUG] [LOCAL ] HYT: Primary data saved (33993 records). [2025-10-25T22:28:40.813398] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-25T22:28:40.813538] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols. HYT took 15.1s. Estimated remaining time: 4h 12m 23s [2025-10-25T22:28:40.984334] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:28:40.984540] [DEBUG] [LOCAL ] HYTR: No existing data file found in primary storage. [2025-10-25T22:28:40.984612] [WARN ] [MAIN ] HYTR: No existing data found, performing full refresh instead. [2025-10-25T22:28:40.984752] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-25T22:28:40.984825] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-25T22:28:40.984905] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-25T22:28:40.984992] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-25T22:28:41.331273] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:28:41.331593] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-25T22:28:41.984496] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-25T22:28:41.985834] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-25T22:28:42.543543] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-25T22:28:42.545235] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-25T22:28:43.136403] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-25T22:28:43.138422] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-25T22:28:43.676691] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-25T22:28:43.678551] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-25T22:28:44.242003] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-25T22:28:44.243768] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-25T22:28:44.729363] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-25T22:28:44.730768] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-25T22:28:45.290771] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-25T22:28:45.292215] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-25T22:28:45.804552] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-25T22:28:45.805869] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-25T22:28:46.327166] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-25T22:28:46.328845] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-25T22:28:46.846180] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-25T22:28:46.847552] [INFO ] [REMOTE ] HYTR: Full fetch complete (4726 records). [2025-10-25T22:28:46.847684] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-25T22:28:47.230300] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-25T22:28:47.230467] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-25T22:28:47.230695] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-25T22:28:47.230784] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-25T22:28:47.231273] [DEBUG] [LOCAL ] HYTR: Trimmed 4726 records to 3140 (keeping 200 days of data) [2025-10-25T22:28:47.251094] [DEBUG] [LOCAL ] HYTR: Primary data saved (3140 records). [2025-10-25T22:28:47.251266] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-25T22:28:47.251470] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols. HYTR took 6.4s. Estimated remaining time: 4h 12m 5s [2025-10-25T22:28:47.420842] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:28:47.421074] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-25T22:28:47.421168] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-25T22:28:47.421318] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-25T22:28:47.421404] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-25T22:28:47.421518] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-25T22:28:47.421605] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-25T22:28:47.771446] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:28:47.771821] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-25T22:28:48.921988] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T22:28:48.927842] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-25T22:28:50.077082] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T22:28:50.082301] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-25T22:28:51.312596] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-25T22:28:51.319992] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-25T22:28:52.773099] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-25T22:28:52.781316] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-25T22:28:53.911994] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T22:28:53.918147] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-25T22:28:55.154089] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-25T22:28:55.160216] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-25T22:28:56.363928] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T22:28:56.371439] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-25T22:28:57.515295] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T22:28:57.521866] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-25T22:28:58.574387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T22:28:58.580845] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-25T22:28:59.762781] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T22:28:59.770757] [INFO ] [REMOTE ] HZO: Full fetch complete (41265 records). [2025-10-25T22:28:59.770991] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-25T22:29:00.299128] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-25T22:29:00.299281] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-25T22:29:00.300124] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-25T22:29:00.300209] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-25T22:29:00.301551] [DEBUG] [LOCAL ] HZO: Trimmed 41265 records to 28844 (keeping 200 days of data) [2025-10-25T22:29:00.469150] [DEBUG] [LOCAL ] HZO: Primary data saved (28844 records). [2025-10-25T22:29:00.469319] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-25T22:29:00.469452] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols. HZO took 13.2s. Estimated remaining time: 4h 11m 55s [2025-10-25T22:29:00.651707] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:29:00.651917] [DEBUG] [LOCAL ] IAE: No existing data file found in primary storage. [2025-10-25T22:29:00.652008] [WARN ] [MAIN ] IAE: No existing data found, performing full refresh instead. [2025-10-25T22:29:00.652127] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-25T22:29:00.652202] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-25T22:29:00.652286] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-25T22:29:00.652360] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-25T22:29:01.020343] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:29:01.020730] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-25T22:29:01.665250] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T22:29:01.667217] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-25T22:29:02.369423] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T22:29:02.371583] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-25T22:29:03.098758] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T22:29:03.100862] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-25T22:29:03.677577] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-25T22:29:03.679541] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-25T22:29:04.333369] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-25T22:29:04.335690] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-25T22:29:04.952899] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T22:29:04.955271] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-25T22:29:05.674071] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T22:29:05.676171] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-25T22:29:06.291841] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-25T22:29:06.293664] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-25T22:29:07.070931] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-25T22:29:07.073390] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-25T22:29:07.834357] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T22:29:07.836810] [INFO ] [REMOTE ] IAE: Full fetch complete (9085 records). [2025-10-25T22:29:07.836914] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-25T22:29:08.201552] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-25T22:29:08.201697] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-25T22:29:08.202105] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-25T22:29:08.202186] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-25T22:29:08.202635] [DEBUG] [LOCAL ] IAE: Trimmed 9085 records to 6423 (keeping 200 days of data) [2025-10-25T22:29:08.241081] [DEBUG] [LOCAL ] IAE: Primary data saved (6423 records). [2025-10-25T22:29:08.241266] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-25T22:29:08.241456] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols. IAE took 7.8s. Estimated remaining time: 4h 11m 39s [2025-10-25T22:29:08.407807] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:29:08.408026] [DEBUG] [LOCAL ] IAG: No existing data file found in primary storage. [2025-10-25T22:29:08.408097] [WARN ] [MAIN ] IAG: No existing data found, performing full refresh instead. [2025-10-25T22:29:08.408188] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-25T22:29:08.408255] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-25T22:29:08.408318] [DEBUG] [LOCAL ] IAG: No primary data file found to delete. [2025-10-25T22:29:08.408381] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-25T22:29:08.750306] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:29:08.750628] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-25T22:29:10.484862] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T22:29:10.495259] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-25T22:29:12.256994] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T22:29:12.268548] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-25T22:29:13.826837] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T22:29:13.838034] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-25T22:29:15.638450] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-25T22:29:15.649984] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-25T22:29:17.541433] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-25T22:29:17.556201] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-25T22:29:19.344967] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-25T22:29:19.356697] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-25T22:29:21.337008] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-25T22:29:21.348809] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-25T22:29:23.280601] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-25T22:29:23.292021] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-25T22:29:25.289452] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-25T22:29:25.301008] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-25T22:29:27.296313] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-25T22:29:27.306373] [INFO ] [REMOTE ] IAG: Full fetch complete (77517 records). [2025-10-25T22:29:27.306593] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-25T22:29:27.697887] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-25T22:29:27.698015] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-25T22:29:27.699088] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-25T22:29:27.699185] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-25T22:29:27.700712] [DEBUG] [LOCAL ] IAG: Trimmed 77517 records to 54272 (keeping 200 days of data) [2025-10-25T22:29:28.006776] [DEBUG] [LOCAL ] IAG: Primary data saved (54272 records). [2025-10-25T22:29:28.006936] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-25T22:29:28.007077] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols. IAG took 19.8s. Estimated remaining time: 4h 11m 37s [2025-10-25T22:29:28.177491] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:29:28.226925] [DEBUG] [LOCAL ] IBM: Loaded 54408 existing records from primary storage. [2025-10-25T22:29:28.227284] [INFO ] [MAIN ] IBM: Data is already up-to-date (last day: 2025-10-24). Skipping. [2025-10-25T22:29:28.228095] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols. IBM took 0.2s. Estimated remaining time: 4h 11m 11s [2025-10-25T22:29:28.395347] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:29:28.395521] [DEBUG] [LOCAL ] IBN: No existing data file found in primary storage. [2025-10-25T22:29:28.395591] [WARN ] [MAIN ] IBN: No existing data found, performing full refresh instead. [2025-10-25T22:29:28.395724] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-25T22:29:28.395798] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-25T22:29:28.395858] [DEBUG] [LOCAL ] IBN: No primary data file found to delete. [2025-10-25T22:29:28.395919] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-25T22:29:28.743926] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:29:28.744231] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-25T22:29:30.419300] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T22:29:30.430334] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-25T22:29:31.936158] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T22:29:31.946025] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-25T22:29:33.565292] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T22:29:33.576222] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-25T22:29:35.248303] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T22:29:35.259720] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-25T22:29:37.167118] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-25T22:29:37.178441] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-25T22:29:38.794422] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T22:29:38.804983] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-25T22:29:40.779224] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-25T22:29:40.790890] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-25T22:29:42.578530] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T22:29:42.590317] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-25T22:29:44.473393] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-25T22:29:44.484586] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-25T22:29:46.297192] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-25T22:29:46.307026] [INFO ] [REMOTE ] IBN: Full fetch complete (76660 records). [2025-10-25T22:29:46.307184] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-25T22:29:46.700127] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-25T22:29:46.700241] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-25T22:29:46.701307] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-25T22:29:46.701390] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-25T22:29:46.702898] [DEBUG] [LOCAL ] IBN: Trimmed 76660 records to 53601 (keeping 200 days of data) [2025-10-25T22:29:47.023068] [DEBUG] [LOCAL ] IBN: Primary data saved (53601 records). [2025-10-25T22:29:47.023262] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-25T22:29:47.023399] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols. IBN took 18.8s. Estimated remaining time: 4h 11m 8s [2025-10-25T22:29:47.191027] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:29:47.191251] [DEBUG] [LOCAL ] IBP: No existing data file found in primary storage. [2025-10-25T22:29:47.191322] [WARN ] [MAIN ] IBP: No existing data found, performing full refresh instead. [2025-10-25T22:29:47.191436] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-25T22:29:47.191505] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-25T22:29:47.191565] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-25T22:29:47.191629] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-25T22:29:47.544155] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:29:47.544580] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-25T22:29:48.826795] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T22:29:48.832131] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-25T22:29:50.056049] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T22:29:50.061900] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-25T22:29:51.470396] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T22:29:51.476939] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-25T22:29:52.765871] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T22:29:52.772914] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-25T22:29:54.075791] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T22:29:54.082179] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-25T22:29:55.349787] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T22:29:55.355955] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-25T22:29:56.606703] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T22:29:56.613584] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-25T22:29:58.099494] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-25T22:29:58.108415] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-25T22:29:59.375070] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T22:29:59.381206] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-25T22:30:00.545881] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T22:30:00.550985] [INFO ] [REMOTE ] IBP: Full fetch complete (41184 records). [2025-10-25T22:30:00.551113] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-25T22:30:00.941894] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-25T22:30:00.942005] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-25T22:30:00.942749] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-25T22:30:00.942830] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-25T22:30:00.943787] [DEBUG] [LOCAL ] IBP: Trimmed 41184 records to 29036 (keeping 200 days of data) [2025-10-25T22:30:01.122214] [DEBUG] [LOCAL ] IBP: Primary data saved (29036 records). [2025-10-25T22:30:01.122412] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-25T22:30:01.122564] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols. IBP took 14.1s. Estimated remaining time: 4h 10m 59s [2025-10-25T22:30:01.293731] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:30:01.293891] [DEBUG] [LOCAL ] IBTA: No existing data file found in primary storage. [2025-10-25T22:30:01.293968] [WARN ] [MAIN ] IBTA: No existing data found, performing full refresh instead. [2025-10-25T22:30:01.294098] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-25T22:30:01.294171] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-25T22:30:01.294268] [DEBUG] [LOCAL ] IBTA: No primary data file found to delete. [2025-10-25T22:30:01.294361] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-25T22:30:01.648125] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:30:01.648513] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-25T22:30:03.427595] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T22:30:03.433331] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-25T22:30:04.745381] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T22:30:04.750557] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-25T22:30:06.343526] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T22:30:06.353566] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-25T22:30:08.066102] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-25T22:30:08.076319] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-25T22:30:09.473231] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T22:30:09.482293] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-25T22:30:10.683777] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T22:30:10.690130] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-25T22:30:12.020324] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T22:30:12.026987] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-25T22:30:13.667370] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T22:30:13.676614] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-25T22:30:15.148506] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T22:30:15.157482] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-25T22:30:16.469412] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-25T22:30:16.475713] [INFO ] [REMOTE ] IBTA: Full fetch complete (51158 records). [2025-10-25T22:30:16.475833] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-25T22:30:16.852331] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-25T22:30:16.852451] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-25T22:30:16.853278] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-25T22:30:16.853359] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-25T22:30:16.854428] [DEBUG] [LOCAL ] IBTA: Trimmed 51158 records to 36486 (keeping 200 days of data) [2025-10-25T22:30:17.059916] [DEBUG] [LOCAL ] IBTA: Primary data saved (36486 records). [2025-10-25T22:30:17.060111] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-25T22:30:17.060320] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols. IBTA took 15.9s. Estimated remaining time: 4h 10m 52s [2025-10-25T22:30:17.229667] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:30:17.229904] [DEBUG] [LOCAL ] ICE: No existing data file found in primary storage. [2025-10-25T22:30:17.229996] [WARN ] [MAIN ] ICE: No existing data found, performing full refresh instead. [2025-10-25T22:30:17.230149] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-25T22:30:17.230228] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-25T22:30:17.230339] [DEBUG] [LOCAL ] ICE: No primary data file found to delete. [2025-10-25T22:30:17.230425] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-25T22:30:17.587178] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:30:17.587568] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-25T22:30:19.345952] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T22:30:19.356428] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-25T22:30:21.193231] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-25T22:30:21.203417] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-25T22:30:23.196748] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T22:30:23.207894] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-25T22:30:27.996994] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (4.79 seconds). [2025-10-25T22:30:28.008232] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-25T22:30:29.797391] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-25T22:30:29.808639] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-25T22:30:31.665070] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-25T22:30:31.676176] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-25T22:30:33.552381] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-25T22:30:33.563761] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-25T22:30:35.430142] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-25T22:30:35.441393] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-25T22:30:37.345322] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-25T22:30:37.356883] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-25T22:30:38.084115] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T22:30:38.094117] [INFO ] [REMOTE ] ICE: Full fetch complete (77023 records). [2025-10-25T22:30:38.094285] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-25T22:30:38.500093] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-25T22:30:38.500233] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-25T22:30:38.501237] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-25T22:30:38.501317] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-25T22:30:38.502813] [DEBUG] [LOCAL ] ICE: Trimmed 77023 records to 53789 (keeping 200 days of data) [2025-10-25T22:30:38.833151] [DEBUG] [LOCAL ] ICE: Primary data saved (53789 records). [2025-10-25T22:30:38.833335] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-25T22:30:38.833513] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols. ICE took 21.8s. Estimated remaining time: 4h 10m 52s [2025-10-25T22:30:39.008637] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:30:39.008869] [DEBUG] [LOCAL ] ICL: No existing data file found in primary storage. [2025-10-25T22:30:39.008941] [WARN ] [MAIN ] ICL: No existing data found, performing full refresh instead. [2025-10-25T22:30:39.009055] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-25T22:30:39.009129] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-25T22:30:39.009210] [DEBUG] [LOCAL ] ICL: No primary data file found to delete. [2025-10-25T22:30:39.009280] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-25T22:30:39.411445] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:30:39.411839] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-25T22:30:40.958241] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T22:30:40.966063] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-25T22:30:42.541055] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T22:30:42.548634] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-25T22:30:43.945114] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T22:30:43.953771] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-25T22:30:45.571599] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T22:30:45.580725] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-25T22:30:46.898149] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-25T22:30:46.906867] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-25T22:30:48.175214] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T22:30:48.183843] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-25T22:30:49.764472] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-25T22:30:49.772780] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-25T22:30:51.241229] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T22:30:51.249424] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-25T22:30:52.695256] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-25T22:30:52.703319] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-25T22:30:54.073153] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T22:30:54.079817] [INFO ] [REMOTE ] ICL: Full fetch complete (55765 records). [2025-10-25T22:30:54.079945] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-25T22:30:54.452267] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-25T22:30:54.452385] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-25T22:30:54.453242] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-25T22:30:54.453326] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-25T22:30:54.454409] [DEBUG] [LOCAL ] ICL: Trimmed 55765 records to 38567 (keeping 200 days of data) [2025-10-25T22:30:54.664871] [DEBUG] [LOCAL ] ICL: Primary data saved (38567 records). [2025-10-25T22:30:54.665046] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-25T22:30:54.665190] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols. ICL took 15.8s. Estimated remaining time: 4h 10m 45s [2025-10-25T22:30:54.829781] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:30:54.829972] [DEBUG] [LOCAL ] IDA: No existing data file found in primary storage. [2025-10-25T22:30:54.830041] [WARN ] [MAIN ] IDA: No existing data found, performing full refresh instead. [2025-10-25T22:30:54.830153] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-25T22:30:54.830222] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-25T22:30:54.830307] [DEBUG] [LOCAL ] IDA: No primary data file found to delete. [2025-10-25T22:30:54.830375] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-25T22:30:55.266296] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:30:55.266669] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-25T22:30:56.686190] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T22:30:56.692828] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-25T22:30:57.906068] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T22:30:57.911661] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-25T22:30:59.183277] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T22:30:59.189041] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-25T22:31:00.706420] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T22:31:00.713489] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-25T22:31:02.530833] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T22:31:02.541909] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-25T22:31:04.007080] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T22:31:04.014730] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-25T22:31:05.556696] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-25T22:31:05.565076] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-25T22:31:07.008492] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T22:31:07.015106] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-25T22:31:08.271412] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-25T22:31:08.277624] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-25T22:31:09.606844] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T22:31:09.612885] [INFO ] [REMOTE ] IDA: Full fetch complete (45427 records). [2025-10-25T22:31:09.613018] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-25T22:31:09.988297] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-25T22:31:09.988415] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-25T22:31:09.989244] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-25T22:31:09.989324] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-25T22:31:09.990338] [DEBUG] [LOCAL ] IDA: Trimmed 45427 records to 33218 (keeping 200 days of data) [2025-10-25T22:31:10.187117] [DEBUG] [LOCAL ] IDA: Primary data saved (33218 records). [2025-10-25T22:31:10.187282] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-25T22:31:10.187467] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols. IDA took 15.5s. Estimated remaining time: 4h 10m 38s [2025-10-25T22:31:10.357638] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:31:10.358049] [DEBUG] [LOCAL ] IDE: No existing data file found in primary storage. [2025-10-25T22:31:10.358134] [WARN ] [MAIN ] IDE: No existing data found, performing full refresh instead. [2025-10-25T22:31:10.358265] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-25T22:31:10.358351] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-25T22:31:10.358456] [DEBUG] [LOCAL ] IDE: No primary data file found to delete. [2025-10-25T22:31:10.358553] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-25T22:31:10.706900] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:31:10.707237] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-25T22:31:11.490517] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T22:31:11.493087] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-25T22:31:12.256833] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T22:31:12.259177] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-25T22:31:12.913061] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-25T22:31:12.915027] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-25T22:31:13.672725] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T22:31:13.674967] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-25T22:31:14.547567] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T22:31:14.550748] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-25T22:31:15.319638] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T22:31:15.322015] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-25T22:31:16.095142] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T22:31:16.098171] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-25T22:31:17.023023] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T22:31:17.026373] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-25T22:31:17.795332] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-25T22:31:17.798200] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-25T22:31:18.554852] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T22:31:18.557778] [INFO ] [REMOTE ] IDE: Full fetch complete (12864 records). [2025-10-25T22:31:18.557900] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-25T22:31:18.963207] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-25T22:31:18.963349] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-25T22:31:18.963722] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-25T22:31:18.963801] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-25T22:31:18.964322] [DEBUG] [LOCAL ] IDE: Trimmed 12864 records to 9211 (keeping 200 days of data) [2025-10-25T22:31:19.021991] [DEBUG] [LOCAL ] IDE: Primary data saved (9211 records). [2025-10-25T22:31:19.022153] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-25T22:31:19.022299] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols. IDE took 8.8s. Estimated remaining time: 4h 10m 23s [2025-10-25T22:31:19.203560] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:31:19.203771] [DEBUG] [LOCAL ] IDT: No existing data file found in primary storage. [2025-10-25T22:31:19.203841] [WARN ] [MAIN ] IDT: No existing data found, performing full refresh instead. [2025-10-25T22:31:19.203955] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-25T22:31:19.204028] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-25T22:31:19.204109] [DEBUG] [LOCAL ] IDT: No primary data file found to delete. [2025-10-25T22:31:19.204178] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-25T22:31:19.550500] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:31:19.550850] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-25T22:31:20.450151] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T22:31:20.452613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-25T22:31:21.238212] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T22:31:21.240480] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-25T22:31:22.152913] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-25T22:31:22.157036] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-25T22:31:23.217905] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T22:31:23.221604] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-25T22:31:24.321036] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T22:31:24.325305] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-25T22:31:25.356941] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T22:31:25.361937] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-25T22:31:26.528360] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T22:31:26.533153] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-25T22:31:27.507505] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T22:31:27.511381] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-25T22:31:28.653535] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T22:31:28.658299] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-25T22:31:29.790075] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T22:31:29.794576] [INFO ] [REMOTE ] IDT: Full fetch complete (24192 records). [2025-10-25T22:31:29.794734] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-25T22:31:30.155948] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-25T22:31:30.156113] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-25T22:31:30.156639] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-25T22:31:30.156737] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-25T22:31:30.157496] [DEBUG] [LOCAL ] IDT: Trimmed 24192 records to 18791 (keeping 200 days of data) [2025-10-25T22:31:30.267890] [DEBUG] [LOCAL ] IDT: Primary data saved (18791 records). [2025-10-25T22:31:30.268060] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-25T22:31:30.268202] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols. IDT took 11.2s. Estimated remaining time: 4h 10m 10s [2025-10-25T22:31:30.442282] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:31:30.442716] [DEBUG] [LOCAL ] IEX: No existing data file found in primary storage. [2025-10-25T22:31:30.442786] [WARN ] [MAIN ] IEX: No existing data found, performing full refresh instead. [2025-10-25T22:31:30.442929] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-25T22:31:30.443001] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-25T22:31:30.443081] [DEBUG] [LOCAL ] IEX: No primary data file found to delete. [2025-10-25T22:31:30.443147] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-25T22:31:30.791042] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:31:30.791370] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-25T22:31:32.051431] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T22:31:32.057824] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-25T22:31:33.398920] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T22:31:33.406054] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-25T22:31:35.007018] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T22:31:35.015339] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-25T22:31:36.901900] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-25T22:31:36.910678] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-25T22:31:37.974509] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T22:31:37.982740] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-25T22:31:39.396124] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T22:31:39.404258] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-25T22:31:40.850530] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T22:31:40.859018] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-25T22:31:43.707333] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-25T22:31:43.719263] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-25T22:31:44.420628] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T22:31:44.429126] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-25T22:31:45.126131] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T22:31:45.135364] [INFO ] [REMOTE ] IEX: Full fetch complete (53794 records). [2025-10-25T22:31:45.135540] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-25T22:31:45.521394] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-25T22:31:45.521509] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-25T22:31:45.522327] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-25T22:31:45.522406] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-25T22:31:45.523507] [DEBUG] [LOCAL ] IEX: Trimmed 53794 records to 38755 (keeping 200 days of data) [2025-10-25T22:31:45.756885] [DEBUG] [LOCAL ] IEX: Primary data saved (38755 records). [2025-10-25T22:31:45.757042] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-25T22:31:45.757159] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols. IEX took 15.5s. Estimated remaining time: 4h 10m 3s [2025-10-25T22:31:45.926537] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:31:45.926709] [DEBUG] [LOCAL ] IFF: No existing data file found in primary storage. [2025-10-25T22:31:45.926764] [WARN ] [MAIN ] IFF: No existing data found, performing full refresh instead. [2025-10-25T22:31:45.926866] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-25T22:31:45.926939] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-25T22:31:45.926997] [DEBUG] [LOCAL ] IFF: No primary data file found to delete. [2025-10-25T22:31:45.927057] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-25T22:31:46.272921] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:31:46.273271] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-25T22:31:47.780065] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T22:31:47.790500] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-25T22:31:49.298805] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T22:31:49.308956] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-25T22:31:51.082269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T22:31:51.093777] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-25T22:31:54.180692] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-10-25T22:31:54.191820] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-25T22:31:55.915810] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T22:31:55.926893] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-25T22:31:57.516504] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T22:31:57.526568] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-25T22:32:00.417592] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-25T22:32:00.429274] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-25T22:32:02.345382] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-25T22:32:02.356618] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-25T22:32:04.114511] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-25T22:32:04.125814] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-25T22:32:04.553783] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-25T22:32:04.563553] [INFO ] [REMOTE ] IFF: Full fetch complete (73766 records). [2025-10-25T22:32:04.563760] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-25T22:32:04.953673] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-25T22:32:04.953793] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-25T22:32:04.954771] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-25T22:32:04.954851] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-25T22:32:04.956239] [DEBUG] [LOCAL ] IFF: Trimmed 73766 records to 51978 (keeping 200 days of data) [2025-10-25T22:32:05.283255] [DEBUG] [LOCAL ] IFF: Primary data saved (51978 records). [2025-10-25T22:32:05.283455] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-25T22:32:05.283621] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols. IFF took 19.5s. Estimated remaining time: 4h 10m 0s [2025-10-25T22:32:05.451499] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:32:05.451719] [DEBUG] [LOCAL ] IFN: No existing data file found in primary storage. [2025-10-25T22:32:05.451791] [WARN ] [MAIN ] IFN: No existing data found, performing full refresh instead. [2025-10-25T22:32:05.451881] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-25T22:32:05.451947] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-25T22:32:05.452029] [DEBUG] [LOCAL ] IFN: No primary data file found to delete. [2025-10-25T22:32:05.452099] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-25T22:32:05.798269] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:32:05.798609] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-25T22:32:06.977535] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T22:32:06.983451] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-25T22:32:08.113745] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T22:32:08.118602] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-25T22:32:09.228294] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-25T22:32:09.232421] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-25T22:32:10.349573] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T22:32:10.354247] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-25T22:32:11.416638] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-25T22:32:11.421234] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-25T22:32:12.436237] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T22:32:12.440025] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-25T22:32:13.602565] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T22:32:13.607866] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-25T22:32:14.688491] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T22:32:14.693834] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-25T22:32:15.873820] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T22:32:15.878118] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-25T22:32:16.913404] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-25T22:32:16.917302] [INFO ] [REMOTE ] IFN: Full fetch complete (28154 records). [2025-10-25T22:32:16.917435] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-25T22:32:17.294684] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-25T22:32:17.294814] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-25T22:32:17.295440] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-25T22:32:17.295518] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-25T22:32:17.296345] [DEBUG] [LOCAL ] IFN: Trimmed 28154 records to 18773 (keeping 200 days of data) [2025-10-25T22:32:17.412959] [DEBUG] [LOCAL ] IFN: Primary data saved (18773 records). [2025-10-25T22:32:17.413136] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-25T22:32:17.413283] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols. IFN took 12.1s. Estimated remaining time: 4h 9m 49s [2025-10-25T22:32:17.585615] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:32:17.585836] [DEBUG] [LOCAL ] IFS: No existing data file found in primary storage. [2025-10-25T22:32:17.585928] [WARN ] [MAIN ] IFS: No existing data found, performing full refresh instead. [2025-10-25T22:32:17.586041] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-25T22:32:17.586112] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-25T22:32:17.586199] [DEBUG] [LOCAL ] IFS: No primary data file found to delete. [2025-10-25T22:32:17.586248] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-25T22:32:17.948397] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:32:17.948778] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-25T22:32:18.970255] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T22:32:18.973978] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-25T22:32:20.032450] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T22:32:20.037771] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-25T22:32:21.112451] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T22:32:21.118218] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-25T22:32:22.412284] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T22:32:22.418170] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-25T22:32:23.421126] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T22:32:23.426268] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-25T22:32:24.466615] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T22:32:24.472697] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-25T22:32:25.565461] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T22:32:25.570189] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-25T22:32:26.681767] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T22:32:26.686826] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-25T22:32:27.813859] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T22:32:27.819917] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-25T22:32:29.007447] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-25T22:32:29.011375] [INFO ] [REMOTE ] IFS: Full fetch complete (32318 records). [2025-10-25T22:32:29.011474] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-25T22:32:29.376374] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-25T22:32:29.376504] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-25T22:32:29.377174] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-25T22:32:29.377253] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-25T22:32:29.378120] [DEBUG] [LOCAL ] IFS: Trimmed 32318 records to 22413 (keeping 200 days of data) [2025-10-25T22:32:29.502153] [DEBUG] [LOCAL ] IFS: Primary data saved (22413 records). [2025-10-25T22:32:29.502323] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-25T22:32:29.502472] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols. IFS took 12.1s. Estimated remaining time: 4h 9m 37s [2025-10-25T22:32:29.669063] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:32:29.669244] [DEBUG] [LOCAL ] IGA: No existing data file found in primary storage. [2025-10-25T22:32:29.669311] [WARN ] [MAIN ] IGA: No existing data found, performing full refresh instead. [2025-10-25T22:32:29.669404] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-25T22:32:29.669471] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-25T22:32:29.669596] [DEBUG] [LOCAL ] IGA: No primary data file found to delete. [2025-10-25T22:32:29.669694] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-25T22:32:30.016842] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:32:30.017162] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-25T22:32:30.874843] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T22:32:30.877682] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-25T22:32:31.690153] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-25T22:32:31.692383] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-25T22:32:32.421973] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T22:32:32.424417] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-25T22:32:33.139369] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-25T22:32:33.143132] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-25T22:32:33.905595] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T22:32:33.907760] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-25T22:32:34.675327] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T22:32:34.677685] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-25T22:32:35.489495] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-25T22:32:35.492786] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-25T22:32:36.245960] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-25T22:32:36.249177] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-25T22:32:37.051383] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T22:32:37.054277] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-25T22:32:37.900629] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T22:32:37.903425] [INFO ] [REMOTE ] IGA: Full fetch complete (14267 records). [2025-10-25T22:32:37.903542] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-25T22:32:38.281309] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-25T22:32:38.281425] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-25T22:32:38.281797] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-25T22:32:38.281876] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-25T22:32:38.282428] [DEBUG] [LOCAL ] IGA: Trimmed 14267 records to 10208 (keeping 200 days of data) [2025-10-25T22:32:38.340889] [DEBUG] [LOCAL ] IGA: Primary data saved (10208 records). [2025-10-25T22:32:38.341070] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-25T22:32:38.341218] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols. IGA took 8.8s. Estimated remaining time: 4h 9m 22s [2025-10-25T22:32:38.540545] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:32:38.540759] [DEBUG] [LOCAL ] IGD: No existing data file found in primary storage. [2025-10-25T22:32:38.540830] [WARN ] [MAIN ] IGD: No existing data found, performing full refresh instead. [2025-10-25T22:32:38.540921] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-25T22:32:38.540987] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-25T22:32:38.541043] [DEBUG] [LOCAL ] IGD: No primary data file found to delete. [2025-10-25T22:32:38.541088] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-25T22:32:38.898857] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:32:38.899249] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-25T22:32:40.088734] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-25T22:32:40.095604] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-25T22:32:41.209701] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-25T22:32:41.214348] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-25T22:32:42.276304] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T22:32:42.281255] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-25T22:32:43.199708] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-25T22:32:43.204278] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-25T22:32:44.205066] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T22:32:44.209665] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-25T22:32:45.481749] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T22:32:45.487002] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-25T22:32:46.655322] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T22:32:46.661627] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-25T22:32:47.608045] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T22:32:47.612937] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-25T22:32:48.544020] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T22:32:48.548600] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-25T22:32:49.615998] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T22:32:49.620771] [INFO ] [REMOTE ] IGD: Full fetch complete (30107 records). [2025-10-25T22:32:49.620898] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-25T22:32:50.039808] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-25T22:32:50.039960] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-25T22:32:50.041029] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-25T22:32:50.041113] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-25T22:32:50.042109] [DEBUG] [LOCAL ] IGD: Trimmed 30107 records to 19483 (keeping 200 days of data) [2025-10-25T22:32:50.158267] [DEBUG] [LOCAL ] IGD: Primary data saved (19483 records). [2025-10-25T22:32:50.158522] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-25T22:32:50.158733] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols. IGD took 11.8s. Estimated remaining time: 4h 9m 10s [2025-10-25T22:32:50.338435] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:32:50.338775] [DEBUG] [LOCAL ] IGI: No existing data file found in primary storage. [2025-10-25T22:32:50.338854] [WARN ] [MAIN ] IGI: No existing data found, performing full refresh instead. [2025-10-25T22:32:50.338956] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-25T22:32:50.339030] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-25T22:32:50.339119] [DEBUG] [LOCAL ] IGI: No primary data file found to delete. [2025-10-25T22:32:50.339202] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-25T22:32:50.719879] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:32:50.720320] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-25T22:32:51.203839] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-25T22:32:51.205058] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-25T22:32:51.648283] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-25T22:32:51.649515] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-25T22:32:52.239149] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-25T22:32:52.240953] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-25T22:32:52.749157] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-25T22:32:52.750482] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-25T22:32:53.123324] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-25T22:32:53.124468] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-25T22:32:53.686733] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T22:32:53.688384] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-25T22:32:54.269770] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T22:32:54.271475] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-25T22:32:54.855329] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-25T22:32:54.857330] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-25T22:32:55.450686] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-25T22:32:55.452309] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-25T22:32:56.090501] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T22:32:56.092225] [INFO ] [REMOTE ] IGI: Full fetch complete (5578 records). [2025-10-25T22:32:56.092313] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-25T22:32:56.457451] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-25T22:32:56.457559] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-25T22:32:56.457782] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-25T22:32:56.457862] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-25T22:32:56.458260] [DEBUG] [LOCAL ] IGI: Trimmed 5578 records to 4180 (keeping 200 days of data) [2025-10-25T22:32:56.483045] [DEBUG] [LOCAL ] IGI: Primary data saved (4180 records). [2025-10-25T22:32:56.483152] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-25T22:32:56.483300] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols. IGI took 6.3s. Estimated remaining time: 4h 8m 52s [2025-10-25T22:32:56.658040] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:32:56.658255] [DEBUG] [LOCAL ] IGR: No existing data file found in primary storage. [2025-10-25T22:32:56.658328] [WARN ] [MAIN ] IGR: No existing data found, performing full refresh instead. [2025-10-25T22:32:56.658444] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-25T22:32:56.658516] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-25T22:32:56.658599] [DEBUG] [LOCAL ] IGR: No primary data file found to delete. [2025-10-25T22:32:56.658693] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-25T22:32:57.027507] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:32:57.027921] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-25T22:32:58.451860] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T22:32:58.462769] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-25T22:32:59.853056] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T22:32:59.859310] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-25T22:33:01.214600] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T22:33:01.220920] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-25T22:33:02.558877] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-25T22:33:02.565775] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-25T22:33:03.796724] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T22:33:03.803261] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-25T22:33:04.980911] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T22:33:04.986014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-25T22:33:06.538846] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T22:33:06.547266] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-25T22:33:08.010968] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T22:33:08.018335] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-25T22:33:09.316420] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T22:33:09.322993] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-25T22:33:10.730887] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T22:33:10.736384] [INFO ] [REMOTE ] IGR: Full fetch complete (44602 records). [2025-10-25T22:33:10.736501] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-25T22:33:11.130873] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-25T22:33:11.130983] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-25T22:33:11.131803] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-25T22:33:11.131883] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-25T22:33:11.132890] [DEBUG] [LOCAL ] IGR: Trimmed 44602 records to 30924 (keeping 200 days of data) [2025-10-25T22:33:11.306779] [DEBUG] [LOCAL ] IGR: Primary data saved (30924 records). [2025-10-25T22:33:11.306936] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-25T22:33:11.307073] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols. IGR took 14.8s. Estimated remaining time: 4h 8m 44s [2025-10-25T22:33:11.473290] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:33:11.473469] [DEBUG] [LOCAL ] IH: No existing data file found in primary storage. [2025-10-25T22:33:11.473539] [WARN ] [MAIN ] IH: No existing data found, performing full refresh instead. [2025-10-25T22:33:11.473672] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-25T22:33:11.473745] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-25T22:33:11.473822] [DEBUG] [LOCAL ] IH: No primary data file found to delete. [2025-10-25T22:33:11.473889] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-25T22:33:11.823056] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:33:11.823415] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-25T22:33:12.270694] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-25T22:33:12.271761] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-25T22:33:12.857946] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-25T22:33:12.860088] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-25T22:33:13.613185] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T22:33:13.615572] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-25T22:33:14.076376] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-25T22:33:14.077829] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-25T22:33:14.523030] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-25T22:33:14.524256] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-25T22:33:14.958184] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-25T22:33:14.959321] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-25T22:33:15.616477] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-25T22:33:15.618303] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-25T22:33:16.160542] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-25T22:33:16.162021] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-25T22:33:16.794309] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T22:33:16.795899] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-25T22:33:17.274294] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T22:33:17.275812] [INFO ] [REMOTE ] IH: Full fetch complete (5044 records). [2025-10-25T22:33:17.275915] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-25T22:33:17.672306] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-25T22:33:17.672439] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-25T22:33:17.672688] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-25T22:33:17.672786] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-25T22:33:17.673207] [DEBUG] [LOCAL ] IH: Trimmed 5044 records to 2759 (keeping 200 days of data) [2025-10-25T22:33:17.688838] [DEBUG] [LOCAL ] IH: Primary data saved (2759 records). [2025-10-25T22:33:17.688952] [INFO ] [MAIN ] IH: Full history saved. [2025-10-25T22:33:17.689106] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols. IH took 6.4s. Estimated remaining time: 4h 8m 26s [2025-10-25T22:33:17.865281] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:33:17.865469] [DEBUG] [LOCAL ] IHD: No existing data file found in primary storage. [2025-10-25T22:33:17.865545] [WARN ] [MAIN ] IHD: No existing data found, performing full refresh instead. [2025-10-25T22:33:17.865701] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-25T22:33:17.865798] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-25T22:33:17.865896] [DEBUG] [LOCAL ] IHD: No primary data file found to delete. [2025-10-25T22:33:17.865981] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-25T22:33:18.257281] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:33:18.257625] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-25T22:33:19.199468] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T22:33:19.202548] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-25T22:33:19.748309] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-25T22:33:19.750866] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-25T22:33:20.503548] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T22:33:20.506122] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-25T22:33:21.172977] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-25T22:33:21.175098] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-25T22:33:21.946315] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T22:33:21.949223] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-25T22:33:22.706489] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T22:33:22.708598] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-25T22:33:23.407756] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T22:33:23.409921] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-25T22:33:24.141936] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T22:33:24.143943] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-25T22:33:24.902724] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T22:33:24.905128] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-25T22:33:25.614621] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T22:33:25.616872] [INFO ] [REMOTE ] IHD: Full fetch complete (11694 records). [2025-10-25T22:33:25.616975] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-25T22:33:25.975349] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-25T22:33:25.975470] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-25T22:33:25.975835] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-25T22:33:25.975927] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-25T22:33:25.976521] [DEBUG] [LOCAL ] IHD: Trimmed 11694 records to 7446 (keeping 200 days of data) [2025-10-25T22:33:26.017577] [DEBUG] [LOCAL ] IHD: Primary data saved (7446 records). [2025-10-25T22:33:26.017771] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-25T22:33:26.018004] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols. IHD took 8.3s. Estimated remaining time: 4h 8m 10s [2025-10-25T22:33:26.187967] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:33:26.188148] [DEBUG] [LOCAL ] IHG: No existing data file found in primary storage. [2025-10-25T22:33:26.188238] [WARN ] [MAIN ] IHG: No existing data found, performing full refresh instead. [2025-10-25T22:33:26.188385] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-25T22:33:26.188465] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-25T22:33:26.188563] [DEBUG] [LOCAL ] IHG: No primary data file found to delete. [2025-10-25T22:33:26.188636] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-25T22:33:26.546677] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:33:26.547165] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-25T22:33:27.488179] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T22:33:27.491788] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-25T22:33:28.593298] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-25T22:33:28.598571] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-25T22:33:29.751517] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T22:33:29.761221] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-25T22:33:31.132672] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T22:33:31.139565] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-25T22:33:32.453771] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T22:33:32.459909] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-25T22:33:33.571539] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T22:33:33.576781] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-25T22:33:34.764110] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-25T22:33:34.769848] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-25T22:33:35.912026] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T22:33:35.918147] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-25T22:33:37.062120] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-25T22:33:37.067079] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-25T22:33:38.216880] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T22:33:38.221243] [INFO ] [REMOTE ] IHG: Full fetch complete (34436 records). [2025-10-25T22:33:38.221352] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-25T22:33:38.604502] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-25T22:33:38.604623] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-25T22:33:38.605323] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-25T22:33:38.605401] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-25T22:33:38.606356] [DEBUG] [LOCAL ] IHG: Trimmed 34436 records to 24297 (keeping 200 days of data) [2025-10-25T22:33:38.777912] [DEBUG] [LOCAL ] IHG: Primary data saved (24297 records). [2025-10-25T22:33:38.778139] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-25T22:33:38.778292] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols. IHG took 12.8s. Estimated remaining time: 4h 7m 60s [2025-10-25T22:33:38.956604] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:33:38.956804] [DEBUG] [LOCAL ] IHS: No existing data file found in primary storage. [2025-10-25T22:33:38.956874] [WARN ] [MAIN ] IHS: No existing data found, performing full refresh instead. [2025-10-25T22:33:38.956991] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-25T22:33:38.957060] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-25T22:33:38.957138] [DEBUG] [LOCAL ] IHS: No primary data file found to delete. [2025-10-25T22:33:38.957211] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-25T22:33:39.319491] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:33:39.319880] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-25T22:33:40.512379] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-25T22:33:40.518362] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-25T22:33:41.516925] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-25T22:33:41.522361] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-25T22:33:43.073364] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T22:33:43.082333] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-25T22:33:44.346973] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T22:33:44.355079] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-25T22:33:46.070826] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T22:33:46.080295] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-25T22:33:47.395565] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T22:33:47.404071] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-25T22:33:48.836415] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-25T22:33:48.845144] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-25T22:33:50.279098] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T22:33:50.287568] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-25T22:33:51.767141] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T22:33:51.775235] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-25T22:33:53.004120] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T22:33:53.009795] [INFO ] [REMOTE ] IHS: Full fetch complete (51566 records). [2025-10-25T22:33:53.009915] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-25T22:33:53.401272] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-25T22:33:53.401408] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-25T22:33:53.402275] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-25T22:33:53.402355] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-25T22:33:53.403426] [DEBUG] [LOCAL ] IHS: Trimmed 51566 records to 37672 (keeping 200 days of data) [2025-10-25T22:33:53.603806] [DEBUG] [LOCAL ] IHS: Primary data saved (37672 records). [2025-10-25T22:33:53.603986] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-25T22:33:53.604136] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols. IHS took 14.8s. Estimated remaining time: 4h 7m 52s [2025-10-25T22:33:53.778845] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:33:53.779057] [DEBUG] [LOCAL ] IIF: No existing data file found in primary storage. [2025-10-25T22:33:53.779128] [WARN ] [MAIN ] IIF: No existing data found, performing full refresh instead. [2025-10-25T22:33:53.779241] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-25T22:33:53.779311] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-25T22:33:53.779393] [DEBUG] [LOCAL ] IIF: No primary data file found to delete. [2025-10-25T22:33:53.779464] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-25T22:33:54.183909] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:33:54.184227] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-25T22:33:55.176987] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T22:33:55.179775] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-25T22:33:55.931914] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T22:33:55.934104] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-25T22:33:56.602222] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T22:33:56.604087] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-25T22:33:57.352135] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T22:33:57.354939] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-25T22:33:57.979470] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-25T22:33:57.981450] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-25T22:33:58.587117] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T22:33:58.588904] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-25T22:33:59.212905] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-25T22:33:59.215000] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-25T22:33:59.824297] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T22:33:59.826166] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-25T22:34:00.397756] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T22:34:00.399217] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-25T22:34:01.427055] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T22:34:01.428518] [INFO ] [REMOTE ] IIF: Full fetch complete (8762 records). [2025-10-25T22:34:01.428632] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-25T22:34:01.837025] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-25T22:34:01.837184] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-25T22:34:01.837680] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-25T22:34:01.837809] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-25T22:34:01.838373] [DEBUG] [LOCAL ] IIF: Trimmed 8762 records to 5325 (keeping 200 days of data) [2025-10-25T22:34:01.878130] [DEBUG] [LOCAL ] IIF: Primary data saved (5325 records). [2025-10-25T22:34:01.878329] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-25T22:34:01.878504] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols. IIF took 8.3s. Estimated remaining time: 4h 7m 36s [2025-10-25T22:34:02.061853] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:34:02.062073] [DEBUG] [LOCAL ] IIIN: No existing data file found in primary storage. [2025-10-25T22:34:02.062144] [WARN ] [MAIN ] IIIN: No existing data found, performing full refresh instead. [2025-10-25T22:34:02.062258] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-25T22:34:02.062327] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-25T22:34:02.062406] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-10-25T22:34:02.062475] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-25T22:34:02.434624] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:34:02.434978] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-25T22:34:03.880822] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T22:34:03.885679] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-25T22:34:04.857340] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-25T22:34:04.861139] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-25T22:34:05.974482] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-25T22:34:05.979571] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-25T22:34:07.077710] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T22:34:07.082854] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-25T22:34:08.153028] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T22:34:08.157173] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-25T22:34:09.131774] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T22:34:09.135534] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-25T22:34:10.164389] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-25T22:34:10.169069] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-25T22:34:10.992451] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-25T22:34:10.997112] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-25T22:34:11.801984] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T22:34:11.805200] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-25T22:34:12.950847] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T22:34:12.954603] [INFO ] [REMOTE ] IIIN: Full fetch complete (24955 records). [2025-10-25T22:34:12.954751] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-25T22:34:13.324041] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-25T22:34:13.324163] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-25T22:34:13.324751] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-25T22:34:13.324833] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-25T22:34:13.325473] [DEBUG] [LOCAL ] IIIN: Trimmed 24955 records to 16519 (keeping 200 days of data) [2025-10-25T22:34:13.423521] [DEBUG] [LOCAL ] IIIN: Primary data saved (16519 records). [2025-10-25T22:34:13.423728] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-25T22:34:13.423859] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols. IIIN took 11.5s. Estimated remaining time: 4h 7m 24s [2025-10-25T22:34:13.598060] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:34:13.598257] [DEBUG] [LOCAL ] IIM: No existing data file found in primary storage. [2025-10-25T22:34:13.598332] [WARN ] [MAIN ] IIM: No existing data found, performing full refresh instead. [2025-10-25T22:34:13.598447] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-25T22:34:13.598523] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-25T22:34:13.598606] [DEBUG] [LOCAL ] IIM: No primary data file found to delete. [2025-10-25T22:34:13.598703] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-25T22:34:13.972806] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:34:13.973133] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-25T22:34:15.325450] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T22:34:15.329842] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-25T22:34:16.387448] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T22:34:16.394934] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-25T22:34:17.511728] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-25T22:34:17.516197] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-25T22:34:18.476047] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T22:34:18.480182] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-25T22:34:19.456084] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T22:34:19.459466] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-25T22:34:20.402778] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T22:34:20.406638] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-25T22:34:21.331948] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T22:34:21.335782] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-25T22:34:22.310516] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T22:34:22.314462] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-25T22:34:23.289542] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T22:34:23.293967] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-25T22:34:24.284951] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T22:34:24.288789] [INFO ] [REMOTE ] IIM: Full fetch complete (24725 records). [2025-10-25T22:34:24.288997] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-25T22:34:24.648015] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-25T22:34:24.648153] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-25T22:34:24.648728] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-25T22:34:24.648808] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-25T22:34:24.649685] [DEBUG] [LOCAL ] IIM: Trimmed 24725 records to 15662 (keeping 200 days of data) [2025-10-25T22:34:24.742376] [DEBUG] [LOCAL ] IIM: Primary data saved (15662 records). [2025-10-25T22:34:24.742554] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-25T22:34:24.742721] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols. IIM took 11.3s. Estimated remaining time: 4h 7m 11s [2025-10-25T22:34:24.907872] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:34:24.908058] [DEBUG] [LOCAL ] IIPR: No existing data file found in primary storage. [2025-10-25T22:34:24.908128] [WARN ] [MAIN ] IIPR: No existing data found, performing full refresh instead. [2025-10-25T22:34:24.908239] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-25T22:34:24.908309] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-25T22:34:24.908365] [DEBUG] [LOCAL ] IIPR: No primary data file found to delete. [2025-10-25T22:34:24.908430] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-25T22:34:25.262856] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:34:25.263322] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-25T22:34:26.769301] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T22:34:26.776379] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-25T22:34:27.706948] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T22:34:27.712824] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-25T22:34:29.111337] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T22:34:29.118466] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-25T22:34:30.553323] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T22:34:30.560535] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-25T22:34:31.775227] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T22:34:31.781311] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-25T22:34:32.956873] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-25T22:34:32.962636] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-25T22:34:34.264009] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T22:34:34.270496] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-25T22:34:35.715788] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T22:34:35.723055] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-25T22:34:37.148234] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T22:34:37.154751] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-25T22:34:38.475954] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-25T22:34:38.481544] [INFO ] [REMOTE ] IIPR: Full fetch complete (43624 records). [2025-10-25T22:34:38.481713] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-25T22:34:38.864458] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-25T22:34:38.864583] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-25T22:34:38.865344] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-25T22:34:38.865426] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-25T22:34:38.866516] [DEBUG] [LOCAL ] IIPR: Trimmed 43624 records to 29218 (keeping 200 days of data) [2025-10-25T22:34:39.043704] [DEBUG] [LOCAL ] IIPR: Primary data saved (29218 records). [2025-10-25T22:34:39.043903] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-25T22:34:39.044052] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols. IIPR took 14.3s. Estimated remaining time: 4h 7m 3s [2025-10-25T22:34:39.213807] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:34:39.214023] [DEBUG] [LOCAL ] IMAX: No existing data file found in primary storage. [2025-10-25T22:34:39.214094] [WARN ] [MAIN ] IMAX: No existing data found, performing full refresh instead. [2025-10-25T22:34:39.214209] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-25T22:34:39.214280] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-25T22:34:39.214361] [DEBUG] [LOCAL ] IMAX: No primary data file found to delete. [2025-10-25T22:34:39.214430] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-25T22:34:39.585742] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:34:39.587165] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-25T22:34:41.133897] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T22:34:41.141227] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-25T22:34:42.452406] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T22:34:42.461081] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-25T22:34:43.972458] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-25T22:34:43.981379] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-25T22:34:45.643589] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T22:34:45.654195] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-25T22:34:47.167258] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T22:34:47.176782] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-25T22:34:48.557425] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T22:34:48.566898] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-25T22:34:50.065419] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T22:34:50.074972] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-25T22:34:51.479976] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T22:34:51.489403] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-25T22:34:52.902090] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T22:34:52.911323] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-25T22:34:54.567264] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-25T22:34:54.575614] [INFO ] [REMOTE ] IMAX: Full fetch complete (61256 records). [2025-10-25T22:34:54.575786] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-25T22:34:54.964815] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-25T22:34:54.964941] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-25T22:34:54.965803] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-25T22:34:54.965882] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-25T22:34:54.967113] [DEBUG] [LOCAL ] IMAX: Trimmed 61256 records to 44157 (keeping 200 days of data) [2025-10-25T22:34:55.211943] [DEBUG] [LOCAL ] IMAX: Primary data saved (44157 records). [2025-10-25T22:34:55.212075] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-25T22:34:55.212216] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols. IMAX took 16.2s. Estimated remaining time: 4h 6m 56s [2025-10-25T22:34:55.379799] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:34:55.380011] [DEBUG] [LOCAL ] INFA: No existing data file found in primary storage. [2025-10-25T22:34:55.380083] [WARN ] [MAIN ] INFA: No existing data found, performing full refresh instead. [2025-10-25T22:34:55.380203] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-25T22:34:55.380273] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-25T22:34:55.380353] [DEBUG] [LOCAL ] INFA: No primary data file found to delete. [2025-10-25T22:34:55.380420] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-25T22:34:55.739710] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:34:55.740092] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-25T22:34:57.463504] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T22:34:57.472977] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-25T22:34:59.145057] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T22:34:59.154404] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-25T22:35:00.896820] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T22:35:00.907357] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-25T22:35:02.824607] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-25T22:35:02.836529] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-25T22:35:04.550908] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-25T22:35:04.562600] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-25T22:35:06.262383] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T22:35:06.272706] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-25T22:35:07.962609] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-25T22:35:07.973387] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-25T22:35:09.896437] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-25T22:35:09.908086] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-25T22:35:11.377044] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T22:35:11.387187] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-25T22:35:12.877114] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-25T22:35:12.884998] [INFO ] [REMOTE ] INFA: Full fetch complete (70681 records). [2025-10-25T22:35:12.885230] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-25T22:35:13.288170] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-25T22:35:13.288322] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-25T22:35:13.289409] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-25T22:35:13.289516] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-25T22:35:13.291049] [DEBUG] [LOCAL ] INFA: Trimmed 70681 records to 49194 (keeping 200 days of data) [2025-10-25T22:35:13.570451] [DEBUG] [LOCAL ] INFA: Primary data saved (49194 records). [2025-10-25T22:35:13.570634] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-25T22:35:13.570836] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols. INFA took 18.4s. Estimated remaining time: 4h 6m 52s [2025-10-25T22:35:13.767275] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:35:13.767539] [DEBUG] [LOCAL ] INFY: No existing data file found in primary storage. [2025-10-25T22:35:13.767627] [WARN ] [MAIN ] INFY: No existing data found, performing full refresh instead. [2025-10-25T22:35:13.767834] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-25T22:35:13.767927] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-25T22:35:13.768033] [DEBUG] [LOCAL ] INFY: No primary data file found to delete. [2025-10-25T22:35:13.768119] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-25T22:35:14.135530] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:35:14.135881] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-25T22:35:16.129577] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T22:35:16.140140] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-25T22:35:18.064036] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T22:35:18.074374] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-25T22:35:19.876476] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T22:35:19.888122] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-25T22:35:21.821248] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-25T22:35:21.832290] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-25T22:35:23.514696] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T22:35:23.526458] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-25T22:35:25.218386] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-25T22:35:25.229718] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-25T22:35:27.234877] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-25T22:35:27.246303] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-25T22:35:28.987762] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T22:35:28.999462] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-25T22:35:30.976295] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-25T22:35:30.987622] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-25T22:35:32.829545] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-25T22:35:32.839373] [INFO ] [REMOTE ] INFY: Full fetch complete (77751 records). [2025-10-25T22:35:32.839595] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-25T22:35:33.226665] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-25T22:35:33.226807] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-25T22:35:33.227904] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-25T22:35:33.228007] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-25T22:35:33.229465] [DEBUG] [LOCAL ] INFY: Trimmed 77751 records to 54376 (keeping 200 days of data) [2025-10-25T22:35:33.541515] [DEBUG] [LOCAL ] INFY: Primary data saved (54376 records). [2025-10-25T22:35:33.541706] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-25T22:35:33.541862] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols. INFY took 20.0s. Estimated remaining time: 4h 6m 49s [2025-10-25T22:35:33.739832] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:35:33.740056] [DEBUG] [LOCAL ] ING: No existing data file found in primary storage. [2025-10-25T22:35:33.740131] [WARN ] [MAIN ] ING: No existing data found, performing full refresh instead. [2025-10-25T22:35:33.740256] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-25T22:35:33.740331] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-25T22:35:33.740436] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-25T22:35:33.740508] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-25T22:35:34.088812] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:35:34.089182] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-25T22:35:35.933892] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T22:35:35.943999] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-25T22:35:37.490092] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T22:35:37.499414] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-25T22:35:39.241529] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T22:35:39.252241] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-25T22:35:40.916882] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T22:35:40.928020] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-25T22:35:42.720085] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-25T22:35:42.731175] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-25T22:35:44.017930] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T22:35:44.027877] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-25T22:35:45.776321] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T22:35:45.787382] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-25T22:35:47.486220] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T22:35:47.496753] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-25T22:35:49.126572] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T22:35:49.137368] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-25T22:35:51.015637] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T22:35:51.024792] [INFO ] [REMOTE ] ING: Full fetch complete (73775 records). [2025-10-25T22:35:51.024936] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-25T22:35:51.410462] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-25T22:35:51.410581] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-25T22:35:51.411577] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-25T22:35:51.411681] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-25T22:35:51.413235] [DEBUG] [LOCAL ] ING: Trimmed 73775 records to 51407 (keeping 200 days of data) [2025-10-25T22:35:51.711766] [DEBUG] [LOCAL ] ING: Primary data saved (51407 records). [2025-10-25T22:35:51.711949] [INFO ] [MAIN ] ING: Full history saved. [2025-10-25T22:35:51.712095] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols. ING took 18.2s. Estimated remaining time: 4h 6m 45s [2025-10-25T22:35:51.882147] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:35:51.882336] [DEBUG] [LOCAL ] INGM: No existing data file found in primary storage. [2025-10-25T22:35:51.882408] [WARN ] [MAIN ] INGM: No existing data found, performing full refresh instead. [2025-10-25T22:35:51.882519] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-25T22:35:51.882590] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-25T22:35:51.882686] [DEBUG] [LOCAL ] INGM: No primary data file found to delete. [2025-10-25T22:35:51.882764] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-25T22:35:52.243730] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:35:52.244108] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-25T22:35:53.608236] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-25T22:35:53.614276] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-25T22:35:54.690410] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T22:35:54.695991] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-25T22:35:56.112380] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T22:35:56.119862] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-25T22:35:57.486050] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T22:35:57.493059] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-25T22:35:58.674433] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T22:35:58.681574] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-25T22:35:59.835997] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T22:35:59.841834] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-25T22:36:01.184858] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T22:36:01.191681] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-25T22:36:03.096767] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-25T22:36:03.102768] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-25T22:36:04.250454] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T22:36:04.256413] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-25T22:36:05.379698] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-25T22:36:05.385081] [INFO ] [REMOTE ] INGM: Full fetch complete (41793 records). [2025-10-25T22:36:05.385199] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-25T22:36:05.755161] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-25T22:36:05.755279] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-25T22:36:05.756009] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-25T22:36:05.756089] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-25T22:36:05.757019] [DEBUG] [LOCAL ] INGM: Trimmed 41793 records to 28491 (keeping 200 days of data) [2025-10-25T22:36:05.927233] [DEBUG] [LOCAL ] INGM: Primary data saved (28491 records). [2025-10-25T22:36:05.927463] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-25T22:36:05.927667] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols. INGM took 14.2s. Estimated remaining time: 4h 6m 35s [2025-10-25T22:36:06.105845] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:36:06.106040] [DEBUG] [LOCAL ] INGR: No existing data file found in primary storage. [2025-10-25T22:36:06.106123] [WARN ] [MAIN ] INGR: No existing data found, performing full refresh instead. [2025-10-25T22:36:06.106238] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-25T22:36:06.106310] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-25T22:36:06.106370] [DEBUG] [LOCAL ] INGR: No primary data file found to delete. [2025-10-25T22:36:06.106437] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-25T22:36:06.472899] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:36:06.473295] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-25T22:36:08.054824] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-25T22:36:08.062211] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-25T22:36:09.642236] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T22:36:09.650170] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-25T22:36:11.360589] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T22:36:11.368564] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-25T22:36:12.762491] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T22:36:12.773799] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-25T22:36:14.280230] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T22:36:14.287432] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-25T22:36:15.614416] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T22:36:15.621086] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-25T22:36:17.009384] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-25T22:36:17.017938] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-25T22:36:18.418489] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T22:36:18.426157] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-25T22:36:19.805629] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T22:36:19.814154] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-25T22:36:21.118736] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-25T22:36:21.125988] [INFO ] [REMOTE ] INGR: Full fetch complete (50824 records). [2025-10-25T22:36:21.126206] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-25T22:36:21.502585] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-25T22:36:21.502733] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-25T22:36:21.503500] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-25T22:36:21.503596] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-25T22:36:21.504749] [DEBUG] [LOCAL ] INGR: Trimmed 50824 records to 34234 (keeping 200 days of data) [2025-10-25T22:36:21.710525] [DEBUG] [LOCAL ] INGR: Primary data saved (34234 records). [2025-10-25T22:36:21.710717] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-25T22:36:21.710879] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols. INGR took 15.8s. Estimated remaining time: 4h 6m 28s [2025-10-25T22:36:21.876986] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:36:21.877218] [DEBUG] [LOCAL ] INN: No existing data file found in primary storage. [2025-10-25T22:36:21.877301] [WARN ] [MAIN ] INN: No existing data found, performing full refresh instead. [2025-10-25T22:36:21.877431] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-25T22:36:21.877515] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-25T22:36:21.877622] [DEBUG] [LOCAL ] INN: No primary data file found to delete. [2025-10-25T22:36:21.877754] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-25T22:36:22.238197] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:36:22.238590] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-25T22:36:23.708001] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T22:36:23.714487] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-25T22:36:24.951197] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T22:36:24.958231] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-25T22:36:26.409598] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T22:36:26.417632] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-25T22:36:27.951081] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T22:36:27.960488] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-25T22:36:29.491861] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T22:36:29.503168] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-25T22:36:31.044610] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T22:36:31.054404] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-25T22:36:32.881860] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T22:36:32.890929] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-25T22:36:34.286499] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T22:36:34.295241] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-25T22:36:35.620376] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T22:36:35.628301] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-25T22:36:37.002067] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T22:36:37.008968] [INFO ] [REMOTE ] INN: Full fetch complete (57670 records). [2025-10-25T22:36:37.009128] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-25T22:36:37.388115] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-25T22:36:37.388247] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-25T22:36:37.389130] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-25T22:36:37.389217] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-25T22:36:37.390478] [DEBUG] [LOCAL ] INN: Trimmed 57670 records to 41981 (keeping 200 days of data) [2025-10-25T22:36:37.622437] [DEBUG] [LOCAL ] INN: Primary data saved (41981 records). [2025-10-25T22:36:37.622614] [INFO ] [MAIN ] INN: Full history saved. [2025-10-25T22:36:37.622833] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols. INN took 15.9s. Estimated remaining time: 4h 6m 21s [2025-10-25T22:36:37.791562] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:36:37.791783] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-25T22:36:37.791874] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-25T22:36:37.792020] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-25T22:36:37.792105] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-25T22:36:37.792212] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-25T22:36:37.792303] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-25T22:36:38.148072] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:36:38.148463] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-25T22:36:38.560898] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-25T22:36:38.561973] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-25T22:36:39.856042] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T22:36:39.863107] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-25T22:36:41.153533] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T22:36:41.160735] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-25T22:36:42.296492] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T22:36:42.302047] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-25T22:36:43.385321] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T22:36:43.391294] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-25T22:36:44.416728] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T22:36:44.422409] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-25T22:36:45.627998] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T22:36:45.634478] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-25T22:36:46.836457] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T22:36:46.842682] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-25T22:36:48.070734] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T22:36:48.077201] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-25T22:36:49.255156] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-25T22:36:49.260424] [INFO ] [REMOTE ] INR: Full fetch complete (37662 records). [2025-10-25T22:36:49.260533] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-25T22:36:49.447894] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-25T22:36:49.448473] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:36:49.448551] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:36:49.448624] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-25T22:36:49.448903] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-25T22:36:49.448978] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-25T22:36:49.449061] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-25T22:36:49.449200] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols. INR took 11.8s. Estimated remaining time: 4h 6m 9s [2025-10-25T22:36:49.616094] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:36:49.616293] [DEBUG] [LOCAL ] INSP: No existing data file found in primary storage. [2025-10-25T22:36:49.616364] [WARN ] [MAIN ] INSP: No existing data found, performing full refresh instead. [2025-10-25T22:36:49.616459] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-25T22:36:49.616526] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-25T22:36:49.616608] [DEBUG] [LOCAL ] INSP: No primary data file found to delete. [2025-10-25T22:36:49.616728] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-25T22:36:49.974030] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:36:49.974365] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-25T22:36:51.471005] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T22:36:51.478216] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-25T22:36:52.750030] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T22:36:52.757265] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-25T22:36:54.162636] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T22:36:54.169577] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-25T22:36:55.614288] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T22:36:55.621531] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-25T22:36:57.037016] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T22:36:57.044375] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-25T22:36:58.279053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-25T22:36:58.286350] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-25T22:36:59.632241] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T22:36:59.640178] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-25T22:37:01.454632] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T22:37:01.465253] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-25T22:37:03.711617] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-25T22:37:03.721547] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-25T22:37:05.222438] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T22:37:05.230634] [INFO ] [REMOTE ] INSP: Full fetch complete (53909 records). [2025-10-25T22:37:05.230819] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-25T22:37:05.658088] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-25T22:37:05.658252] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-25T22:37:05.659329] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-25T22:37:05.659438] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-25T22:37:05.660794] [DEBUG] [LOCAL ] INSP: Trimmed 53909 records to 39188 (keeping 200 days of data) [2025-10-25T22:37:05.980472] [DEBUG] [LOCAL ] INSP: Primary data saved (39188 records). [2025-10-25T22:37:05.980776] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-25T22:37:05.980998] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols. INSP took 16.5s. Estimated remaining time: 4h 6m 3s [2025-10-25T22:37:06.254383] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:37:06.254621] [DEBUG] [LOCAL ] INSW: No existing data file found in primary storage. [2025-10-25T22:37:06.254736] [WARN ] [MAIN ] INSW: No existing data found, performing full refresh instead. [2025-10-25T22:37:06.254876] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-25T22:37:06.254962] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-25T22:37:06.255065] [DEBUG] [LOCAL ] INSW: No primary data file found to delete. [2025-10-25T22:37:06.255144] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-25T22:37:06.653685] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:37:06.654071] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-25T22:37:08.288072] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T22:37:08.298360] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-25T22:37:09.853791] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T22:37:09.863202] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-25T22:37:11.395208] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T22:37:11.405935] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-25T22:37:13.018197] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T22:37:13.027850] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-25T22:37:14.266329] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-25T22:37:14.275334] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-25T22:37:15.635187] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T22:37:15.643916] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-25T22:37:17.325173] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T22:37:17.333822] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-25T22:37:18.799837] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T22:37:18.808466] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-25T22:37:20.248259] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T22:37:20.256587] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-25T22:37:21.789768] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-25T22:37:21.796895] [INFO ] [REMOTE ] INSW: Full fetch complete (59337 records). [2025-10-25T22:37:21.797039] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-25T22:37:22.212365] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-25T22:37:22.212491] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-25T22:37:22.213485] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-25T22:37:22.213571] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-25T22:37:22.214890] [DEBUG] [LOCAL ] INSW: Trimmed 59337 records to 39745 (keeping 200 days of data) [2025-10-25T22:37:22.450189] [DEBUG] [LOCAL ] INSW: Primary data saved (39745 records). [2025-10-25T22:37:22.450369] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-25T22:37:22.450514] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols. INSW took 16.5s. Estimated remaining time: 4h 5m 56s [2025-10-25T22:37:22.614785] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:37:22.614970] [DEBUG] [LOCAL ] INVH: No existing data file found in primary storage. [2025-10-25T22:37:22.615039] [WARN ] [MAIN ] INVH: No existing data found, performing full refresh instead. [2025-10-25T22:37:22.615149] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-25T22:37:22.615219] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-25T22:37:22.615305] [DEBUG] [LOCAL ] INVH: No primary data file found to delete. [2025-10-25T22:37:22.615378] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-25T22:37:22.960020] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:37:22.960346] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-25T22:37:24.703623] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T22:37:24.714902] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-25T22:37:26.306637] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T22:37:26.317109] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-25T22:37:27.933005] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T22:37:27.944978] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-25T22:37:29.675188] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T22:37:29.686535] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-25T22:37:31.381362] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T22:37:31.392578] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-25T22:37:32.986729] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T22:37:32.997415] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-25T22:37:34.790201] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-25T22:37:34.801843] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-25T22:37:36.405000] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T22:37:36.417695] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-25T22:37:37.222561] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T22:37:37.237721] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-25T22:37:37.977540] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T22:37:37.987578] [INFO ] [REMOTE ] INVH: Full fetch complete (76992 records). [2025-10-25T22:37:37.987851] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-25T22:37:38.400111] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-25T22:37:38.400243] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-25T22:37:38.401442] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-25T22:37:38.401534] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-25T22:37:38.403160] [DEBUG] [LOCAL ] INVH: Trimmed 76992 records to 53967 (keeping 200 days of data) [2025-10-25T22:37:38.727298] [DEBUG] [LOCAL ] INVH: Primary data saved (53967 records). [2025-10-25T22:37:38.727488] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-25T22:37:38.727638] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols. INVH took 16.3s. Estimated remaining time: 4h 5m 49s [2025-10-25T22:37:38.902448] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:37:38.902673] [DEBUG] [LOCAL ] INVX: No existing data file found in primary storage. [2025-10-25T22:37:38.902753] [WARN ] [MAIN ] INVX: No existing data found, performing full refresh instead. [2025-10-25T22:37:38.902865] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-25T22:37:38.902936] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-25T22:37:38.903016] [DEBUG] [LOCAL ] INVX: No primary data file found to delete. [2025-10-25T22:37:38.903090] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-25T22:37:39.249358] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:37:39.249755] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-25T22:37:40.821983] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T22:37:40.829941] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-25T22:37:42.019129] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-25T22:37:42.026168] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-25T22:37:43.239494] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T22:37:43.245530] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-25T22:37:44.761223] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T22:37:44.769050] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-25T22:37:45.949312] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T22:37:45.956048] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-25T22:37:47.113242] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T22:37:47.119848] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-25T22:37:48.374333] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T22:37:48.381401] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-25T22:37:49.513479] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T22:37:49.519894] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-25T22:37:50.717737] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-25T22:37:50.723762] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-25T22:37:51.597840] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-25T22:37:51.603166] [INFO ] [REMOTE ] INVX: Full fetch complete (42697 records). [2025-10-25T22:37:51.603309] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-25T22:37:52.002918] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-25T22:37:52.003047] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-25T22:37:52.003810] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-25T22:37:52.003907] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-25T22:37:52.004931] [DEBUG] [LOCAL ] INVX: Trimmed 42697 records to 29473 (keeping 200 days of data) [2025-10-25T22:37:52.166898] [DEBUG] [LOCAL ] INVX: Primary data saved (29473 records). [2025-10-25T22:37:52.167060] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-25T22:37:52.167220] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols. INVX took 13.4s. Estimated remaining time: 4h 5m 39s [2025-10-25T22:37:52.333066] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:37:52.333260] [DEBUG] [LOCAL ] IONQ: No existing data file found in primary storage. [2025-10-25T22:37:52.333353] [WARN ] [MAIN ] IONQ: No existing data found, performing full refresh instead. [2025-10-25T22:37:52.333507] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-25T22:37:52.333604] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-25T22:37:52.333725] [DEBUG] [LOCAL ] IONQ: No primary data file found to delete. [2025-10-25T22:37:52.333811] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-25T22:37:52.689973] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:37:52.690494] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-25T22:37:55.409240] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-25T22:37:55.420199] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-25T22:37:57.663586] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-25T22:37:57.674119] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-25T22:37:59.989766] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-25T22:38:00.000731] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-25T22:38:02.794808] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-25T22:38:02.806185] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-25T22:38:05.319829] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-25T22:38:05.331420] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-25T22:38:07.654361] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-25T22:38:07.667579] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-25T22:38:10.277165] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-25T22:38:10.289195] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-25T22:38:13.129792] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-25T22:38:13.142211] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-25T22:38:15.588148] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-25T22:38:15.600965] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-25T22:38:18.421623] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-25T22:38:18.431901] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-25T22:38:18.432087] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-25T22:38:18.836230] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-25T22:38:18.836346] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-25T22:38:18.837361] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-25T22:38:18.837442] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-25T22:38:18.838896] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-25T22:38:19.154615] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-25T22:38:19.154831] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-25T22:38:19.154991] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols. IONQ took 27.0s. Estimated remaining time: 4h 5m 45s [2025-10-25T22:38:19.331599] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:38:19.331809] [DEBUG] [LOCAL ] IOT: No existing data file found in primary storage. [2025-10-25T22:38:19.331879] [WARN ] [MAIN ] IOT: No existing data found, performing full refresh instead. [2025-10-25T22:38:19.331970] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-25T22:38:19.332037] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-25T22:38:19.332117] [DEBUG] [LOCAL ] IOT: No primary data file found to delete. [2025-10-25T22:38:19.332185] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-25T22:38:19.701982] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:38:19.702355] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-25T22:38:21.638438] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-25T22:38:21.649226] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-25T22:38:23.525396] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T22:38:23.535549] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-25T22:38:25.532328] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-25T22:38:25.543715] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-25T22:38:27.384907] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T22:38:27.396520] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-25T22:38:29.174479] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-25T22:38:29.185583] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-25T22:38:31.020008] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T22:38:31.031036] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-25T22:38:32.902714] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-25T22:38:32.914447] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-25T22:38:34.705168] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T22:38:34.716545] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-25T22:38:36.529596] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-25T22:38:36.541521] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-25T22:38:38.252601] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-25T22:38:38.262972] [INFO ] [REMOTE ] IOT: Full fetch complete (77529 records). [2025-10-25T22:38:38.263233] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-25T22:38:38.673196] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-25T22:38:38.673338] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-25T22:38:38.674413] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-25T22:38:38.674501] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-25T22:38:38.676136] [DEBUG] [LOCAL ] IOT: Trimmed 77529 records to 54232 (keeping 200 days of data) [2025-10-25T22:38:38.981048] [DEBUG] [LOCAL ] IOT: Primary data saved (54232 records). [2025-10-25T22:38:38.981216] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-25T22:38:38.981359] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols. IOT took 19.8s. Estimated remaining time: 4h 5m 42s [2025-10-25T22:38:39.148552] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:38:39.148795] [DEBUG] [LOCAL ] IP: No existing data file found in primary storage. [2025-10-25T22:38:39.148867] [WARN ] [MAIN ] IP: No existing data found, performing full refresh instead. [2025-10-25T22:38:39.148980] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-25T22:38:39.149050] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-25T22:38:39.149130] [DEBUG] [LOCAL ] IP: No primary data file found to delete. [2025-10-25T22:38:39.149200] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-25T22:38:39.507535] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:38:39.507949] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-25T22:38:41.211535] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T22:38:41.222000] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-25T22:38:42.938959] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T22:38:42.948987] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-25T22:38:44.716688] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T22:38:44.727618] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-25T22:38:46.582046] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T22:38:46.593041] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-25T22:38:48.309139] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T22:38:48.320326] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-25T22:38:49.893558] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T22:38:49.904228] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-25T22:38:51.762946] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T22:38:51.774404] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-25T22:38:53.410622] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T22:38:53.422491] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-25T22:38:55.140292] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T22:38:55.151722] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-25T22:38:55.873874] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T22:38:55.883795] [INFO ] [REMOTE ] IP: Full fetch complete (77419 records). [2025-10-25T22:38:55.883935] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-25T22:38:56.283475] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-25T22:38:56.283621] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-25T22:38:56.284748] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-25T22:38:56.284854] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-25T22:38:56.286492] [DEBUG] [LOCAL ] IP: Trimmed 77419 records to 54078 (keeping 200 days of data) [2025-10-25T22:38:56.603343] [DEBUG] [LOCAL ] IP: Primary data saved (54078 records). [2025-10-25T22:38:56.603508] [INFO ] [MAIN ] IP: Full history saved. [2025-10-25T22:38:56.603671] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols. IP took 17.6s. Estimated remaining time: 4h 5m 36s [2025-10-25T22:38:56.781619] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:38:56.781832] [DEBUG] [LOCAL ] IPG: No existing data file found in primary storage. [2025-10-25T22:38:56.781905] [WARN ] [MAIN ] IPG: No existing data found, performing full refresh instead. [2025-10-25T22:38:56.782012] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-25T22:38:56.782087] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-25T22:38:56.782175] [DEBUG] [LOCAL ] IPG: No primary data file found to delete. [2025-10-25T22:38:56.782245] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-25T22:38:57.166355] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:38:57.166748] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-25T22:38:59.205534] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-25T22:38:59.216054] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-25T22:39:00.800967] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T22:39:00.811926] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-25T22:39:03.089457] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-25T22:39:03.101777] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-25T22:39:04.836448] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T22:39:04.847430] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-25T22:39:06.645356] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-25T22:39:06.656766] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-25T22:39:08.264397] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T22:39:08.275184] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-25T22:39:10.002512] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T22:39:10.014277] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-25T22:39:11.718879] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T22:39:11.730940] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-25T22:39:12.543167] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-25T22:39:12.555818] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-25T22:39:13.281079] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T22:39:13.290833] [INFO ] [REMOTE ] IPG: Full fetch complete (77445 records). [2025-10-25T22:39:13.290984] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-25T22:39:13.703952] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-25T22:39:13.704082] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-25T22:39:13.705289] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-25T22:39:13.705382] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-25T22:39:13.707085] [DEBUG] [LOCAL ] IPG: Trimmed 77445 records to 54110 (keeping 200 days of data) [2025-10-25T22:39:14.023750] [DEBUG] [LOCAL ] IPG: Primary data saved (54110 records). [2025-10-25T22:39:14.023921] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-25T22:39:14.024045] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols. IPG took 17.4s. Estimated remaining time: 4h 5m 31s [2025-10-25T22:39:14.192447] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:39:14.192697] [DEBUG] [LOCAL ] IPI: No existing data file found in primary storage. [2025-10-25T22:39:14.192777] [WARN ] [MAIN ] IPI: No existing data found, performing full refresh instead. [2025-10-25T22:39:14.192897] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-25T22:39:14.192971] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-25T22:39:14.193049] [DEBUG] [LOCAL ] IPI: No primary data file found to delete. [2025-10-25T22:39:14.193116] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-25T22:39:14.536859] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:39:14.537184] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-25T22:39:15.778213] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T22:39:15.782063] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-25T22:39:16.748149] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-25T22:39:16.752342] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-25T22:39:17.879129] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-25T22:39:17.884733] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-25T22:39:18.983198] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T22:39:18.988922] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-25T22:39:20.123412] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T22:39:20.129192] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-25T22:39:21.133761] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T22:39:21.140546] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-25T22:39:22.156607] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T22:39:22.161616] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-25T22:39:23.238737] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T22:39:23.243727] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-25T22:39:24.432479] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-25T22:39:24.437523] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-25T22:39:25.664505] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-25T22:39:25.669255] [INFO ] [REMOTE ] IPI: Full fetch complete (30410 records). [2025-10-25T22:39:25.669354] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-25T22:39:26.032705] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-25T22:39:26.032833] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-25T22:39:26.033529] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-25T22:39:26.033612] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-25T22:39:26.034437] [DEBUG] [LOCAL ] IPI: Trimmed 30410 records to 21710 (keeping 200 days of data) [2025-10-25T22:39:26.155850] [DEBUG] [LOCAL ] IPI: Primary data saved (21710 records). [2025-10-25T22:39:26.156019] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-25T22:39:26.156172] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols. IPI took 12.1s. Estimated remaining time: 4h 5m 19s [2025-10-25T22:39:26.329700] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:39:26.329932] [DEBUG] [LOCAL ] IQI: No existing data file found in primary storage. [2025-10-25T22:39:26.330011] [WARN ] [MAIN ] IQI: No existing data found, performing full refresh instead. [2025-10-25T22:39:26.330130] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-25T22:39:26.330233] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-25T22:39:26.330326] [DEBUG] [LOCAL ] IQI: No primary data file found to delete. [2025-10-25T22:39:26.330398] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-25T22:39:26.686860] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:39:26.687196] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-25T22:39:27.961325] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-25T22:39:27.965473] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-25T22:39:28.983044] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T22:39:28.988186] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-25T22:39:29.972529] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T22:39:29.977023] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-25T22:39:31.068136] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T22:39:31.073794] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-25T22:39:31.725511] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-25T22:39:31.729847] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-25T22:39:32.773229] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T22:39:32.777199] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-25T22:39:33.855877] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T22:39:33.862447] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-25T22:39:34.924524] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T22:39:34.929961] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-25T22:39:35.869123] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T22:39:35.873979] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-25T22:39:36.724405] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T22:39:36.727597] [INFO ] [REMOTE ] IQI: Full fetch complete (26273 records). [2025-10-25T22:39:36.727711] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-25T22:39:37.085673] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-25T22:39:37.085785] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-25T22:39:37.086293] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-25T22:39:37.086361] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-25T22:39:37.087051] [DEBUG] [LOCAL ] IQI: Trimmed 26273 records to 17915 (keeping 200 days of data) [2025-10-25T22:39:37.188169] [DEBUG] [LOCAL ] IQI: Primary data saved (17915 records). [2025-10-25T22:39:37.188326] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-25T22:39:37.188472] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols. IQI took 11.0s. Estimated remaining time: 4h 5m 6s [2025-10-25T22:39:37.352892] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:39:37.353072] [DEBUG] [LOCAL ] IQV: No existing data file found in primary storage. [2025-10-25T22:39:37.353121] [WARN ] [MAIN ] IQV: No existing data found, performing full refresh instead. [2025-10-25T22:39:37.353253] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-25T22:39:37.353322] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-25T22:39:37.353401] [DEBUG] [LOCAL ] IQV: No primary data file found to delete. [2025-10-25T22:39:37.353477] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-25T22:39:37.704968] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:39:37.705305] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-25T22:39:39.388484] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T22:39:39.398134] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-25T22:39:40.934302] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:39:40.943777] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-25T22:39:42.569971] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T22:39:42.580527] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-25T22:39:44.164323] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T22:39:44.175432] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-25T22:39:45.893212] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T22:39:45.913210] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-25T22:39:47.654489] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-25T22:39:47.668561] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-25T22:39:49.584423] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-25T22:39:49.596355] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-25T22:39:51.151617] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T22:39:51.164057] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-25T22:39:52.666596] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T22:39:52.676528] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-25T22:39:53.403392] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T22:39:53.412761] [INFO ] [REMOTE ] IQV: Full fetch complete (72625 records). [2025-10-25T22:39:53.412946] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-25T22:39:53.797785] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-25T22:39:53.797927] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-25T22:39:53.799017] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-25T22:39:53.799119] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-25T22:39:53.800529] [DEBUG] [LOCAL ] IQV: Trimmed 72625 records to 50707 (keeping 200 days of data) [2025-10-25T22:39:54.088158] [DEBUG] [LOCAL ] IQV: Primary data saved (50707 records). [2025-10-25T22:39:54.088341] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-25T22:39:54.088506] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols. IQV took 16.9s. Estimated remaining time: 4h 5m 0s [2025-10-25T22:39:54.261975] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:39:54.262199] [DEBUG] [LOCAL ] IR: No existing data file found in primary storage. [2025-10-25T22:39:54.262285] [WARN ] [MAIN ] IR: No existing data found, performing full refresh instead. [2025-10-25T22:39:54.262422] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-25T22:39:54.262512] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-25T22:39:54.262619] [DEBUG] [LOCAL ] IR: No primary data file found to delete. [2025-10-25T22:39:54.262765] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-25T22:39:54.621854] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:39:54.622173] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-25T22:39:56.303760] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T22:39:56.313981] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-25T22:39:57.855242] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:39:57.865364] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-25T22:39:59.562892] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T22:39:59.573615] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-25T22:40:01.517512] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T22:40:01.528907] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-25T22:40:03.522796] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T22:40:03.534799] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-25T22:40:05.239744] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T22:40:05.250442] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-25T22:40:06.975253] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-25T22:40:06.986795] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-25T22:40:08.670596] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T22:40:08.682051] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-25T22:40:10.465718] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T22:40:10.477843] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-25T22:40:11.231445] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T22:40:11.240942] [INFO ] [REMOTE ] IR: Full fetch complete (76478 records). [2025-10-25T22:40:11.241104] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-25T22:40:11.623398] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-25T22:40:11.623512] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-25T22:40:11.624501] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-25T22:40:11.624580] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-25T22:40:11.626179] [DEBUG] [LOCAL ] IR: Trimmed 76478 records to 53502 (keeping 200 days of data) [2025-10-25T22:40:11.939924] [DEBUG] [LOCAL ] IR: Primary data saved (53502 records). [2025-10-25T22:40:11.940111] [INFO ] [MAIN ] IR: Full history saved. [2025-10-25T22:40:11.940282] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols. IR took 17.9s. Estimated remaining time: 4h 4m 55s [2025-10-25T22:40:12.107447] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:40:12.107671] [DEBUG] [LOCAL ] IRM: No existing data file found in primary storage. [2025-10-25T22:40:12.107767] [WARN ] [MAIN ] IRM: No existing data found, performing full refresh instead. [2025-10-25T22:40:12.107881] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-25T22:40:12.107956] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-25T22:40:12.108015] [DEBUG] [LOCAL ] IRM: No primary data file found to delete. [2025-10-25T22:40:12.108076] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-25T22:40:12.455474] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:40:12.455817] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-25T22:40:14.435039] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-25T22:40:14.445161] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-25T22:40:16.354532] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-25T22:40:16.364329] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-25T22:40:18.178725] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T22:40:18.189599] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-25T22:40:19.944872] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-25T22:40:19.955514] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-25T22:40:21.832705] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-25T22:40:21.843063] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-25T22:40:23.464288] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T22:40:23.474629] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-25T22:40:25.118136] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T22:40:25.128783] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-25T22:40:26.731801] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T22:40:26.742255] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-25T22:40:28.412788] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T22:40:28.423432] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-25T22:40:29.151863] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T22:40:29.160592] [INFO ] [REMOTE ] IRM: Full fetch complete (71995 records). [2025-10-25T22:40:29.160776] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-25T22:40:29.564120] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-25T22:40:29.564271] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-25T22:40:29.565337] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-25T22:40:29.565423] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-25T22:40:29.566851] [DEBUG] [LOCAL ] IRM: Trimmed 71995 records to 49536 (keeping 200 days of data) [2025-10-25T22:40:29.861141] [DEBUG] [LOCAL ] IRM: Primary data saved (49536 records). [2025-10-25T22:40:29.861323] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-25T22:40:29.861491] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols. IRM took 17.9s. Estimated remaining time: 4h 4m 50s [2025-10-25T22:40:30.029103] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:40:30.029299] [DEBUG] [LOCAL ] IRS: No existing data file found in primary storage. [2025-10-25T22:40:30.029372] [WARN ] [MAIN ] IRS: No existing data found, performing full refresh instead. [2025-10-25T22:40:30.029493] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-25T22:40:30.029567] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-25T22:40:30.029674] [DEBUG] [LOCAL ] IRS: No primary data file found to delete. [2025-10-25T22:40:30.029750] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-25T22:40:30.390131] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:40:30.390456] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-25T22:40:31.533349] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T22:40:31.539748] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-25T22:40:32.552994] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T22:40:32.557484] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-25T22:40:33.591908] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T22:40:33.596021] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-25T22:40:34.604310] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T22:40:34.609220] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-25T22:40:35.610083] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T22:40:35.614560] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-25T22:40:36.631342] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T22:40:36.636067] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-25T22:40:37.673518] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T22:40:37.678537] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-25T22:40:38.678033] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-25T22:40:38.683121] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-25T22:40:40.026436] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T22:40:40.033404] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-25T22:40:41.202947] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-25T22:40:41.208460] [INFO ] [REMOTE ] IRS: Full fetch complete (32636 records). [2025-10-25T22:40:41.208565] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-25T22:40:41.586134] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-25T22:40:41.586249] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-25T22:40:41.586906] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-25T22:40:41.586984] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-25T22:40:41.587814] [DEBUG] [LOCAL ] IRS: Trimmed 32636 records to 23670 (keeping 200 days of data) [2025-10-25T22:40:41.717553] [DEBUG] [LOCAL ] IRS: Primary data saved (23670 records). [2025-10-25T22:40:41.717758] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-25T22:40:41.717991] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols. IRS took 11.9s. Estimated remaining time: 4h 4m 38s [2025-10-25T22:40:41.886051] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:40:41.886260] [DEBUG] [LOCAL ] IRT: No existing data file found in primary storage. [2025-10-25T22:40:41.886338] [WARN ] [MAIN ] IRT: No existing data found, performing full refresh instead. [2025-10-25T22:40:41.886429] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-25T22:40:41.886495] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-25T22:40:41.886576] [DEBUG] [LOCAL ] IRT: No primary data file found to delete. [2025-10-25T22:40:41.886664] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-25T22:40:42.274850] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:40:42.275265] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-25T22:40:43.810188] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T22:40:43.819763] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-25T22:40:45.325076] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T22:40:45.334308] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-25T22:40:46.863277] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T22:40:46.873837] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-25T22:40:48.451799] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T22:40:48.462378] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-25T22:40:50.054391] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T22:40:50.064979] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-25T22:40:51.561477] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T22:40:51.572005] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-25T22:40:53.223334] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T22:40:53.234589] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-25T22:40:54.912787] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T22:40:54.924026] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-25T22:40:56.372483] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-25T22:40:56.383714] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-25T22:40:57.853678] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T22:40:57.862773] [INFO ] [REMOTE ] IRT: Full fetch complete (72837 records). [2025-10-25T22:40:57.862925] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-25T22:40:58.272697] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-25T22:40:58.272834] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-25T22:40:58.273878] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-25T22:40:58.273962] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-25T22:40:58.275419] [DEBUG] [LOCAL ] IRT: Trimmed 72837 records to 51098 (keeping 200 days of data) [2025-10-25T22:40:58.574763] [DEBUG] [LOCAL ] IRT: Primary data saved (51098 records). [2025-10-25T22:40:58.574923] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-25T22:40:58.575066] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols. IRT took 16.9s. Estimated remaining time: 4h 4m 31s [2025-10-25T22:40:58.742013] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:40:58.742226] [DEBUG] [LOCAL ] ISD: No existing data file found in primary storage. [2025-10-25T22:40:58.742299] [WARN ] [MAIN ] ISD: No existing data found, performing full refresh instead. [2025-10-25T22:40:58.742415] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-25T22:40:58.742489] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-25T22:40:58.742573] [DEBUG] [LOCAL ] ISD: No primary data file found to delete. [2025-10-25T22:40:58.742665] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-25T22:40:59.094241] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:40:59.094576] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-25T22:41:00.307779] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T22:41:00.312577] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-25T22:41:02.243669] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T22:41:02.248512] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-25T22:41:03.343131] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-25T22:41:03.347217] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-25T22:41:04.441739] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T22:41:04.446218] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-25T22:41:05.041583] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T22:41:05.045616] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-25T22:41:05.961794] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T22:41:05.965793] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-25T22:41:06.532458] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T22:41:06.536103] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-25T22:41:07.422623] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-25T22:41:07.426235] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-25T22:41:08.346309] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-25T22:41:08.350036] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-25T22:41:09.281807] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T22:41:09.285473] [INFO ] [REMOTE ] ISD: Full fetch complete (24029 records). [2025-10-25T22:41:09.285576] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-25T22:41:09.700671] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-25T22:41:09.700800] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-25T22:41:09.701391] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-25T22:41:09.701472] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-25T22:41:09.702140] [DEBUG] [LOCAL ] ISD: Trimmed 24029 records to 15824 (keeping 200 days of data) [2025-10-25T22:41:09.801856] [DEBUG] [LOCAL ] ISD: Primary data saved (15824 records). [2025-10-25T22:41:09.802051] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-25T22:41:09.802202] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols. ISD took 11.2s. Estimated remaining time: 4h 4m 19s [2025-10-25T22:41:09.984952] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:41:09.985172] [DEBUG] [LOCAL ] IT: No existing data file found in primary storage. [2025-10-25T22:41:09.985245] [WARN ] [MAIN ] IT: No existing data found, performing full refresh instead. [2025-10-25T22:41:09.985360] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-25T22:41:09.985447] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-25T22:41:09.985531] [DEBUG] [LOCAL ] IT: No primary data file found to delete. [2025-10-25T22:41:09.985601] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-25T22:41:10.345290] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:41:10.345632] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-25T22:41:11.642680] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T22:41:11.649360] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-25T22:41:12.993995] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T22:41:13.000873] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-25T22:41:14.349176] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T22:41:14.357183] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-25T22:41:15.979443] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T22:41:15.987675] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-25T22:41:17.365145] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T22:41:17.373874] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-25T22:41:18.713242] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T22:41:18.721436] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-25T22:41:20.327712] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T22:41:20.336965] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-25T22:41:21.986546] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-25T22:41:21.996991] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-25T22:41:23.759513] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-25T22:41:23.769386] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-25T22:41:25.149950] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T22:41:25.158144] [INFO ] [REMOTE ] IT: Full fetch complete (58112 records). [2025-10-25T22:41:25.158283] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-25T22:41:25.542896] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-25T22:41:25.543028] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-25T22:41:25.543988] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-25T22:41:25.544087] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-25T22:41:25.545377] [DEBUG] [LOCAL ] IT: Trimmed 58112 records to 42830 (keeping 200 days of data) [2025-10-25T22:41:25.792223] [DEBUG] [LOCAL ] IT: Primary data saved (42830 records). [2025-10-25T22:41:25.792403] [INFO ] [MAIN ] IT: Full history saved. [2025-10-25T22:41:25.792576] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols. IT took 16.0s. Estimated remaining time: 4h 4m 12s [2025-10-25T22:41:25.958637] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:41:25.958836] [DEBUG] [LOCAL ] ITGR: No existing data file found in primary storage. [2025-10-25T22:41:25.958924] [WARN ] [MAIN ] ITGR: No existing data found, performing full refresh instead. [2025-10-25T22:41:25.959055] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-25T22:41:25.959149] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-25T22:41:25.959261] [DEBUG] [LOCAL ] ITGR: No primary data file found to delete. [2025-10-25T22:41:25.959347] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-25T22:41:26.316279] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:41:26.317515] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-25T22:41:27.334095] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T22:41:27.338422] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-25T22:41:28.501266] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T22:41:28.506462] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-25T22:41:29.850374] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T22:41:29.858037] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-25T22:41:31.313106] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T22:41:31.321871] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-25T22:41:32.590930] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-25T22:41:32.598340] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-25T22:41:33.805083] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T22:41:33.811178] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-25T22:41:35.118021] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-25T22:41:35.128453] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-25T22:41:36.235157] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T22:41:36.240772] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-25T22:41:37.497599] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-25T22:41:37.504318] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-25T22:41:38.777541] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T22:41:38.787031] [INFO ] [REMOTE ] ITGR: Full fetch complete (43800 records). [2025-10-25T22:41:38.787346] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-25T22:41:39.216062] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-25T22:41:39.216183] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-25T22:41:39.216957] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-25T22:41:39.217037] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-25T22:41:39.218102] [DEBUG] [LOCAL ] ITGR: Trimmed 43800 records to 31720 (keeping 200 days of data) [2025-10-25T22:41:39.399417] [DEBUG] [LOCAL ] ITGR: Primary data saved (31720 records). [2025-10-25T22:41:39.399581] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-25T22:41:39.399735] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols. ITGR took 13.6s. Estimated remaining time: 4h 4m 2s [2025-10-25T22:41:39.571178] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:41:39.571412] [DEBUG] [LOCAL ] ITT: No existing data file found in primary storage. [2025-10-25T22:41:39.571498] [WARN ] [MAIN ] ITT: No existing data found, performing full refresh instead. [2025-10-25T22:41:39.571609] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-25T22:41:39.571699] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-25T22:41:39.571781] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-10-25T22:41:39.571848] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-25T22:41:39.933662] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:41:39.934030] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-25T22:41:41.565759] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T22:41:41.571803] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-25T22:41:42.864123] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T22:41:42.871057] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-25T22:41:44.278865] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-25T22:41:44.286586] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-25T22:41:45.906563] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T22:41:45.916451] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-25T22:41:47.495290] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-25T22:41:47.503409] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-25T22:41:48.750265] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T22:41:48.756307] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-25T22:41:50.053867] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T22:41:50.060777] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-25T22:41:51.299592] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T22:41:51.305970] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-25T22:41:52.633905] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T22:41:52.641000] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-25T22:41:53.968452] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T22:41:53.975735] [INFO ] [REMOTE ] ITT: Full fetch complete (47530 records). [2025-10-25T22:41:53.975956] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-25T22:41:54.368930] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-25T22:41:54.369061] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-25T22:41:54.369894] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-25T22:41:54.369976] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-25T22:41:54.371144] [DEBUG] [LOCAL ] ITT: Trimmed 47530 records to 32727 (keeping 200 days of data) [2025-10-25T22:41:54.573090] [DEBUG] [LOCAL ] ITT: Primary data saved (32727 records). [2025-10-25T22:41:54.573288] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-25T22:41:54.573456] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols. ITT took 15.2s. Estimated remaining time: 4h 3m 53s [2025-10-25T22:41:54.741704] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:41:54.741964] [DEBUG] [LOCAL ] ITUB: No existing data file found in primary storage. [2025-10-25T22:41:54.742039] [WARN ] [MAIN ] ITUB: No existing data found, performing full refresh instead. [2025-10-25T22:41:54.742158] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-25T22:41:54.742244] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-25T22:41:54.742327] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-10-25T22:41:54.742400] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-25T22:41:55.121435] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:41:55.121838] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-25T22:41:56.750441] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T22:41:56.761302] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-25T22:41:58.361242] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T22:41:58.371276] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-25T22:41:59.979596] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T22:41:59.994412] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-25T22:42:01.827089] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T22:42:01.838882] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-25T22:42:03.577547] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T22:42:03.589410] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-25T22:42:05.225913] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T22:42:05.236956] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-25T22:42:07.012843] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T22:42:07.024480] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-25T22:42:08.871814] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-25T22:42:08.883195] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-25T22:42:10.535351] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T22:42:10.546984] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-25T22:42:12.240899] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T22:42:12.250629] [INFO ] [REMOTE ] ITUB: Full fetch complete (77312 records). [2025-10-25T22:42:12.250865] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-25T22:42:12.650545] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-25T22:42:12.650680] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-25T22:42:12.651763] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-25T22:42:12.651845] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-25T22:42:12.653456] [DEBUG] [LOCAL ] ITUB: Trimmed 77312 records to 54090 (keeping 200 days of data) [2025-10-25T22:42:12.960879] [DEBUG] [LOCAL ] ITUB: Primary data saved (54090 records). [2025-10-25T22:42:12.961052] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-25T22:42:12.961198] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols. ITUB took 18.4s. Estimated remaining time: 4h 3m 49s [2025-10-25T22:42:13.139572] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:42:13.139797] [DEBUG] [LOCAL ] ITW: No existing data file found in primary storage. [2025-10-25T22:42:13.139872] [WARN ] [MAIN ] ITW: No existing data found, performing full refresh instead. [2025-10-25T22:42:13.139998] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-25T22:42:13.140074] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-25T22:42:13.140156] [DEBUG] [LOCAL ] ITW: No primary data file found to delete. [2025-10-25T22:42:13.140225] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-25T22:42:13.531031] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:42:13.531385] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-25T22:42:15.062003] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T22:42:15.070944] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-25T22:42:16.691045] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T22:42:16.700176] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-25T22:42:18.514666] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T22:42:18.525049] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-25T22:42:20.325198] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-25T22:42:20.335545] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-25T22:42:21.857448] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T22:42:21.870939] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-25T22:42:23.474495] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T22:42:23.483993] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-25T22:42:25.234396] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-25T22:42:25.244503] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-25T22:42:26.811912] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T22:42:26.821754] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-25T22:42:28.385287] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T22:42:28.394814] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-25T22:42:28.757909] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-25T22:42:28.766415] [INFO ] [REMOTE ] ITW: Full fetch complete (66907 records). [2025-10-25T22:42:28.766622] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-25T22:42:29.152600] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-25T22:42:29.152740] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-25T22:42:29.153742] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-25T22:42:29.153824] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-25T22:42:29.155112] [DEBUG] [LOCAL ] ITW: Trimmed 66907 records to 46349 (keeping 200 days of data) [2025-10-25T22:42:29.438492] [DEBUG] [LOCAL ] ITW: Primary data saved (46349 records). [2025-10-25T22:42:29.438690] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-25T22:42:29.438838] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols. ITW took 16.5s. Estimated remaining time: 4h 3m 42s [2025-10-25T22:42:29.622738] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:42:29.622934] [DEBUG] [LOCAL ] IVR: No existing data file found in primary storage. [2025-10-25T22:42:29.623005] [WARN ] [MAIN ] IVR: No existing data found, performing full refresh instead. [2025-10-25T22:42:29.623118] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-25T22:42:29.623188] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-25T22:42:29.623268] [DEBUG] [LOCAL ] IVR: No primary data file found to delete. [2025-10-25T22:42:29.623338] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-25T22:42:29.969847] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:42:29.970207] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-25T22:42:31.886500] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T22:42:31.895890] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-25T22:42:33.452144] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T22:42:33.460932] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-25T22:42:35.089226] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T22:42:35.099068] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-25T22:42:37.008576] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-25T22:42:37.020368] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-25T22:42:38.625479] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T22:42:38.635311] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-25T22:42:40.362589] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-25T22:42:40.373707] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-25T22:42:42.182068] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-25T22:42:42.198259] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-25T22:42:43.730323] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T22:42:43.740563] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-25T22:42:45.451424] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T22:42:45.461478] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-25T22:42:47.092721] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T22:42:47.101761] [INFO ] [REMOTE ] IVR: Full fetch complete (69059 records). [2025-10-25T22:42:47.101927] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-25T22:42:47.501090] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-25T22:42:47.501216] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-25T22:42:47.502239] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-25T22:42:47.502323] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-25T22:42:47.503861] [DEBUG] [LOCAL ] IVR: Trimmed 69059 records to 48532 (keeping 200 days of data) [2025-10-25T22:42:47.801337] [DEBUG] [LOCAL ] IVR: Primary data saved (48532 records). [2025-10-25T22:42:47.801493] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-25T22:42:47.801637] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols. IVR took 18.4s. Estimated remaining time: 4h 3m 37s [2025-10-25T22:42:47.971616] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:42:47.971822] [DEBUG] [LOCAL ] IVT: No existing data file found in primary storage. [2025-10-25T22:42:47.971893] [WARN ] [MAIN ] IVT: No existing data found, performing full refresh instead. [2025-10-25T22:42:47.972013] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-25T22:42:47.972086] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-25T22:42:47.972167] [DEBUG] [LOCAL ] IVT: No primary data file found to delete. [2025-10-25T22:42:47.972236] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-25T22:42:48.335293] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:42:48.335663] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-25T22:42:49.783729] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T22:42:49.790342] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-25T22:42:51.022794] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T22:42:51.028988] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-25T22:42:52.338379] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T22:42:52.345310] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-25T22:42:53.842066] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T22:42:53.849777] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-25T22:42:55.075490] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T22:42:55.082174] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-25T22:42:56.334805] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T22:42:56.341011] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-25T22:42:57.671998] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-25T22:42:57.679098] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-25T22:42:58.912021] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T22:42:58.919255] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-25T22:43:00.072151] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T22:43:00.078965] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-25T22:43:01.549602] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T22:43:01.556264] [INFO ] [REMOTE ] IVT: Full fetch complete (45629 records). [2025-10-25T22:43:01.556409] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-25T22:43:01.945926] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-25T22:43:01.946051] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-25T22:43:01.946837] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-25T22:43:01.946916] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-25T22:43:01.948138] [DEBUG] [LOCAL ] IVT: Trimmed 45629 records to 31798 (keeping 200 days of data) [2025-10-25T22:43:02.136158] [DEBUG] [LOCAL ] IVT: Primary data saved (31798 records). [2025-10-25T22:43:02.136341] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-25T22:43:02.136469] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols. IVT took 14.3s. Estimated remaining time: 4h 3m 28s [2025-10-25T22:43:02.313965] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:43:02.314188] [DEBUG] [LOCAL ] IVZ: No existing data file found in primary storage. [2025-10-25T22:43:02.314252] [WARN ] [MAIN ] IVZ: No existing data found, performing full refresh instead. [2025-10-25T22:43:02.314361] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-25T22:43:02.314434] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-25T22:43:02.314496] [DEBUG] [LOCAL ] IVZ: No primary data file found to delete. [2025-10-25T22:43:02.314560] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-25T22:43:02.672105] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:43:02.672470] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-25T22:43:04.659507] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T22:43:04.669749] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-25T22:43:06.213187] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T22:43:06.223044] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-25T22:43:07.908478] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T22:43:07.919907] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-25T22:43:09.640534] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T22:43:09.651919] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-25T22:43:11.326933] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T22:43:11.338365] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-25T22:43:12.915548] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T22:43:12.926208] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-25T22:43:14.809586] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-25T22:43:14.821151] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-25T22:43:16.420598] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T22:43:16.435820] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-25T22:43:16.885855] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-25T22:43:16.897388] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-25T22:43:17.694628] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T22:43:17.707837] [INFO ] [REMOTE ] IVZ: Full fetch complete (77060 records). [2025-10-25T22:43:17.708070] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-25T22:43:18.119161] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-25T22:43:18.119281] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-25T22:43:18.120334] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-25T22:43:18.120413] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-25T22:43:18.121945] [DEBUG] [LOCAL ] IVZ: Trimmed 77060 records to 53908 (keeping 200 days of data) [2025-10-25T22:43:18.439284] [DEBUG] [LOCAL ] IVZ: Primary data saved (53908 records). [2025-10-25T22:43:18.439508] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-25T22:43:18.439685] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols. IVZ took 16.3s. Estimated remaining time: 4h 3m 20s [2025-10-25T22:43:18.606768] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:43:18.606970] [DEBUG] [LOCAL ] IX: No existing data file found in primary storage. [2025-10-25T22:43:18.607075] [WARN ] [MAIN ] IX: No existing data found, performing full refresh instead. [2025-10-25T22:43:18.607189] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-25T22:43:18.607259] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-25T22:43:18.607339] [DEBUG] [LOCAL ] IX: No primary data file found to delete. [2025-10-25T22:43:18.607406] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-25T22:43:18.952658] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:43:18.952999] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-25T22:43:19.698872] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T22:43:19.701126] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-25T22:43:20.537086] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-25T22:43:20.539748] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-25T22:43:21.704926] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-25T22:43:21.710068] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-25T22:43:22.951966] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T22:43:22.958632] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-25T22:43:24.115046] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T22:43:24.121101] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-25T22:43:25.187346] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T22:43:25.192391] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-25T22:43:26.022242] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T22:43:26.027903] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-25T22:43:27.019444] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T22:43:27.023536] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-25T22:43:27.928412] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T22:43:27.934773] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-25T22:43:28.952317] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T22:43:28.956334] [INFO ] [REMOTE ] IX: Full fetch complete (28838 records). [2025-10-25T22:43:28.956434] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-25T22:43:29.321817] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-25T22:43:29.321933] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-25T22:43:29.322537] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-25T22:43:29.322611] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-25T22:43:29.323373] [DEBUG] [LOCAL ] IX: Trimmed 28838 records to 22374 (keeping 200 days of data) [2025-10-25T22:43:29.445808] [DEBUG] [LOCAL ] IX: Primary data saved (22374 records). [2025-10-25T22:43:29.445969] [INFO ] [MAIN ] IX: Full history saved. [2025-10-25T22:43:29.446105] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols. IX took 11.0s. Estimated remaining time: 4h 3m 8s [2025-10-25T22:43:29.612447] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:43:29.612701] [DEBUG] [LOCAL ] J: No existing data file found in primary storage. [2025-10-25T22:43:29.612773] [WARN ] [MAIN ] J: No existing data found, performing full refresh instead. [2025-10-25T22:43:29.612891] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-25T22:43:29.612961] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-25T22:43:29.613039] [DEBUG] [LOCAL ] J: No primary data file found to delete. [2025-10-25T22:43:29.613140] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-25T22:43:29.964861] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:43:29.965219] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-25T22:43:31.665937] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T22:43:31.673996] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-25T22:43:33.261933] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T22:43:33.270262] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-25T22:43:34.829938] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-25T22:43:34.839105] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-25T22:43:36.368254] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T22:43:36.377392] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-25T22:43:37.999983] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T22:43:38.009175] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-25T22:43:39.445160] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T22:43:39.453198] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-25T22:43:40.890519] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-25T22:43:40.899984] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-25T22:43:42.156399] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-25T22:43:42.165400] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-25T22:43:43.020983] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-25T22:43:43.029742] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-25T22:43:43.728562] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T22:43:43.736783] [INFO ] [REMOTE ] J: Full fetch complete (59871 records). [2025-10-25T22:43:43.736931] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-25T22:43:44.122880] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-25T22:43:44.122994] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-25T22:43:44.123852] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-25T22:43:44.123937] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-25T22:43:44.125110] [DEBUG] [LOCAL ] J: Trimmed 59871 records to 41171 (keeping 200 days of data) [2025-10-25T22:43:44.375778] [DEBUG] [LOCAL ] J: Primary data saved (41171 records). [2025-10-25T22:43:44.375940] [INFO ] [MAIN ] J: Full history saved. [2025-10-25T22:43:44.376063] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols. J took 14.9s. Estimated remaining time: 4h 2m 59s [2025-10-25T22:43:44.548960] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:43:44.549182] [DEBUG] [LOCAL ] JBGS: No existing data file found in primary storage. [2025-10-25T22:43:44.549261] [WARN ] [MAIN ] JBGS: No existing data found, performing full refresh instead. [2025-10-25T22:43:44.549375] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-25T22:43:44.549450] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-25T22:43:44.549532] [DEBUG] [LOCAL ] JBGS: No primary data file found to delete. [2025-10-25T22:43:44.549602] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-25T22:43:44.918798] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:43:44.919150] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-25T22:43:46.424626] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T22:43:46.431807] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-25T22:43:47.698180] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-25T22:43:47.705673] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-25T22:43:49.154053] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T22:43:49.165823] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-25T22:43:50.773161] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T22:43:50.782547] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-25T22:43:52.310091] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T22:43:52.319473] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-25T22:43:53.909609] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T22:43:53.920021] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-25T22:43:55.446796] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T22:43:55.455859] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-25T22:43:56.809334] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T22:43:56.817988] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-25T22:43:58.206759] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T22:43:58.216108] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-25T22:43:59.557033] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-25T22:43:59.563666] [INFO ] [REMOTE ] JBGS: Full fetch complete (59132 records). [2025-10-25T22:43:59.563864] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-25T22:43:59.952958] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-25T22:43:59.953084] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-25T22:43:59.953968] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-25T22:43:59.954050] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-25T22:43:59.955291] [DEBUG] [LOCAL ] JBGS: Trimmed 59132 records to 42157 (keeping 200 days of data) [2025-10-25T22:44:00.214976] [DEBUG] [LOCAL ] JBGS: Primary data saved (42157 records). [2025-10-25T22:44:00.215141] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-25T22:44:00.215293] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols. JBGS took 15.8s. Estimated remaining time: 4h 2m 51s [2025-10-25T22:44:00.382287] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:44:00.382491] [DEBUG] [LOCAL ] JBI: No existing data file found in primary storage. [2025-10-25T22:44:00.382561] [WARN ] [MAIN ] JBI: No existing data found, performing full refresh instead. [2025-10-25T22:44:00.382700] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-25T22:44:00.382773] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-25T22:44:00.382859] [DEBUG] [LOCAL ] JBI: No primary data file found to delete. [2025-10-25T22:44:00.382926] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-25T22:44:00.730708] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:44:00.731014] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-25T22:44:02.825202] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-25T22:44:02.835553] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-25T22:44:04.384565] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T22:44:04.392948] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-25T22:44:05.995611] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T22:44:06.005637] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-25T22:44:07.565751] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T22:44:07.575969] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-25T22:44:09.248245] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T22:44:09.258264] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-25T22:44:10.909584] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T22:44:10.918592] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-25T22:44:12.397989] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T22:44:12.407151] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-25T22:44:14.040337] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T22:44:14.049503] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-25T22:44:15.391292] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T22:44:15.400537] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-25T22:44:16.853606] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T22:44:16.860974] [INFO ] [REMOTE ] JBI: Full fetch complete (63344 records). [2025-10-25T22:44:16.861131] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-25T22:44:17.240158] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-25T22:44:17.240273] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-25T22:44:17.241191] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-25T22:44:17.241270] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-25T22:44:17.242541] [DEBUG] [LOCAL ] JBI: Trimmed 63344 records to 43031 (keeping 200 days of data) [2025-10-25T22:44:17.477840] [DEBUG] [LOCAL ] JBI: Primary data saved (43031 records). [2025-10-25T22:44:17.478006] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-25T22:44:17.478156] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols. JBI took 17.3s. Estimated remaining time: 4h 2m 45s [2025-10-25T22:44:17.647158] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:44:17.647361] [DEBUG] [LOCAL ] JBL: No existing data file found in primary storage. [2025-10-25T22:44:17.647411] [WARN ] [MAIN ] JBL: No existing data found, performing full refresh instead. [2025-10-25T22:44:17.647515] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-25T22:44:17.647586] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-25T22:44:17.647691] [DEBUG] [LOCAL ] JBL: No primary data file found to delete. [2025-10-25T22:44:17.647930] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-25T22:44:18.013457] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:44:18.013854] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-25T22:44:19.745994] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T22:44:19.756035] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-25T22:44:21.301625] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T22:44:21.311881] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-25T22:44:23.239377] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-25T22:44:23.250922] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-25T22:44:25.122919] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-25T22:44:25.133182] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-25T22:44:26.800235] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T22:44:26.809580] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-25T22:44:28.659130] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-25T22:44:28.669289] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-25T22:44:30.288955] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T22:44:30.299775] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-25T22:44:31.971929] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T22:44:31.982056] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-25T22:44:33.668949] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T22:44:33.679273] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-25T22:44:34.474143] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T22:44:34.483738] [INFO ] [REMOTE ] JBL: Full fetch complete (70600 records). [2025-10-25T22:44:34.483935] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-25T22:44:34.897840] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-25T22:44:34.898040] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-25T22:44:34.899036] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-25T22:44:34.899117] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-25T22:44:34.900557] [DEBUG] [LOCAL ] JBL: Trimmed 70600 records to 49039 (keeping 200 days of data) [2025-10-25T22:44:35.189213] [DEBUG] [LOCAL ] JBL: Primary data saved (49039 records). [2025-10-25T22:44:35.189370] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-25T22:44:35.189511] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols. JBL took 17.7s. Estimated remaining time: 4h 2m 39s [2025-10-25T22:44:35.354431] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:44:35.354624] [DEBUG] [LOCAL ] JBND: No existing data file found in primary storage. [2025-10-25T22:44:35.354718] [WARN ] [MAIN ] JBND: No existing data found, performing full refresh instead. [2025-10-25T22:44:35.354828] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-25T22:44:35.354898] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-25T22:44:35.354959] [DEBUG] [LOCAL ] JBND: No primary data file found to delete. [2025-10-25T22:44:35.355000] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-25T22:44:35.700390] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:44:35.700770] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-25T22:44:36.719582] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T22:44:36.723544] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-25T22:44:37.681975] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T22:44:37.685810] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-25T22:44:38.697578] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T22:44:38.702855] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-25T22:44:39.818687] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T22:44:39.824113] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-25T22:44:40.854156] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T22:44:40.859531] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-25T22:44:41.918167] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-25T22:44:41.923313] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-25T22:44:43.023033] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T22:44:43.028693] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-25T22:44:44.257456] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T22:44:44.263928] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-25T22:44:45.598021] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T22:44:45.609245] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-25T22:44:46.987396] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T22:44:46.995705] [INFO ] [REMOTE ] JBND: Full fetch complete (36441 records). [2025-10-25T22:44:46.995862] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-25T22:44:47.363403] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-25T22:44:47.363516] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-25T22:44:47.364238] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-25T22:44:47.364319] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-25T22:44:47.365236] [DEBUG] [LOCAL ] JBND: Trimmed 36441 records to 27871 (keeping 200 days of data) [2025-10-25T22:44:47.529790] [DEBUG] [LOCAL ] JBND: Primary data saved (27871 records). [2025-10-25T22:44:47.529954] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-25T22:44:47.530100] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols. JBND took 12.3s. Estimated remaining time: 4h 2m 28s [2025-10-25T22:44:47.694506] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:44:47.694716] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-25T22:44:47.694787] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-25T22:44:47.694898] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-25T22:44:47.694968] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-25T22:44:47.695048] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-25T22:44:47.695119] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-25T22:44:48.073235] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:44:48.073582] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-25T22:44:48.288486] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T22:44:48.288891] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-25T22:44:48.288977] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T22:44:48.289054] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-25T22:44:48.289122] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T22:44:48.289196] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-25T22:44:48.289289] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-25T22:44:48.289358] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-25T22:44:48.289438] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-25T22:44:48.289578] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols. JBS took 0.8s. Estimated remaining time: 4h 2m 4s [2025-10-25T22:44:48.463988] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:44:48.464173] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-25T22:44:48.464247] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-25T22:44:48.464334] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-25T22:44:48.464400] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-25T22:44:48.464458] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-25T22:44:48.464519] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-25T22:44:48.817068] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:44:48.817411] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-25T22:44:50.280485] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T22:44:50.286615] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-25T22:44:51.592764] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T22:44:51.601278] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-25T22:44:52.940984] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T22:44:52.947357] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-25T22:44:54.408623] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T22:44:54.416668] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-25T22:44:55.747293] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T22:44:55.754785] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-25T22:44:56.698702] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-25T22:44:56.705916] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-25T22:44:58.102542] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-25T22:44:58.109973] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-25T22:44:59.337033] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T22:44:59.343570] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-25T22:45:00.661266] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T22:45:00.668362] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-25T22:45:02.637796] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-25T22:45:02.645037] [INFO ] [REMOTE ] JBTM: Full fetch complete (47001 records). [2025-10-25T22:45:02.645219] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-25T22:45:03.017569] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-25T22:45:03.017700] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-25T22:45:03.018348] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-25T22:45:03.018426] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-25T22:45:03.019380] [DEBUG] [LOCAL ] JBTM: Trimmed 47001 records to 33976 (keeping 200 days of data) [2025-10-25T22:45:03.218760] [DEBUG] [LOCAL ] JBTM: Primary data saved (33976 records). [2025-10-25T22:45:03.218914] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-25T22:45:03.219060] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols. JBTM took 14.9s. Estimated remaining time: 4h 1m 56s [2025-10-25T22:45:03.383250] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:45:03.383418] [DEBUG] [LOCAL ] JCE: No existing data file found in primary storage. [2025-10-25T22:45:03.383494] [WARN ] [MAIN ] JCE: No existing data found, performing full refresh instead. [2025-10-25T22:45:03.383600] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-25T22:45:03.383699] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-25T22:45:03.383762] [DEBUG] [LOCAL ] JCE: No primary data file found to delete. [2025-10-25T22:45:03.383823] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-25T22:45:03.731458] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:45:03.731840] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-25T22:45:04.836893] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T22:45:04.838834] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-25T22:45:05.505827] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-25T22:45:05.507377] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-25T22:45:06.276799] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T22:45:06.278557] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-25T22:45:07.225012] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T22:45:07.227309] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-25T22:45:07.854091] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T22:45:07.855984] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-25T22:45:08.640208] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-25T22:45:08.644062] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-25T22:45:09.410908] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T22:45:09.413835] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-25T22:45:10.072721] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-25T22:45:10.075082] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-25T22:45:10.826625] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T22:45:10.829501] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-25T22:45:11.609947] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T22:45:11.612233] [INFO ] [REMOTE ] JCE: Full fetch complete (9606 records). [2025-10-25T22:45:11.612326] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-25T22:45:11.988103] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-25T22:45:11.988261] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-25T22:45:11.988677] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-25T22:45:11.988763] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-25T22:45:11.989481] [DEBUG] [LOCAL ] JCE: Trimmed 9606 records to 7308 (keeping 200 days of data) [2025-10-25T22:45:12.036754] [DEBUG] [LOCAL ] JCE: Primary data saved (7308 records). [2025-10-25T22:45:12.036971] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-25T22:45:12.037161] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols. JCE took 8.8s. Estimated remaining time: 4h 1m 40s [2025-10-25T22:45:12.214498] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:45:12.214783] [DEBUG] [LOCAL ] JCI: No existing data file found in primary storage. [2025-10-25T22:45:12.214858] [WARN ] [MAIN ] JCI: No existing data found, performing full refresh instead. [2025-10-25T22:45:12.214983] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-25T22:45:12.215085] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-25T22:45:12.215169] [DEBUG] [LOCAL ] JCI: No primary data file found to delete. [2025-10-25T22:45:12.215241] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-25T22:45:12.589074] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:45:12.589467] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-25T22:45:14.267884] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T22:45:14.282053] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-25T22:45:16.102019] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T22:45:16.111948] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-25T22:45:17.883327] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T22:45:17.894323] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-25T22:45:19.671978] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T22:45:19.688839] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-25T22:45:21.433442] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T22:45:21.444925] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-25T22:45:23.142623] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T22:45:23.153243] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-25T22:45:25.191527] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-25T22:45:25.203327] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-25T22:45:26.946861] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T22:45:26.958169] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-25T22:45:28.845375] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T22:45:28.856793] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-25T22:45:29.610484] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T22:45:29.620308] [INFO ] [REMOTE ] JCI: Full fetch complete (77658 records). [2025-10-25T22:45:29.620492] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-25T22:45:30.011194] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-25T22:45:30.011322] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-25T22:45:30.012365] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-25T22:45:30.012444] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-25T22:45:30.013941] [DEBUG] [LOCAL ] JCI: Trimmed 77658 records to 54295 (keeping 200 days of data) [2025-10-25T22:45:30.339846] [DEBUG] [LOCAL ] JCI: Primary data saved (54295 records). [2025-10-25T22:45:30.340000] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-25T22:45:30.340146] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols. JCI took 18.3s. Estimated remaining time: 4h 1m 35s [2025-10-25T22:45:30.507067] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:45:30.507233] [DEBUG] [LOCAL ] JEF: No existing data file found in primary storage. [2025-10-25T22:45:30.507303] [WARN ] [MAIN ] JEF: No existing data found, performing full refresh instead. [2025-10-25T22:45:30.507419] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-25T22:45:30.507489] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-25T22:45:30.507574] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-10-25T22:45:30.507658] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-25T22:45:30.861950] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:45:30.862266] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-25T22:45:32.591003] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T22:45:32.600958] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-25T22:45:34.159249] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T22:45:34.168813] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-25T22:45:35.853276] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-25T22:45:35.864026] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-25T22:45:37.725282] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-25T22:45:37.736128] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-25T22:45:39.495421] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T22:45:39.505664] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-25T22:45:41.158129] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T22:45:41.168569] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-25T22:45:42.851425] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T22:45:42.862778] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-25T22:45:44.454850] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T22:45:44.465396] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-25T22:45:46.129205] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-25T22:45:46.140191] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-25T22:45:47.874569] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-25T22:45:47.884425] [INFO ] [REMOTE ] JEF: Full fetch complete (73334 records). [2025-10-25T22:45:47.884674] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-25T22:45:48.267979] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-25T22:45:48.268099] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-25T22:45:48.269265] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-25T22:45:48.269349] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-25T22:45:48.270798] [DEBUG] [LOCAL ] JEF: Trimmed 73334 records to 50955 (keeping 200 days of data) [2025-10-25T22:45:48.569880] [DEBUG] [LOCAL ] JEF: Primary data saved (50955 records). [2025-10-25T22:45:48.570065] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-25T22:45:48.570267] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols. JEF took 18.2s. Estimated remaining time: 4h 1m 30s [2025-10-25T22:45:48.738538] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:45:48.738774] [DEBUG] [LOCAL ] JELD: No existing data file found in primary storage. [2025-10-25T22:45:48.738869] [WARN ] [MAIN ] JELD: No existing data found, performing full refresh instead. [2025-10-25T22:45:48.739012] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-25T22:45:48.739095] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-25T22:45:48.739201] [DEBUG] [LOCAL ] JELD: No primary data file found to delete. [2025-10-25T22:45:48.739280] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-25T22:45:49.110923] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:45:49.111247] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-25T22:45:50.541797] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T22:45:50.553339] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-25T22:45:51.991178] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-25T22:45:52.003008] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-25T22:45:53.483105] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-25T22:45:53.492972] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-25T22:45:55.114780] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T22:45:55.125176] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-25T22:45:56.760057] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T22:45:56.770484] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-25T22:45:58.264572] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-25T22:45:58.273551] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-25T22:45:59.773870] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T22:45:59.783851] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-25T22:46:01.619795] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-25T22:46:01.630088] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-25T22:46:03.773548] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-25T22:46:03.783365] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-25T22:46:05.165249] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T22:46:05.173284] [INFO ] [REMOTE ] JELD: Full fetch complete (64601 records). [2025-10-25T22:46:05.173450] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-25T22:46:05.571615] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-25T22:46:05.571767] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-25T22:46:05.572751] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-25T22:46:05.572835] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-25T22:46:05.574238] [DEBUG] [LOCAL ] JELD: Trimmed 64601 records to 46422 (keeping 200 days of data) [2025-10-25T22:46:05.829624] [DEBUG] [LOCAL ] JELD: Primary data saved (46422 records). [2025-10-25T22:46:05.829834] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-25T22:46:05.830003] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols. JELD took 17.3s. Estimated remaining time: 4h 1m 24s [2025-10-25T22:46:05.997030] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:46:05.997224] [DEBUG] [LOCAL ] JFR: No existing data file found in primary storage. [2025-10-25T22:46:05.997296] [WARN ] [MAIN ] JFR: No existing data found, performing full refresh instead. [2025-10-25T22:46:05.997385] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-25T22:46:05.997452] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-25T22:46:05.997513] [DEBUG] [LOCAL ] JFR: No primary data file found to delete. [2025-10-25T22:46:05.997576] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-25T22:46:06.347574] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:46:06.347972] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-25T22:46:07.963861] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T22:46:07.972385] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-25T22:46:09.368119] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-25T22:46:09.377294] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-25T22:46:10.340630] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T22:46:10.352450] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-25T22:46:11.733287] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T22:46:11.741262] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-25T22:46:12.848451] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T22:46:12.854552] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-25T22:46:14.244550] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T22:46:14.250885] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-25T22:46:15.663959] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-25T22:46:15.671105] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-25T22:46:16.891492] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T22:46:16.902888] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-25T22:46:18.202627] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T22:46:18.209951] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-25T22:46:19.598875] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-25T22:46:19.606025] [INFO ] [REMOTE ] JFR: Full fetch complete (48671 records). [2025-10-25T22:46:19.606263] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-25T22:46:20.010840] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-25T22:46:20.010968] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-25T22:46:20.011863] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-25T22:46:20.011945] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-25T22:46:20.013110] [DEBUG] [LOCAL ] JFR: Trimmed 48671 records to 31608 (keeping 200 days of data) [2025-10-25T22:46:20.205591] [DEBUG] [LOCAL ] JFR: Primary data saved (31608 records). [2025-10-25T22:46:20.205861] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-25T22:46:20.206030] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols. JFR took 14.4s. Estimated remaining time: 4h 1m 15s [2025-10-25T22:46:20.377618] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:46:20.377921] [DEBUG] [LOCAL ] JGH: No existing data file found in primary storage. [2025-10-25T22:46:20.377998] [WARN ] [MAIN ] JGH: No existing data found, performing full refresh instead. [2025-10-25T22:46:20.378131] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-25T22:46:20.378203] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-25T22:46:20.378283] [DEBUG] [LOCAL ] JGH: No primary data file found to delete. [2025-10-25T22:46:20.378351] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-25T22:46:20.747552] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:46:20.747974] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-25T22:46:21.674222] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-25T22:46:21.676738] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-25T22:46:22.291286] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T22:46:22.293256] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-25T22:46:23.063681] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T22:46:23.066246] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-25T22:46:23.822590] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T22:46:23.825793] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-25T22:46:24.569621] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T22:46:24.572432] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-25T22:46:25.374548] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T22:46:25.377317] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-25T22:46:26.270306] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T22:46:26.273387] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-25T22:46:27.168631] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T22:46:27.173400] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-25T22:46:27.965382] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T22:46:27.968778] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-25T22:46:28.942810] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T22:46:28.947541] [INFO ] [REMOTE ] JGH: Full fetch complete (16375 records). [2025-10-25T22:46:28.947710] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-25T22:46:29.337453] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-25T22:46:29.337573] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-25T22:46:29.338008] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-25T22:46:29.338090] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-25T22:46:29.338689] [DEBUG] [LOCAL ] JGH: Trimmed 16375 records to 12716 (keeping 200 days of data) [2025-10-25T22:46:29.412959] [DEBUG] [LOCAL ] JGH: Primary data saved (12716 records). [2025-10-25T22:46:29.413143] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-25T22:46:29.413296] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols. JGH took 9.2s. Estimated remaining time: 4h 0m 60s [2025-10-25T22:46:29.591055] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:46:29.591277] [DEBUG] [LOCAL ] JHG: No existing data file found in primary storage. [2025-10-25T22:46:29.591367] [WARN ] [MAIN ] JHG: No existing data found, performing full refresh instead. [2025-10-25T22:46:29.591486] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-25T22:46:29.591560] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-25T22:46:29.591622] [DEBUG] [LOCAL ] JHG: No primary data file found to delete. [2025-10-25T22:46:29.591711] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-25T22:46:29.949622] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:46:29.949979] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-25T22:46:31.382738] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T22:46:31.391613] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-25T22:46:32.623312] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T22:46:32.632018] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-25T22:46:34.136962] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T22:46:34.147565] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-25T22:46:35.736742] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-25T22:46:35.747795] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-25T22:46:37.391541] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T22:46:37.402237] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-25T22:46:39.043110] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T22:46:39.052494] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-25T22:46:40.643996] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T22:46:40.654455] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-25T22:46:42.099417] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-25T22:46:42.109551] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-25T22:46:43.672943] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T22:46:43.683665] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-25T22:46:45.341094] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-25T22:46:45.349904] [INFO ] [REMOTE ] JHG: Full fetch complete (68664 records). [2025-10-25T22:46:45.350081] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-25T22:46:45.732926] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-25T22:46:45.733063] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-25T22:46:45.734032] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-25T22:46:45.734110] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-25T22:46:45.735375] [DEBUG] [LOCAL ] JHG: Trimmed 68664 records to 48186 (keeping 200 days of data) [2025-10-25T22:46:46.015304] [DEBUG] [LOCAL ] JHG: Primary data saved (48186 records). [2025-10-25T22:46:46.015475] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-25T22:46:46.015624] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols. JHG took 16.6s. Estimated remaining time: 4h 0m 53s [2025-10-25T22:46:46.184358] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:46:46.184584] [DEBUG] [LOCAL ] JHI: No existing data file found in primary storage. [2025-10-25T22:46:46.184676] [WARN ] [MAIN ] JHI: No existing data found, performing full refresh instead. [2025-10-25T22:46:46.184774] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-25T22:46:46.184840] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-25T22:46:46.184919] [DEBUG] [LOCAL ] JHI: No primary data file found to delete. [2025-10-25T22:46:46.184993] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-25T22:46:46.544126] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:46:46.544473] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-25T22:46:47.138576] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-25T22:46:47.140037] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-25T22:46:47.613518] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T22:46:47.614833] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-25T22:46:48.199608] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T22:46:48.201392] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-25T22:46:48.878882] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-25T22:46:48.880630] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-25T22:46:49.433892] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-25T22:46:49.435899] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-25T22:46:50.005108] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T22:46:50.006515] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-25T22:46:50.501799] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-25T22:46:50.503361] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-25T22:46:51.059454] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-25T22:46:51.060853] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-25T22:46:51.671721] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T22:46:51.673548] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-25T22:46:52.164838] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T22:46:52.166882] [INFO ] [REMOTE ] JHI: Full fetch complete (5819 records). [2025-10-25T22:46:52.166976] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-25T22:46:52.531687] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-25T22:46:52.531796] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-25T22:46:52.532000] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-25T22:46:52.532075] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-25T22:46:52.532488] [DEBUG] [LOCAL ] JHI: Trimmed 5819 records to 4189 (keeping 200 days of data) [2025-10-25T22:46:52.556932] [DEBUG] [LOCAL ] JHI: Primary data saved (4189 records). [2025-10-25T22:46:52.557039] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-25T22:46:52.557156] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols. JHI took 6.5s. Estimated remaining time: 4h 0m 35s [2025-10-25T22:46:52.733761] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:46:52.734001] [DEBUG] [LOCAL ] JHS: No existing data file found in primary storage. [2025-10-25T22:46:52.734073] [WARN ] [MAIN ] JHS: No existing data found, performing full refresh instead. [2025-10-25T22:46:52.734189] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-25T22:46:52.734260] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-25T22:46:52.734341] [DEBUG] [LOCAL ] JHS: No primary data file found to delete. [2025-10-25T22:46:52.734415] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-25T22:46:53.103826] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:46:53.104150] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-25T22:46:53.653841] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-25T22:46:53.655231] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-25T22:46:54.253287] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T22:46:54.254961] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-25T22:46:54.715336] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T22:46:54.716567] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-25T22:46:55.122506] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-25T22:46:55.123806] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-25T22:46:55.600135] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T22:46:55.601336] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-25T22:46:56.205603] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-25T22:46:56.207323] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-25T22:46:56.760006] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-25T22:46:56.761500] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-25T22:46:57.242776] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-25T22:46:57.244001] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-25T22:46:57.813832] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T22:46:57.815471] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-25T22:46:58.280839] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-25T22:46:58.282017] [INFO ] [REMOTE ] JHS: Full fetch complete (4573 records). [2025-10-25T22:46:58.282124] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-25T22:46:58.642193] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-25T22:46:58.642302] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-25T22:46:58.642475] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-25T22:46:58.642551] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-25T22:46:58.642985] [DEBUG] [LOCAL ] JHS: Trimmed 4573 records to 3045 (keeping 200 days of data) [2025-10-25T22:46:58.660839] [DEBUG] [LOCAL ] JHS: Primary data saved (3045 records). [2025-10-25T22:46:58.660923] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-25T22:46:58.661057] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols. JHS took 6.1s. Estimated remaining time: 4h 0m 17s [2025-10-25T22:46:58.833783] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:46:58.833996] [DEBUG] [LOCAL ] JHX: No existing data file found in primary storage. [2025-10-25T22:46:58.834067] [WARN ] [MAIN ] JHX: No existing data found, performing full refresh instead. [2025-10-25T22:46:58.834195] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-25T22:46:58.834276] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-25T22:46:58.834337] [DEBUG] [LOCAL ] JHX: No primary data file found to delete. [2025-10-25T22:46:58.834400] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-25T22:46:59.216731] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:46:59.217106] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-25T22:47:00.178045] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-25T22:47:00.181750] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-25T22:47:01.053316] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-25T22:47:01.056275] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-25T22:47:02.365449] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T22:47:02.372026] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-25T22:47:04.098564] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T22:47:04.109313] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-25T22:47:05.977347] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-25T22:47:05.988493] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-25T22:47:07.606133] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T22:47:07.616870] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-25T22:47:09.334447] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-25T22:47:09.346960] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-25T22:47:11.111806] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T22:47:11.123147] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-25T22:47:12.872058] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-25T22:47:12.883390] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-25T22:47:14.828444] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-25T22:47:14.838133] [INFO ] [REMOTE ] JHX: Full fetch complete (63144 records). [2025-10-25T22:47:14.838296] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-25T22:47:15.220954] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-25T22:47:15.221084] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-25T22:47:15.222077] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-25T22:47:15.222158] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-25T22:47:15.223546] [DEBUG] [LOCAL ] JHX: Trimmed 63144 records to 53967 (keeping 200 days of data) [2025-10-25T22:47:15.525093] [DEBUG] [LOCAL ] JHX: Primary data saved (53967 records). [2025-10-25T22:47:15.525256] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-25T22:47:15.525401] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols. JHX took 16.9s. Estimated remaining time: 4h 0m 11s [2025-10-25T22:47:15.700749] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:47:15.700974] [DEBUG] [LOCAL ] JILL: No existing data file found in primary storage. [2025-10-25T22:47:15.701048] [WARN ] [MAIN ] JILL: No existing data found, performing full refresh instead. [2025-10-25T22:47:15.701140] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-25T22:47:15.701209] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-25T22:47:15.701298] [DEBUG] [LOCAL ] JILL: No primary data file found to delete. [2025-10-25T22:47:15.701378] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-25T22:47:16.074718] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:47:16.075061] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-25T22:47:16.890845] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T22:47:16.893899] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-25T22:47:17.724380] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-25T22:47:17.727546] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-25T22:47:18.754486] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T22:47:18.759096] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-25T22:47:19.788145] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T22:47:19.792411] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-25T22:47:20.452756] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-25T22:47:20.456201] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-25T22:47:21.310025] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T22:47:21.314521] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-25T22:47:22.257605] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T22:47:22.261168] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-25T22:47:23.207757] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T22:47:23.211622] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-25T22:47:24.178493] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T22:47:24.182561] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-25T22:47:24.799773] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T22:47:24.804061] [INFO ] [REMOTE ] JILL: Full fetch complete (22351 records). [2025-10-25T22:47:24.804327] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-25T22:47:25.180521] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-25T22:47:25.180677] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-25T22:47:25.181152] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-25T22:47:25.181228] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-25T22:47:25.181865] [DEBUG] [LOCAL ] JILL: Trimmed 22351 records to 15415 (keeping 200 days of data) [2025-10-25T22:47:25.271393] [DEBUG] [LOCAL ] JILL: Primary data saved (15415 records). [2025-10-25T22:47:25.271548] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-25T22:47:25.271709] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols. JILL took 9.7s. Estimated remaining time: 3h 59m 56s [2025-10-25T22:47:25.440724] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:47:25.440934] [DEBUG] [LOCAL ] JKS: No existing data file found in primary storage. [2025-10-25T22:47:25.441005] [WARN ] [MAIN ] JKS: No existing data found, performing full refresh instead. [2025-10-25T22:47:25.441115] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-25T22:47:25.441184] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-25T22:47:25.441263] [DEBUG] [LOCAL ] JKS: No primary data file found to delete. [2025-10-25T22:47:25.441334] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-25T22:47:25.795678] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:47:25.796023] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-25T22:47:27.465010] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T22:47:27.473555] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-25T22:47:28.863780] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T22:47:28.872086] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-25T22:47:30.347579] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-25T22:47:30.356661] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-25T22:47:31.753307] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T22:47:31.763482] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-25T22:47:33.255617] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-25T22:47:33.264682] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-25T22:47:34.733317] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T22:47:34.741468] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-25T22:47:36.181463] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-25T22:47:36.190368] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-25T22:47:37.504306] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-25T22:47:37.511958] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-25T22:47:38.989084] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T22:47:38.997712] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-25T22:47:40.506043] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-25T22:47:40.514193] [INFO ] [REMOTE ] JKS: Full fetch complete (58539 records). [2025-10-25T22:47:40.514505] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-25T22:47:40.905306] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-25T22:47:40.905441] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-25T22:47:40.906381] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-25T22:47:40.906461] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-25T22:47:40.907766] [DEBUG] [LOCAL ] JKS: Trimmed 58539 records to 39701 (keeping 200 days of data) [2025-10-25T22:47:41.135301] [DEBUG] [LOCAL ] JKS: Primary data saved (39701 records). [2025-10-25T22:47:41.135468] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-25T22:47:41.135617] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols. JKS took 15.9s. Estimated remaining time: 3h 59m 49s [2025-10-25T22:47:41.307392] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:47:41.307604] [DEBUG] [LOCAL ] JLL: No existing data file found in primary storage. [2025-10-25T22:47:41.307703] [WARN ] [MAIN ] JLL: No existing data found, performing full refresh instead. [2025-10-25T22:47:41.307847] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-25T22:47:41.307920] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-25T22:47:41.308004] [DEBUG] [LOCAL ] JLL: No primary data file found to delete. [2025-10-25T22:47:41.308077] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-25T22:47:41.673379] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:47:41.673760] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-25T22:47:42.852374] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T22:47:42.858203] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-25T22:47:44.166713] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T22:47:44.174016] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-25T22:47:45.462233] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-25T22:47:45.469242] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-25T22:47:46.789903] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T22:47:46.798084] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-25T22:47:48.162473] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T22:47:48.169770] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-25T22:47:49.422378] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-25T22:47:49.430211] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-25T22:47:50.813621] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T22:47:50.820920] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-25T22:47:52.162543] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T22:47:52.170541] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-25T22:47:53.404384] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T22:47:53.411458] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-25T22:47:54.292196] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T22:47:54.297920] [INFO ] [REMOTE ] JLL: Full fetch complete (45177 records). [2025-10-25T22:47:54.298104] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-25T22:47:54.703683] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-25T22:47:54.703828] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-25T22:47:54.705314] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-25T22:47:54.705441] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-25T22:47:54.707024] [DEBUG] [LOCAL ] JLL: Trimmed 45177 records to 31885 (keeping 200 days of data) [2025-10-25T22:47:54.910626] [DEBUG] [LOCAL ] JLL: Primary data saved (31885 records). [2025-10-25T22:47:54.910898] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-25T22:47:54.911098] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols. JLL took 13.8s. Estimated remaining time: 3h 59m 39s [2025-10-25T22:47:55.086391] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:47:55.086683] [DEBUG] [LOCAL ] JLS: No existing data file found in primary storage. [2025-10-25T22:47:55.086760] [WARN ] [MAIN ] JLS: No existing data found, performing full refresh instead. [2025-10-25T22:47:55.086886] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-25T22:47:55.086961] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-25T22:47:55.087046] [DEBUG] [LOCAL ] JLS: No primary data file found to delete. [2025-10-25T22:47:55.087120] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-25T22:47:55.461226] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:47:55.461694] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-25T22:47:56.510570] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T22:47:56.512105] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-25T22:47:57.112740] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T22:47:57.114182] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-25T22:47:57.673778] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-25T22:47:57.676475] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-25T22:47:58.319856] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-25T22:47:58.322496] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-25T22:47:58.795910] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-25T22:47:58.797698] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-25T22:47:59.417586] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T22:47:59.419272] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-25T22:48:00.009864] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-25T22:48:00.011550] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-25T22:48:00.670037] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-25T22:48:00.671472] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-25T22:48:01.413466] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-25T22:48:01.415165] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-25T22:48:03.994827] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-25T22:48:03.996175] [INFO ] [REMOTE ] JLS: Full fetch complete (5814 records). [2025-10-25T22:48:03.996266] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-25T22:48:04.367765] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-25T22:48:04.367881] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-25T22:48:04.368080] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-25T22:48:04.368174] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-25T22:48:04.368684] [DEBUG] [LOCAL ] JLS: Trimmed 5814 records to 4056 (keeping 200 days of data) [2025-10-25T22:48:04.393346] [DEBUG] [LOCAL ] JLS: Primary data saved (4056 records). [2025-10-25T22:48:04.393516] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-25T22:48:04.393700] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols. JLS took 9.5s. Estimated remaining time: 3h 59m 24s [2025-10-25T22:48:04.572848] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:48:04.573054] [DEBUG] [LOCAL ] JMIA: No existing data file found in primary storage. [2025-10-25T22:48:04.573128] [WARN ] [MAIN ] JMIA: No existing data found, performing full refresh instead. [2025-10-25T22:48:04.573241] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-25T22:48:04.573312] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-25T22:48:04.573398] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-10-25T22:48:04.573469] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-25T22:48:04.934964] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:48:04.935313] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-25T22:48:06.507409] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T22:48:06.517528] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-25T22:48:08.339291] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-25T22:48:08.349123] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-25T22:48:10.177378] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T22:48:10.187689] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-25T22:48:11.973378] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T22:48:11.983785] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-25T22:48:13.789838] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T22:48:13.800892] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-25T22:48:15.417711] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T22:48:15.427885] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-25T22:48:17.172564] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T22:48:17.183888] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-25T22:48:19.024829] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-25T22:48:19.036153] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-25T22:48:20.843598] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-25T22:48:20.855040] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-25T22:48:22.868922] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-25T22:48:22.878435] [INFO ] [REMOTE ] JMIA: Full fetch complete (73513 records). [2025-10-25T22:48:22.878579] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-25T22:48:23.265612] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-25T22:48:23.265746] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-25T22:48:23.266814] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-25T22:48:23.266896] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-25T22:48:23.268351] [DEBUG] [LOCAL ] JMIA: Trimmed 73513 records to 51953 (keeping 200 days of data) [2025-10-25T22:48:23.563970] [DEBUG] [LOCAL ] JMIA: Primary data saved (51953 records). [2025-10-25T22:48:23.564140] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-25T22:48:23.564296] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols. JMIA took 19.2s. Estimated remaining time: 3h 59m 20s [2025-10-25T22:48:23.729779] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:48:23.729969] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-25T22:48:23.730061] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-25T22:48:23.730169] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-25T22:48:23.730247] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-25T22:48:23.730331] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-25T22:48:23.730407] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-25T22:48:24.075968] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:48:24.076304] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-25T22:48:24.425270] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-25T22:48:24.426182] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-25T22:48:24.836189] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-25T22:48:24.837254] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-25T22:48:25.180222] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-25T22:48:25.181154] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-25T22:48:25.600907] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-25T22:48:25.602000] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-25T22:48:26.081609] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T22:48:26.083400] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-25T22:48:26.555934] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T22:48:26.557261] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-25T22:48:27.020865] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-25T22:48:27.022174] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-25T22:48:27.482248] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T22:48:27.483346] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-25T22:48:27.953374] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-25T22:48:27.954454] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-25T22:48:28.362102] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-25T22:48:28.362948] [INFO ] [REMOTE ] JMM: Full fetch complete (2308 records). [2025-10-25T22:48:28.363035] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-25T22:48:28.544904] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-25T22:48:28.545092] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:48:28.545162] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:48:28.545236] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-25T22:48:28.545329] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-25T22:48:28.545398] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-25T22:48:28.545495] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-25T22:48:28.545632] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols. JMM took 5.0s. Estimated remaining time: 3h 59m 1s [2025-10-25T22:48:28.718030] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:48:28.718257] [DEBUG] [LOCAL ] JNJ: No existing data file found in primary storage. [2025-10-25T22:48:28.718331] [WARN ] [MAIN ] JNJ: No existing data found, performing full refresh instead. [2025-10-25T22:48:28.718471] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-25T22:48:28.718542] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-25T22:48:28.718625] [DEBUG] [LOCAL ] JNJ: No primary data file found to delete. [2025-10-25T22:48:28.718722] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-25T22:48:29.086558] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:48:29.086919] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-25T22:48:31.508580] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-25T22:48:31.519074] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-25T22:48:33.521858] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T22:48:33.532555] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-25T22:48:35.588703] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T22:48:35.605689] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-25T22:48:37.942263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-25T22:48:37.955594] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-25T22:48:40.286459] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-25T22:48:40.297820] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-25T22:48:42.245083] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-25T22:48:42.256007] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-25T22:48:44.417212] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-25T22:48:44.428816] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-25T22:48:46.688468] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-25T22:48:46.699991] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-25T22:48:49.055451] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-25T22:48:49.067253] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-25T22:48:49.776260] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T22:48:49.786806] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-25T22:48:49.786987] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-25T22:48:50.209197] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-25T22:48:50.209323] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-25T22:48:50.210472] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-25T22:48:50.210565] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-25T22:48:50.212067] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54533 (keeping 200 days of data) [2025-10-25T22:48:50.541735] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-25T22:48:50.541893] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-25T22:48:50.542036] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols. JNJ took 22.0s. Estimated remaining time: 3h 58m 59s [2025-10-25T22:48:50.710695] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:48:50.710903] [DEBUG] [LOCAL ] JOBY: No existing data file found in primary storage. [2025-10-25T22:48:50.710975] [WARN ] [MAIN ] JOBY: No existing data found, performing full refresh instead. [2025-10-25T22:48:50.711086] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-25T22:48:50.711166] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-25T22:48:50.711225] [DEBUG] [LOCAL ] JOBY: No primary data file found to delete. [2025-10-25T22:48:50.711308] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-25T22:48:51.069968] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:48:51.070327] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-25T22:48:53.562623] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-25T22:48:53.573307] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-25T22:48:55.764688] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-25T22:48:55.774768] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-25T22:48:58.038579] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-25T22:48:58.052768] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-25T22:49:00.561918] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-25T22:49:00.573046] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-25T22:49:03.981564] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-10-25T22:49:03.993198] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-25T22:49:06.717368] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-25T22:49:06.728764] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-25T22:49:09.342220] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-25T22:49:09.354141] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-25T22:49:12.099873] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-25T22:49:12.111418] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-25T22:49:14.873864] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-25T22:49:14.885496] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-25T22:49:17.677266] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-25T22:49:17.687118] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-25T22:49:17.687304] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-25T22:49:18.106219] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-25T22:49:18.106334] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-25T22:49:18.107358] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-25T22:49:18.107438] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-25T22:49:18.108922] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54589 (keeping 200 days of data) [2025-10-25T22:49:18.434998] [DEBUG] [LOCAL ] JOBY: Primary data saved (54589 records). [2025-10-25T22:49:18.435190] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-25T22:49:18.435377] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols. JOBY took 27.9s. Estimated remaining time: 3h 59m 4s [2025-10-25T22:49:18.600963] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:49:18.601160] [DEBUG] [LOCAL ] JOE: No existing data file found in primary storage. [2025-10-25T22:49:18.601232] [WARN ] [MAIN ] JOE: No existing data found, performing full refresh instead. [2025-10-25T22:49:18.601321] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-25T22:49:18.601387] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-25T22:49:18.601446] [DEBUG] [LOCAL ] JOE: No primary data file found to delete. [2025-10-25T22:49:18.601508] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-25T22:49:18.945709] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:49:18.946091] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-25T22:49:20.297812] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T22:49:20.306287] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-25T22:49:21.355973] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-25T22:49:21.360876] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-25T22:49:22.757122] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T22:49:22.763126] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-25T22:49:24.034352] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T22:49:24.040771] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-25T22:49:25.143128] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T22:49:25.148897] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-25T22:49:26.254133] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T22:49:26.259665] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-25T22:49:27.423768] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T22:49:27.429770] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-25T22:49:28.600272] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T22:49:28.605549] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-25T22:49:29.709376] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T22:49:29.715506] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-25T22:49:30.748814] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T22:49:30.752899] [INFO ] [REMOTE ] JOE: Full fetch complete (35406 records). [2025-10-25T22:49:30.752996] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-25T22:49:31.114794] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-25T22:49:31.114902] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-25T22:49:31.115513] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-25T22:49:31.115588] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-25T22:49:31.116407] [DEBUG] [LOCAL ] JOE: Trimmed 35406 records to 23916 (keeping 200 days of data) [2025-10-25T22:49:31.255687] [DEBUG] [LOCAL ] JOE: Primary data saved (23916 records). [2025-10-25T22:49:31.255924] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-25T22:49:31.256124] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols. JOE took 12.8s. Estimated remaining time: 3h 58m 53s [2025-10-25T22:49:31.421313] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:49:31.421484] [DEBUG] [LOCAL ] JOF: No existing data file found in primary storage. [2025-10-25T22:49:31.421554] [WARN ] [MAIN ] JOF: No existing data found, performing full refresh instead. [2025-10-25T22:49:31.421692] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-25T22:49:31.421768] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-25T22:49:31.421848] [DEBUG] [LOCAL ] JOF: No primary data file found to delete. [2025-10-25T22:49:31.421914] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-25T22:49:31.767098] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:49:31.767421] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-25T22:49:32.530717] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-25T22:49:32.533045] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-25T22:49:33.292127] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T22:49:33.293728] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-25T22:49:34.023221] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-25T22:49:34.025551] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-25T22:49:34.765936] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T22:49:34.768604] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-25T22:49:35.359855] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T22:49:35.361631] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-25T22:49:35.981099] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-25T22:49:35.982972] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-25T22:49:36.619254] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T22:49:36.621279] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-25T22:49:37.399029] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T22:49:37.401503] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-25T22:49:37.959281] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-25T22:49:37.961529] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-25T22:49:38.643107] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-25T22:49:38.644862] [INFO ] [REMOTE ] JOF: Full fetch complete (9525 records). [2025-10-25T22:49:38.644949] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-25T22:49:39.000361] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-25T22:49:39.000490] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-25T22:49:39.000760] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-25T22:49:39.000839] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-25T22:49:39.001287] [DEBUG] [LOCAL ] JOF: Trimmed 9525 records to 6999 (keeping 200 days of data) [2025-10-25T22:49:39.042334] [DEBUG] [LOCAL ] JOF: Primary data saved (6999 records). [2025-10-25T22:49:39.042507] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-25T22:49:39.042635] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols. JOF took 7.8s. Estimated remaining time: 3h 58m 37s [2025-10-25T22:49:39.213981] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:49:39.214200] [DEBUG] [LOCAL ] JPC: No existing data file found in primary storage. [2025-10-25T22:49:39.214271] [WARN ] [MAIN ] JPC: No existing data found, performing full refresh instead. [2025-10-25T22:49:39.214389] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-25T22:49:39.214462] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-25T22:49:39.214544] [DEBUG] [LOCAL ] JPC: No primary data file found to delete. [2025-10-25T22:49:39.214624] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-25T22:49:39.582072] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:49:39.582443] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-25T22:49:41.022000] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T22:49:41.030333] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-25T22:49:42.482938] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T22:49:42.491411] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-25T22:49:44.015509] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T22:49:44.024140] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-25T22:49:45.480610] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T22:49:45.489576] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-25T22:49:46.808054] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-25T22:49:46.815938] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-25T22:49:48.092399] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T22:49:48.099694] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-25T22:49:49.480088] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T22:49:49.488442] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-25T22:49:50.897932] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T22:49:50.906095] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-25T22:49:52.435469] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T22:49:52.443810] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-25T22:49:53.872115] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T22:49:53.879817] [INFO ] [REMOTE ] JPC: Full fetch complete (54952 records). [2025-10-25T22:49:53.880039] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-25T22:49:54.418406] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-25T22:49:54.418585] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-25T22:49:54.420339] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-25T22:49:54.420459] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-25T22:49:54.422167] [DEBUG] [LOCAL ] JPC: Trimmed 54952 records to 37523 (keeping 200 days of data) [2025-10-25T22:49:54.745082] [DEBUG] [LOCAL ] JPC: Primary data saved (37523 records). [2025-10-25T22:49:54.745284] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-25T22:49:54.745506] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols. JPC took 15.7s. Estimated remaining time: 3h 58m 29s [2025-10-25T22:49:54.959070] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:49:54.959505] [DEBUG] [LOCAL ] JPM: No existing data file found in primary storage. [2025-10-25T22:49:54.959580] [WARN ] [MAIN ] JPM: No existing data found, performing full refresh instead. [2025-10-25T22:49:54.959727] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-25T22:49:54.959801] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-25T22:49:54.959886] [DEBUG] [LOCAL ] JPM: No primary data file found to delete. [2025-10-25T22:49:54.959973] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-25T22:49:55.322967] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:49:55.323305] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-25T22:49:57.683909] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-25T22:49:57.694486] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-25T22:50:00.002257] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-25T22:50:00.012430] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-25T22:50:02.382541] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-25T22:50:02.393850] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-25T22:50:05.853904] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-10-25T22:50:05.865166] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-25T22:50:08.382558] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-25T22:50:08.393635] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-25T22:50:10.845388] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-25T22:50:10.856390] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-25T22:50:13.227370] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-25T22:50:13.239091] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-25T22:50:15.597303] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-25T22:50:15.608713] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-25T22:50:17.961552] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-25T22:50:17.973017] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-25T22:50:18.738449] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T22:50:18.749361] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-25T22:50:18.749607] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-25T22:50:19.164054] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-25T22:50:19.164169] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-25T22:50:19.165223] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-25T22:50:19.165306] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-25T22:50:19.166829] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54574 (keeping 200 days of data) [2025-10-25T22:50:19.498111] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-25T22:50:19.498277] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-25T22:50:19.498424] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols. JPM took 24.8s. Estimated remaining time: 3h 58m 30s [2025-10-25T22:50:19.662018] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:50:19.662210] [DEBUG] [LOCAL ] JQC: No existing data file found in primary storage. [2025-10-25T22:50:19.662279] [WARN ] [MAIN ] JQC: No existing data found, performing full refresh instead. [2025-10-25T22:50:19.662391] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-25T22:50:19.662461] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-25T22:50:19.662542] [DEBUG] [LOCAL ] JQC: No primary data file found to delete. [2025-10-25T22:50:19.662612] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-25T22:50:20.005745] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:50:20.006089] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-25T22:50:21.406396] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T22:50:21.413922] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-25T22:50:22.715423] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-25T22:50:22.724785] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-25T22:50:24.063084] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T22:50:24.072575] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-25T22:50:25.554074] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T22:50:25.562118] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-25T22:50:26.826216] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-25T22:50:26.833245] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-25T22:50:27.951915] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T22:50:27.958006] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-25T22:50:29.568338] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T22:50:29.576885] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-25T22:50:30.960294] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T22:50:30.967500] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-25T22:50:32.197170] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T22:50:32.204407] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-25T22:50:33.655881] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-25T22:50:33.662870] [INFO ] [REMOTE ] JQC: Full fetch complete (50106 records). [2025-10-25T22:50:33.663031] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-25T22:50:34.033750] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-25T22:50:34.033857] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-25T22:50:34.034629] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-25T22:50:34.034725] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-25T22:50:34.035749] [DEBUG] [LOCAL ] JQC: Trimmed 50106 records to 34356 (keeping 200 days of data) [2025-10-25T22:50:34.227592] [DEBUG] [LOCAL ] JQC: Primary data saved (34356 records). [2025-10-25T22:50:34.227796] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-25T22:50:34.227922] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols. JQC took 14.7s. Estimated remaining time: 3h 58m 21s [2025-10-25T22:50:34.394585] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:50:34.394835] [DEBUG] [LOCAL ] JRI: No existing data file found in primary storage. [2025-10-25T22:50:34.394923] [WARN ] [MAIN ] JRI: No existing data found, performing full refresh instead. [2025-10-25T22:50:34.395049] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-25T22:50:34.395119] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-25T22:50:34.395198] [DEBUG] [LOCAL ] JRI: No primary data file found to delete. [2025-10-25T22:50:34.395265] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-25T22:50:34.745572] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:50:34.745939] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-25T22:50:35.857987] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T22:50:35.862421] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-25T22:50:36.845379] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T22:50:36.849470] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-25T22:50:37.794956] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T22:50:37.798618] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-25T22:50:38.754799] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T22:50:38.758423] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-25T22:50:39.698893] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T22:50:39.702409] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-25T22:50:40.500814] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T22:50:40.504268] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-25T22:50:41.467549] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T22:50:41.472504] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-25T22:50:42.333764] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-25T22:50:42.338635] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-25T22:50:43.372816] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T22:50:43.377749] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-25T22:50:44.311867] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T22:50:44.315813] [INFO ] [REMOTE ] JRI: Full fetch complete (22822 records). [2025-10-25T22:50:44.315998] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-25T22:50:44.722881] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-25T22:50:44.723001] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-25T22:50:44.723524] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-25T22:50:44.723620] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-25T22:50:44.724258] [DEBUG] [LOCAL ] JRI: Trimmed 22822 records to 15493 (keeping 200 days of data) [2025-10-25T22:50:44.815071] [DEBUG] [LOCAL ] JRI: Primary data saved (15493 records). [2025-10-25T22:50:44.815238] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-25T22:50:44.815384] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols. JRI took 10.6s. Estimated remaining time: 3h 58m 7s [2025-10-25T22:50:44.992460] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:50:44.992665] [DEBUG] [LOCAL ] JRS: No existing data file found in primary storage. [2025-10-25T22:50:44.992738] [WARN ] [MAIN ] JRS: No existing data found, performing full refresh instead. [2025-10-25T22:50:44.992859] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-25T22:50:44.992929] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-25T22:50:44.993029] [DEBUG] [LOCAL ] JRS: No primary data file found to delete. [2025-10-25T22:50:44.993104] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-25T22:50:45.373385] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:50:45.373750] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-25T22:50:46.175852] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T22:50:46.178769] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-25T22:50:46.953388] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-25T22:50:46.956034] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-25T22:50:47.816171] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T22:50:47.819057] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-25T22:50:48.638272] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T22:50:48.641127] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-25T22:50:49.448686] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T22:50:49.451380] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-25T22:50:50.253720] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-25T22:50:50.256632] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-25T22:50:51.146281] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T22:50:51.150007] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-25T22:50:51.909215] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T22:50:51.912174] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-25T22:50:52.819042] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-25T22:50:52.822349] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-25T22:50:53.631945] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T22:50:53.634757] [INFO ] [REMOTE ] JRS: Full fetch complete (16075 records). [2025-10-25T22:50:53.634859] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-25T22:50:53.992993] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-25T22:50:53.993103] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-25T22:50:53.993510] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-25T22:50:53.993587] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-25T22:50:53.994196] [DEBUG] [LOCAL ] JRS: Trimmed 16075 records to 11662 (keeping 200 days of data) [2025-10-25T22:50:54.058381] [DEBUG] [LOCAL ] JRS: Primary data saved (11662 records). [2025-10-25T22:50:54.058543] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-25T22:50:54.058708] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols. JRS took 9.2s. Estimated remaining time: 3h 57m 53s [2025-10-25T22:50:54.225378] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:50:54.225558] [DEBUG] [LOCAL ] JXN: No existing data file found in primary storage. [2025-10-25T22:50:54.225630] [WARN ] [MAIN ] JXN: No existing data found, performing full refresh instead. [2025-10-25T22:50:54.225765] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-25T22:50:54.225837] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-25T22:50:54.225918] [DEBUG] [LOCAL ] JXN: No primary data file found to delete. [2025-10-25T22:50:54.225985] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-25T22:50:54.598990] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:50:54.599333] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-25T22:50:56.011480] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T22:50:56.022241] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-25T22:50:57.481608] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T22:50:57.490500] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-25T22:50:59.196737] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T22:50:59.207353] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-25T22:51:00.761202] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T22:51:00.770963] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-25T22:51:02.460147] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-25T22:51:02.470231] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-25T22:51:04.002356] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T22:51:04.012343] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-25T22:51:05.654307] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T22:51:05.663471] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-25T22:51:07.182853] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-25T22:51:07.192600] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-25T22:51:08.685685] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T22:51:08.695223] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-25T22:51:09.987215] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T22:51:09.994575] [INFO ] [REMOTE ] JXN: Full fetch complete (65308 records). [2025-10-25T22:51:09.994833] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-25T22:51:10.394316] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-25T22:51:10.394430] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-25T22:51:10.395543] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-25T22:51:10.395628] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-25T22:51:10.397044] [DEBUG] [LOCAL ] JXN: Trimmed 65308 records to 44772 (keeping 200 days of data) [2025-10-25T22:51:10.660927] [DEBUG] [LOCAL ] JXN: Primary data saved (44772 records). [2025-10-25T22:51:10.661102] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-25T22:51:10.661292] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols. JXN took 16.6s. Estimated remaining time: 3h 57m 45s [2025-10-25T22:51:10.827855] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:51:10.828070] [DEBUG] [LOCAL ] K: No existing data file found in primary storage. [2025-10-25T22:51:10.828156] [WARN ] [MAIN ] K: No existing data found, performing full refresh instead. [2025-10-25T22:51:10.828303] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-25T22:51:10.828393] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-25T22:51:10.828504] [DEBUG] [LOCAL ] K: No primary data file found to delete. [2025-10-25T22:51:10.828592] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-25T22:51:11.178434] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:51:11.178875] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-25T22:51:12.646803] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T22:51:12.656470] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-25T22:51:14.264455] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T22:51:14.274600] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-25T22:51:15.975617] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T22:51:15.985586] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-25T22:51:17.296418] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T22:51:17.307530] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-25T22:51:18.948700] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T22:51:18.960393] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-25T22:51:20.624832] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T22:51:20.635200] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-25T22:51:22.369494] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T22:51:22.380521] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-25T22:51:24.022722] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T22:51:24.033556] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-25T22:51:25.660103] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-25T22:51:25.671293] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-25T22:51:26.385237] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T22:51:26.394738] [INFO ] [REMOTE ] K: Full fetch complete (72287 records). [2025-10-25T22:51:26.394892] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-25T22:51:26.791724] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-25T22:51:26.791840] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-25T22:51:26.792934] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-25T22:51:26.793019] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-25T22:51:26.794399] [DEBUG] [LOCAL ] K: Trimmed 72287 records to 51098 (keeping 200 days of data) [2025-10-25T22:51:27.101164] [DEBUG] [LOCAL ] K: Primary data saved (51098 records). [2025-10-25T22:51:27.101347] [INFO ] [MAIN ] K: Full history saved. [2025-10-25T22:51:27.101588] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols. K took 16.4s. Estimated remaining time: 3h 57m 38s [2025-10-25T22:51:27.268953] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:51:27.269143] [DEBUG] [LOCAL ] KAI: No existing data file found in primary storage. [2025-10-25T22:51:27.269213] [WARN ] [MAIN ] KAI: No existing data found, performing full refresh instead. [2025-10-25T22:51:27.269325] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-25T22:51:27.269397] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-25T22:51:27.269476] [DEBUG] [LOCAL ] KAI: No primary data file found to delete. [2025-10-25T22:51:27.269544] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-25T22:51:27.628313] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:51:27.628665] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-25T22:51:28.375508] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T22:51:28.377850] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-25T22:51:29.471071] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-25T22:51:29.474925] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-25T22:51:30.481048] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-25T22:51:30.485213] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-25T22:51:31.365349] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T22:51:31.370401] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-25T22:51:32.184244] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T22:51:32.187836] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-25T22:51:33.192562] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T22:51:33.196239] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-25T22:51:34.154255] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T22:51:34.158014] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-25T22:51:35.075466] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-25T22:51:35.080080] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-25T22:51:35.894628] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-25T22:51:35.898208] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-25T22:51:36.775969] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T22:51:36.779263] [INFO ] [REMOTE ] KAI: Full fetch complete (19335 records). [2025-10-25T22:51:36.779373] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-25T22:51:37.177677] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-25T22:51:37.177820] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-25T22:51:37.178278] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-25T22:51:37.178366] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-25T22:51:37.179014] [DEBUG] [LOCAL ] KAI: Trimmed 19335 records to 13576 (keeping 200 days of data) [2025-10-25T22:51:37.267153] [DEBUG] [LOCAL ] KAI: Primary data saved (13576 records). [2025-10-25T22:51:37.267367] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-25T22:51:37.267543] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols. KAI took 10.2s. Estimated remaining time: 3h 57m 24s [2025-10-25T22:51:37.456079] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:51:37.456267] [DEBUG] [LOCAL ] KAR: No existing data file found in primary storage. [2025-10-25T22:51:37.456338] [WARN ] [MAIN ] KAR: No existing data found, performing full refresh instead. [2025-10-25T22:51:37.456432] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-25T22:51:37.456501] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-25T22:51:37.456565] [DEBUG] [LOCAL ] KAR: No primary data file found to delete. [2025-10-25T22:51:37.456627] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-25T22:51:37.847260] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:51:37.847637] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-25T22:51:39.186216] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T22:51:39.193280] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-25T22:51:40.533711] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T22:51:40.541305] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-25T22:51:42.145538] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T22:51:42.154132] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-25T22:51:43.550637] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T22:51:43.559234] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-25T22:51:44.972037] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T22:51:44.980516] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-25T22:51:46.306774] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T22:51:46.314551] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-25T22:51:47.824076] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-25T22:51:47.833525] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-25T22:51:49.248323] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T22:51:49.257121] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-25T22:51:50.731328] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T22:51:50.740039] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-25T22:51:52.147143] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T22:51:52.154492] [INFO ] [REMOTE ] KAR: Full fetch complete (56986 records). [2025-10-25T22:51:52.154701] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-25T22:51:52.532982] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-25T22:51:52.533096] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-25T22:51:52.533947] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-25T22:51:52.534026] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-25T22:51:52.535257] [DEBUG] [LOCAL ] KAR: Trimmed 56986 records to 40299 (keeping 200 days of data) [2025-10-25T22:51:52.762378] [DEBUG] [LOCAL ] KAR: Primary data saved (40299 records). [2025-10-25T22:51:52.762565] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-25T22:51:52.762766] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols. KAR took 15.5s. Estimated remaining time: 3h 57m 16s [2025-10-25T22:51:52.950274] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:51:52.950473] [DEBUG] [LOCAL ] KB: No existing data file found in primary storage. [2025-10-25T22:51:52.950552] [WARN ] [MAIN ] KB: No existing data found, performing full refresh instead. [2025-10-25T22:51:52.950683] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-25T22:51:52.950773] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-25T22:51:52.950861] [DEBUG] [LOCAL ] KB: No primary data file found to delete. [2025-10-25T22:51:52.950931] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-25T22:51:53.336715] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:51:53.337082] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-25T22:51:54.346491] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T22:51:54.350732] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-25T22:51:55.416712] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-25T22:51:55.421949] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-25T22:51:56.837084] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T22:51:56.843045] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-25T22:51:57.988213] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T22:51:57.993990] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-25T22:51:59.095714] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T22:51:59.101564] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-25T22:52:00.207401] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-25T22:52:00.213292] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-25T22:52:01.576694] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T22:52:01.582869] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-25T22:52:02.646227] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T22:52:02.652566] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-25T22:52:03.750294] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-25T22:52:03.754686] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-25T22:52:04.779505] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T22:52:04.783010] [INFO ] [REMOTE ] KB: Full fetch complete (33407 records). [2025-10-25T22:52:04.783111] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-25T22:52:05.151152] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-25T22:52:05.151287] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-25T22:52:05.152020] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-25T22:52:05.152099] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-25T22:52:05.153055] [DEBUG] [LOCAL ] KB: Trimmed 33407 records to 23210 (keeping 200 days of data) [2025-10-25T22:52:05.286258] [DEBUG] [LOCAL ] KB: Primary data saved (23210 records). [2025-10-25T22:52:05.286415] [INFO ] [MAIN ] KB: Full history saved. [2025-10-25T22:52:05.286578] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols. KB took 12.5s. Estimated remaining time: 3h 57m 5s [2025-10-25T22:52:05.453378] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:52:05.453563] [DEBUG] [LOCAL ] KBDC: No existing data file found in primary storage. [2025-10-25T22:52:05.453633] [WARN ] [MAIN ] KBDC: No existing data found, performing full refresh instead. [2025-10-25T22:52:05.453780] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-25T22:52:05.453849] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-25T22:52:05.453928] [DEBUG] [LOCAL ] KBDC: No primary data file found to delete. [2025-10-25T22:52:05.454000] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-25T22:52:05.799568] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:52:05.799922] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-25T22:52:06.749243] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T22:52:06.752936] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-25T22:52:07.664291] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T22:52:07.668046] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-25T22:52:08.723678] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T22:52:08.729363] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-25T22:52:09.843202] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T22:52:09.849104] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-25T22:52:10.804696] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T22:52:10.809321] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-25T22:52:11.742066] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-25T22:52:11.746301] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-25T22:52:12.672334] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T22:52:12.677145] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-25T22:52:13.659504] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T22:52:13.663933] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-25T22:52:14.644920] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T22:52:14.651520] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-25T22:52:15.984822] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T22:52:15.990901] [INFO ] [REMOTE ] KBDC: Full fetch complete (31038 records). [2025-10-25T22:52:15.991031] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-25T22:52:16.350559] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-25T22:52:16.350699] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-25T22:52:16.351407] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-25T22:52:16.351500] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-25T22:52:16.352389] [DEBUG] [LOCAL ] KBDC: Trimmed 31038 records to 22964 (keeping 200 days of data) [2025-10-25T22:52:16.485253] [DEBUG] [LOCAL ] KBDC: Primary data saved (22964 records). [2025-10-25T22:52:16.485426] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-25T22:52:16.485711] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols. KBDC took 11.2s. Estimated remaining time: 3h 56m 52s [2025-10-25T22:52:16.655976] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:52:16.656190] [DEBUG] [LOCAL ] KBH: No existing data file found in primary storage. [2025-10-25T22:52:16.656279] [WARN ] [MAIN ] KBH: No existing data found, performing full refresh instead. [2025-10-25T22:52:16.656428] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-25T22:52:16.656520] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-25T22:52:16.656630] [DEBUG] [LOCAL ] KBH: No primary data file found to delete. [2025-10-25T22:52:16.656783] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-25T22:52:17.000830] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:52:17.001262] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-25T22:52:18.642205] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T22:52:18.652161] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-25T22:52:20.257710] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T22:52:20.266914] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-25T22:52:21.965680] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T22:52:21.980122] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-25T22:52:23.613435] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T22:52:23.624073] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-25T22:52:25.287504] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T22:52:25.297304] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-25T22:52:26.936562] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T22:52:26.946575] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-25T22:52:28.591351] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T22:52:28.602334] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-25T22:52:30.194072] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T22:52:30.204635] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-25T22:52:31.817630] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T22:52:31.828508] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-25T22:52:33.419450] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-25T22:52:33.428386] [INFO ] [REMOTE ] KBH: Full fetch complete (71065 records). [2025-10-25T22:52:33.428503] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-25T22:52:33.812464] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-25T22:52:33.812581] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-25T22:52:33.813546] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-25T22:52:33.813627] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-25T22:52:33.815019] [DEBUG] [LOCAL ] KBH: Trimmed 71065 records to 49358 (keeping 200 days of data) [2025-10-25T22:52:34.102205] [DEBUG] [LOCAL ] KBH: Primary data saved (49358 records). [2025-10-25T22:52:34.102381] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-25T22:52:34.102576] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols. KBH took 17.6s. Estimated remaining time: 3h 56m 46s [2025-10-25T22:52:34.269193] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:52:34.269397] [DEBUG] [LOCAL ] KBR: No existing data file found in primary storage. [2025-10-25T22:52:34.269468] [WARN ] [MAIN ] KBR: No existing data found, performing full refresh instead. [2025-10-25T22:52:34.269580] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-25T22:52:34.269689] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-25T22:52:34.269787] [DEBUG] [LOCAL ] KBR: No primary data file found to delete. [2025-10-25T22:52:34.269868] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-25T22:52:34.618923] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:52:34.619265] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-25T22:52:36.081072] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T22:52:36.090298] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-25T22:52:37.713006] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T22:52:37.722735] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-25T22:52:39.428253] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T22:52:39.438775] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-25T22:52:41.000061] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T22:52:41.010185] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-25T22:52:42.731367] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T22:52:42.741705] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-25T22:52:45.213526] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-25T22:52:45.223318] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-25T22:52:46.998266] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-25T22:52:47.009090] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-25T22:52:48.944579] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-25T22:52:48.954904] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-25T22:52:50.726691] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T22:52:50.736718] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-25T22:52:52.425845] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T22:52:52.434448] [INFO ] [REMOTE ] KBR: Full fetch complete (70045 records). [2025-10-25T22:52:52.434593] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-25T22:52:52.815737] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-25T22:52:52.815847] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-25T22:52:52.816842] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-25T22:52:52.816924] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-25T22:52:52.821522] [DEBUG] [LOCAL ] KBR: Trimmed 70045 records to 48714 (keeping 200 days of data) [2025-10-25T22:52:53.101277] [DEBUG] [LOCAL ] KBR: Primary data saved (48714 records). [2025-10-25T22:52:53.101447] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-25T22:52:53.101628] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols. KBR took 19.0s. Estimated remaining time: 3h 56m 41s [2025-10-25T22:52:53.267021] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:52:53.267201] [DEBUG] [LOCAL ] KD: No existing data file found in primary storage. [2025-10-25T22:52:53.267298] [WARN ] [MAIN ] KD: No existing data found, performing full refresh instead. [2025-10-25T22:52:53.267450] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-25T22:52:53.267535] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-25T22:52:53.267672] [DEBUG] [LOCAL ] KD: No primary data file found to delete. [2025-10-25T22:52:53.267774] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-25T22:52:53.613733] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:52:53.614049] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-25T22:52:55.438769] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T22:52:55.449312] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-25T22:52:57.033221] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T22:52:57.042980] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-25T22:52:58.822892] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T22:52:58.833667] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-25T22:53:00.578863] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T22:53:00.589807] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-25T22:53:02.401250] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T22:53:02.412148] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-25T22:53:04.269838] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-25T22:53:04.280311] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-25T22:53:06.232993] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-25T22:53:06.244240] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-25T22:53:08.168741] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-25T22:53:08.180116] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-25T22:53:09.961622] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T22:53:09.973230] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-25T22:53:11.848329] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T22:53:11.857975] [INFO ] [REMOTE ] KD: Full fetch complete (76084 records). [2025-10-25T22:53:11.858167] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-25T22:53:12.241632] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-25T22:53:12.241771] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-25T22:53:12.242819] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-25T22:53:12.242901] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-25T22:53:12.244364] [DEBUG] [LOCAL ] KD: Trimmed 76084 records to 53087 (keeping 200 days of data) [2025-10-25T22:53:12.540075] [DEBUG] [LOCAL ] KD: Primary data saved (53087 records). [2025-10-25T22:53:12.540242] [INFO ] [MAIN ] KD: Full history saved. [2025-10-25T22:53:12.540480] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols. KD took 19.4s. Estimated remaining time: 3h 56m 36s [2025-10-25T22:53:12.704154] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:53:12.704345] [DEBUG] [LOCAL ] KEN: No existing data file found in primary storage. [2025-10-25T22:53:12.704415] [WARN ] [MAIN ] KEN: No existing data found, performing full refresh instead. [2025-10-25T22:53:12.704527] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-25T22:53:12.704598] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-25T22:53:12.704703] [DEBUG] [LOCAL ] KEN: No primary data file found to delete. [2025-10-25T22:53:12.704773] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-25T22:53:13.052727] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:53:13.053106] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-25T22:53:13.672021] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T22:53:13.673382] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-25T22:53:14.212878] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-25T22:53:14.214044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-25T22:53:14.887384] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-25T22:53:14.889054] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-25T22:53:15.513026] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-25T22:53:15.515750] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-25T22:53:16.203684] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-25T22:53:16.205441] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-25T22:53:16.846495] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-25T22:53:16.848336] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-25T22:53:17.570457] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T22:53:17.573113] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-25T22:53:18.206727] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-25T22:53:18.208425] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-25T22:53:18.817592] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T22:53:18.819135] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-25T22:53:19.313445] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T22:53:19.314578] [INFO ] [REMOTE ] KEN: Full fetch complete (5834 records). [2025-10-25T22:53:19.314723] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-25T22:53:19.667235] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-25T22:53:19.667369] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-25T22:53:19.667586] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-25T22:53:19.667707] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-25T22:53:19.668166] [DEBUG] [LOCAL ] KEN: Trimmed 5834 records to 4617 (keeping 200 days of data) [2025-10-25T22:53:19.694476] [DEBUG] [LOCAL ] KEN: Primary data saved (4617 records). [2025-10-25T22:53:19.694669] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-25T22:53:19.694841] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols. KEN took 7.2s. Estimated remaining time: 3h 56m 19s [2025-10-25T22:53:19.865920] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:53:19.866189] [DEBUG] [LOCAL ] KEP: No existing data file found in primary storage. [2025-10-25T22:53:19.866276] [WARN ] [MAIN ] KEP: No existing data found, performing full refresh instead. [2025-10-25T22:53:19.866409] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-25T22:53:19.866497] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-25T22:53:19.866607] [DEBUG] [LOCAL ] KEP: No primary data file found to delete. [2025-10-25T22:53:19.866725] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-25T22:53:20.230388] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:53:20.230795] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-25T22:53:21.415715] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T22:53:21.421487] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-25T22:53:22.399000] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T22:53:22.403464] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-25T22:53:23.181194] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-25T22:53:23.185903] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-25T22:53:24.462052] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T22:53:24.468120] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-25T22:53:25.833603] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T22:53:25.840054] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-25T22:53:27.282295] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T22:53:27.290220] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-25T22:53:28.815481] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T22:53:28.823588] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-25T22:53:30.244900] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T22:53:30.251996] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-25T22:53:31.724161] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T22:53:31.731044] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-25T22:53:33.262116] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-25T22:53:33.269088] [INFO ] [REMOTE ] KEP: Full fetch complete (42462 records). [2025-10-25T22:53:33.269364] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-25T22:53:33.660702] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-25T22:53:33.660853] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-25T22:53:33.661905] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-25T22:53:33.661988] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-25T22:53:33.663368] [DEBUG] [LOCAL ] KEP: Trimmed 42462 records to 32980 (keeping 200 days of data) [2025-10-25T22:53:33.862751] [DEBUG] [LOCAL ] KEP: Primary data saved (32980 records). [2025-10-25T22:53:33.863009] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-25T22:53:33.863256] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols. KEP took 14.2s. Estimated remaining time: 3h 56m 10s [2025-10-25T22:53:34.046544] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:53:34.046872] [DEBUG] [LOCAL ] KEX: No existing data file found in primary storage. [2025-10-25T22:53:34.046947] [WARN ] [MAIN ] KEX: No existing data found, performing full refresh instead. [2025-10-25T22:53:34.047069] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-25T22:53:34.047143] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-25T22:53:34.047225] [DEBUG] [LOCAL ] KEX: No primary data file found to delete. [2025-10-25T22:53:34.047297] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-25T22:53:34.394733] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:53:34.395113] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-25T22:53:35.946605] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T22:53:35.954964] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-25T22:53:37.533821] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T22:53:37.540872] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-25T22:53:39.640074] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-25T22:53:39.648349] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-25T22:53:41.044052] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-25T22:53:41.052287] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-25T22:53:42.484042] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T22:53:42.493079] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-25T22:53:43.850737] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T22:53:43.857662] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-25T22:53:45.318567] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T22:53:45.326361] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-25T22:53:46.903081] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T22:53:46.912612] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-25T22:53:48.437142] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T22:53:48.447987] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-25T22:53:50.079576] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T22:53:50.087638] [INFO ] [REMOTE ] KEX: Full fetch complete (56082 records). [2025-10-25T22:53:50.087841] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-25T22:53:50.476752] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-25T22:53:50.476878] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-25T22:53:50.477733] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-25T22:53:50.477814] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-25T22:53:50.478909] [DEBUG] [LOCAL ] KEX: Trimmed 56082 records to 39315 (keeping 200 days of data) [2025-10-25T22:53:50.700154] [DEBUG] [LOCAL ] KEX: Primary data saved (39315 records). [2025-10-25T22:53:50.700312] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-25T22:53:50.700461] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols. KEX took 16.8s. Estimated remaining time: 3h 56m 3s [2025-10-25T22:53:50.865340] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:53:50.865520] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-25T22:53:50.865570] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-25T22:53:50.865699] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-25T22:53:50.865778] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-25T22:53:50.865861] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-25T22:53:50.865935] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-25T22:53:51.210954] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:53:51.211285] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-25T22:53:52.867369] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T22:53:52.877860] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-25T22:53:54.573608] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T22:53:54.583954] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-25T22:53:56.204946] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T22:53:56.216059] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-25T22:53:58.253356] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-25T22:53:58.264626] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-25T22:54:00.127122] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-25T22:54:00.139259] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-25T22:54:01.969336] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T22:54:01.980176] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-25T22:54:03.864898] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-25T22:54:03.876299] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-25T22:54:05.753767] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-25T22:54:05.766181] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-25T22:54:06.525287] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T22:54:06.537254] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-25T22:54:07.290172] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T22:54:07.304369] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-25T22:54:07.304610] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-25T22:54:07.505675] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T22:54:07.506452] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-25T22:54:07.506529] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-25T22:54:07.506619] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-25T22:54:07.506760] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-25T22:54:07.506851] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-25T22:54:07.506959] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-25T22:54:07.507092] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols. KEY took 16.8s. Estimated remaining time: 3h 55m 55s [2025-10-25T22:54:07.673604] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:54:07.673873] [DEBUG] [LOCAL ] KEYS: No existing data file found in primary storage. [2025-10-25T22:54:07.673960] [WARN ] [MAIN ] KEYS: No existing data found, performing full refresh instead. [2025-10-25T22:54:07.674097] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-25T22:54:07.674186] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-25T22:54:07.674291] [DEBUG] [LOCAL ] KEYS: No primary data file found to delete. [2025-10-25T22:54:07.674376] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-25T22:54:08.024471] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:54:08.024833] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-25T22:54:09.493538] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T22:54:09.501931] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-25T22:54:11.027217] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T22:54:11.039151] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-25T22:54:12.631070] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T22:54:12.640487] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-25T22:54:14.324121] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-25T22:54:14.333739] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-25T22:54:15.933773] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T22:54:15.943165] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-25T22:54:17.467841] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T22:54:17.479987] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-25T22:54:19.027132] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T22:54:19.037856] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-25T22:54:20.795678] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T22:54:20.806823] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-25T22:54:22.481116] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T22:54:22.490636] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-25T22:54:24.222918] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-25T22:54:24.231185] [INFO ] [REMOTE ] KEYS: Full fetch complete (63055 records). [2025-10-25T22:54:24.231342] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-25T22:54:24.614324] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-25T22:54:24.614465] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-25T22:54:24.615508] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-25T22:54:24.615606] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-25T22:54:24.616941] [DEBUG] [LOCAL ] KEYS: Trimmed 63055 records to 43717 (keeping 200 days of data) [2025-10-25T22:54:24.902478] [DEBUG] [LOCAL ] KEYS: Primary data saved (43717 records). [2025-10-25T22:54:24.902716] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-25T22:54:24.902911] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols. KEYS took 17.4s. Estimated remaining time: 3h 55m 49s [2025-10-25T22:54:25.080922] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:54:25.081194] [DEBUG] [LOCAL ] KF: No existing data file found in primary storage. [2025-10-25T22:54:25.081269] [WARN ] [MAIN ] KF: No existing data found, performing full refresh instead. [2025-10-25T22:54:25.081367] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-25T22:54:25.081437] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-25T22:54:25.081494] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-10-25T22:54:25.081559] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-25T22:54:25.448260] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:54:25.448714] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-25T22:54:26.225230] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T22:54:26.226894] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-25T22:54:26.684098] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-25T22:54:26.685506] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-25T22:54:27.218270] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-25T22:54:27.219880] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-25T22:54:27.822752] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T22:54:27.824768] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-25T22:54:28.386744] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-25T22:54:28.388423] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-25T22:54:28.940609] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T22:54:28.942154] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-25T22:54:29.399485] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-25T22:54:29.400614] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-25T22:54:29.872320] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-25T22:54:29.873836] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-25T22:54:30.317433] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-25T22:54:30.318558] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-25T22:54:30.781505] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T22:54:30.782540] [INFO ] [REMOTE ] KF: Full fetch complete (3420 records). [2025-10-25T22:54:30.782668] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-25T22:54:31.139048] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-25T22:54:31.139173] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-25T22:54:31.139337] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-25T22:54:31.139413] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-25T22:54:31.139844] [DEBUG] [LOCAL ] KF: Trimmed 3420 records to 2377 (keeping 200 days of data) [2025-10-25T22:54:31.154032] [DEBUG] [LOCAL ] KF: Primary data saved (2377 records). [2025-10-25T22:54:31.154145] [INFO ] [MAIN ] KF: Full history saved. [2025-10-25T22:54:31.154284] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols. KF took 6.3s. Estimated remaining time: 3h 55m 31s [2025-10-25T22:54:31.324952] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:54:31.325150] [DEBUG] [LOCAL ] KFRC: No existing data file found in primary storage. [2025-10-25T22:54:31.325219] [WARN ] [MAIN ] KFRC: No existing data found, performing full refresh instead. [2025-10-25T22:54:31.325329] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-25T22:54:31.325402] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-25T22:54:31.325480] [DEBUG] [LOCAL ] KFRC: No primary data file found to delete. [2025-10-25T22:54:31.325545] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-25T22:54:31.675214] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:54:31.675836] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-25T22:54:32.558678] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-25T22:54:32.561799] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-25T22:54:33.505769] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-25T22:54:33.509120] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-25T22:54:34.264081] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T22:54:34.269685] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-25T22:54:35.284052] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-25T22:54:35.288669] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-25T22:54:36.269935] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T22:54:36.274190] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-25T22:54:37.160153] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-25T22:54:37.164107] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-25T22:54:38.322807] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T22:54:38.329566] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-25T22:54:39.616466] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T22:54:39.622209] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-25T22:54:40.654802] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T22:54:40.660367] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-25T22:54:41.880730] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T22:54:41.885388] [INFO ] [REMOTE ] KFRC: Full fetch complete (27202 records). [2025-10-25T22:54:41.885496] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-25T22:54:42.248346] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-25T22:54:42.248461] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-25T22:54:42.249068] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-25T22:54:42.249152] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-25T22:54:42.249903] [DEBUG] [LOCAL ] KFRC: Trimmed 27202 records to 21172 (keeping 200 days of data) [2025-10-25T22:54:42.375672] [DEBUG] [LOCAL ] KFRC: Primary data saved (21172 records). [2025-10-25T22:54:42.375836] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-25T22:54:42.375978] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols. KFRC took 11.2s. Estimated remaining time: 3h 55m 18s [2025-10-25T22:54:42.539767] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:54:42.539923] [DEBUG] [LOCAL ] KFS: No existing data file found in primary storage. [2025-10-25T22:54:42.539991] [WARN ] [MAIN ] KFS: No existing data found, performing full refresh instead. [2025-10-25T22:54:42.540079] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-25T22:54:42.540145] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-25T22:54:42.540203] [DEBUG] [LOCAL ] KFS: No primary data file found to delete. [2025-10-25T22:54:42.540263] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-25T22:54:42.880486] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:54:42.880804] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-25T22:54:43.821502] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T22:54:43.823402] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-25T22:54:44.253274] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-25T22:54:44.254834] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-25T22:54:44.885527] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T22:54:44.888308] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-25T22:54:45.638610] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T22:54:45.641165] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-25T22:54:46.475934] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-25T22:54:46.478444] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-25T22:54:47.248921] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T22:54:47.251904] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-25T22:54:47.967255] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T22:54:47.970078] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-25T22:54:48.712688] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-25T22:54:48.715458] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-25T22:54:49.474263] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T22:54:49.477237] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-25T22:54:50.126730] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T22:54:50.129354] [INFO ] [REMOTE ] KFS: Full fetch complete (11263 records). [2025-10-25T22:54:50.129458] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-25T22:54:50.500542] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-25T22:54:50.500725] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-25T22:54:50.501156] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-25T22:54:50.501265] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-25T22:54:50.501935] [DEBUG] [LOCAL ] KFS: Trimmed 11263 records to 8813 (keeping 200 days of data) [2025-10-25T22:54:50.555852] [DEBUG] [LOCAL ] KFS: Primary data saved (8813 records). [2025-10-25T22:54:50.556084] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-25T22:54:50.556281] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols. KFS took 8.2s. Estimated remaining time: 3h 55m 3s [2025-10-25T22:54:50.733459] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:54:50.733749] [DEBUG] [LOCAL ] KFY: No existing data file found in primary storage. [2025-10-25T22:54:50.733839] [WARN ] [MAIN ] KFY: No existing data found, performing full refresh instead. [2025-10-25T22:54:50.733990] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-25T22:54:50.734080] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-25T22:54:50.734182] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-25T22:54:50.734266] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-25T22:54:51.107204] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:54:51.108478] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-25T22:54:52.257698] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T22:54:52.263586] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-25T22:54:53.417887] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T22:54:53.423535] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-25T22:54:54.897619] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T22:54:54.905112] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-25T22:54:56.401424] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T22:54:56.409290] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-25T22:54:57.572147] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T22:54:57.578118] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-25T22:54:59.189331] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T22:54:59.196530] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-25T22:55:00.545984] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T22:55:00.553142] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-25T22:55:02.231390] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T22:55:02.237524] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-25T22:55:03.732187] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T22:55:03.739085] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-25T22:55:05.032039] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-25T22:55:05.040236] [INFO ] [REMOTE ] KFY: Full fetch complete (43306 records). [2025-10-25T22:55:05.040371] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-25T22:55:05.415422] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-25T22:55:05.415530] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-25T22:55:05.416316] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-25T22:55:05.416395] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-25T22:55:05.417403] [DEBUG] [LOCAL ] KFY: Trimmed 43306 records to 29905 (keeping 200 days of data) [2025-10-25T22:55:05.590684] [DEBUG] [LOCAL ] KFY: Primary data saved (29905 records). [2025-10-25T22:55:05.590836] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-25T22:55:05.590984] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols. KFY took 15.0s. Estimated remaining time: 3h 54m 54s [2025-10-25T22:55:05.758350] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:55:05.758563] [DEBUG] [LOCAL ] KGC: No existing data file found in primary storage. [2025-10-25T22:55:05.758662] [WARN ] [MAIN ] KGC: No existing data found, performing full refresh instead. [2025-10-25T22:55:05.758766] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-25T22:55:05.758840] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-25T22:55:05.758899] [DEBUG] [LOCAL ] KGC: No primary data file found to delete. [2025-10-25T22:55:05.758960] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-25T22:55:06.118713] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:55:06.119046] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-25T22:55:08.096219] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-25T22:55:08.107450] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-25T22:55:10.040524] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T22:55:10.051708] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-25T22:55:12.222522] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-25T22:55:12.233946] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-25T22:55:14.571596] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-25T22:55:14.583890] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-25T22:55:16.873953] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-25T22:55:16.885972] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-25T22:55:18.879526] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-25T22:55:18.890866] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-25T22:55:21.090538] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-25T22:55:21.103161] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-25T22:55:23.293251] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-25T22:55:23.306120] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-25T22:55:25.606464] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-25T22:55:25.618767] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-25T22:55:27.882781] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-25T22:55:27.894620] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-25T22:55:27.894981] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-25T22:55:28.326011] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-25T22:55:28.326170] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-25T22:55:28.327785] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-25T22:55:28.327880] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-25T22:55:28.330175] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 54479 (keeping 200 days of data) [2025-10-25T22:55:28.677598] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-10-25T22:55:28.677899] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-25T22:55:28.678095] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols. KGC took 23.1s. Estimated remaining time: 3h 54m 53s [2025-10-25T22:55:28.881079] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:55:28.881502] [DEBUG] [LOCAL ] KGS: No existing data file found in primary storage. [2025-10-25T22:55:28.881580] [WARN ] [MAIN ] KGS: No existing data found, performing full refresh instead. [2025-10-25T22:55:28.881733] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-25T22:55:28.881857] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-25T22:55:28.881947] [DEBUG] [LOCAL ] KGS: No primary data file found to delete. [2025-10-25T22:55:28.882025] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-25T22:55:29.261794] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:55:29.262243] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-25T22:55:30.984895] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-25T22:55:30.994393] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-25T22:55:32.601738] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T22:55:32.611419] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-25T22:55:34.264770] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T22:55:34.275382] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-25T22:55:35.987283] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-25T22:55:35.999231] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-25T22:55:37.613098] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-25T22:55:37.622984] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-25T22:55:39.119294] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T22:55:39.129165] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-25T22:55:40.757609] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T22:55:40.768429] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-25T22:55:42.298258] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T22:55:42.310195] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-25T22:55:44.019530] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T22:55:44.031267] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-25T22:55:45.643405] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T22:55:45.652422] [INFO ] [REMOTE ] KGS: Full fetch complete (66538 records). [2025-10-25T22:55:45.652626] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-25T22:55:46.051022] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-25T22:55:46.051183] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-25T22:55:46.052866] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-25T22:55:46.052953] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-25T22:55:46.054891] [DEBUG] [LOCAL ] KGS: Trimmed 66538 records to 46710 (keeping 200 days of data) [2025-10-25T22:55:46.354492] [DEBUG] [LOCAL ] KGS: Primary data saved (46710 records). [2025-10-25T22:55:46.354778] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-25T22:55:46.354997] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols. KGS took 17.7s. Estimated remaining time: 3h 54m 46s [2025-10-25T22:55:46.534342] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:55:46.534696] [DEBUG] [LOCAL ] KIM: No existing data file found in primary storage. [2025-10-25T22:55:46.534772] [WARN ] [MAIN ] KIM: No existing data found, performing full refresh instead. [2025-10-25T22:55:46.534929] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-25T22:55:46.535002] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-25T22:55:46.535082] [DEBUG] [LOCAL ] KIM: No primary data file found to delete. [2025-10-25T22:55:46.535153] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-25T22:55:46.925851] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:55:46.926317] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-25T22:55:48.701756] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T22:55:48.713197] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-25T22:55:50.323033] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T22:55:50.333439] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-25T22:55:52.183536] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T22:55:52.194444] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-25T22:55:53.764842] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T22:55:53.775979] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-25T22:55:55.405368] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T22:55:55.416784] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-25T22:55:57.202725] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-25T22:55:57.213557] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-25T22:55:59.186778] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-25T22:55:59.198776] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-25T22:56:00.968515] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T22:56:00.979609] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-25T22:56:02.098056] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T22:56:02.110087] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-25T22:56:02.816804] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T22:56:02.826598] [INFO ] [REMOTE ] KIM: Full fetch complete (76966 records). [2025-10-25T22:56:02.826793] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-25T22:56:03.213397] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-25T22:56:03.213536] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-25T22:56:03.214606] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-25T22:56:03.214713] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-25T22:56:03.216212] [DEBUG] [LOCAL ] KIM: Trimmed 76966 records to 53768 (keeping 200 days of data) [2025-10-25T22:56:03.546132] [DEBUG] [LOCAL ] KIM: Primary data saved (53768 records). [2025-10-25T22:56:03.546340] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-25T22:56:03.546562] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols. KIM took 17.2s. Estimated remaining time: 3h 54m 40s [2025-10-25T22:56:03.721631] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:03.721842] [DEBUG] [LOCAL ] KIO: No existing data file found in primary storage. [2025-10-25T22:56:03.721914] [WARN ] [MAIN ] KIO: No existing data found, performing full refresh instead. [2025-10-25T22:56:03.722035] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-25T22:56:03.722108] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-25T22:56:03.722189] [DEBUG] [LOCAL ] KIO: No primary data file found to delete. [2025-10-25T22:56:03.722279] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-25T22:56:04.096638] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:04.097018] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-25T22:56:05.248632] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T22:56:05.253567] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-25T22:56:06.418817] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-25T22:56:06.423862] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-25T22:56:07.473339] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-25T22:56:07.478411] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-25T22:56:08.467550] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T22:56:08.472370] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-25T22:56:09.678298] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T22:56:09.683330] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-25T22:56:10.663815] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T22:56:10.667985] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-25T22:56:11.903825] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-25T22:56:11.909745] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-25T22:56:13.048168] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T22:56:13.053553] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-25T22:56:14.047874] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T22:56:14.052782] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-25T22:56:15.200367] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T22:56:15.205308] [INFO ] [REMOTE ] KIO: Full fetch complete (32329 records). [2025-10-25T22:56:15.205425] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-25T22:56:15.573320] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-25T22:56:15.573451] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-25T22:56:15.574167] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-25T22:56:15.574245] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-25T22:56:15.575055] [DEBUG] [LOCAL ] KIO: Trimmed 32329 records to 21965 (keeping 200 days of data) [2025-10-25T22:56:15.704630] [DEBUG] [LOCAL ] KIO: Primary data saved (21965 records). [2025-10-25T22:56:15.704950] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-25T22:56:15.705094] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols. KIO took 12.2s. Estimated remaining time: 3h 54m 28s [2025-10-25T22:56:15.869716] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:15.869922] [DEBUG] [LOCAL ] KKR: No existing data file found in primary storage. [2025-10-25T22:56:15.869994] [WARN ] [MAIN ] KKR: No existing data found, performing full refresh instead. [2025-10-25T22:56:15.870108] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-25T22:56:15.870180] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-25T22:56:15.870262] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-10-25T22:56:15.870333] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-25T22:56:16.218596] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:16.218991] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-25T22:56:18.393984] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-25T22:56:18.404946] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-25T22:56:20.117998] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T22:56:20.129979] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-25T22:56:22.069791] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-25T22:56:22.081104] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-25T22:56:24.072584] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-25T22:56:24.084155] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-25T22:56:26.006832] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-25T22:56:26.018153] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-25T22:56:27.846832] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T22:56:27.857527] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-25T22:56:29.891753] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-25T22:56:29.903273] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-25T22:56:31.586550] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-25T22:56:31.597989] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-25T22:56:33.448764] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-25T22:56:33.460152] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-25T22:56:34.211334] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T22:56:34.221200] [INFO ] [REMOTE ] KKR: Full fetch complete (77659 records). [2025-10-25T22:56:34.221371] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-25T22:56:34.616011] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-25T22:56:34.616134] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-25T22:56:34.617474] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-25T22:56:34.617572] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-25T22:56:34.619247] [DEBUG] [LOCAL ] KKR: Trimmed 77659 records to 54277 (keeping 200 days of data) [2025-10-25T22:56:34.942609] [DEBUG] [LOCAL ] KKR: Primary data saved (54277 records). [2025-10-25T22:56:34.942792] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-25T22:56:34.942945] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols. KKR took 19.2s. Estimated remaining time: 3h 54m 23s [2025-10-25T22:56:35.108720] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:35.108914] [DEBUG] [LOCAL ] KKRS: No existing data file found in primary storage. [2025-10-25T22:56:35.108986] [WARN ] [MAIN ] KKRS: No existing data found, performing full refresh instead. [2025-10-25T22:56:35.109100] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-25T22:56:35.109172] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-25T22:56:35.109259] [DEBUG] [LOCAL ] KKRS: No primary data file found to delete. [2025-10-25T22:56:35.109333] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-25T22:56:35.459348] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:35.459732] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-25T22:56:36.162852] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-25T22:56:36.164230] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-25T22:56:36.744199] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T22:56:36.746051] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-25T22:56:37.319068] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T22:56:37.320779] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-25T22:56:38.133206] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T22:56:38.135757] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-25T22:56:38.845352] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T22:56:38.847540] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-25T22:56:39.532693] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-25T22:56:39.534706] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-25T22:56:40.084040] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-25T22:56:40.085723] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-25T22:56:40.654362] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T22:56:40.656162] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-25T22:56:41.224575] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-25T22:56:41.226166] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-25T22:56:41.720512] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T22:56:41.721619] [INFO ] [REMOTE ] KKRS: Full fetch complete (7530 records). [2025-10-25T22:56:41.721730] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-25T22:56:42.073865] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-25T22:56:42.073981] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-25T22:56:42.074216] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-25T22:56:42.074290] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-25T22:56:42.074773] [DEBUG] [LOCAL ] KKRS: Trimmed 7530 records to 5581 (keeping 200 days of data) [2025-10-25T22:56:42.107049] [DEBUG] [LOCAL ] KKRS: Primary data saved (5581 records). [2025-10-25T22:56:42.107159] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-25T22:56:42.107299] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols. KKRS took 7.2s. Estimated remaining time: 3h 54m 6s [2025-10-25T22:56:42.273101] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:42.273276] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-25T22:56:42.273347] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-25T22:56:42.273473] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-25T22:56:42.273551] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-25T22:56:42.273611] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-25T22:56:42.273695] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-25T22:56:42.624992] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:42.625361] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-25T22:56:42.839245] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T22:56:42.839610] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-25T22:56:42.839719] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T22:56:42.839820] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-25T22:56:42.839890] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T22:56:42.839960] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-25T22:56:42.840054] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-25T22:56:42.840125] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-25T22:56:42.840204] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-25T22:56:42.840328] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols. KKRT took 0.7s. Estimated remaining time: 3h 53m 43s [2025-10-25T22:56:43.007905] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:43.008069] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-25T22:56:43.008139] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-25T22:56:43.008249] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-25T22:56:43.008319] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-25T22:56:43.008422] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-25T22:56:43.008498] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-25T22:56:43.363486] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:43.363874] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-25T22:56:43.583697] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T22:56:43.583977] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-25T22:56:43.584071] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T22:56:43.584147] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-25T22:56:43.584214] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T22:56:43.584287] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-25T22:56:43.584375] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-25T22:56:43.584443] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-25T22:56:43.584523] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-25T22:56:43.584674] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols. KLAR took 0.7s. Estimated remaining time: 3h 53m 20s [2025-10-25T22:56:43.751158] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:43.751342] [DEBUG] [LOCAL ] KLC: No existing data file found in primary storage. [2025-10-25T22:56:43.751413] [WARN ] [MAIN ] KLC: No existing data found, performing full refresh instead. [2025-10-25T22:56:43.751500] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-25T22:56:43.751565] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-25T22:56:43.751623] [DEBUG] [LOCAL ] KLC: No primary data file found to delete. [2025-10-25T22:56:43.751695] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-25T22:56:44.119987] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:44.120310] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-25T22:56:45.334308] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T22:56:45.340584] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-25T22:56:46.472474] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T22:56:46.478000] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-25T22:56:47.842057] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T22:56:47.849781] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-25T22:56:49.337434] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T22:56:49.345981] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-25T22:56:50.832792] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-25T22:56:50.841204] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-25T22:56:52.062429] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T22:56:52.073175] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-25T22:56:53.408988] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-25T22:56:53.416445] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-25T22:56:54.779724] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T22:56:54.788089] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-25T22:56:56.116010] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T22:56:56.124381] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-25T22:56:57.494734] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T22:56:57.501447] [INFO ] [REMOTE ] KLC: Full fetch complete (50668 records). [2025-10-25T22:56:57.501557] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-25T22:56:57.872110] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-25T22:56:57.872220] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-25T22:56:57.873061] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-25T22:56:57.873138] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-25T22:56:57.874181] [DEBUG] [LOCAL ] KLC: Trimmed 50668 records to 36622 (keeping 200 days of data) [2025-10-25T22:56:58.071353] [DEBUG] [LOCAL ] KLC: Primary data saved (36622 records). [2025-10-25T22:56:58.071505] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-25T22:56:58.071671] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols. KLC took 14.5s. Estimated remaining time: 3h 53m 11s [2025-10-25T22:56:58.244922] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:56:58.245065] [DEBUG] [LOCAL ] KMI: No existing data file found in primary storage. [2025-10-25T22:56:58.245133] [WARN ] [MAIN ] KMI: No existing data found, performing full refresh instead. [2025-10-25T22:56:58.245244] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-25T22:56:58.245313] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-25T22:56:58.245392] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-10-25T22:56:58.245460] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-25T22:56:58.592516] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:56:58.592915] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-25T22:57:00.837039] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-25T22:57:00.847573] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-25T22:57:03.058751] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-25T22:57:03.069178] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-25T22:57:05.147223] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-25T22:57:05.159126] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-25T22:57:07.234445] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-25T22:57:07.245907] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-25T22:57:09.103111] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-25T22:57:09.114197] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-25T22:57:10.981174] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-25T22:57:10.992311] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-25T22:57:12.947022] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-25T22:57:12.958616] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-25T22:57:15.024210] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-25T22:57:15.035448] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-25T22:57:17.066744] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-25T22:57:17.078099] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-25T22:57:17.880568] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T22:57:17.890359] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-25T22:57:17.890520] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-25T22:57:18.273726] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-25T22:57:18.273837] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-25T22:57:18.274892] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-25T22:57:18.274973] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-25T22:57:18.276444] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54473 (keeping 200 days of data) [2025-10-25T22:57:18.588473] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-10-25T22:57:18.588630] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-25T22:57:18.588792] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols. KMI took 20.5s. Estimated remaining time: 3h 53m 7s [2025-10-25T22:57:18.752441] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:57:18.752612] [DEBUG] [LOCAL ] KMPB: No existing data file found in primary storage. [2025-10-25T22:57:18.752709] [WARN ] [MAIN ] KMPB: No existing data found, performing full refresh instead. [2025-10-25T22:57:18.752819] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-25T22:57:18.752888] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-25T22:57:18.752967] [DEBUG] [LOCAL ] KMPB: No primary data file found to delete. [2025-10-25T22:57:18.753033] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-25T22:57:19.104322] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:57:19.104756] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-25T22:57:19.560936] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-25T22:57:19.562147] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-25T22:57:20.044635] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-25T22:57:20.046174] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-25T22:57:20.532957] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-25T22:57:20.534851] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-25T22:57:21.150049] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-25T22:57:21.151448] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-25T22:57:21.679299] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-25T22:57:21.680630] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-25T22:57:22.268287] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T22:57:22.270024] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-25T22:57:22.752106] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-25T22:57:22.753441] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-25T22:57:23.189016] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-25T22:57:23.190765] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-25T22:57:23.612955] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-25T22:57:23.614496] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-25T22:57:24.111232] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-25T22:57:24.112508] [INFO ] [REMOTE ] KMPB: Full fetch complete (4922 records). [2025-10-25T22:57:24.112602] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-25T22:57:24.491946] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-25T22:57:24.492095] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-25T22:57:24.492301] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-25T22:57:24.492380] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-25T22:57:24.492824] [DEBUG] [LOCAL ] KMPB: Trimmed 4922 records to 3498 (keeping 200 days of data) [2025-10-25T22:57:24.513981] [DEBUG] [LOCAL ] KMPB: Primary data saved (3498 records). [2025-10-25T22:57:24.514105] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-25T22:57:24.514257] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols. KMPB took 5.9s. Estimated remaining time: 3h 52m 49s [2025-10-25T22:57:24.693462] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:57:24.693696] [DEBUG] [LOCAL ] KMPR: No existing data file found in primary storage. [2025-10-25T22:57:24.693770] [WARN ] [MAIN ] KMPR: No existing data found, performing full refresh instead. [2025-10-25T22:57:24.693886] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-25T22:57:24.693958] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-25T22:57:24.694040] [DEBUG] [LOCAL ] KMPR: No primary data file found to delete. [2025-10-25T22:57:24.694110] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-25T22:57:25.063345] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:57:25.063774] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-25T22:57:26.166286] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T22:57:26.172059] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-25T22:57:27.412827] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T22:57:27.418714] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-25T22:57:28.732058] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T22:57:28.738803] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-25T22:57:30.116983] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T22:57:30.124783] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-25T22:57:31.581855] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T22:57:31.589304] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-25T22:57:32.969436] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-25T22:57:32.977304] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-25T22:57:34.462315] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T22:57:34.471334] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-25T22:57:36.113580] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T22:57:36.123463] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-25T22:57:37.786243] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-25T22:57:37.796377] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-25T22:57:39.326384] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-25T22:57:39.335575] [INFO ] [REMOTE ] KMPR: Full fetch complete (53754 records). [2025-10-25T22:57:39.335837] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-25T22:57:39.737388] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-25T22:57:39.737551] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-25T22:57:39.738921] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-25T22:57:39.739010] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-25T22:57:39.740748] [DEBUG] [LOCAL ] KMPR: Trimmed 53754 records to 41064 (keeping 200 days of data) [2025-10-25T22:57:39.993095] [DEBUG] [LOCAL ] KMPR: Primary data saved (41064 records). [2025-10-25T22:57:39.993309] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-25T22:57:39.993521] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols. KMPR took 15.5s. Estimated remaining time: 3h 52m 40s [2025-10-25T22:57:40.167725] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:57:40.167984] [DEBUG] [LOCAL ] KMT: No existing data file found in primary storage. [2025-10-25T22:57:40.168058] [WARN ] [MAIN ] KMT: No existing data found, performing full refresh instead. [2025-10-25T22:57:40.168182] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-25T22:57:40.168254] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-25T22:57:40.168337] [DEBUG] [LOCAL ] KMT: No primary data file found to delete. [2025-10-25T22:57:40.168409] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-25T22:57:40.531904] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:57:40.532360] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-25T22:57:42.025283] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-25T22:57:42.035566] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-25T22:57:43.552003] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T22:57:43.560932] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-25T22:57:44.960267] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-25T22:57:44.969898] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-25T22:57:46.391591] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T22:57:46.401482] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-25T22:57:47.997203] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T22:57:48.006791] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-25T22:57:49.486619] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T22:57:49.495639] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-25T22:57:51.089366] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-25T22:57:51.099771] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-25T22:57:52.478425] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T22:57:52.488154] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-25T22:57:53.961821] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T22:57:53.971086] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-25T22:57:55.448478] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-25T22:57:55.457220] [INFO ] [REMOTE ] KMT: Full fetch complete (61891 records). [2025-10-25T22:57:55.457417] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-25T22:57:55.898764] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-25T22:57:55.898887] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-25T22:57:55.899906] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-25T22:57:55.899997] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-25T22:57:55.901444] [DEBUG] [LOCAL ] KMT: Trimmed 61891 records to 43438 (keeping 200 days of data) [2025-10-25T22:57:56.177205] [DEBUG] [LOCAL ] KMT: Primary data saved (43438 records). [2025-10-25T22:57:56.177370] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-25T22:57:56.177521] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols. KMT took 16.2s. Estimated remaining time: 3h 52m 33s [2025-10-25T22:57:56.360708] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:57:56.360921] [DEBUG] [LOCAL ] KMX: No existing data file found in primary storage. [2025-10-25T22:57:56.360995] [WARN ] [MAIN ] KMX: No existing data found, performing full refresh instead. [2025-10-25T22:57:56.361112] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-25T22:57:56.361181] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-25T22:57:56.361264] [DEBUG] [LOCAL ] KMX: No primary data file found to delete. [2025-10-25T22:57:56.361313] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-25T22:57:56.725163] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:57:56.725504] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-25T22:57:58.270695] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T22:57:58.280826] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-25T22:57:59.831430] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T22:57:59.841196] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-25T22:58:02.051191] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-25T22:58:02.062369] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-25T22:58:04.023174] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-25T22:58:04.034409] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-25T22:58:05.937904] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-25T22:58:05.949119] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-25T22:58:07.784629] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-25T22:58:07.795292] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-25T22:58:09.813495] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-25T22:58:09.825387] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-25T22:58:11.526877] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T22:58:11.538318] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-25T22:58:12.288296] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T22:58:12.299465] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-25T22:58:12.704976] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-25T22:58:12.714990] [INFO ] [REMOTE ] KMX: Full fetch complete (76415 records). [2025-10-25T22:58:12.715195] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-25T22:58:13.111434] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-25T22:58:13.111631] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-25T22:58:13.112763] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-25T22:58:13.112857] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-25T22:58:13.114463] [DEBUG] [LOCAL ] KMX: Trimmed 76415 records to 54064 (keeping 200 days of data) [2025-10-25T22:58:13.419596] [DEBUG] [LOCAL ] KMX: Primary data saved (54064 records). [2025-10-25T22:58:13.419804] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-25T22:58:13.419967] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols. KMX took 17.2s. Estimated remaining time: 3h 52m 26s [2025-10-25T22:58:13.588750] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:58:13.588957] [DEBUG] [LOCAL ] KN: No existing data file found in primary storage. [2025-10-25T22:58:13.589030] [WARN ] [MAIN ] KN: No existing data found, performing full refresh instead. [2025-10-25T22:58:13.589145] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-25T22:58:13.589216] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-25T22:58:13.589295] [DEBUG] [LOCAL ] KN: No primary data file found to delete. [2025-10-25T22:58:13.589361] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-25T22:58:13.936143] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:58:13.936503] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-25T22:58:15.335347] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T22:58:15.343417] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-25T22:58:16.671349] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-25T22:58:16.679694] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-25T22:58:18.249917] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-25T22:58:18.258900] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-25T22:58:19.823969] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T22:58:19.833937] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-25T22:58:21.148054] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T22:58:21.156539] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-25T22:58:22.454688] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T22:58:22.462391] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-25T22:58:24.078371] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T22:58:24.086801] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-25T22:58:25.377447] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-25T22:58:25.385391] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-25T22:58:26.869084] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T22:58:26.877610] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-25T22:58:28.210979] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T22:58:28.218620] [INFO ] [REMOTE ] KN: Full fetch complete (56806 records). [2025-10-25T22:58:28.218939] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-25T22:58:28.638720] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-25T22:58:28.638865] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-25T22:58:28.639768] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-25T22:58:28.639848] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-25T22:58:28.641049] [DEBUG] [LOCAL ] KN: Trimmed 56806 records to 39073 (keeping 200 days of data) [2025-10-25T22:58:28.859529] [DEBUG] [LOCAL ] KN: Primary data saved (39073 records). [2025-10-25T22:58:28.859734] [INFO ] [MAIN ] KN: Full history saved. [2025-10-25T22:58:28.859884] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols. KN took 15.4s. Estimated remaining time: 3h 52m 17s [2025-10-25T22:58:29.037472] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:58:29.037700] [DEBUG] [LOCAL ] KNF: No existing data file found in primary storage. [2025-10-25T22:58:29.037794] [WARN ] [MAIN ] KNF: No existing data found, performing full refresh instead. [2025-10-25T22:58:29.037887] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-25T22:58:29.037955] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-25T22:58:29.038036] [DEBUG] [LOCAL ] KNF: No primary data file found to delete. [2025-10-25T22:58:29.038108] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-25T22:58:29.398155] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:58:29.398481] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-25T22:58:30.850017] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-25T22:58:30.856519] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-25T22:58:32.149287] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T22:58:32.155936] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-25T22:58:33.480430] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T22:58:33.487763] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-25T22:58:35.064603] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T22:58:35.072499] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-25T22:58:36.305328] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T22:58:36.312436] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-25T22:58:37.665930] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T22:58:37.673860] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-25T22:58:39.044381] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T22:58:39.055238] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-25T22:58:40.410981] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-25T22:58:40.419446] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-25T22:58:41.801523] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T22:58:41.809997] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-25T22:58:43.060799] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T22:58:43.068328] [INFO ] [REMOTE ] KNF: Full fetch complete (51538 records). [2025-10-25T22:58:43.068456] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-25T22:58:43.489212] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-25T22:58:43.489419] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-25T22:58:43.490380] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-25T22:58:43.490461] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-25T22:58:43.491544] [DEBUG] [LOCAL ] KNF: Trimmed 51538 records to 37242 (keeping 200 days of data) [2025-10-25T22:58:43.699545] [DEBUG] [LOCAL ] KNF: Primary data saved (37242 records). [2025-10-25T22:58:43.699717] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-25T22:58:43.699867] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols. KNF took 14.8s. Estimated remaining time: 3h 52m 8s [2025-10-25T22:58:43.869047] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:58:43.869270] [DEBUG] [LOCAL ] KNOP: No existing data file found in primary storage. [2025-10-25T22:58:43.869341] [WARN ] [MAIN ] KNOP: No existing data found, performing full refresh instead. [2025-10-25T22:58:43.869491] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-25T22:58:43.869580] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-25T22:58:43.869704] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-25T22:58:43.869791] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-25T22:58:44.230223] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:58:44.230579] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-25T22:58:45.074760] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-25T22:58:45.077283] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-25T22:58:45.844021] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-25T22:58:45.846398] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-25T22:58:46.670501] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-25T22:58:46.673497] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-25T22:58:47.668328] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T22:58:47.672714] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-25T22:58:48.425798] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-25T22:58:48.430840] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-25T22:58:49.183034] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T22:58:49.186094] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-25T22:58:49.971097] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T22:58:49.974693] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-25T22:58:50.640866] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-25T22:58:50.643094] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-25T22:58:51.447959] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T22:58:51.451205] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-25T22:58:52.267673] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T22:58:52.270703] [INFO ] [REMOTE ] KNOP: Full fetch complete (14655 records). [2025-10-25T22:58:52.270798] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-25T22:58:52.642602] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-25T22:58:52.642740] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-25T22:58:52.643123] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-25T22:58:52.643197] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-25T22:58:52.643742] [DEBUG] [LOCAL ] KNOP: Trimmed 14655 records to 10190 (keeping 200 days of data) [2025-10-25T22:58:52.700909] [DEBUG] [LOCAL ] KNOP: Primary data saved (10190 records). [2025-10-25T22:58:52.701075] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-25T22:58:52.701224] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols. KNOP took 9.0s. Estimated remaining time: 3h 51m 53s [2025-10-25T22:58:52.869901] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:58:52.870082] [DEBUG] [LOCAL ] KNSL: No existing data file found in primary storage. [2025-10-25T22:58:52.870153] [WARN ] [MAIN ] KNSL: No existing data found, performing full refresh instead. [2025-10-25T22:58:52.870265] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-25T22:58:52.870337] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-25T22:58:52.870417] [DEBUG] [LOCAL ] KNSL: No primary data file found to delete. [2025-10-25T22:58:52.870487] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-25T22:58:53.228163] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:58:53.228581] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-25T22:58:54.261508] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T22:58:54.266285] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-25T22:58:55.301087] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T22:58:55.305594] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-25T22:58:56.287407] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T22:58:56.292210] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-25T22:58:57.461942] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T22:58:57.466923] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-25T22:58:58.482534] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T22:58:58.488377] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-25T22:58:59.483007] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T22:58:59.487558] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-25T22:59:00.593304] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T22:59:00.598680] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-25T22:59:01.769064] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T22:59:01.774927] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-25T22:59:02.853136] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T22:59:02.858189] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-25T22:59:03.990612] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T22:59:03.994894] [INFO ] [REMOTE ] KNSL: Full fetch complete (27168 records). [2025-10-25T22:59:03.994994] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-25T22:59:04.369418] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-25T22:59:04.369598] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-25T22:59:04.370796] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-25T22:59:04.370896] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-25T22:59:04.372004] [DEBUG] [LOCAL ] KNSL: Trimmed 27168 records to 18763 (keeping 200 days of data) [2025-10-25T22:59:04.484505] [DEBUG] [LOCAL ] KNSL: Primary data saved (18763 records). [2025-10-25T22:59:04.484715] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-25T22:59:04.484873] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols. KNSL took 11.8s. Estimated remaining time: 3h 51m 41s [2025-10-25T22:59:04.648823] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:59:04.649022] [DEBUG] [LOCAL ] KNTK: No existing data file found in primary storage. [2025-10-25T22:59:04.649092] [WARN ] [MAIN ] KNTK: No existing data found, performing full refresh instead. [2025-10-25T22:59:04.649203] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-25T22:59:04.649272] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-25T22:59:04.649352] [DEBUG] [LOCAL ] KNTK: No primary data file found to delete. [2025-10-25T22:59:04.649420] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-25T22:59:04.997980] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:59:04.998367] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-25T22:59:06.561123] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T22:59:06.569223] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-25T22:59:07.940246] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T22:59:07.948423] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-25T22:59:09.441900] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T22:59:09.451047] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-25T22:59:11.024261] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T22:59:11.033639] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-25T22:59:12.566113] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T22:59:12.576316] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-25T22:59:14.177608] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T22:59:14.187611] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-25T22:59:15.679083] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-25T22:59:15.689693] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-25T22:59:17.460696] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T22:59:17.471338] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-25T22:59:18.986966] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T22:59:18.998313] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-25T22:59:20.632833] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T22:59:20.642567] [INFO ] [REMOTE ] KNTK: Full fetch complete (66025 records). [2025-10-25T22:59:20.642812] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-25T22:59:21.045961] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-25T22:59:21.046144] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-25T22:59:21.047838] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-25T22:59:21.047939] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-25T22:59:21.049986] [DEBUG] [LOCAL ] KNTK: Trimmed 66025 records to 47955 (keeping 200 days of data) [2025-10-25T22:59:21.351507] [DEBUG] [LOCAL ] KNTK: Primary data saved (47955 records). [2025-10-25T22:59:21.351759] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-25T22:59:21.351959] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols. KNTK took 16.9s. Estimated remaining time: 3h 51m 33s [2025-10-25T22:59:21.520785] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:59:21.521114] [DEBUG] [LOCAL ] KNX: No existing data file found in primary storage. [2025-10-25T22:59:21.521188] [WARN ] [MAIN ] KNX: No existing data found, performing full refresh instead. [2025-10-25T22:59:21.521316] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-25T22:59:21.521389] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-25T22:59:21.521474] [DEBUG] [LOCAL ] KNX: No primary data file found to delete. [2025-10-25T22:59:21.521546] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-25T22:59:21.900085] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:59:21.900511] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-25T22:59:23.538841] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-25T22:59:23.549489] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-25T22:59:25.210182] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T22:59:25.220046] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-25T22:59:26.888681] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T22:59:26.899512] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-25T22:59:28.425698] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T22:59:28.436606] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-25T22:59:29.994964] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T22:59:30.006096] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-25T22:59:32.140473] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-25T22:59:32.151553] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-25T22:59:33.882333] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T22:59:33.893743] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-25T22:59:35.718965] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-25T22:59:35.729892] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-25T22:59:37.336673] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T22:59:37.348729] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-25T22:59:38.253215] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-25T22:59:38.263088] [INFO ] [REMOTE ] KNX: Full fetch complete (76319 records). [2025-10-25T22:59:38.263275] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-25T22:59:38.647691] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-25T22:59:38.647875] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-25T22:59:38.649014] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-25T22:59:38.649095] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-25T22:59:38.650495] [DEBUG] [LOCAL ] KNX: Trimmed 76319 records to 53425 (keeping 200 days of data) [2025-10-25T22:59:38.960980] [DEBUG] [LOCAL ] KNX: Primary data saved (53425 records). [2025-10-25T22:59:38.961190] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-25T22:59:38.961345] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols. KNX took 17.6s. Estimated remaining time: 3h 51m 27s [2025-10-25T22:59:39.128127] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T22:59:39.128316] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-25T22:59:39.128393] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-25T22:59:39.128501] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-25T22:59:39.128620] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-25T22:59:39.128860] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-25T22:59:39.128932] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-25T22:59:39.476384] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T22:59:39.476744] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-25T22:59:41.798309] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-25T22:59:41.809339] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-25T22:59:44.025458] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-25T22:59:44.035671] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-25T22:59:46.379140] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-25T22:59:46.391379] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-25T22:59:48.888471] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-25T22:59:48.899682] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-25T22:59:51.353471] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-25T22:59:51.364667] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-25T22:59:53.659480] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-25T22:59:53.670391] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-25T22:59:56.126573] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-25T22:59:56.139370] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-25T22:59:58.422906] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-25T22:59:58.434740] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-25T23:00:00.638986] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-25T23:00:00.649610] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-25T23:00:01.850603] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T23:00:01.864916] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-25T23:00:01.865167] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-25T23:00:02.073915] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T23:00:02.074951] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:00:02.075037] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:00:02.075118] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-25T23:00:02.075224] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-25T23:00:02.075276] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-25T23:00:02.075351] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-25T23:00:02.075475] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols. KO took 23.1s. Estimated remaining time: 3h 51m 25s [2025-10-25T23:00:02.259733] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:00:02.259953] [DEBUG] [LOCAL ] KODK: No existing data file found in primary storage. [2025-10-25T23:00:02.260024] [WARN ] [MAIN ] KODK: No existing data found, performing full refresh instead. [2025-10-25T23:00:02.260140] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-25T23:00:02.260212] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-25T23:00:02.260292] [DEBUG] [LOCAL ] KODK: No primary data file found to delete. [2025-10-25T23:00:02.260382] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-25T23:00:02.625675] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:00:02.626051] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-25T23:00:05.031285] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-25T23:00:05.041029] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-25T23:00:07.127516] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-25T23:00:07.136450] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-25T23:00:08.787279] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T23:00:08.796397] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-25T23:00:10.574965] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T23:00:10.584669] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-25T23:00:12.322118] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T23:00:12.331420] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-25T23:00:13.922669] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T23:00:13.930749] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-25T23:00:16.617173] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-25T23:00:16.627373] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-25T23:00:19.414801] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-25T23:00:19.424859] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-25T23:00:20.947894] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T23:00:20.956990] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-25T23:00:22.571103] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T23:00:22.579294] [INFO ] [REMOTE ] KODK: Full fetch complete (63277 records). [2025-10-25T23:00:22.579460] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-25T23:00:22.955509] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-25T23:00:22.955629] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-25T23:00:22.956604] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-25T23:00:22.956707] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-25T23:00:22.957972] [DEBUG] [LOCAL ] KODK: Trimmed 63277 records to 44310 (keeping 200 days of data) [2025-10-25T23:00:23.191249] [DEBUG] [LOCAL ] KODK: Primary data saved (44310 records). [2025-10-25T23:00:23.191399] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-25T23:00:23.191551] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols. KODK took 21.1s. Estimated remaining time: 3h 51m 22s [2025-10-25T23:00:23.382354] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:00:23.382741] [DEBUG] [LOCAL ] KOF: No existing data file found in primary storage. [2025-10-25T23:00:23.382825] [WARN ] [MAIN ] KOF: No existing data found, performing full refresh instead. [2025-10-25T23:00:23.382959] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-25T23:00:23.383036] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-25T23:00:23.383127] [DEBUG] [LOCAL ] KOF: No primary data file found to delete. [2025-10-25T23:00:23.383203] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-25T23:00:23.755523] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:00:23.756014] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-25T23:00:24.854911] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T23:00:24.860666] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-25T23:00:26.027145] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-25T23:00:26.032844] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-25T23:00:26.870419] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-25T23:00:26.875363] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-25T23:00:28.190169] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T23:00:28.196495] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-25T23:00:29.068765] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T23:00:29.074833] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-25T23:00:30.348602] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T23:00:30.354828] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-25T23:00:31.561258] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-25T23:00:31.567508] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-25T23:00:32.591313] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T23:00:32.597332] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-25T23:00:33.820980] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-25T23:00:33.827105] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-25T23:00:35.029170] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-25T23:00:35.034281] [INFO ] [REMOTE ] KOF: Full fetch complete (37900 records). [2025-10-25T23:00:35.034396] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-25T23:00:35.405069] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-25T23:00:35.405199] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-25T23:00:35.405946] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-25T23:00:35.406026] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-25T23:00:35.406981] [DEBUG] [LOCAL ] KOF: Trimmed 37900 records to 26803 (keeping 200 days of data) [2025-10-25T23:00:35.566912] [DEBUG] [LOCAL ] KOF: Primary data saved (26803 records). [2025-10-25T23:00:35.567054] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-25T23:00:35.567202] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols. KOF took 12.4s. Estimated remaining time: 3h 51m 10s [2025-10-25T23:00:35.737400] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:00:35.737619] [DEBUG] [LOCAL ] KOP: No existing data file found in primary storage. [2025-10-25T23:00:35.737740] [WARN ] [MAIN ] KOP: No existing data found, performing full refresh instead. [2025-10-25T23:00:35.737866] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-25T23:00:35.737941] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-25T23:00:35.738024] [DEBUG] [LOCAL ] KOP: No primary data file found to delete. [2025-10-25T23:00:35.738096] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-25T23:00:36.109609] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:00:36.110035] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-25T23:00:37.028388] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-25T23:00:37.032203] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-25T23:00:38.172605] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T23:00:38.176221] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-25T23:00:39.138509] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-25T23:00:39.143515] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-25T23:00:40.237207] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T23:00:40.242148] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-25T23:00:41.206812] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-25T23:00:41.211190] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-25T23:00:42.022030] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-25T23:00:42.025845] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-25T23:00:42.883071] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-25T23:00:42.886999] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-25T23:00:43.861623] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T23:00:43.865970] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-25T23:00:44.792425] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T23:00:44.797027] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-25T23:00:45.722109] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T23:00:45.726729] [INFO ] [REMOTE ] KOP: Full fetch complete (25305 records). [2025-10-25T23:00:45.726901] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-25T23:00:46.264722] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-25T23:00:46.264863] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-25T23:00:46.265728] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-25T23:00:46.265838] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-25T23:00:46.267011] [DEBUG] [LOCAL ] KOP: Trimmed 25305 records to 17502 (keeping 200 days of data) [2025-10-25T23:00:46.382982] [DEBUG] [LOCAL ] KOP: Primary data saved (17502 records). [2025-10-25T23:00:46.383178] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-25T23:00:46.383337] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols. KOP took 10.8s. Estimated remaining time: 3h 50m 57s [2025-10-25T23:00:46.573253] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:00:46.573482] [DEBUG] [LOCAL ] KORE: No existing data file found in primary storage. [2025-10-25T23:00:46.573557] [WARN ] [MAIN ] KORE: No existing data found, performing full refresh instead. [2025-10-25T23:00:46.573697] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-25T23:00:46.573771] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-25T23:00:46.573852] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-25T23:00:46.573923] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-25T23:00:46.971255] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:00:46.971633] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-25T23:00:47.781856] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-25T23:00:47.785165] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-25T23:00:48.252818] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T23:00:48.254353] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-25T23:00:48.749892] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-25T23:00:48.751254] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-25T23:00:49.290685] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-25T23:00:49.291877] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-25T23:00:49.623220] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-25T23:00:49.624432] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-25T23:00:50.075561] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-25T23:00:50.077399] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-25T23:00:50.578321] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-25T23:00:50.580286] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-25T23:00:51.038558] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T23:00:51.039709] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-25T23:00:51.426347] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-25T23:00:51.427583] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-25T23:00:51.929434] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-25T23:00:51.930691] [INFO ] [REMOTE ] KORE: Full fetch complete (3884 records). [2025-10-25T23:00:51.930786] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-25T23:00:52.302223] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-25T23:00:52.302355] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-25T23:00:52.302583] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-25T23:00:52.302691] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-25T23:00:52.303108] [DEBUG] [LOCAL ] KORE: Trimmed 3884 records to 2257 (keeping 200 days of data) [2025-10-25T23:00:52.315730] [DEBUG] [LOCAL ] KORE: Primary data saved (2257 records). [2025-10-25T23:00:52.315818] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-25T23:00:52.315960] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols. KORE took 5.9s. Estimated remaining time: 3h 50m 39s [2025-10-25T23:00:52.489433] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:00:52.489632] [DEBUG] [LOCAL ] KOS: No existing data file found in primary storage. [2025-10-25T23:00:52.489722] [WARN ] [MAIN ] KOS: No existing data found, performing full refresh instead. [2025-10-25T23:00:52.489836] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-25T23:00:52.489909] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-25T23:00:52.489975] [DEBUG] [LOCAL ] KOS: No primary data file found to delete. [2025-10-25T23:00:52.490043] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-25T23:00:52.857258] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:00:52.857623] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-25T23:00:54.622991] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-25T23:00:54.633431] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-25T23:00:56.264873] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T23:00:56.274745] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-25T23:00:57.968709] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T23:00:57.979458] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-25T23:00:59.709571] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T23:00:59.724730] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-25T23:01:02.379326] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-25T23:01:02.390742] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-25T23:01:04.105740] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T23:01:04.116370] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-25T23:01:05.942784] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T23:01:05.955699] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-25T23:01:07.860331] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-25T23:01:07.871780] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-25T23:01:09.731301] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T23:01:09.742572] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-25T23:01:11.244371] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T23:01:11.254184] [INFO ] [REMOTE ] KOS: Full fetch complete (77037 records). [2025-10-25T23:01:11.254364] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-25T23:01:11.639157] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-25T23:01:11.639274] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-25T23:01:11.640416] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-25T23:01:11.640498] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-25T23:01:11.641967] [DEBUG] [LOCAL ] KOS: Trimmed 77037 records to 53873 (keeping 200 days of data) [2025-10-25T23:01:11.936715] [DEBUG] [LOCAL ] KOS: Primary data saved (53873 records). [2025-10-25T23:01:11.936959] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-25T23:01:11.937116] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols. KOS took 19.6s. Estimated remaining time: 3h 50m 35s [2025-10-25T23:01:12.102830] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:01:12.103052] [DEBUG] [LOCAL ] KR: No existing data file found in primary storage. [2025-10-25T23:01:12.103126] [WARN ] [MAIN ] KR: No existing data found, performing full refresh instead. [2025-10-25T23:01:12.103234] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-25T23:01:12.103302] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-25T23:01:12.103380] [DEBUG] [LOCAL ] KR: No primary data file found to delete. [2025-10-25T23:01:12.103446] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-25T23:01:12.451417] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:01:12.451788] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-25T23:01:14.210440] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T23:01:14.220914] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-25T23:01:16.281801] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-25T23:01:16.292229] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-25T23:01:18.146513] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-25T23:01:18.157551] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-25T23:01:19.988449] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T23:01:19.999591] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-25T23:01:21.990670] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T23:01:22.001889] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-25T23:01:23.673780] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T23:01:23.685810] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-25T23:01:25.547015] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T23:01:25.558800] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-25T23:01:27.148170] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T23:01:27.160797] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-25T23:01:29.043334] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-25T23:01:29.056057] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-25T23:01:29.796152] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T23:01:29.806138] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-25T23:01:29.806351] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-25T23:01:30.196995] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-25T23:01:30.197193] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-25T23:01:30.198283] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-25T23:01:30.198369] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-25T23:01:30.199960] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 54461 (keeping 200 days of data) [2025-10-25T23:01:30.520065] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-10-25T23:01:30.520237] [INFO ] [MAIN ] KR: Full history saved. [2025-10-25T23:01:30.520383] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols. KR took 18.6s. Estimated remaining time: 3h 50m 29s [2025-10-25T23:01:30.686383] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:01:30.686614] [DEBUG] [LOCAL ] KRC: No existing data file found in primary storage. [2025-10-25T23:01:30.686710] [WARN ] [MAIN ] KRC: No existing data found, performing full refresh instead. [2025-10-25T23:01:30.686822] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-25T23:01:30.686893] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-25T23:01:30.686975] [DEBUG] [LOCAL ] KRC: No primary data file found to delete. [2025-10-25T23:01:30.687045] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-25T23:01:31.034492] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:01:31.034882] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-25T23:01:32.491962] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T23:01:32.501177] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-25T23:01:34.009603] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T23:01:34.021165] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-25T23:01:35.566893] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T23:01:35.577480] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-25T23:01:37.220153] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T23:01:37.230359] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-25T23:01:38.803166] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T23:01:38.813778] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-25T23:01:40.353791] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-25T23:01:40.363487] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-25T23:01:41.909196] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T23:01:41.920135] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-25T23:01:43.852863] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-25T23:01:43.862976] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-25T23:01:45.395788] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T23:01:45.406257] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-25T23:01:46.908988] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T23:01:46.918931] [INFO ] [REMOTE ] KRC: Full fetch complete (70049 records). [2025-10-25T23:01:46.919106] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-25T23:01:47.312972] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-25T23:01:47.313105] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-25T23:01:47.314195] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-25T23:01:47.314278] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-25T23:01:47.315782] [DEBUG] [LOCAL ] KRC: Trimmed 70049 records to 48712 (keeping 200 days of data) [2025-10-25T23:01:47.605442] [DEBUG] [LOCAL ] KRC: Primary data saved (48712 records). [2025-10-25T23:01:47.605621] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-25T23:01:47.605796] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols. KRC took 17.1s. Estimated remaining time: 3h 50m 22s [2025-10-25T23:01:47.801481] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:01:47.801724] [DEBUG] [LOCAL ] KREF: No existing data file found in primary storage. [2025-10-25T23:01:47.801811] [WARN ] [MAIN ] KREF: No existing data found, performing full refresh instead. [2025-10-25T23:01:47.801943] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-25T23:01:47.802032] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-25T23:01:47.802135] [DEBUG] [LOCAL ] KREF: No primary data file found to delete. [2025-10-25T23:01:47.802221] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-25T23:01:48.204425] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:01:48.204818] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-25T23:01:49.480732] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T23:01:49.487089] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-25T23:01:50.631374] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T23:01:50.637628] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-25T23:01:52.009452] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-25T23:01:52.017409] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-25T23:01:53.446731] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T23:01:53.455291] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-25T23:01:54.851916] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T23:01:54.860360] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-25T23:01:56.268073] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T23:01:56.276116] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-25T23:01:57.722845] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T23:01:57.731290] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-25T23:01:58.953333] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-25T23:01:58.960623] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-25T23:02:00.325892] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T23:02:00.334203] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-25T23:02:02.045473] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-25T23:02:02.053284] [INFO ] [REMOTE ] KREF: Full fetch complete (53041 records). [2025-10-25T23:02:02.053501] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-25T23:02:02.434854] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-25T23:02:02.434968] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-25T23:02:02.435905] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-25T23:02:02.435986] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-25T23:02:02.437067] [DEBUG] [LOCAL ] KREF: Trimmed 53041 records to 38596 (keeping 200 days of data) [2025-10-25T23:02:02.657208] [DEBUG] [LOCAL ] KREF: Primary data saved (38596 records). [2025-10-25T23:02:02.657370] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-25T23:02:02.657527] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols. KREF took 15.1s. Estimated remaining time: 3h 50m 12s [2025-10-25T23:02:02.827850] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:02:02.828069] [DEBUG] [LOCAL ] KRG: No existing data file found in primary storage. [2025-10-25T23:02:02.828141] [WARN ] [MAIN ] KRG: No existing data found, performing full refresh instead. [2025-10-25T23:02:02.828255] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-25T23:02:02.828327] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-25T23:02:02.828410] [DEBUG] [LOCAL ] KRG: No primary data file found to delete. [2025-10-25T23:02:02.828482] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-25T23:02:03.184542] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:02:03.184937] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-25T23:02:04.711629] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T23:02:04.721145] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-25T23:02:06.281540] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-25T23:02:06.290859] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-25T23:02:07.959457] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T23:02:07.969848] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-25T23:02:09.860980] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-25T23:02:09.871983] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-25T23:02:11.399159] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T23:02:11.409364] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-25T23:02:12.979800] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T23:02:12.989978] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-25T23:02:14.636001] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T23:02:14.646967] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-25T23:02:16.154558] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T23:02:16.164695] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-25T23:02:17.900910] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-25T23:02:17.911782] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-25T23:02:19.368508] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T23:02:19.377749] [INFO ] [REMOTE ] KRG: Full fetch complete (71427 records). [2025-10-25T23:02:19.377917] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-25T23:02:19.764513] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-25T23:02:19.764629] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-25T23:02:19.765618] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-25T23:02:19.765723] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-25T23:02:19.767112] [DEBUG] [LOCAL ] KRG: Trimmed 71427 records to 49992 (keeping 200 days of data) [2025-10-25T23:02:20.065775] [DEBUG] [LOCAL ] KRG: Primary data saved (49992 records). [2025-10-25T23:02:20.065952] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-25T23:02:20.066099] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols. KRG took 17.4s. Estimated remaining time: 3h 50m 5s [2025-10-25T23:02:20.235282] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:02:20.235498] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-25T23:02:20.235571] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-25T23:02:20.235711] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-25T23:02:20.235785] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-25T23:02:20.235868] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-25T23:02:20.235920] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-25T23:02:20.587611] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:02:20.587973] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-25T23:02:20.825916] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:02:20.826139] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-25T23:02:20.826232] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:02:20.826287] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-25T23:02:20.826324] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:02:20.826389] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-25T23:02:20.826477] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-25T23:02:20.826549] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-25T23:02:20.826630] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-25T23:02:20.826776] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols. KRMN took 0.8s. Estimated remaining time: 3h 49m 43s [2025-10-25T23:02:20.990969] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:02:20.991145] [DEBUG] [LOCAL ] KRO: No existing data file found in primary storage. [2025-10-25T23:02:20.991216] [WARN ] [MAIN ] KRO: No existing data found, performing full refresh instead. [2025-10-25T23:02:20.991323] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-25T23:02:20.991392] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-25T23:02:20.991473] [DEBUG] [LOCAL ] KRO: No primary data file found to delete. [2025-10-25T23:02:20.991543] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-25T23:02:21.334965] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:02:21.335309] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-25T23:02:22.407987] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T23:02:22.412235] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-25T23:02:23.438607] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T23:02:23.442547] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-25T23:02:24.502298] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T23:02:24.507255] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-25T23:02:25.758739] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T23:02:25.765872] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-25T23:02:26.870086] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T23:02:26.875748] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-25T23:02:27.955990] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T23:02:27.961936] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-25T23:02:29.097239] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T23:02:29.103536] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-25T23:02:30.375566] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T23:02:30.382474] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-25T23:02:31.559533] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T23:02:31.565915] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-25T23:02:32.646048] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T23:02:32.651083] [INFO ] [REMOTE ] KRO: Full fetch complete (35361 records). [2025-10-25T23:02:32.651193] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-25T23:02:33.019105] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-25T23:02:33.019231] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-25T23:02:33.019995] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-25T23:02:33.020076] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-25T23:02:33.021341] [DEBUG] [LOCAL ] KRO: Trimmed 35361 records to 26911 (keeping 200 days of data) [2025-10-25T23:02:33.168164] [DEBUG] [LOCAL ] KRO: Primary data saved (26911 records). [2025-10-25T23:02:33.168328] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-25T23:02:33.168486] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols. KRO took 12.3s. Estimated remaining time: 3h 49m 31s [2025-10-25T23:02:33.337378] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:02:33.337666] [DEBUG] [LOCAL ] KRP: No existing data file found in primary storage. [2025-10-25T23:02:33.337758] [WARN ] [MAIN ] KRP: No existing data found, performing full refresh instead. [2025-10-25T23:02:33.337878] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-25T23:02:33.337950] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-25T23:02:33.338071] [DEBUG] [LOCAL ] KRP: No primary data file found to delete. [2025-10-25T23:02:33.338146] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-25T23:02:33.687114] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:02:33.687472] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-25T23:02:35.086270] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T23:02:35.094584] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-25T23:02:36.401394] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T23:02:36.409273] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-25T23:02:37.932972] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T23:02:37.942398] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-25T23:02:39.281834] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-25T23:02:39.290583] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-25T23:02:40.658048] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T23:02:40.666131] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-25T23:02:42.038250] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-25T23:02:42.046188] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-25T23:02:43.543092] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T23:02:43.550936] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-25T23:02:44.968144] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T23:02:44.976417] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-25T23:02:46.103160] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T23:02:46.114401] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-25T23:02:47.274548] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-25T23:02:47.283117] [INFO ] [REMOTE ] KRP: Full fetch complete (54945 records). [2025-10-25T23:02:47.283287] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-25T23:02:47.673509] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-25T23:02:47.673661] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-25T23:02:47.674886] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-25T23:02:47.674986] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-25T23:02:47.676259] [DEBUG] [LOCAL ] KRP: Trimmed 54945 records to 36327 (keeping 200 days of data) [2025-10-25T23:02:47.892376] [DEBUG] [LOCAL ] KRP: Primary data saved (36327 records). [2025-10-25T23:02:47.892537] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-25T23:02:47.892706] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols. KRP took 14.7s. Estimated remaining time: 3h 49m 22s [2025-10-25T23:02:48.064624] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:02:48.064893] [DEBUG] [LOCAL ] KSS: No existing data file found in primary storage. [2025-10-25T23:02:48.064966] [WARN ] [MAIN ] KSS: No existing data found, performing full refresh instead. [2025-10-25T23:02:48.065077] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-25T23:02:48.065148] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-25T23:02:48.065230] [DEBUG] [LOCAL ] KSS: No primary data file found to delete. [2025-10-25T23:02:48.065300] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-25T23:02:48.411967] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:02:48.412315] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-25T23:02:50.455000] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-25T23:02:50.465585] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-25T23:02:52.333638] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-25T23:02:52.343540] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-25T23:02:54.492547] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-25T23:02:54.503696] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-25T23:02:56.657573] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-25T23:02:56.669530] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-25T23:02:58.501299] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-25T23:02:58.512877] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-25T23:03:00.429903] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-25T23:03:00.440858] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-25T23:03:02.511694] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-25T23:03:02.523850] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-25T23:03:04.741625] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-25T23:03:04.752911] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-25T23:03:06.565196] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-25T23:03:06.576556] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-25T23:03:08.170143] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-25T23:03:08.180766] [INFO ] [REMOTE ] KSS: Full fetch complete (77738 records). [2025-10-25T23:03:08.181077] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-25T23:03:08.570006] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-25T23:03:08.570125] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-25T23:03:08.571283] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-25T23:03:08.571369] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-25T23:03:08.572951] [DEBUG] [LOCAL ] KSS: Trimmed 77738 records to 54355 (keeping 200 days of data) [2025-10-25T23:03:08.915918] [DEBUG] [LOCAL ] KSS: Primary data saved (54355 records). [2025-10-25T23:03:08.916116] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-25T23:03:08.916344] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols. KSS took 21.0s. Estimated remaining time: 3h 49m 18s [2025-10-25T23:03:09.087155] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:03:09.087373] [DEBUG] [LOCAL ] KT: No existing data file found in primary storage. [2025-10-25T23:03:09.087445] [WARN ] [MAIN ] KT: No existing data found, performing full refresh instead. [2025-10-25T23:03:09.087626] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-25T23:03:09.087737] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-25T23:03:09.087828] [DEBUG] [LOCAL ] KT: No primary data file found to delete. [2025-10-25T23:03:09.087899] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-25T23:03:09.449100] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:03:09.449457] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-25T23:03:11.263287] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T23:03:11.272355] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-25T23:03:13.002728] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T23:03:13.013548] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-25T23:03:14.515422] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-25T23:03:14.525218] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-25T23:03:16.163691] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T23:03:16.173748] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-25T23:03:17.899897] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T23:03:17.909603] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-25T23:03:19.379529] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T23:03:19.389515] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-25T23:03:20.960020] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T23:03:20.969491] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-25T23:03:22.504671] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T23:03:22.514083] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-25T23:03:24.057126] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T23:03:24.067362] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-25T23:03:25.500520] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-25T23:03:25.508678] [INFO ] [REMOTE ] KT: Full fetch complete (66674 records). [2025-10-25T23:03:25.508829] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-25T23:03:25.894891] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-25T23:03:25.895026] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-25T23:03:25.896040] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-25T23:03:25.896123] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-25T23:03:25.897418] [DEBUG] [LOCAL ] KT: Trimmed 66674 records to 45999 (keeping 200 days of data) [2025-10-25T23:03:26.163924] [DEBUG] [LOCAL ] KT: Primary data saved (45999 records). [2025-10-25T23:03:26.164088] [INFO ] [MAIN ] KT: Full history saved. [2025-10-25T23:03:26.164237] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols. KT took 17.2s. Estimated remaining time: 3h 49m 11s [2025-10-25T23:03:26.346066] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:03:26.346282] [DEBUG] [LOCAL ] KTB: No existing data file found in primary storage. [2025-10-25T23:03:26.346355] [WARN ] [MAIN ] KTB: No existing data found, performing full refresh instead. [2025-10-25T23:03:26.346494] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-25T23:03:26.346567] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-25T23:03:26.346673] [DEBUG] [LOCAL ] KTB: No primary data file found to delete. [2025-10-25T23:03:26.346745] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-25T23:03:26.704084] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:03:26.704446] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-25T23:03:27.961076] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T23:03:27.967890] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-25T23:03:29.391703] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T23:03:29.399859] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-25T23:03:30.975233] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T23:03:30.984406] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-25T23:03:32.612094] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T23:03:32.621023] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-25T23:03:34.265676] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T23:03:34.274328] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-25T23:03:35.634948] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T23:03:35.642773] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-25T23:03:37.267947] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T23:03:37.277531] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-25T23:03:38.779007] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T23:03:38.789328] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-25T23:03:40.259059] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-25T23:03:40.267419] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-25T23:03:41.189152] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T23:03:41.195618] [INFO ] [REMOTE ] KTB: Full fetch complete (58311 records). [2025-10-25T23:03:41.195757] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-25T23:03:41.572152] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-25T23:03:41.572269] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-25T23:03:41.573189] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-25T23:03:41.573271] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-25T23:03:41.574401] [DEBUG] [LOCAL ] KTB: Trimmed 58311 records to 40735 (keeping 200 days of data) [2025-10-25T23:03:41.815945] [DEBUG] [LOCAL ] KTB: Primary data saved (40735 records). [2025-10-25T23:03:41.816106] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-25T23:03:41.816255] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols. KTB took 15.7s. Estimated remaining time: 3h 49m 2s [2025-10-25T23:03:41.981464] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:03:41.981681] [DEBUG] [LOCAL ] KTF: No existing data file found in primary storage. [2025-10-25T23:03:41.981751] [WARN ] [MAIN ] KTF: No existing data found, performing full refresh instead. [2025-10-25T23:03:41.981861] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-25T23:03:41.981931] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-25T23:03:41.982009] [DEBUG] [LOCAL ] KTF: No primary data file found to delete. [2025-10-25T23:03:41.982075] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-25T23:03:42.333801] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:03:42.334146] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-25T23:03:43.091045] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-25T23:03:43.093598] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-25T23:03:43.691516] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T23:03:43.694312] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-25T23:03:44.494445] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T23:03:44.498764] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-25T23:03:45.499954] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T23:03:45.504017] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-25T23:03:46.373580] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T23:03:46.376212] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-25T23:03:47.414181] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-25T23:03:47.417680] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-25T23:03:48.191526] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T23:03:48.194566] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-25T23:03:48.983826] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-25T23:03:48.987002] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-25T23:03:49.823341] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T23:03:49.825986] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-25T23:03:50.591489] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T23:03:50.594437] [INFO ] [REMOTE ] KTF: Full fetch complete (17323 records). [2025-10-25T23:03:50.594562] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-25T23:03:50.976037] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-25T23:03:50.976156] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-25T23:03:50.976558] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-25T23:03:50.976632] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-25T23:03:50.977280] [DEBUG] [LOCAL ] KTF: Trimmed 17323 records to 11768 (keeping 200 days of data) [2025-10-25T23:03:51.047950] [DEBUG] [LOCAL ] KTF: Primary data saved (11768 records). [2025-10-25T23:03:51.048125] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-25T23:03:51.048296] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols. KTF took 9.2s. Estimated remaining time: 3h 48m 47s [2025-10-25T23:03:51.216739] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:03:51.216944] [DEBUG] [LOCAL ] KVUE: No existing data file found in primary storage. [2025-10-25T23:03:51.217029] [WARN ] [MAIN ] KVUE: No existing data found, performing full refresh instead. [2025-10-25T23:03:51.217162] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-25T23:03:51.217250] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-25T23:03:51.217355] [DEBUG] [LOCAL ] KVUE: No primary data file found to delete. [2025-10-25T23:03:51.217441] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-25T23:03:51.574492] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:03:51.574858] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-25T23:03:53.207635] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T23:03:53.218143] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-25T23:03:55.051678] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T23:03:55.061774] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-25T23:03:57.009945] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T23:03:57.024790] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-25T23:03:58.837129] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T23:03:58.850586] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-25T23:04:00.752363] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-25T23:04:00.764282] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-25T23:04:03.593173] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-25T23:04:03.603858] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-25T23:04:05.605762] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-25T23:04:05.617243] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-25T23:04:07.427721] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T23:04:07.438874] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-25T23:04:09.521553] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-25T23:04:09.533131] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-25T23:04:10.254368] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:04:10.264272] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-25T23:04:10.264458] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-25T23:04:10.679674] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-25T23:04:10.679836] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-25T23:04:10.681314] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-25T23:04:10.681429] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-25T23:04:10.683398] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 54447 (keeping 200 days of data) [2025-10-25T23:04:10.999248] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-25T23:04:10.999427] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-25T23:04:10.999592] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols. KVUE took 20.0s. Estimated remaining time: 3h 48m 43s [2025-10-25T23:04:11.171825] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:04:11.172002] [DEBUG] [LOCAL ] KVYO: No existing data file found in primary storage. [2025-10-25T23:04:11.172087] [WARN ] [MAIN ] KVYO: No existing data found, performing full refresh instead. [2025-10-25T23:04:11.172203] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-25T23:04:11.172275] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-25T23:04:11.172355] [DEBUG] [LOCAL ] KVYO: No primary data file found to delete. [2025-10-25T23:04:11.172426] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-25T23:04:11.526498] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:04:11.526847] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-25T23:04:13.073182] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T23:04:13.082519] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-25T23:04:14.663963] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T23:04:14.674433] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-25T23:04:16.384261] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T23:04:16.395902] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-25T23:04:18.142370] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T23:04:18.152920] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-25T23:04:20.035630] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-25T23:04:20.046483] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-25T23:04:21.811901] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-25T23:04:21.828257] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-25T23:04:23.360290] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T23:04:23.370690] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-25T23:04:24.843194] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T23:04:24.854936] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-25T23:04:26.455699] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T23:04:26.467589] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-25T23:04:27.849199] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T23:04:27.861810] [INFO ] [REMOTE ] KVYO: Full fetch complete (72367 records). [2025-10-25T23:04:27.862036] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-25T23:04:28.246222] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-25T23:04:28.246343] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-25T23:04:28.247362] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-25T23:04:28.247441] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-25T23:04:28.249006] [DEBUG] [LOCAL ] KVYO: Trimmed 72367 records to 51644 (keeping 200 days of data) [2025-10-25T23:04:28.532996] [DEBUG] [LOCAL ] KVYO: Primary data saved (51644 records). [2025-10-25T23:04:28.533151] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-25T23:04:28.533275] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols. KVYO took 17.5s. Estimated remaining time: 3h 48m 36s [2025-10-25T23:04:28.701257] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:04:28.701513] [DEBUG] [LOCAL ] KW: No existing data file found in primary storage. [2025-10-25T23:04:28.701586] [WARN ] [MAIN ] KW: No existing data found, performing full refresh instead. [2025-10-25T23:04:28.701727] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-25T23:04:28.701798] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-25T23:04:28.701878] [DEBUG] [LOCAL ] KW: No primary data file found to delete. [2025-10-25T23:04:28.701947] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-25T23:04:29.062068] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:04:29.062427] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-25T23:04:30.455797] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T23:04:30.464893] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-25T23:04:31.701442] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T23:04:31.708265] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-25T23:04:33.061268] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T23:04:33.069717] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-25T23:04:34.666787] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T23:04:34.676470] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-25T23:04:36.123979] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T23:04:36.133789] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-25T23:04:37.655972] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T23:04:37.664732] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-25T23:04:39.136289] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T23:04:39.145856] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-25T23:04:40.520577] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T23:04:40.529248] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-25T23:04:42.055284] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T23:04:42.063855] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-25T23:04:43.131300] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T23:04:43.138464] [INFO ] [REMOTE ] KW: Full fetch complete (57221 records). [2025-10-25T23:04:43.138624] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-25T23:04:43.527149] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-25T23:04:43.527286] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-25T23:04:43.528277] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-25T23:04:43.528375] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-25T23:04:43.529560] [DEBUG] [LOCAL ] KW: Trimmed 57221 records to 40820 (keeping 200 days of data) [2025-10-25T23:04:43.757800] [DEBUG] [LOCAL ] KW: Primary data saved (40820 records). [2025-10-25T23:04:43.757986] [INFO ] [MAIN ] KW: Full history saved. [2025-10-25T23:04:43.758153] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols. KW took 15.2s. Estimated remaining time: 3h 48m 27s [2025-10-25T23:04:43.922663] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:04:43.922865] [DEBUG] [LOCAL ] KWR: No existing data file found in primary storage. [2025-10-25T23:04:43.922952] [WARN ] [MAIN ] KWR: No existing data found, performing full refresh instead. [2025-10-25T23:04:43.923063] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-25T23:04:43.923132] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-25T23:04:43.923211] [DEBUG] [LOCAL ] KWR: No primary data file found to delete. [2025-10-25T23:04:43.923280] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-25T23:04:44.269770] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:04:44.270124] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-25T23:04:45.593555] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T23:04:45.597369] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-25T23:04:46.560573] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-25T23:04:46.564524] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-25T23:04:47.583117] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T23:04:47.587186] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-25T23:04:48.730041] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-25T23:04:48.734635] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-25T23:04:49.735399] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T23:04:49.739696] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-25T23:04:50.794509] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T23:04:50.799917] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-25T23:04:51.805695] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T23:04:51.810161] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-25T23:04:52.765401] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T23:04:52.769360] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-25T23:04:53.571883] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T23:04:53.575567] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-25T23:04:54.395085] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T23:04:54.398073] [INFO ] [REMOTE ] KWR: Full fetch complete (23199 records). [2025-10-25T23:04:54.398189] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-25T23:04:54.778967] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-25T23:04:54.779135] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-25T23:04:54.779936] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-25T23:04:54.780025] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-25T23:04:54.781222] [DEBUG] [LOCAL ] KWR: Trimmed 23199 records to 15854 (keeping 200 days of data) [2025-10-25T23:04:54.887813] [DEBUG] [LOCAL ] KWR: Primary data saved (15854 records). [2025-10-25T23:04:54.888059] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-25T23:04:54.888255] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols. KWR took 11.1s. Estimated remaining time: 3h 48m 14s [2025-10-25T23:04:55.071434] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:04:55.071814] [DEBUG] [LOCAL ] KYN: No existing data file found in primary storage. [2025-10-25T23:04:55.071893] [WARN ] [MAIN ] KYN: No existing data found, performing full refresh instead. [2025-10-25T23:04:55.072028] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-25T23:04:55.072103] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-25T23:04:55.072189] [DEBUG] [LOCAL ] KYN: No primary data file found to delete. [2025-10-25T23:04:55.072261] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-25T23:04:55.443473] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:04:55.443914] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-25T23:04:56.732906] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-25T23:04:56.740138] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-25T23:04:57.949214] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T23:04:57.956449] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-25T23:04:59.300623] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T23:04:59.307006] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-25T23:05:00.479007] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T23:05:00.486864] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-25T23:05:02.514538] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-25T23:05:02.521622] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-25T23:05:04.492124] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-25T23:05:04.498123] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-25T23:05:05.770368] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-25T23:05:05.777420] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-25T23:05:07.178189] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T23:05:07.184954] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-25T23:05:08.485240] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T23:05:08.491629] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-25T23:05:09.837937] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T23:05:09.847179] [INFO ] [REMOTE ] KYN: Full fetch complete (44377 records). [2025-10-25T23:05:09.847422] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-25T23:05:10.416404] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-25T23:05:10.416544] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-25T23:05:10.417632] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-25T23:05:10.417764] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-25T23:05:10.419022] [DEBUG] [LOCAL ] KYN: Trimmed 44377 records to 30665 (keeping 200 days of data) [2025-10-25T23:05:10.624988] [DEBUG] [LOCAL ] KYN: Primary data saved (30665 records). [2025-10-25T23:05:10.625293] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-25T23:05:10.625450] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols. KYN took 15.7s. Estimated remaining time: 3h 48m 5s [2025-10-25T23:05:10.819338] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:05:10.819555] [DEBUG] [LOCAL ] L: No existing data file found in primary storage. [2025-10-25T23:05:10.819627] [WARN ] [MAIN ] L: No existing data found, performing full refresh instead. [2025-10-25T23:05:10.819761] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-25T23:05:10.819831] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-25T23:05:10.819890] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-25T23:05:10.819961] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-25T23:05:11.165935] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:05:11.166277] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-25T23:05:12.694374] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T23:05:12.705324] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-25T23:05:14.082792] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-25T23:05:14.094382] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-25T23:05:15.643165] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T23:05:15.651926] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-25T23:05:17.133996] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T23:05:17.142630] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-25T23:05:18.648041] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T23:05:18.656287] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-25T23:05:20.330721] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T23:05:20.339739] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-25T23:05:21.803083] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T23:05:21.812870] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-25T23:05:23.346307] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T23:05:23.354914] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-25T23:05:24.063077] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T23:05:24.076022] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-25T23:05:24.908972] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T23:05:24.916590] [INFO ] [REMOTE ] L: Full fetch complete (59291 records). [2025-10-25T23:05:24.916766] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-25T23:05:25.312235] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-25T23:05:25.312348] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-25T23:05:25.313272] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-25T23:05:25.313354] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-25T23:05:25.314513] [DEBUG] [LOCAL ] L: Trimmed 59291 records to 41681 (keeping 200 days of data) [2025-10-25T23:05:25.566941] [DEBUG] [LOCAL ] L: Primary data saved (41681 records). [2025-10-25T23:05:25.567124] [INFO ] [MAIN ] L: Full history saved. [2025-10-25T23:05:25.567275] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols. L took 14.9s. Estimated remaining time: 3h 47m 56s [2025-10-25T23:05:25.736604] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:05:25.736839] [DEBUG] [LOCAL ] LAC: No existing data file found in primary storage. [2025-10-25T23:05:25.736913] [WARN ] [MAIN ] LAC: No existing data found, performing full refresh instead. [2025-10-25T23:05:25.737050] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-25T23:05:25.737122] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-25T23:05:25.737205] [DEBUG] [LOCAL ] LAC: No primary data file found to delete. [2025-10-25T23:05:25.737277] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-25T23:05:26.099698] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:05:26.100960] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-25T23:05:27.980437] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T23:05:27.990893] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-25T23:05:29.841380] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-25T23:05:29.850984] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-25T23:05:31.668081] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-25T23:05:31.678916] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-25T23:05:33.452163] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T23:05:33.463298] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-25T23:05:35.282278] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T23:05:35.293117] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-25T23:05:36.958444] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-25T23:05:36.969999] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-25T23:05:38.907341] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-25T23:05:38.919397] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-25T23:05:40.909078] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-25T23:05:40.920206] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-25T23:05:43.001223] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-25T23:05:43.012785] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-25T23:05:45.459404] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-25T23:05:45.469294] [INFO ] [REMOTE ] LAC: Full fetch complete (76148 records). [2025-10-25T23:05:45.469472] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-25T23:05:45.863976] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-25T23:05:45.864136] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-25T23:05:45.865322] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-25T23:05:45.865427] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-25T23:05:45.867103] [DEBUG] [LOCAL ] LAC: Trimmed 76148 records to 53351 (keeping 200 days of data) [2025-10-25T23:05:46.166221] [DEBUG] [LOCAL ] LAC: Primary data saved (53351 records). [2025-10-25T23:05:46.166432] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-25T23:05:46.166583] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols. LAC took 20.6s. Estimated remaining time: 3h 47m 51s [2025-10-25T23:05:46.334325] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:05:46.334529] [DEBUG] [LOCAL ] LAD: No existing data file found in primary storage. [2025-10-25T23:05:46.334599] [WARN ] [MAIN ] LAD: No existing data found, performing full refresh instead. [2025-10-25T23:05:46.334731] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-25T23:05:46.334801] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-25T23:05:46.334880] [DEBUG] [LOCAL ] LAD: No primary data file found to delete. [2025-10-25T23:05:46.334985] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-25T23:05:46.693823] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:05:46.694176] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-25T23:05:48.087629] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T23:05:48.093919] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-25T23:05:49.291414] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-25T23:05:49.296420] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-25T23:05:50.537545] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T23:05:50.544134] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-25T23:05:51.845044] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T23:05:51.851804] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-25T23:05:52.929235] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T23:05:52.933987] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-25T23:05:53.698621] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T23:05:53.703152] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-25T23:05:54.670992] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T23:05:54.676774] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-25T23:05:55.731892] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T23:05:55.737458] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-25T23:05:56.798754] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T23:05:56.803929] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-25T23:05:58.023945] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-25T23:05:58.028801] [INFO ] [REMOTE ] LAD: Full fetch complete (35673 records). [2025-10-25T23:05:58.028949] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-25T23:05:58.396693] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-25T23:05:58.396804] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-25T23:05:58.397506] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-25T23:05:58.397583] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-25T23:05:58.398432] [DEBUG] [LOCAL ] LAD: Trimmed 35673 records to 23777 (keeping 200 days of data) [2025-10-25T23:05:58.542072] [DEBUG] [LOCAL ] LAD: Primary data saved (23777 records). [2025-10-25T23:05:58.542240] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-25T23:05:58.542398] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols. LAD took 12.4s. Estimated remaining time: 3h 47m 40s [2025-10-25T23:05:58.709054] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:05:58.709272] [DEBUG] [LOCAL ] LADR: No existing data file found in primary storage. [2025-10-25T23:05:58.709345] [WARN ] [MAIN ] LADR: No existing data found, performing full refresh instead. [2025-10-25T23:05:58.709459] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-25T23:05:58.709532] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-25T23:05:58.709594] [DEBUG] [LOCAL ] LADR: No primary data file found to delete. [2025-10-25T23:05:58.709682] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-25T23:05:59.061911] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:05:59.062273] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-25T23:06:00.415505] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T23:06:00.422897] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-25T23:06:02.484778] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-25T23:06:02.496336] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-25T23:06:03.879144] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T23:06:03.886894] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-25T23:06:05.405958] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T23:06:05.415348] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-25T23:06:06.814549] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T23:06:06.822141] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-25T23:06:08.427475] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T23:06:08.435762] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-25T23:06:09.932571] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T23:06:09.941882] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-25T23:06:11.364273] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T23:06:11.372743] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-25T23:06:12.914478] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-25T23:06:12.923408] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-25T23:06:14.297911] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T23:06:14.305323] [INFO ] [REMOTE ] LADR: Full fetch complete (55688 records). [2025-10-25T23:06:14.305496] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-25T23:06:14.688473] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-25T23:06:14.688637] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-25T23:06:14.689536] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-25T23:06:14.689631] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-25T23:06:14.690833] [DEBUG] [LOCAL ] LADR: Trimmed 55688 records to 39961 (keeping 200 days of data) [2025-10-25T23:06:14.922167] [DEBUG] [LOCAL ] LADR: Primary data saved (39961 records). [2025-10-25T23:06:14.922340] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-25T23:06:14.922507] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols. LADR took 16.4s. Estimated remaining time: 3h 47m 32s [2025-10-25T23:06:15.087801] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:06:15.088019] [DEBUG] [LOCAL ] LANV: No existing data file found in primary storage. [2025-10-25T23:06:15.088105] [WARN ] [MAIN ] LANV: No existing data found, performing full refresh instead. [2025-10-25T23:06:15.088248] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-25T23:06:15.088340] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-25T23:06:15.088448] [DEBUG] [LOCAL ] LANV: No primary data file found to delete. [2025-10-25T23:06:15.088537] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-25T23:06:15.435922] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:06:15.436261] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-25T23:06:17.023258] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T23:06:17.024860] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-25T23:06:17.464460] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-25T23:06:17.465776] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-25T23:06:17.931886] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-25T23:06:17.933290] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-25T23:06:18.376387] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-25T23:06:18.377736] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-25T23:06:18.831117] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-25T23:06:18.832257] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-25T23:06:19.282290] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-25T23:06:19.283554] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-25T23:06:19.748111] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-25T23:06:19.749447] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-25T23:06:20.323932] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T23:06:20.325408] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-25T23:06:21.293880] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T23:06:21.295597] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-25T23:06:21.753608] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T23:06:21.754708] [INFO ] [REMOTE ] LANV: Full fetch complete (4239 records). [2025-10-25T23:06:21.754819] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-25T23:06:22.111740] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-25T23:06:22.111878] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-25T23:06:22.112090] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-25T23:06:22.112187] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-25T23:06:22.112637] [DEBUG] [LOCAL ] LANV: Trimmed 4239 records to 2817 (keeping 200 days of data) [2025-10-25T23:06:22.131226] [DEBUG] [LOCAL ] LANV: Primary data saved (2817 records). [2025-10-25T23:06:22.131378] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-25T23:06:22.131592] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols. LANV took 7.2s. Estimated remaining time: 3h 47m 15s [2025-10-25T23:06:22.303444] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:06:22.303665] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-25T23:06:22.303751] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-25T23:06:22.303882] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-25T23:06:22.303973] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-25T23:06:22.304080] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-25T23:06:22.304166] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-25T23:06:22.663440] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:06:22.663815] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-25T23:06:23.418630] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T23:06:23.421757] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-25T23:06:24.950591] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T23:06:24.961974] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-25T23:06:26.703889] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T23:06:26.713033] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-25T23:06:28.344432] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T23:06:28.353942] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-25T23:06:29.921164] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T23:06:29.930463] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-25T23:06:31.512730] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T23:06:31.521489] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-25T23:06:33.263300] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T23:06:33.275779] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-25T23:06:35.020722] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T23:06:35.030569] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-25T23:06:36.642332] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T23:06:36.652562] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-25T23:06:38.544257] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-25T23:06:38.553758] [INFO ] [REMOTE ] LAR: Full fetch complete (63231 records). [2025-10-25T23:06:38.553898] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-25T23:06:38.745973] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-25T23:06:38.746612] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:06:38.746704] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:06:38.746757] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-25T23:06:38.746841] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-25T23:06:38.746913] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-25T23:06:38.746993] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-25T23:06:38.747096] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols. LAR took 16.6s. Estimated remaining time: 3h 47m 7s [2025-10-25T23:06:38.930413] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:06:38.930702] [DEBUG] [LOCAL ] LAW: No existing data file found in primary storage. [2025-10-25T23:06:38.930798] [WARN ] [MAIN ] LAW: No existing data found, performing full refresh instead. [2025-10-25T23:06:38.930951] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-25T23:06:38.931045] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-25T23:06:38.931152] [DEBUG] [LOCAL ] LAW: No primary data file found to delete. [2025-10-25T23:06:38.931248] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-25T23:06:39.284041] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:06:39.284375] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-25T23:06:40.012210] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T23:06:40.015525] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-25T23:06:40.613772] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-25T23:06:40.617264] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-25T23:06:42.140154] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-25T23:06:42.143292] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-25T23:06:43.078312] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T23:06:43.081604] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-25T23:06:43.972825] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-25T23:06:43.976321] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-25T23:06:44.945439] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T23:06:44.949764] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-25T23:06:45.824839] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T23:06:45.828436] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-25T23:06:46.806449] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T23:06:46.810529] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-25T23:06:47.807767] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T23:06:47.811580] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-25T23:06:48.731984] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-25T23:06:48.735787] [INFO ] [REMOTE ] LAW: Full fetch complete (21228 records). [2025-10-25T23:06:48.735882] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-25T23:06:49.099162] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-25T23:06:49.099278] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-25T23:06:49.099816] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-25T23:06:49.099893] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-25T23:06:49.100588] [DEBUG] [LOCAL ] LAW: Trimmed 21228 records to 15240 (keeping 200 days of data) [2025-10-25T23:06:49.194151] [DEBUG] [LOCAL ] LAW: Primary data saved (15240 records). [2025-10-25T23:06:49.194332] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-25T23:06:49.194480] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols. LAW took 10.4s. Estimated remaining time: 3h 46m 54s [2025-10-25T23:06:49.379015] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:06:49.379268] [DEBUG] [LOCAL ] LAZ: No existing data file found in primary storage. [2025-10-25T23:06:49.379357] [WARN ] [MAIN ] LAZ: No existing data found, performing full refresh instead. [2025-10-25T23:06:49.379497] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-25T23:06:49.379585] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-25T23:06:49.379726] [DEBUG] [LOCAL ] LAZ: No primary data file found to delete. [2025-10-25T23:06:49.379815] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-25T23:06:49.908429] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:06:49.908976] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-25T23:06:51.586353] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T23:06:51.597208] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-25T23:06:53.355473] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T23:06:53.364774] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-25T23:06:56.357637] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-10-25T23:06:56.367413] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-25T23:06:58.005194] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T23:06:58.015323] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-25T23:06:59.716052] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-25T23:06:59.725395] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-25T23:07:01.595513] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-25T23:07:01.604633] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-25T23:07:03.749311] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-25T23:07:03.759530] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-25T23:07:05.237833] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T23:07:05.246942] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-25T23:07:06.665479] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T23:07:06.674815] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-25T23:07:08.079993] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T23:07:08.087621] [INFO ] [REMOTE ] LAZ: Full fetch complete (65378 records). [2025-10-25T23:07:08.087818] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-25T23:07:08.476992] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-25T23:07:08.477113] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-25T23:07:08.478101] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-25T23:07:08.478181] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-25T23:07:08.479394] [DEBUG] [LOCAL ] LAZ: Trimmed 65378 records to 45115 (keeping 200 days of data) [2025-10-25T23:07:08.736949] [DEBUG] [LOCAL ] LAZ: Primary data saved (45115 records). [2025-10-25T23:07:08.737099] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-25T23:07:08.737247] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols. LAZ took 19.5s. Estimated remaining time: 3h 46m 48s [2025-10-25T23:07:08.902891] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:07:08.903054] [DEBUG] [LOCAL ] LB: No existing data file found in primary storage. [2025-10-25T23:07:08.903129] [WARN ] [MAIN ] LB: No existing data found, performing full refresh instead. [2025-10-25T23:07:08.903239] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-25T23:07:08.903309] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-25T23:07:08.903388] [DEBUG] [LOCAL ] LB: No primary data file found to delete. [2025-10-25T23:07:08.903456] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-25T23:07:09.255438] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:07:09.255818] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-25T23:07:10.987368] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T23:07:10.995840] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-25T23:07:12.985147] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-25T23:07:12.993044] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-25T23:07:14.242104] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-25T23:07:14.255362] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-25T23:07:15.427459] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-25T23:07:15.435569] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-25T23:07:16.869519] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T23:07:16.877050] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-25T23:07:18.706253] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T23:07:18.713947] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-25T23:07:20.263015] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T23:07:20.272428] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-25T23:07:21.648995] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T23:07:21.657256] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-25T23:07:22.980873] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T23:07:22.991003] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-25T23:07:24.401315] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-25T23:07:24.408105] [INFO ] [REMOTE ] LB: Full fetch complete (55581 records). [2025-10-25T23:07:24.408271] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-25T23:07:24.792237] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-25T23:07:24.792366] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-25T23:07:24.793252] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-25T23:07:24.793349] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-25T23:07:24.794446] [DEBUG] [LOCAL ] LB: Trimmed 55581 records to 37459 (keeping 200 days of data) [2025-10-25T23:07:25.010188] [DEBUG] [LOCAL ] LB: Primary data saved (37459 records). [2025-10-25T23:07:25.010366] [INFO ] [MAIN ] LB: Full history saved. [2025-10-25T23:07:25.010537] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols. LB took 16.3s. Estimated remaining time: 3h 46m 40s [2025-10-25T23:07:25.183983] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:07:25.184186] [DEBUG] [LOCAL ] LBRT: No existing data file found in primary storage. [2025-10-25T23:07:25.184276] [WARN ] [MAIN ] LBRT: No existing data found, performing full refresh instead. [2025-10-25T23:07:25.184415] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-25T23:07:25.184508] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-25T23:07:25.184616] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-25T23:07:25.184727] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-25T23:07:25.529583] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:07:25.529938] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-25T23:07:27.287587] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T23:07:27.297919] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-25T23:07:28.934725] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T23:07:28.945599] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-25T23:07:30.663536] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T23:07:30.675253] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-25T23:07:32.465196] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T23:07:32.477095] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-25T23:07:34.466543] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T23:07:34.477749] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-25T23:07:36.043337] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T23:07:36.054323] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-25T23:07:37.894615] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-25T23:07:37.908290] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-25T23:07:39.570202] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T23:07:39.581432] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-25T23:07:41.321047] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-25T23:07:41.332502] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-25T23:07:43.028793] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-25T23:07:43.038442] [INFO ] [REMOTE ] LBRT: Full fetch complete (76926 records). [2025-10-25T23:07:43.038610] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-25T23:07:43.462266] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-25T23:07:43.462396] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-25T23:07:43.463704] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-25T23:07:43.463802] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-25T23:07:43.465267] [DEBUG] [LOCAL ] LBRT: Trimmed 76926 records to 53783 (keeping 200 days of data) [2025-10-25T23:07:43.782563] [DEBUG] [LOCAL ] LBRT: Primary data saved (53783 records). [2025-10-25T23:07:43.782762] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-25T23:07:43.782927] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols. LBRT took 18.8s. Estimated remaining time: 3h 46m 34s [2025-10-25T23:07:43.953849] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:07:43.954070] [DEBUG] [LOCAL ] LC: No existing data file found in primary storage. [2025-10-25T23:07:43.954156] [WARN ] [MAIN ] LC: No existing data found, performing full refresh instead. [2025-10-25T23:07:43.954292] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-25T23:07:43.954380] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-25T23:07:43.954486] [DEBUG] [LOCAL ] LC: No primary data file found to delete. [2025-10-25T23:07:43.954573] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-25T23:07:44.311072] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:07:44.311484] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-25T23:07:45.987790] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T23:07:45.997939] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-25T23:07:47.720635] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-25T23:07:47.730474] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-25T23:07:49.341110] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T23:07:49.351346] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-25T23:07:50.872281] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-25T23:07:50.882966] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-25T23:07:52.536195] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T23:07:52.546431] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-25T23:07:54.078519] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-25T23:07:54.087941] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-25T23:07:55.707628] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T23:07:55.718499] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-25T23:07:57.324270] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T23:07:57.334712] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-25T23:07:59.112065] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T23:07:59.126549] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-25T23:08:00.764833] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-25T23:08:00.774543] [INFO ] [REMOTE ] LC: Full fetch complete (70724 records). [2025-10-25T23:08:00.774743] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-25T23:08:01.206895] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-25T23:08:01.207068] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-25T23:08:01.208177] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-25T23:08:01.208264] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-25T23:08:01.209842] [DEBUG] [LOCAL ] LC: Trimmed 70724 records to 49022 (keeping 200 days of data) [2025-10-25T23:08:01.506229] [DEBUG] [LOCAL ] LC: Primary data saved (49022 records). [2025-10-25T23:08:01.506439] [INFO ] [MAIN ] LC: Full history saved. [2025-10-25T23:08:01.506602] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols. LC took 17.7s. Estimated remaining time: 3h 46m 27s [2025-10-25T23:08:01.696889] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:08:01.697094] [DEBUG] [LOCAL ] LCII: No existing data file found in primary storage. [2025-10-25T23:08:01.697181] [WARN ] [MAIN ] LCII: No existing data found, performing full refresh instead. [2025-10-25T23:08:01.697350] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-25T23:08:01.697454] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-25T23:08:01.697573] [DEBUG] [LOCAL ] LCII: No primary data file found to delete. [2025-10-25T23:08:01.697705] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-25T23:08:02.094698] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:08:02.095075] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-25T23:08:03.357855] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T23:08:03.362998] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-25T23:08:04.661851] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-25T23:08:04.667175] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-25T23:08:06.003475] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T23:08:06.010828] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-25T23:08:07.468785] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-25T23:08:07.476962] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-25T23:08:08.938406] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T23:08:08.946498] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-25T23:08:10.283856] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T23:08:10.290315] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-25T23:08:11.611503] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-25T23:08:11.618098] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-25T23:08:12.937143] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-25T23:08:12.944517] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-25T23:08:14.062971] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T23:08:14.068283] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-25T23:08:15.154702] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-25T23:08:15.158834] [INFO ] [REMOTE ] LCII: Full fetch complete (39059 records). [2025-10-25T23:08:15.158976] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-25T23:08:15.533772] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-25T23:08:15.533906] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-25T23:08:15.534621] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-25T23:08:15.534721] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-25T23:08:15.535725] [DEBUG] [LOCAL ] LCII: Trimmed 39059 records to 27122 (keeping 200 days of data) [2025-10-25T23:08:15.696050] [DEBUG] [LOCAL ] LCII: Primary data saved (27122 records). [2025-10-25T23:08:15.696208] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-25T23:08:15.696358] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols. LCII took 14.2s. Estimated remaining time: 3h 46m 17s [2025-10-25T23:08:15.864498] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:08:15.864731] [DEBUG] [LOCAL ] LDI: No existing data file found in primary storage. [2025-10-25T23:08:15.864843] [WARN ] [MAIN ] LDI: No existing data found, performing full refresh instead. [2025-10-25T23:08:15.864960] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-25T23:08:15.865032] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-25T23:08:15.865123] [DEBUG] [LOCAL ] LDI: No primary data file found to delete. [2025-10-25T23:08:15.865193] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-25T23:08:16.213808] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:08:16.214174] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-25T23:08:17.459898] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T23:08:17.466798] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-25T23:08:18.747532] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-25T23:08:18.754829] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-25T23:08:20.301165] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T23:08:20.310190] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-25T23:08:21.759685] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-25T23:08:21.769190] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-25T23:08:23.187371] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T23:08:23.195930] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-25T23:08:24.407988] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-25T23:08:24.416682] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-25T23:08:26.148387] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-25T23:08:26.158163] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-25T23:08:27.645154] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-25T23:08:27.654727] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-25T23:08:29.742153] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-25T23:08:29.753094] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-25T23:08:31.894591] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-25T23:08:31.905476] [INFO ] [REMOTE ] LDI: Full fetch complete (62381 records). [2025-10-25T23:08:31.905693] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-25T23:08:32.304196] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-25T23:08:32.304724] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-25T23:08:32.305772] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-25T23:08:32.306007] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-25T23:08:32.307404] [DEBUG] [LOCAL ] LDI: Trimmed 62381 records to 45883 (keeping 200 days of data) [2025-10-25T23:08:32.558807] [DEBUG] [LOCAL ] LDI: Primary data saved (45883 records). [2025-10-25T23:08:32.558966] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-25T23:08:32.559113] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols. LDI took 16.9s. Estimated remaining time: 3h 46m 9s [2025-10-25T23:08:32.723429] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:08:32.723663] [DEBUG] [LOCAL ] LDOS: No existing data file found in primary storage. [2025-10-25T23:08:32.723729] [WARN ] [MAIN ] LDOS: No existing data found, performing full refresh instead. [2025-10-25T23:08:32.723831] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-25T23:08:32.723902] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-25T23:08:32.723970] [DEBUG] [LOCAL ] LDOS: No primary data file found to delete. [2025-10-25T23:08:32.724034] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-25T23:08:33.072482] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:08:33.072900] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-25T23:08:34.733132] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T23:08:34.742927] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-25T23:08:36.481517] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T23:08:36.491220] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-25T23:08:38.184413] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T23:08:38.194544] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-25T23:08:39.818780] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T23:08:39.829087] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-25T23:08:41.746277] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-25T23:08:41.756541] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-25T23:08:43.416246] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T23:08:43.425785] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-25T23:08:44.708051] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-25T23:08:44.717392] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-25T23:08:46.526751] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T23:08:46.542463] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-25T23:08:48.043838] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T23:08:48.053998] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-25T23:08:48.739775] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-25T23:08:48.747564] [INFO ] [REMOTE ] LDOS: Full fetch complete (66775 records). [2025-10-25T23:08:48.747846] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-25T23:08:49.126579] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-25T23:08:49.126716] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-25T23:08:49.127731] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-25T23:08:49.127829] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-25T23:08:49.129121] [DEBUG] [LOCAL ] LDOS: Trimmed 66775 records to 45191 (keeping 200 days of data) [2025-10-25T23:08:49.404911] [DEBUG] [LOCAL ] LDOS: Primary data saved (45191 records). [2025-10-25T23:08:49.405072] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-25T23:08:49.405228] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols. LDOS took 16.8s. Estimated remaining time: 3h 46m 1s [2025-10-25T23:08:49.571299] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:08:49.571519] [DEBUG] [LOCAL ] LDP: No existing data file found in primary storage. [2025-10-25T23:08:49.571589] [WARN ] [MAIN ] LDP: No existing data found, performing full refresh instead. [2025-10-25T23:08:49.571721] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-25T23:08:49.571791] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-25T23:08:49.571870] [DEBUG] [LOCAL ] LDP: No primary data file found to delete. [2025-10-25T23:08:49.571937] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-25T23:08:49.922160] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:08:49.922495] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-25T23:08:50.945586] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T23:08:50.951043] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-25T23:08:51.795120] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-25T23:08:51.798000] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-25T23:08:52.674615] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T23:08:52.678143] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-25T23:08:53.696532] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T23:08:53.700157] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-25T23:08:54.615784] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-25T23:08:54.619475] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-25T23:08:55.378092] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T23:08:55.381046] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-25T23:08:56.347731] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T23:08:56.351613] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-25T23:08:57.065107] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T23:08:57.068379] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-25T23:08:57.940954] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T23:08:57.944256] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-25T23:08:58.757077] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T23:08:58.759470] [INFO ] [REMOTE ] LDP: Full fetch complete (18572 records). [2025-10-25T23:08:58.759576] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-25T23:08:59.124727] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-25T23:08:59.124859] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-25T23:08:59.125355] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-25T23:08:59.125450] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-25T23:08:59.126270] [DEBUG] [LOCAL ] LDP: Trimmed 18572 records to 12611 (keeping 200 days of data) [2025-10-25T23:08:59.200749] [DEBUG] [LOCAL ] LDP: Primary data saved (12611 records). [2025-10-25T23:08:59.200919] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-25T23:08:59.201104] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols. LDP took 9.8s. Estimated remaining time: 3h 45m 47s [2025-10-25T23:08:59.377216] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:08:59.377423] [DEBUG] [LOCAL ] LEA: No existing data file found in primary storage. [2025-10-25T23:08:59.377493] [WARN ] [MAIN ] LEA: No existing data found, performing full refresh instead. [2025-10-25T23:08:59.377579] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-25T23:08:59.377669] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-25T23:08:59.377774] [DEBUG] [LOCAL ] LEA: No primary data file found to delete. [2025-10-25T23:08:59.377853] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-25T23:08:59.731957] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:08:59.732286] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-25T23:09:01.537085] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T23:09:01.545594] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-25T23:09:03.579707] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-25T23:09:03.587737] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-25T23:09:05.314775] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T23:09:05.324436] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-25T23:09:06.991760] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T23:09:07.000605] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-25T23:09:08.400328] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T23:09:08.409823] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-25T23:09:09.830174] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T23:09:09.839374] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-25T23:09:11.099465] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-25T23:09:11.109286] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-25T23:09:12.580468] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T23:09:12.589183] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-25T23:09:14.092588] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T23:09:14.102453] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-25T23:09:15.558374] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-25T23:09:15.565472] [INFO ] [REMOTE ] LEA: Full fetch complete (60435 records). [2025-10-25T23:09:15.565597] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-25T23:09:15.939982] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-25T23:09:15.940098] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-25T23:09:15.941012] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-25T23:09:15.941095] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-25T23:09:15.942295] [DEBUG] [LOCAL ] LEA: Trimmed 60435 records to 41626 (keeping 200 days of data) [2025-10-25T23:09:16.190136] [DEBUG] [LOCAL ] LEA: Primary data saved (41626 records). [2025-10-25T23:09:16.190310] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-25T23:09:16.190472] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols. LEA took 17.0s. Estimated remaining time: 3h 45m 39s [2025-10-25T23:09:16.355852] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:09:16.356030] [DEBUG] [LOCAL ] LEG: No existing data file found in primary storage. [2025-10-25T23:09:16.356081] [WARN ] [MAIN ] LEG: No existing data found, performing full refresh instead. [2025-10-25T23:09:16.356234] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-25T23:09:16.356310] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-25T23:09:16.356395] [DEBUG] [LOCAL ] LEG: No primary data file found to delete. [2025-10-25T23:09:16.356464] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-25T23:09:16.700867] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:09:16.701208] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-25T23:09:18.213066] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T23:09:18.222841] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-25T23:09:19.748014] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T23:09:19.757702] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-25T23:09:21.367580] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T23:09:21.378553] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-25T23:09:23.110754] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T23:09:23.121520] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-25T23:09:24.802836] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T23:09:24.813389] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-25T23:09:26.386280] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-25T23:09:26.396216] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-25T23:09:28.002141] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-25T23:09:28.013261] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-25T23:09:29.636679] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T23:09:29.647288] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-25T23:09:31.212270] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T23:09:31.223224] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-25T23:09:32.900634] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T23:09:32.909426] [INFO ] [REMOTE ] LEG: Full fetch complete (72803 records). [2025-10-25T23:09:32.909568] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-25T23:09:33.317165] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-25T23:09:33.317316] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-25T23:09:33.318348] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-25T23:09:33.318433] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-25T23:09:33.319888] [DEBUG] [LOCAL ] LEG: Trimmed 72803 records to 50679 (keeping 200 days of data) [2025-10-25T23:09:33.607000] [DEBUG] [LOCAL ] LEG: Primary data saved (50679 records). [2025-10-25T23:09:33.607157] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-25T23:09:33.607308] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols. LEG took 17.4s. Estimated remaining time: 3h 45m 32s [2025-10-25T23:09:33.774466] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:09:33.774635] [DEBUG] [LOCAL ] LEN: No existing data file found in primary storage. [2025-10-25T23:09:33.774728] [WARN ] [MAIN ] LEN: No existing data found, performing full refresh instead. [2025-10-25T23:09:33.774840] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-25T23:09:33.774911] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-25T23:09:33.774994] [DEBUG] [LOCAL ] LEN: No primary data file found to delete. [2025-10-25T23:09:33.775059] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-25T23:09:34.125040] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:09:34.125377] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-25T23:09:35.926060] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T23:09:35.936552] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-25T23:09:37.836332] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T23:09:37.846352] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-25T23:09:39.659999] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T23:09:39.672315] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-25T23:09:41.462499] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-25T23:09:41.474117] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-25T23:09:43.350431] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-25T23:09:43.361746] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-25T23:09:45.173438] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T23:09:45.184595] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-25T23:09:47.319095] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-25T23:09:47.331751] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-25T23:09:49.628693] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-25T23:09:49.639901] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-25T23:09:51.742771] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-25T23:09:51.754184] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-25T23:09:53.666451] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-25T23:09:53.677024] [INFO ] [REMOTE ] LEN: Full fetch complete (77223 records). [2025-10-25T23:09:53.677270] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-25T23:09:54.117714] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-25T23:09:54.117840] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-25T23:09:54.119043] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-25T23:09:54.119150] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-25T23:09:54.120819] [DEBUG] [LOCAL ] LEN: Trimmed 77223 records to 53974 (keeping 200 days of data) [2025-10-25T23:09:54.489148] [DEBUG] [LOCAL ] LEN: Primary data saved (53974 records). [2025-10-25T23:09:54.489339] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-25T23:09:54.489508] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols. LEN took 20.9s. Estimated remaining time: 3h 45m 28s [2025-10-25T23:09:54.676263] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:09:54.676481] [DEBUG] [LOCAL ] LEO: No existing data file found in primary storage. [2025-10-25T23:09:54.676556] [WARN ] [MAIN ] LEO: No existing data found, performing full refresh instead. [2025-10-25T23:09:54.676695] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-25T23:09:54.676769] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-25T23:09:54.676848] [DEBUG] [LOCAL ] LEO: No primary data file found to delete. [2025-10-25T23:09:54.676918] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-25T23:09:55.082237] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:09:55.082710] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-25T23:09:56.230033] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T23:09:56.236843] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-25T23:09:57.389182] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T23:09:57.394286] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-25T23:09:58.392773] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-25T23:09:58.397529] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-25T23:09:59.578418] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T23:09:59.584261] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-25T23:10:00.308920] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T23:10:00.312299] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-25T23:10:01.388326] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T23:10:01.393096] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-25T23:10:03.325456] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-25T23:10:03.329705] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-25T23:10:04.244374] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T23:10:04.248364] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-25T23:10:05.246750] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T23:10:05.250537] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-25T23:10:06.177100] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-25T23:10:06.180343] [INFO ] [REMOTE ] LEO: Full fetch complete (26429 records). [2025-10-25T23:10:06.180439] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-25T23:10:06.550761] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-25T23:10:06.550885] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-25T23:10:06.551460] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-25T23:10:06.551537] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-25T23:10:06.552324] [DEBUG] [LOCAL ] LEO: Trimmed 26429 records to 17046 (keeping 200 days of data) [2025-10-25T23:10:06.645827] [DEBUG] [LOCAL ] LEO: Primary data saved (17046 records). [2025-10-25T23:10:06.646010] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-25T23:10:06.646166] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols. LEO took 12.2s. Estimated remaining time: 3h 45m 16s [2025-10-25T23:10:06.824353] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:10:06.824588] [DEBUG] [LOCAL ] LEVI: No existing data file found in primary storage. [2025-10-25T23:10:06.824685] [WARN ] [MAIN ] LEVI: No existing data found, performing full refresh instead. [2025-10-25T23:10:06.824796] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-25T23:10:06.824867] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-25T23:10:06.824949] [DEBUG] [LOCAL ] LEVI: No primary data file found to delete. [2025-10-25T23:10:06.825018] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-25T23:10:07.170851] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:10:07.171190] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-25T23:10:08.829163] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T23:10:08.840363] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-25T23:10:10.435313] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T23:10:10.446550] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-25T23:10:12.307461] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T23:10:12.318228] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-25T23:10:14.102063] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T23:10:14.114426] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-25T23:10:16.116473] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-25T23:10:16.127723] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-25T23:10:17.677726] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T23:10:17.689231] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-25T23:10:19.599180] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-25T23:10:19.611949] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-25T23:10:21.214729] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T23:10:21.225863] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-25T23:10:23.077825] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-25T23:10:23.088960] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-25T23:10:24.884223] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-25T23:10:24.894413] [INFO ] [REMOTE ] LEVI: Full fetch complete (74998 records). [2025-10-25T23:10:24.894574] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-25T23:10:25.338308] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-25T23:10:25.338452] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-25T23:10:25.339737] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-25T23:10:25.339845] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-25T23:10:25.341543] [DEBUG] [LOCAL ] LEVI: Trimmed 74998 records to 52588 (keeping 200 days of data) [2025-10-25T23:10:25.668637] [DEBUG] [LOCAL ] LEVI: Primary data saved (52588 records). [2025-10-25T23:10:25.668823] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-25T23:10:25.668975] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols. LEVI took 19.0s. Estimated remaining time: 3h 45m 10s [2025-10-25T23:10:25.840118] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:10:25.840301] [DEBUG] [LOCAL ] LFT: No existing data file found in primary storage. [2025-10-25T23:10:25.840371] [WARN ] [MAIN ] LFT: No existing data found, performing full refresh instead. [2025-10-25T23:10:25.840461] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-25T23:10:25.840527] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-25T23:10:25.840586] [DEBUG] [LOCAL ] LFT: No primary data file found to delete. [2025-10-25T23:10:25.840674] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-25T23:10:26.195602] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:10:26.196250] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-25T23:10:27.203874] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T23:10:27.209598] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-25T23:10:27.963445] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T23:10:27.967409] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-25T23:10:28.857903] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-25T23:10:28.862537] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-25T23:10:29.714698] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-25T23:10:29.719144] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-25T23:10:30.733550] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-25T23:10:30.737935] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-25T23:10:32.025811] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T23:10:32.031316] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-25T23:10:33.098886] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T23:10:33.103540] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-25T23:10:34.124998] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T23:10:34.129351] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-25T23:10:35.082067] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T23:10:35.086031] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-25T23:10:35.929817] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T23:10:35.932943] [INFO ] [REMOTE ] LFT: Full fetch complete (23763 records). [2025-10-25T23:10:35.933065] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-25T23:10:36.315864] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-25T23:10:36.316005] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-25T23:10:36.316597] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-25T23:10:36.316712] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-25T23:10:36.317520] [DEBUG] [LOCAL ] LFT: Trimmed 23763 records to 18343 (keeping 200 days of data) [2025-10-25T23:10:36.420438] [DEBUG] [LOCAL ] LFT: Primary data saved (18343 records). [2025-10-25T23:10:36.420615] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-25T23:10:36.420808] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols. LFT took 10.8s. Estimated remaining time: 3h 44m 56s [2025-10-25T23:10:36.589097] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:10:36.589323] [DEBUG] [LOCAL ] LGI: No existing data file found in primary storage. [2025-10-25T23:10:36.589409] [WARN ] [MAIN ] LGI: No existing data found, performing full refresh instead. [2025-10-25T23:10:36.589543] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-25T23:10:36.589632] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-25T23:10:36.589761] [DEBUG] [LOCAL ] LGI: No primary data file found to delete. [2025-10-25T23:10:36.589847] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-25T23:10:36.946581] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:10:36.946947] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-25T23:10:37.946049] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-25T23:10:37.948590] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-25T23:10:38.763913] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-25T23:10:38.766414] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-25T23:10:39.621105] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-25T23:10:39.624054] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-25T23:10:40.427082] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-25T23:10:40.430097] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-25T23:10:41.210277] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-25T23:10:41.213282] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-25T23:10:41.939297] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T23:10:41.941861] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-25T23:10:42.645305] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T23:10:42.647724] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-25T23:10:43.614561] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T23:10:43.618329] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-25T23:10:44.321964] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T23:10:44.324245] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-25T23:10:45.106746] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T23:10:45.109124] [INFO ] [REMOTE ] LGI: Full fetch complete (14452 records). [2025-10-25T23:10:45.109217] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-25T23:10:45.475412] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-25T23:10:45.475527] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-25T23:10:45.475912] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-25T23:10:45.475994] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-25T23:10:45.476524] [DEBUG] [LOCAL ] LGI: Trimmed 14452 records to 10091 (keeping 200 days of data) [2025-10-25T23:10:45.535451] [DEBUG] [LOCAL ] LGI: Primary data saved (10091 records). [2025-10-25T23:10:45.535590] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-25T23:10:45.535758] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols. LGI took 9.1s. Estimated remaining time: 3h 44m 42s [2025-10-25T23:10:45.713365] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:10:45.713573] [DEBUG] [LOCAL ] LH: No existing data file found in primary storage. [2025-10-25T23:10:45.713663] [WARN ] [MAIN ] LH: No existing data found, performing full refresh instead. [2025-10-25T23:10:45.713789] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-25T23:10:45.713857] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-25T23:10:45.713939] [DEBUG] [LOCAL ] LH: No primary data file found to delete. [2025-10-25T23:10:45.714008] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-25T23:10:46.073156] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:10:46.073579] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-25T23:10:47.605948] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T23:10:47.616224] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-25T23:10:48.872150] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T23:10:48.879635] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-25T23:10:50.531465] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-25T23:10:50.540778] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-25T23:10:52.154563] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T23:10:52.164264] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-25T23:10:53.801413] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T23:10:53.810263] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-25T23:10:55.164773] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T23:10:55.172902] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-25T23:10:56.627094] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-25T23:10:56.636548] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-25T23:10:58.036624] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T23:10:58.044081] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-25T23:10:59.137833] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-25T23:10:59.144556] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-25T23:10:59.971262] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T23:10:59.980336] [INFO ] [REMOTE ] LH: Full fetch complete (54745 records). [2025-10-25T23:10:59.980506] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-25T23:11:00.361981] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-25T23:11:00.362094] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-25T23:11:00.363047] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-25T23:11:00.363131] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-25T23:11:00.364271] [DEBUG] [LOCAL ] LH: Trimmed 54745 records to 37491 (keeping 200 days of data) [2025-10-25T23:11:00.591382] [DEBUG] [LOCAL ] LH: Primary data saved (37491 records). [2025-10-25T23:11:00.591558] [INFO ] [MAIN ] LH: Full history saved. [2025-10-25T23:11:00.591731] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols. LH took 15.1s. Estimated remaining time: 3h 44m 32s [2025-10-25T23:11:00.757765] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:11:00.757934] [DEBUG] [LOCAL ] LHX: No existing data file found in primary storage. [2025-10-25T23:11:00.758005] [WARN ] [MAIN ] LHX: No existing data found, performing full refresh instead. [2025-10-25T23:11:00.758115] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-25T23:11:00.758192] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-25T23:11:00.758272] [DEBUG] [LOCAL ] LHX: No primary data file found to delete. [2025-10-25T23:11:00.758342] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-25T23:11:01.104084] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:11:01.104429] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-25T23:11:03.602776] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-25T23:11:03.612499] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-25T23:11:05.257545] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T23:11:05.268141] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-25T23:11:07.059739] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T23:11:07.070409] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-25T23:11:09.228547] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-25T23:11:09.239166] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-25T23:11:11.062242] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T23:11:11.072994] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-25T23:11:13.115746] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-25T23:11:13.125855] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-25T23:11:15.062274] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-25T23:11:15.073176] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-25T23:11:16.868575] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-25T23:11:16.878509] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-25T23:11:18.673202] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T23:11:18.683328] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-25T23:11:19.373925] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-25T23:11:19.382529] [INFO ] [REMOTE ] LHX: Full fetch complete (70699 records). [2025-10-25T23:11:19.382733] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-25T23:11:19.781623] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-25T23:11:19.781786] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-25T23:11:19.783325] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-25T23:11:19.783440] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-25T23:11:19.784994] [DEBUG] [LOCAL ] LHX: Trimmed 70699 records to 49076 (keeping 200 days of data) [2025-10-25T23:11:20.092034] [DEBUG] [LOCAL ] LHX: Primary data saved (49076 records). [2025-10-25T23:11:20.092213] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-25T23:11:20.092364] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols. LHX took 19.5s. Estimated remaining time: 3h 44m 27s [2025-10-25T23:11:20.271326] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:11:20.271564] [DEBUG] [LOCAL ] LII: No existing data file found in primary storage. [2025-10-25T23:11:20.271661] [WARN ] [MAIN ] LII: No existing data found, performing full refresh instead. [2025-10-25T23:11:20.271792] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-25T23:11:20.271868] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-25T23:11:20.271952] [DEBUG] [LOCAL ] LII: No primary data file found to delete. [2025-10-25T23:11:20.272025] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-25T23:11:20.636255] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:11:20.636635] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-25T23:11:22.058405] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T23:11:22.064705] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-25T23:11:23.534442] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T23:11:23.540589] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-25T23:11:25.120226] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T23:11:25.127470] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-25T23:11:26.619514] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-25T23:11:26.627093] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-25T23:11:28.057635] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T23:11:28.064197] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-25T23:11:29.500331] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-25T23:11:29.506543] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-25T23:11:31.040569] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-25T23:11:31.046891] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-25T23:11:32.156088] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T23:11:32.161668] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-25T23:11:33.102412] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-25T23:11:33.108507] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-25T23:11:33.995257] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-25T23:11:34.001046] [INFO ] [REMOTE ] LII: Full fetch complete (41941 records). [2025-10-25T23:11:34.001164] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-25T23:11:34.374239] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-25T23:11:34.374360] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-25T23:11:34.375242] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-25T23:11:34.375325] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-25T23:11:34.376318] [DEBUG] [LOCAL ] LII: Trimmed 41941 records to 28260 (keeping 200 days of data) [2025-10-25T23:11:34.550091] [DEBUG] [LOCAL ] LII: Primary data saved (28260 records). [2025-10-25T23:11:34.550232] [INFO ] [MAIN ] LII: Full history saved. [2025-10-25T23:11:34.550384] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols. LII took 14.5s. Estimated remaining time: 3h 44m 16s [2025-10-25T23:11:34.721234] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:11:34.721433] [DEBUG] [LOCAL ] LION: No existing data file found in primary storage. [2025-10-25T23:11:34.721506] [WARN ] [MAIN ] LION: No existing data found, performing full refresh instead. [2025-10-25T23:11:34.721621] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-25T23:11:34.721712] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-25T23:11:34.721798] [DEBUG] [LOCAL ] LION: No primary data file found to delete. [2025-10-25T23:11:34.721867] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-25T23:11:35.101579] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:11:35.102043] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-25T23:11:36.427018] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T23:11:36.432598] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-25T23:11:37.563435] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T23:11:37.571436] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-25T23:11:38.614288] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T23:11:38.619720] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-25T23:11:39.876098] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T23:11:39.882827] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-25T23:11:41.367028] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T23:11:41.377088] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-25T23:11:42.855219] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T23:11:42.865362] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-25T23:11:44.483027] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-25T23:11:44.493698] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-25T23:11:46.114950] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T23:11:46.125429] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-25T23:11:47.717819] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T23:11:47.728187] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-25T23:11:49.241055] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-25T23:11:49.250150] [INFO ] [REMOTE ] LION: Full fetch complete (58321 records). [2025-10-25T23:11:49.250286] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-25T23:11:49.629295] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-25T23:11:49.629416] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-25T23:11:49.630320] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-25T23:11:49.630400] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-25T23:11:49.631603] [DEBUG] [LOCAL ] LION: Trimmed 58321 records to 47662 (keeping 200 days of data) [2025-10-25T23:11:49.891076] [DEBUG] [LOCAL ] LION: Primary data saved (47662 records). [2025-10-25T23:11:49.891243] [INFO ] [MAIN ] LION: Full history saved. [2025-10-25T23:11:49.891393] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols. LION took 15.3s. Estimated remaining time: 3h 44m 7s [2025-10-25T23:11:50.059843] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:11:50.060032] [DEBUG] [LOCAL ] LITB: No existing data file found in primary storage. [2025-10-25T23:11:50.060103] [WARN ] [MAIN ] LITB: No existing data found, performing full refresh instead. [2025-10-25T23:11:50.060216] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-25T23:11:50.060287] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-25T23:11:50.060373] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-10-25T23:11:50.060444] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-25T23:11:50.422695] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:11:50.423050] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-25T23:11:51.063828] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T23:11:51.065184] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-25T23:11:51.514383] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-25T23:11:51.515682] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-25T23:11:52.149731] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T23:11:52.151592] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-25T23:11:52.888435] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T23:11:52.891013] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-25T23:11:53.375264] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T23:11:53.376718] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-25T23:11:53.819412] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-25T23:11:53.820749] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-25T23:11:54.323278] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-25T23:11:54.324525] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-25T23:11:54.766369] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-25T23:11:54.767547] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-25T23:11:55.396252] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T23:11:55.398520] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-25T23:11:55.980462] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:11:55.981964] [INFO ] [REMOTE ] LITB: Full fetch complete (5800 records). [2025-10-25T23:11:55.982080] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-25T23:11:56.341769] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-25T23:11:56.341895] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-25T23:11:56.342084] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-25T23:11:56.342183] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-25T23:11:56.342695] [DEBUG] [LOCAL ] LITB: Trimmed 5800 records to 3922 (keeping 200 days of data) [2025-10-25T23:11:56.364689] [DEBUG] [LOCAL ] LITB: Primary data saved (3922 records). [2025-10-25T23:11:56.364845] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-25T23:11:56.365066] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols. LITB took 6.5s. Estimated remaining time: 3h 43m 50s [2025-10-25T23:11:56.533808] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:11:56.534021] [DEBUG] [LOCAL ] LLY: No existing data file found in primary storage. [2025-10-25T23:11:56.534121] [WARN ] [MAIN ] LLY: No existing data found, performing full refresh instead. [2025-10-25T23:11:56.534296] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-25T23:11:56.534387] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-25T23:11:56.534489] [DEBUG] [LOCAL ] LLY: No primary data file found to delete. [2025-10-25T23:11:56.534563] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-25T23:11:56.888831] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:11:56.889266] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-25T23:11:59.177046] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-25T23:11:59.187375] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-25T23:12:01.615493] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-25T23:12:01.625709] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-25T23:12:04.148335] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-25T23:12:04.160009] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-25T23:12:06.816842] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-25T23:12:06.828927] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-25T23:12:09.806284] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-10-25T23:12:09.817947] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-25T23:12:12.090270] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-25T23:12:12.100971] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-25T23:12:14.787490] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-25T23:12:14.799078] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-25T23:12:17.214528] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-25T23:12:17.225831] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-25T23:12:19.846614] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-25T23:12:19.857887] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-25T23:12:20.586562] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T23:12:20.596322] [INFO ] [REMOTE ] LLY: Full fetch complete (77201 records). [2025-10-25T23:12:20.596557] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-25T23:12:20.984450] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-25T23:12:20.984571] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-25T23:12:20.985633] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-25T23:12:20.985763] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-25T23:12:20.987199] [DEBUG] [LOCAL ] LLY: Trimmed 77201 records to 53960 (keeping 200 days of data) [2025-10-25T23:12:21.314917] [DEBUG] [LOCAL ] LLY: Primary data saved (53960 records). [2025-10-25T23:12:21.315092] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-25T23:12:21.315258] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols. LLY took 25.0s. Estimated remaining time: 3h 43m 49s [2025-10-25T23:12:21.482134] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:12:21.482329] [DEBUG] [LOCAL ] LMND: No existing data file found in primary storage. [2025-10-25T23:12:21.482413] [WARN ] [MAIN ] LMND: No existing data found, performing full refresh instead. [2025-10-25T23:12:21.482536] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-25T23:12:21.482606] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-25T23:12:21.482706] [DEBUG] [LOCAL ] LMND: No primary data file found to delete. [2025-10-25T23:12:21.482780] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-25T23:12:21.839381] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:12:21.839820] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-25T23:12:23.617141] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-25T23:12:23.630059] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-25T23:12:25.511014] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-25T23:12:25.521180] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-25T23:12:27.402377] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-25T23:12:27.413539] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-25T23:12:29.089598] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-25T23:12:29.100264] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-25T23:12:30.966805] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-25T23:12:30.977505] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-25T23:12:32.861050] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-25T23:12:32.871856] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-25T23:12:34.811385] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-25T23:12:34.822672] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-25T23:12:36.931389] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-25T23:12:36.942420] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-25T23:12:38.884685] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-25T23:12:38.896033] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-25T23:12:40.976694] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-25T23:12:40.987113] [INFO ] [REMOTE ] LMND: Full fetch complete (75480 records). [2025-10-25T23:12:40.987267] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-25T23:12:41.423603] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-25T23:12:41.423779] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-25T23:12:41.425197] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-25T23:12:41.425303] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-25T23:12:41.427295] [DEBUG] [LOCAL ] LMND: Trimmed 75480 records to 52880 (keeping 200 days of data) [2025-10-25T23:12:41.785333] [DEBUG] [LOCAL ] LMND: Primary data saved (52880 records). [2025-10-25T23:12:41.785534] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-25T23:12:41.785704] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols. LMND took 20.5s. Estimated remaining time: 3h 43m 44s [2025-10-25T23:12:41.969710] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:12:41.969905] [DEBUG] [LOCAL ] LMT: No existing data file found in primary storage. [2025-10-25T23:12:41.969978] [WARN ] [MAIN ] LMT: No existing data found, performing full refresh instead. [2025-10-25T23:12:41.970122] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-25T23:12:41.970203] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-25T23:12:41.970267] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-10-25T23:12:41.970353] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-25T23:12:42.365411] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:12:42.365802] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-25T23:12:44.351116] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-25T23:12:44.360820] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-25T23:12:46.532797] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-25T23:12:46.542385] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-25T23:12:48.752412] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-25T23:12:48.763075] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-25T23:12:50.962432] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-25T23:12:50.974426] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-25T23:12:52.886810] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-25T23:12:52.896663] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-25T23:12:55.277407] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-25T23:12:55.288296] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-25T23:12:57.733573] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-25T23:12:57.745855] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-25T23:12:59.824230] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-25T23:12:59.835030] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-25T23:13:01.982413] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-25T23:13:01.995231] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-25T23:13:02.795383] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T23:13:02.804255] [INFO ] [REMOTE ] LMT: Full fetch complete (72552 records). [2025-10-25T23:13:02.804427] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-25T23:13:03.186943] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-25T23:13:03.187066] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-25T23:13:03.188602] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-25T23:13:03.188709] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-25T23:13:03.190236] [DEBUG] [LOCAL ] LMT: Trimmed 72552 records to 50333 (keeping 200 days of data) [2025-10-25T23:13:03.500292] [DEBUG] [LOCAL ] LMT: Primary data saved (50333 records). [2025-10-25T23:13:03.500498] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-25T23:13:03.500669] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols. LMT took 21.7s. Estimated remaining time: 3h 43m 41s [2025-10-25T23:13:03.667042] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:13:03.667301] [DEBUG] [LOCAL ] LNC: No existing data file found in primary storage. [2025-10-25T23:13:03.667378] [WARN ] [MAIN ] LNC: No existing data found, performing full refresh instead. [2025-10-25T23:13:03.667494] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-25T23:13:03.667565] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-25T23:13:03.667704] [DEBUG] [LOCAL ] LNC: No primary data file found to delete. [2025-10-25T23:13:03.667776] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-25T23:13:04.033451] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:13:04.033832] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-25T23:13:05.704016] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T23:13:05.713705] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-25T23:13:07.318174] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-25T23:13:07.328817] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-25T23:13:09.024622] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-25T23:13:09.035489] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-25T23:13:10.757004] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T23:13:10.768522] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-25T23:13:12.401980] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-25T23:13:12.412858] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-25T23:13:14.032285] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T23:13:14.042784] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-25T23:13:15.824171] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T23:13:15.837290] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-25T23:13:17.710262] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-25T23:13:17.721950] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-25T23:13:19.538541] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-25T23:13:19.550147] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-25T23:13:21.130551] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-25T23:13:21.140689] [INFO ] [REMOTE ] LNC: Full fetch complete (74546 records). [2025-10-25T23:13:21.140906] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-25T23:13:21.557563] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-25T23:13:21.557845] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-25T23:13:21.559238] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-25T23:13:21.559329] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-25T23:13:21.561449] [DEBUG] [LOCAL ] LNC: Trimmed 74546 records to 52139 (keeping 200 days of data) [2025-10-25T23:13:21.893194] [DEBUG] [LOCAL ] LNC: Primary data saved (52139 records). [2025-10-25T23:13:21.893442] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-25T23:13:21.893709] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols. LNC took 18.4s. Estimated remaining time: 3h 43m 34s [2025-10-25T23:13:22.063349] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:13:22.063683] [DEBUG] [LOCAL ] LND: No existing data file found in primary storage. [2025-10-25T23:13:22.063748] [WARN ] [MAIN ] LND: No existing data found, performing full refresh instead. [2025-10-25T23:13:22.063871] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-25T23:13:22.063943] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-25T23:13:22.063998] [DEBUG] [LOCAL ] LND: No primary data file found to delete. [2025-10-25T23:13:22.064066] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-25T23:13:22.428703] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:13:22.429117] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-25T23:13:23.042682] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T23:13:23.044765] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-25T23:13:23.749167] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T23:13:23.751938] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-25T23:13:24.381294] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T23:13:24.383531] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-25T23:13:25.132088] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T23:13:25.134307] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-25T23:13:25.739842] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-25T23:13:25.741959] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-25T23:13:26.516906] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-25T23:13:26.522437] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-25T23:13:27.216776] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-25T23:13:27.218785] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-25T23:13:27.819084] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-25T23:13:27.821537] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-25T23:13:28.451503] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T23:13:28.453696] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-25T23:13:29.051935] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T23:13:29.053554] [INFO ] [REMOTE ] LND: Full fetch complete (7816 records). [2025-10-25T23:13:29.053694] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-25T23:13:29.424283] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-25T23:13:29.424397] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-25T23:13:29.424695] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-25T23:13:29.424828] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-25T23:13:29.425332] [DEBUG] [LOCAL ] LND: Trimmed 7816 records to 5066 (keeping 200 days of data) [2025-10-25T23:13:29.454381] [DEBUG] [LOCAL ] LND: Primary data saved (5066 records). [2025-10-25T23:13:29.454542] [INFO ] [MAIN ] LND: Full history saved. [2025-10-25T23:13:29.454780] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols. LND took 7.6s. Estimated remaining time: 3h 43m 18s [2025-10-25T23:13:29.628679] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:13:29.628893] [DEBUG] [LOCAL ] LNG: No existing data file found in primary storage. [2025-10-25T23:13:29.628978] [WARN ] [MAIN ] LNG: No existing data found, performing full refresh instead. [2025-10-25T23:13:29.629124] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-25T23:13:29.629214] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-25T23:13:29.629315] [DEBUG] [LOCAL ] LNG: No primary data file found to delete. [2025-10-25T23:13:29.629423] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-25T23:13:29.997029] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:13:29.997388] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-25T23:13:31.908885] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T23:13:31.919095] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-25T23:13:33.845639] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-25T23:13:33.855793] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-25T23:13:35.664366] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T23:13:35.675212] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-25T23:13:37.350847] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-25T23:13:37.361830] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-25T23:13:38.935986] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-25T23:13:38.946972] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-25T23:13:40.754116] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T23:13:40.764513] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-25T23:13:42.835487] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-25T23:13:42.846894] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-25T23:13:44.559441] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T23:13:44.570189] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-25T23:13:46.216339] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-25T23:13:46.227251] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-25T23:13:47.852897] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T23:13:47.861932] [INFO ] [REMOTE ] LNG: Full fetch complete (74682 records). [2025-10-25T23:13:47.862090] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-25T23:13:48.260543] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-25T23:13:48.260683] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-25T23:13:48.261777] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-25T23:13:48.261859] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-25T23:13:48.263293] [DEBUG] [LOCAL ] LNG: Trimmed 74682 records to 51798 (keeping 200 days of data) [2025-10-25T23:13:48.579450] [DEBUG] [LOCAL ] LNG: Primary data saved (51798 records). [2025-10-25T23:13:48.579628] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-25T23:13:48.579792] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols. LNG took 19.1s. Estimated remaining time: 3h 43m 12s [2025-10-25T23:13:48.754912] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:13:48.755141] [DEBUG] [LOCAL ] LNN: No existing data file found in primary storage. [2025-10-25T23:13:48.755212] [WARN ] [MAIN ] LNN: No existing data found, performing full refresh instead. [2025-10-25T23:13:48.755335] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-25T23:13:48.755414] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-25T23:13:48.755497] [DEBUG] [LOCAL ] LNN: No primary data file found to delete. [2025-10-25T23:13:48.755567] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-25T23:13:49.131961] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:13:49.132426] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-25T23:13:49.925064] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-25T23:13:49.927863] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-25T23:13:50.738843] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-25T23:13:50.741457] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-25T23:13:51.454506] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T23:13:51.457370] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-25T23:13:52.528710] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T23:13:52.532468] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-25T23:13:53.281784] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-25T23:13:53.284431] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-25T23:13:54.241763] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T23:13:54.245763] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-25T23:13:55.177980] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T23:13:55.182487] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-25T23:13:56.018968] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-25T23:13:56.021884] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-25T23:13:56.634336] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T23:13:56.637413] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-25T23:13:57.233221] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T23:13:57.236866] [INFO ] [REMOTE ] LNN: Full fetch complete (16294 records). [2025-10-25T23:13:57.236996] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-25T23:13:57.726725] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-25T23:13:57.726883] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-25T23:13:57.727444] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-25T23:13:57.727521] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-25T23:13:57.728312] [DEBUG] [LOCAL ] LNN: Trimmed 16294 records to 11861 (keeping 200 days of data) [2025-10-25T23:13:57.808194] [DEBUG] [LOCAL ] LNN: Primary data saved (11861 records). [2025-10-25T23:13:57.808433] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-25T23:13:57.808630] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols. LNN took 9.2s. Estimated remaining time: 3h 42m 57s [2025-10-25T23:13:57.984596] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:13:57.984872] [DEBUG] [LOCAL ] LOAR: No existing data file found in primary storage. [2025-10-25T23:13:57.984946] [WARN ] [MAIN ] LOAR: No existing data found, performing full refresh instead. [2025-10-25T23:13:57.985089] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-25T23:13:57.985169] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-25T23:13:57.985262] [DEBUG] [LOCAL ] LOAR: No primary data file found to delete. [2025-10-25T23:13:57.985342] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-25T23:13:58.355293] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:13:58.355851] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-25T23:13:59.603235] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-25T23:13:59.609916] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-25T23:14:00.984479] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T23:14:00.991688] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-25T23:14:03.002479] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-25T23:14:03.013724] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-25T23:14:04.514413] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T23:14:04.523192] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-25T23:14:06.302753] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-25T23:14:06.312794] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-25T23:14:07.781881] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-25T23:14:07.790939] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-25T23:14:09.156707] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T23:14:09.165567] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-25T23:14:10.597989] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T23:14:10.612475] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-25T23:14:12.036155] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T23:14:12.044561] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-25T23:14:13.515950] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T23:14:13.522826] [INFO ] [REMOTE ] LOAR: Full fetch complete (56051 records). [2025-10-25T23:14:13.522967] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-25T23:14:13.916739] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-25T23:14:13.916877] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-25T23:14:13.917860] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-25T23:14:13.917943] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-25T23:14:13.919172] [DEBUG] [LOCAL ] LOAR: Trimmed 56051 records to 42569 (keeping 200 days of data) [2025-10-25T23:14:14.164582] [DEBUG] [LOCAL ] LOAR: Primary data saved (42569 records). [2025-10-25T23:14:14.164759] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-25T23:14:14.164906] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols. LOAR took 16.4s. Estimated remaining time: 3h 42m 49s [2025-10-25T23:14:14.332070] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:14:14.332279] [DEBUG] [LOCAL ] LOB: No existing data file found in primary storage. [2025-10-25T23:14:14.332351] [WARN ] [MAIN ] LOB: No existing data found, performing full refresh instead. [2025-10-25T23:14:14.332468] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-25T23:14:14.332541] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-25T23:14:14.332623] [DEBUG] [LOCAL ] LOB: No primary data file found to delete. [2025-10-25T23:14:14.332728] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-25T23:14:14.703892] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:14:14.704378] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-25T23:14:15.775521] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T23:14:15.781167] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-25T23:14:16.864088] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T23:14:16.869040] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-25T23:14:18.075554] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-25T23:14:18.082155] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-25T23:14:19.562824] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-25T23:14:19.573946] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-25T23:14:20.688772] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T23:14:20.694607] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-25T23:14:21.864582] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T23:14:21.870303] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-25T23:14:22.797751] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T23:14:22.803925] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-25T23:14:23.710339] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T23:14:23.716220] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-25T23:14:24.954499] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-25T23:14:24.962471] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-25T23:14:26.051415] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-25T23:14:26.056573] [INFO ] [REMOTE ] LOB: Full fetch complete (38768 records). [2025-10-25T23:14:26.056884] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-25T23:14:26.421331] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-25T23:14:26.421442] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-25T23:14:26.422111] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-25T23:14:26.422190] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-25T23:14:26.423052] [DEBUG] [LOCAL ] LOB: Trimmed 38768 records to 27102 (keeping 200 days of data) [2025-10-25T23:14:26.576510] [DEBUG] [LOCAL ] LOB: Primary data saved (27102 records). [2025-10-25T23:14:26.576685] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-25T23:14:26.576834] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols. LOB took 12.4s. Estimated remaining time: 3h 42m 37s [2025-10-25T23:14:26.753097] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:14:26.753289] [DEBUG] [LOCAL ] LOCL: No existing data file found in primary storage. [2025-10-25T23:14:26.753361] [WARN ] [MAIN ] LOCL: No existing data found, performing full refresh instead. [2025-10-25T23:14:26.753473] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-25T23:14:26.753544] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-25T23:14:26.753626] [DEBUG] [LOCAL ] LOCL: No primary data file found to delete. [2025-10-25T23:14:26.753714] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-25T23:14:27.100049] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:14:27.100374] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-25T23:14:27.544505] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-25T23:14:27.545598] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-25T23:14:27.943269] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-25T23:14:27.944295] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-25T23:14:28.425690] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-25T23:14:28.427149] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-25T23:14:29.203113] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-25T23:14:29.205737] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-25T23:14:29.643538] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-25T23:14:29.644669] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-25T23:14:30.026599] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-25T23:14:30.028381] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-25T23:14:30.622768] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-25T23:14:30.624208] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-25T23:14:31.120582] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-25T23:14:31.121983] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-25T23:14:31.766362] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-25T23:14:31.768210] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-25T23:14:32.356743] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T23:14:32.358004] [INFO ] [REMOTE ] LOCL: Full fetch complete (4535 records). [2025-10-25T23:14:32.358093] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-25T23:14:32.728566] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-25T23:14:32.728713] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-25T23:14:32.728899] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-25T23:14:32.728974] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-25T23:14:32.729416] [DEBUG] [LOCAL ] LOCL: Trimmed 4535 records to 3535 (keeping 200 days of data) [2025-10-25T23:14:32.749419] [DEBUG] [LOCAL ] LOCL: Primary data saved (3535 records). [2025-10-25T23:14:32.749551] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-25T23:14:32.749716] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols. LOCL took 6.2s. Estimated remaining time: 3h 42m 19s [2025-10-25T23:14:32.931993] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:14:32.932181] [DEBUG] [LOCAL ] LOMA: No existing data file found in primary storage. [2025-10-25T23:14:32.932252] [WARN ] [MAIN ] LOMA: No existing data found, performing full refresh instead. [2025-10-25T23:14:32.932361] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-25T23:14:32.932431] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-25T23:14:32.932510] [DEBUG] [LOCAL ] LOMA: No primary data file found to delete. [2025-10-25T23:14:32.932562] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-25T23:14:33.301074] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:14:33.301428] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-25T23:14:34.564582] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T23:14:34.572304] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-25T23:14:35.808396] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T23:14:35.814957] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-25T23:14:36.781256] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T23:14:36.788065] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-25T23:14:37.992579] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T23:14:37.999445] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-25T23:14:39.522343] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T23:14:39.529425] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-25T23:14:40.648409] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-25T23:14:40.654532] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-25T23:14:41.848596] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-25T23:14:41.855264] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-25T23:14:43.150935] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-25T23:14:43.158255] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-25T23:14:44.600370] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T23:14:44.609777] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-25T23:14:45.965389] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T23:14:45.972395] [INFO ] [REMOTE ] LOMA: Full fetch complete (47850 records). [2025-10-25T23:14:45.972575] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-25T23:14:46.360455] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-25T23:14:46.360594] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-25T23:14:46.361414] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-25T23:14:46.361491] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-25T23:14:46.362497] [DEBUG] [LOCAL ] LOMA: Trimmed 47850 records to 33310 (keeping 200 days of data) [2025-10-25T23:14:46.549843] [DEBUG] [LOCAL ] LOMA: Primary data saved (33310 records). [2025-10-25T23:14:46.550027] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-25T23:14:46.550174] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols. LOMA took 13.8s. Estimated remaining time: 3h 42m 9s [2025-10-25T23:14:46.719788] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:14:46.720014] [DEBUG] [LOCAL ] LOW: No existing data file found in primary storage. [2025-10-25T23:14:46.720084] [WARN ] [MAIN ] LOW: No existing data found, performing full refresh instead. [2025-10-25T23:14:46.720192] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-25T23:14:46.720269] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-25T23:14:46.720328] [DEBUG] [LOCAL ] LOW: No primary data file found to delete. [2025-10-25T23:14:46.720389] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-25T23:14:47.073449] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:14:47.073829] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-25T23:14:48.989827] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T23:14:49.001186] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-25T23:14:50.647165] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T23:14:50.657280] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-25T23:14:52.547515] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-25T23:14:52.558609] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-25T23:14:54.524536] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-25T23:14:54.535780] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-25T23:14:56.487827] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-25T23:14:56.499449] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-25T23:14:58.261320] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T23:14:58.272001] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-25T23:15:00.379689] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-25T23:15:00.391158] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-25T23:15:02.711129] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-25T23:15:02.723129] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-25T23:15:04.914203] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-25T23:15:04.927557] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-25T23:15:05.724018] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T23:15:05.734901] [INFO ] [REMOTE ] LOW: Full fetch complete (76717 records). [2025-10-25T23:15:05.735149] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-25T23:15:06.156779] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-25T23:15:06.156896] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-25T23:15:06.157984] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-25T23:15:06.158067] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-25T23:15:06.159528] [DEBUG] [LOCAL ] LOW: Trimmed 76717 records to 53735 (keeping 200 days of data) [2025-10-25T23:15:06.486238] [DEBUG] [LOCAL ] LOW: Primary data saved (53735 records). [2025-10-25T23:15:06.486396] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-25T23:15:06.486541] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols. LOW took 19.9s. Estimated remaining time: 3h 42m 3s [2025-10-25T23:15:06.651393] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:15:06.651567] [DEBUG] [LOCAL ] LPG: No existing data file found in primary storage. [2025-10-25T23:15:06.651637] [WARN ] [MAIN ] LPG: No existing data found, performing full refresh instead. [2025-10-25T23:15:06.651765] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-25T23:15:06.651832] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-25T23:15:06.651900] [DEBUG] [LOCAL ] LPG: No primary data file found to delete. [2025-10-25T23:15:06.651964] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-25T23:15:07.001374] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:15:07.001778] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-25T23:15:08.474161] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-25T23:15:08.482951] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-25T23:15:09.963414] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T23:15:09.972079] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-25T23:15:11.406121] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-25T23:15:11.415085] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-25T23:15:13.035752] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-25T23:15:13.044825] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-25T23:15:14.525833] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-25T23:15:14.534963] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-25T23:15:15.881798] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T23:15:15.890489] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-25T23:15:17.459031] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T23:15:17.467589] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-25T23:15:18.954549] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-25T23:15:18.962948] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-25T23:15:20.444479] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T23:15:20.452510] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-25T23:15:21.728313] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T23:15:21.734793] [INFO ] [REMOTE ] LPG: Full fetch complete (58685 records). [2025-10-25T23:15:21.734955] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-25T23:15:22.126807] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-25T23:15:22.126974] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-25T23:15:22.127900] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-25T23:15:22.127980] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-25T23:15:22.129183] [DEBUG] [LOCAL ] LPG: Trimmed 58685 records to 39709 (keeping 200 days of data) [2025-10-25T23:15:22.359766] [DEBUG] [LOCAL ] LPG: Primary data saved (39709 records). [2025-10-25T23:15:22.359937] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-25T23:15:22.360066] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols. LPG took 15.9s. Estimated remaining time: 3h 41m 54s [2025-10-25T23:15:22.531428] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:15:22.531638] [DEBUG] [LOCAL ] LPL: No existing data file found in primary storage. [2025-10-25T23:15:22.531733] [WARN ] [MAIN ] LPL: No existing data found, performing full refresh instead. [2025-10-25T23:15:22.531824] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-25T23:15:22.531891] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-25T23:15:22.531972] [DEBUG] [LOCAL ] LPL: No primary data file found to delete. [2025-10-25T23:15:22.532043] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-25T23:15:22.886073] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:15:22.886409] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-25T23:15:23.903217] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T23:15:23.907554] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-25T23:15:24.992293] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T23:15:24.998598] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-25T23:15:26.187531] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T23:15:26.191795] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-25T23:15:27.304218] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-25T23:15:27.310208] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-25T23:15:28.358998] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-25T23:15:28.363228] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-25T23:15:29.082844] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T23:15:29.089186] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-25T23:15:30.009059] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-25T23:15:30.015014] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-25T23:15:31.620274] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T23:15:31.628466] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-25T23:15:33.149804] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T23:15:33.158188] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-25T23:15:34.578019] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T23:15:34.585850] [INFO ] [REMOTE ] LPL: Full fetch complete (37852 records). [2025-10-25T23:15:34.586021] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-25T23:15:34.952817] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-25T23:15:34.952979] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-25T23:15:34.953743] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-25T23:15:34.953823] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-25T23:15:34.954742] [DEBUG] [LOCAL ] LPL: Trimmed 37852 records to 29601 (keeping 200 days of data) [2025-10-25T23:15:35.118111] [DEBUG] [LOCAL ] LPL: Primary data saved (29601 records). [2025-10-25T23:15:35.118335] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-25T23:15:35.118492] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols. LPL took 12.8s. Estimated remaining time: 3h 41m 43s [2025-10-25T23:15:35.286186] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:15:35.286401] [DEBUG] [LOCAL ] LPX: No existing data file found in primary storage. [2025-10-25T23:15:35.286472] [WARN ] [MAIN ] LPX: No existing data found, performing full refresh instead. [2025-10-25T23:15:35.286589] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-25T23:15:35.286681] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-25T23:15:35.286764] [DEBUG] [LOCAL ] LPX: No primary data file found to delete. [2025-10-25T23:15:35.286835] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-25T23:15:35.648031] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:15:35.648375] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-25T23:15:37.445098] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T23:15:37.453545] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-25T23:15:39.030585] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T23:15:39.038852] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-25T23:15:40.499356] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T23:15:40.507884] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-25T23:15:42.005033] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T23:15:42.013269] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-25T23:15:43.392930] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-25T23:15:43.401611] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-25T23:15:44.815905] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T23:15:44.824489] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-25T23:15:46.230328] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-25T23:15:46.239048] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-25T23:15:47.802933] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:15:47.812393] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-25T23:15:49.212047] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T23:15:49.221201] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-25T23:15:50.709629] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-25T23:15:50.717289] [INFO ] [REMOTE ] LPX: Full fetch complete (58724 records). [2025-10-25T23:15:50.717425] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-25T23:15:51.095015] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-25T23:15:51.095151] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-25T23:15:51.096171] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-25T23:15:51.096268] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-25T23:15:51.097467] [DEBUG] [LOCAL ] LPX: Trimmed 58724 records to 40685 (keeping 200 days of data) [2025-10-25T23:15:51.336882] [DEBUG] [LOCAL ] LPX: Primary data saved (40685 records). [2025-10-25T23:15:51.337055] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-25T23:15:51.337226] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols. LPX took 16.2s. Estimated remaining time: 3h 41m 34s [2025-10-25T23:15:51.505963] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:15:51.506191] [DEBUG] [LOCAL ] LRN: No existing data file found in primary storage. [2025-10-25T23:15:51.506287] [WARN ] [MAIN ] LRN: No existing data found, performing full refresh instead. [2025-10-25T23:15:51.506437] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-25T23:15:51.506524] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-25T23:15:51.506633] [DEBUG] [LOCAL ] LRN: No primary data file found to delete. [2025-10-25T23:15:51.506745] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-25T23:15:51.869078] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:15:51.869411] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-25T23:15:53.542257] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T23:15:53.551376] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-25T23:15:55.178039] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T23:15:55.185932] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-25T23:15:56.677064] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T23:15:56.685620] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-25T23:15:58.000236] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T23:15:58.009312] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-25T23:15:59.630889] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T23:15:59.642765] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-25T23:16:01.449528] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-25T23:16:01.458111] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-25T23:16:03.425603] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-25T23:16:03.433909] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-25T23:16:04.992333] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:16:05.005366] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-25T23:16:06.670970] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T23:16:06.679899] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-25T23:16:08.080906] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-25T23:16:08.087917] [INFO ] [REMOTE ] LRN: Full fetch complete (58132 records). [2025-10-25T23:16:08.088103] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-25T23:16:08.494058] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-25T23:16:08.494277] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-25T23:16:08.496869] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-25T23:16:08.497005] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-25T23:16:08.499113] [DEBUG] [LOCAL ] LRN: Trimmed 58132 records to 39785 (keeping 200 days of data) [2025-10-25T23:16:08.778606] [DEBUG] [LOCAL ] LRN: Primary data saved (39785 records). [2025-10-25T23:16:08.778922] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-25T23:16:08.779159] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols. LRN took 17.4s. Estimated remaining time: 3h 41m 26s [2025-10-25T23:16:08.955550] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:16:08.955793] [DEBUG] [LOCAL ] LSPD: No existing data file found in primary storage. [2025-10-25T23:16:08.955866] [WARN ] [MAIN ] LSPD: No existing data found, performing full refresh instead. [2025-10-25T23:16:08.955979] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-25T23:16:08.956049] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-25T23:16:08.956134] [DEBUG] [LOCAL ] LSPD: No primary data file found to delete. [2025-10-25T23:16:08.956204] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-25T23:16:09.304994] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:16:09.305356] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-25T23:16:10.715121] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T23:16:10.722457] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-25T23:16:12.254779] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T23:16:12.264060] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-25T23:16:13.863880] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-25T23:16:13.874160] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-25T23:16:15.470859] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T23:16:15.481634] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-25T23:16:17.222492] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-25T23:16:17.231419] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-25T23:16:18.679272] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-25T23:16:18.688527] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-25T23:16:20.067631] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T23:16:20.076635] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-25T23:16:21.589260] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-25T23:16:21.597596] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-25T23:16:22.930553] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T23:16:22.941886] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-25T23:16:24.639183] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-25T23:16:24.647209] [INFO ] [REMOTE ] LSPD: Full fetch complete (62405 records). [2025-10-25T23:16:24.647363] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-25T23:16:25.035931] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-25T23:16:25.036046] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-25T23:16:25.036995] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-25T23:16:25.037084] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-25T23:16:25.038397] [DEBUG] [LOCAL ] LSPD: Trimmed 62405 records to 42896 (keeping 200 days of data) [2025-10-25T23:16:25.276857] [DEBUG] [LOCAL ] LSPD: Primary data saved (42896 records). [2025-10-25T23:16:25.277037] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-25T23:16:25.277193] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols. LSPD took 16.5s. Estimated remaining time: 3h 41m 18s [2025-10-25T23:16:25.445581] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:16:25.445785] [DEBUG] [LOCAL ] LTC: No existing data file found in primary storage. [2025-10-25T23:16:25.445855] [WARN ] [MAIN ] LTC: No existing data found, performing full refresh instead. [2025-10-25T23:16:25.445969] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-25T23:16:25.446046] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-25T23:16:25.446144] [DEBUG] [LOCAL ] LTC: No primary data file found to delete. [2025-10-25T23:16:25.446217] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-25T23:16:25.796069] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:16:25.796382] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-25T23:16:27.170435] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-25T23:16:27.176474] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-25T23:16:28.385595] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-25T23:16:28.391583] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-25T23:16:29.631984] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T23:16:29.638218] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-25T23:16:30.913687] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T23:16:30.920212] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-25T23:16:32.393966] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-25T23:16:32.400786] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-25T23:16:33.691088] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T23:16:33.697371] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-25T23:16:35.047061] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T23:16:35.054513] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-25T23:16:36.381967] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-25T23:16:36.389045] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-25T23:16:37.801455] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-25T23:16:37.808487] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-25T23:16:39.211270] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-25T23:16:39.217330] [INFO ] [REMOTE ] LTC: Full fetch complete (43890 records). [2025-10-25T23:16:39.217476] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-25T23:16:39.639430] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-25T23:16:39.639555] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-25T23:16:39.640471] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-25T23:16:39.640577] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-25T23:16:39.641836] [DEBUG] [LOCAL ] LTC: Trimmed 43890 records to 31075 (keeping 200 days of data) [2025-10-25T23:16:39.829249] [DEBUG] [LOCAL ] LTC: Primary data saved (31075 records). [2025-10-25T23:16:39.829420] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-25T23:16:39.829573] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols. LTC took 14.6s. Estimated remaining time: 3h 41m 8s [2025-10-25T23:16:39.999381] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:16:39.999664] [DEBUG] [LOCAL ] LTH: No existing data file found in primary storage. [2025-10-25T23:16:39.999739] [WARN ] [MAIN ] LTH: No existing data found, performing full refresh instead. [2025-10-25T23:16:39.999853] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-25T23:16:39.999926] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-25T23:16:40.000008] [DEBUG] [LOCAL ] LTH: No primary data file found to delete. [2025-10-25T23:16:40.000079] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-25T23:16:40.358525] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:16:40.358915] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-25T23:16:41.848989] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-25T23:16:41.858707] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-25T23:16:43.482926] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T23:16:43.492878] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-25T23:16:45.023953] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T23:16:45.035546] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-25T23:16:46.884449] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T23:16:46.895351] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-25T23:16:48.576535] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T23:16:48.588321] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-25T23:16:50.208292] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-25T23:16:50.221295] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-25T23:16:51.875290] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T23:16:51.888085] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-25T23:16:53.421791] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-25T23:16:53.432464] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-25T23:16:55.178455] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-25T23:16:55.189440] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-25T23:16:56.799285] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T23:16:56.808478] [INFO ] [REMOTE ] LTH: Full fetch complete (74745 records). [2025-10-25T23:16:56.808635] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-25T23:16:57.192220] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-25T23:16:57.192349] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-25T23:16:57.193398] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-25T23:16:57.193477] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-25T23:16:57.194867] [DEBUG] [LOCAL ] LTH: Trimmed 74745 records to 52315 (keeping 200 days of data) [2025-10-25T23:16:57.480055] [DEBUG] [LOCAL ] LTH: Primary data saved (52315 records). [2025-10-25T23:16:57.480209] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-25T23:16:57.480358] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols. LTH took 17.7s. Estimated remaining time: 3h 41m 0s [2025-10-25T23:16:57.648165] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:16:57.648379] [DEBUG] [LOCAL ] LTM: No existing data file found in primary storage. [2025-10-25T23:16:57.648452] [WARN ] [MAIN ] LTM: No existing data found, performing full refresh instead. [2025-10-25T23:16:57.648570] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-25T23:16:57.648639] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-25T23:16:57.648738] [DEBUG] [LOCAL ] LTM: No primary data file found to delete. [2025-10-25T23:16:57.648805] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-25T23:16:58.003509] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:16:58.003883] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-25T23:16:59.076793] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T23:16:59.081689] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-25T23:17:00.237267] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T23:17:00.242742] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-25T23:17:01.560181] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T23:17:01.566872] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-25T23:17:03.974155] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-25T23:17:03.980999] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-25T23:17:06.545322] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-25T23:17:06.552464] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-25T23:17:07.946009] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T23:17:07.953499] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-25T23:17:09.353288] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-25T23:17:09.361591] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-25T23:17:10.928367] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T23:17:10.937895] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-25T23:17:12.581059] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T23:17:12.591531] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-25T23:17:14.278052] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T23:17:14.286721] [INFO ] [REMOTE ] LTM: Full fetch complete (51735 records). [2025-10-25T23:17:14.286866] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-25T23:17:14.669631] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-25T23:17:14.669789] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-25T23:17:14.670755] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-25T23:17:14.670857] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-25T23:17:14.672048] [DEBUG] [LOCAL ] LTM: Trimmed 51735 records to 39877 (keeping 200 days of data) [2025-10-25T23:17:14.893994] [DEBUG] [LOCAL ] LTM: Primary data saved (39877 records). [2025-10-25T23:17:14.894180] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-25T23:17:14.894350] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols. LTM took 17.4s. Estimated remaining time: 3h 40m 52s [2025-10-25T23:17:15.061780] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:17:15.061996] [DEBUG] [LOCAL ] LU: No existing data file found in primary storage. [2025-10-25T23:17:15.062084] [WARN ] [MAIN ] LU: No existing data found, performing full refresh instead. [2025-10-25T23:17:15.062230] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-25T23:17:15.062323] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-25T23:17:15.062439] [DEBUG] [LOCAL ] LU: No primary data file found to delete. [2025-10-25T23:17:15.062549] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-25T23:17:15.409969] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:17:15.410300] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-25T23:17:17.221561] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T23:17:17.230979] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-25T23:17:18.845914] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T23:17:18.855166] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-25T23:17:20.566777] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T23:17:20.579219] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-25T23:17:21.994498] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-25T23:17:22.004828] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-25T23:17:23.653886] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T23:17:23.664475] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-25T23:17:25.140328] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T23:17:25.150806] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-25T23:17:26.697713] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-25T23:17:26.708490] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-25T23:17:28.260304] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-25T23:17:28.270401] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-25T23:17:29.926333] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-25T23:17:29.937026] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-25T23:17:31.503795] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T23:17:31.512669] [INFO ] [REMOTE ] LU: Full fetch complete (70934 records). [2025-10-25T23:17:31.512807] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-25T23:17:31.895335] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-25T23:17:31.895477] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-25T23:17:31.896690] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-25T23:17:31.896771] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-25T23:17:31.898401] [DEBUG] [LOCAL ] LU: Trimmed 70934 records to 49888 (keeping 200 days of data) [2025-10-25T23:17:32.164740] [DEBUG] [LOCAL ] LU: Primary data saved (49888 records). [2025-10-25T23:17:32.164919] [INFO ] [MAIN ] LU: Full history saved. [2025-10-25T23:17:32.165078] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols. LU took 17.3s. Estimated remaining time: 3h 40m 45s [2025-10-25T23:17:32.336164] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:17:32.336353] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-10-25T23:17:32.336425] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-10-25T23:17:32.336538] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-25T23:17:32.336610] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-25T23:17:32.336716] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-10-25T23:17:32.336789] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-25T23:17:32.689257] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:17:32.689609] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-25T23:17:34.009154] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-25T23:17:34.017115] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-25T23:17:35.236944] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-25T23:17:35.244210] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-25T23:17:36.500356] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-25T23:17:36.506706] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-25T23:17:37.789533] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T23:17:37.795872] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-25T23:17:38.949357] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-25T23:17:38.955946] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-25T23:17:40.127475] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-25T23:17:40.133551] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-25T23:17:40.978578] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T23:17:40.984481] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-25T23:17:42.045514] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T23:17:42.049717] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-25T23:17:43.120350] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-25T23:17:43.126192] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-25T23:17:44.160864] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T23:17:44.164583] [INFO ] [REMOTE ] LUCK: Full fetch complete (38988 records). [2025-10-25T23:17:44.164720] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-25T23:17:44.565336] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-25T23:17:44.565469] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-25T23:17:44.566325] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-25T23:17:44.566410] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-25T23:17:44.567404] [DEBUG] [LOCAL ] LUCK: Trimmed 38988 records to 24073 (keeping 200 days of data) [2025-10-25T23:17:44.705072] [DEBUG] [LOCAL ] LUCK: Primary data saved (24073 records). [2025-10-25T23:17:44.705226] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-25T23:17:44.705374] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols. LUCK took 12.5s. Estimated remaining time: 3h 40m 33s [2025-10-25T23:17:44.876416] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:17:44.876669] [DEBUG] [LOCAL ] LUMN: No existing data file found in primary storage. [2025-10-25T23:17:44.876733] [WARN ] [MAIN ] LUMN: No existing data found, performing full refresh instead. [2025-10-25T23:17:44.876811] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-25T23:17:44.876882] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-25T23:17:44.876967] [DEBUG] [LOCAL ] LUMN: No primary data file found to delete. [2025-10-25T23:17:44.877036] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-25T23:17:45.230860] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:17:45.231203] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-25T23:17:47.048977] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T23:17:47.060573] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-25T23:17:48.375026] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-25T23:17:48.386008] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-25T23:17:50.189586] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T23:17:50.200704] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-25T23:17:52.104414] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-25T23:17:52.115806] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-25T23:17:54.114964] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-25T23:17:54.126186] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-25T23:17:56.053819] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-25T23:17:56.064841] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-25T23:17:58.160227] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-25T23:17:58.172397] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-25T23:18:00.231204] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-25T23:18:00.243086] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-25T23:18:02.493574] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-25T23:18:02.506750] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-25T23:18:04.577421] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-25T23:18:04.588112] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-25T23:18:04.588357] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-25T23:18:04.988965] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-25T23:18:04.989143] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-25T23:18:04.990933] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-25T23:18:04.991034] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-25T23:18:04.993321] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 54425 (keeping 200 days of data) [2025-10-25T23:18:05.318943] [DEBUG] [LOCAL ] LUMN: Primary data saved (54425 records). [2025-10-25T23:18:05.319179] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-25T23:18:05.319443] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols. LUMN took 20.6s. Estimated remaining time: 3h 40m 28s [2025-10-25T23:18:05.502048] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:18:05.502346] [DEBUG] [LOCAL ] LUV: No existing data file found in primary storage. [2025-10-25T23:18:05.502424] [WARN ] [MAIN ] LUV: No existing data found, performing full refresh instead. [2025-10-25T23:18:05.502558] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-25T23:18:05.502632] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-25T23:18:05.502741] [DEBUG] [LOCAL ] LUV: No primary data file found to delete. [2025-10-25T23:18:05.502817] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-25T23:18:05.864030] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:18:05.864500] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-25T23:18:07.983458] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-25T23:18:07.994220] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-25T23:18:09.758849] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T23:18:09.769201] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-25T23:18:11.844261] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-25T23:18:11.855350] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-25T23:18:13.861838] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-25T23:18:13.873161] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-25T23:18:15.728448] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-25T23:18:15.739878] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-25T23:18:17.488818] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T23:18:17.500236] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-25T23:18:19.780638] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-25T23:18:19.792119] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-25T23:18:21.872005] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-25T23:18:21.883504] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-25T23:18:23.668550] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T23:18:23.679989] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-25T23:18:24.390881] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T23:18:24.401045] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-25T23:18:24.401245] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-25T23:18:24.800186] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-25T23:18:24.800307] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-25T23:18:24.801473] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-25T23:18:24.801575] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-25T23:18:24.803225] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 54469 (keeping 200 days of data) [2025-10-25T23:18:25.127792] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-10-25T23:18:25.127980] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-25T23:18:25.128214] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols. LUV took 19.8s. Estimated remaining time: 3h 40m 22s [2025-10-25T23:18:25.301474] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:18:25.301619] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-25T23:18:25.301701] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-25T23:18:25.301811] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-25T23:18:25.301883] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-25T23:18:25.301972] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-25T23:18:25.302043] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-25T23:18:25.661637] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:18:25.662034] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-25T23:18:25.880050] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:18:25.880456] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-25T23:18:25.880575] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:18:25.880706] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-25T23:18:25.880793] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:18:25.880889] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-25T23:18:25.881032] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-25T23:18:25.881114] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-25T23:18:25.881221] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-25T23:18:25.881410] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols. LUXE took 0.8s. Estimated remaining time: 3h 40m 0s [2025-10-25T23:18:26.052083] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:18:26.052289] [DEBUG] [LOCAL ] LVS: No existing data file found in primary storage. [2025-10-25T23:18:26.052362] [WARN ] [MAIN ] LVS: No existing data found, performing full refresh instead. [2025-10-25T23:18:26.052480] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-25T23:18:26.052549] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-25T23:18:26.052631] [DEBUG] [LOCAL ] LVS: No primary data file found to delete. [2025-10-25T23:18:26.052721] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-25T23:18:26.404234] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:18:26.404550] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-25T23:18:28.131567] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-25T23:18:28.141892] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-25T23:18:30.125816] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-25T23:18:30.136056] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-25T23:18:32.054342] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T23:18:32.065483] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-25T23:18:33.997224] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-25T23:18:34.008971] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-25T23:18:35.831298] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T23:18:35.842530] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-25T23:18:37.538904] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T23:18:37.549844] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-25T23:18:39.577816] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-25T23:18:39.589260] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-25T23:18:41.349993] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-25T23:18:41.361340] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-25T23:18:42.156957] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T23:18:42.168809] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-25T23:18:42.957437] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T23:18:42.967343] [INFO ] [REMOTE ] LVS: Full fetch complete (77725 records). [2025-10-25T23:18:42.967499] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-25T23:18:43.361081] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-25T23:18:43.361223] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-25T23:18:43.362307] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-25T23:18:43.362393] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-25T23:18:43.364031] [DEBUG] [LOCAL ] LVS: Trimmed 77725 records to 54349 (keeping 200 days of data) [2025-10-25T23:18:43.683197] [DEBUG] [LOCAL ] LVS: Primary data saved (54349 records). [2025-10-25T23:18:43.683369] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-25T23:18:43.683537] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols. LVS took 17.8s. Estimated remaining time: 3h 39m 53s [2025-10-25T23:18:43.853817] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:18:43.854045] [DEBUG] [LOCAL ] LVWR: No existing data file found in primary storage. [2025-10-25T23:18:43.854118] [WARN ] [MAIN ] LVWR: No existing data found, performing full refresh instead. [2025-10-25T23:18:43.854234] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-25T23:18:43.854314] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-25T23:18:43.854375] [DEBUG] [LOCAL ] LVWR: No primary data file found to delete. [2025-10-25T23:18:43.854441] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-25T23:18:44.214060] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:18:44.214405] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-25T23:18:44.822559] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T23:18:44.824370] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-25T23:18:45.486768] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-25T23:18:45.488404] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-25T23:18:46.134601] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-25T23:18:46.136127] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-25T23:18:46.800306] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-25T23:18:46.802403] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-25T23:18:48.011164] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T23:18:48.015367] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-25T23:18:49.859130] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-25T23:18:49.868174] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-25T23:18:50.919635] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T23:18:50.924506] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-25T23:18:51.724545] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T23:18:51.728009] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-25T23:18:52.782025] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T23:18:52.786695] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-25T23:18:53.624178] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T23:18:53.628384] [INFO ] [REMOTE ] LVWR: Full fetch complete (20865 records). [2025-10-25T23:18:53.628533] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-25T23:18:54.043465] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-25T23:18:54.043606] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-25T23:18:54.044120] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-25T23:18:54.044198] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-25T23:18:54.044915] [DEBUG] [LOCAL ] LVWR: Trimmed 20865 records to 18752 (keeping 200 days of data) [2025-10-25T23:18:54.147435] [DEBUG] [LOCAL ] LVWR: Primary data saved (18752 records). [2025-10-25T23:18:54.147614] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-25T23:18:54.147815] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols. LVWR took 10.5s. Estimated remaining time: 3h 39m 39s [2025-10-25T23:18:54.315233] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:18:54.315476] [DEBUG] [LOCAL ] LW: No existing data file found in primary storage. [2025-10-25T23:18:54.315550] [WARN ] [MAIN ] LW: No existing data found, performing full refresh instead. [2025-10-25T23:18:54.315691] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-25T23:18:54.315766] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-25T23:18:54.315848] [DEBUG] [LOCAL ] LW: No primary data file found to delete. [2025-10-25T23:18:54.315920] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-25T23:18:54.693627] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:18:54.694051] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-25T23:18:56.358129] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T23:18:56.369544] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-25T23:18:58.042519] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T23:18:58.053258] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-25T23:18:59.882677] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-25T23:18:59.895415] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-25T23:19:02.103703] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-25T23:19:02.114681] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-25T23:19:03.982454] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-25T23:19:03.993424] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-25T23:19:05.757212] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T23:19:05.772784] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-25T23:19:07.746372] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-25T23:19:07.757560] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-25T23:19:09.399271] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-25T23:19:09.409870] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-25T23:19:10.157671] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T23:19:10.168398] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-25T23:19:10.885954] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:19:10.898468] [INFO ] [REMOTE ] LW: Full fetch complete (74763 records). [2025-10-25T23:19:10.898629] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-25T23:19:11.286060] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-25T23:19:11.286185] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-25T23:19:11.287900] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-25T23:19:11.287985] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-25T23:19:11.289537] [DEBUG] [LOCAL ] LW: Trimmed 74763 records to 51910 (keeping 200 days of data) [2025-10-25T23:19:11.596370] [DEBUG] [LOCAL ] LW: Primary data saved (51910 records). [2025-10-25T23:19:11.596541] [INFO ] [MAIN ] LW: Full history saved. [2025-10-25T23:19:11.596712] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols. LW took 17.4s. Estimated remaining time: 3h 39m 31s [2025-10-25T23:19:11.770768] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:19:11.771209] [DEBUG] [LOCAL ] LXFR: No existing data file found in primary storage. [2025-10-25T23:19:11.771285] [WARN ] [MAIN ] LXFR: No existing data found, performing full refresh instead. [2025-10-25T23:19:11.771398] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-25T23:19:11.771518] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-25T23:19:11.771604] [DEBUG] [LOCAL ] LXFR: No primary data file found to delete. [2025-10-25T23:19:11.771696] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-25T23:19:12.124422] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:19:12.124793] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-25T23:19:13.152420] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T23:19:13.156458] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-25T23:19:14.091165] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-25T23:19:14.095264] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-25T23:19:15.173900] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-25T23:19:15.178327] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-25T23:19:16.252417] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T23:19:16.256898] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-25T23:19:17.249606] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T23:19:17.253841] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-25T23:19:18.076602] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-25T23:19:18.081431] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-25T23:19:19.100151] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-25T23:19:19.104771] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-25T23:19:20.143597] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T23:19:20.147885] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-25T23:19:21.109807] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T23:19:21.113458] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-25T23:19:21.924731] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T23:19:21.927627] [INFO ] [REMOTE ] LXFR: Full fetch complete (24629 records). [2025-10-25T23:19:21.927775] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-25T23:19:22.294762] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-25T23:19:22.294884] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-25T23:19:22.295396] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-25T23:19:22.295471] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-25T23:19:22.296136] [DEBUG] [LOCAL ] LXFR: Trimmed 24629 records to 16581 (keeping 200 days of data) [2025-10-25T23:19:22.392769] [DEBUG] [LOCAL ] LXFR: Primary data saved (16581 records). [2025-10-25T23:19:22.392935] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-25T23:19:22.393084] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols. LXFR took 10.8s. Estimated remaining time: 3h 39m 18s [2025-10-25T23:19:22.565428] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:19:22.565616] [DEBUG] [LOCAL ] LXP: No existing data file found in primary storage. [2025-10-25T23:19:22.565711] [WARN ] [MAIN ] LXP: No existing data found, performing full refresh instead. [2025-10-25T23:19:22.565824] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-25T23:19:22.565894] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-25T23:19:22.565976] [DEBUG] [LOCAL ] LXP: No primary data file found to delete. [2025-10-25T23:19:22.566045] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-25T23:19:22.913716] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:19:22.914046] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-25T23:19:24.609760] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T23:19:24.620005] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-25T23:19:25.993173] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T23:19:26.003478] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-25T23:19:27.734182] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-25T23:19:27.744416] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-25T23:19:29.395743] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T23:19:29.409229] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-25T23:19:30.951548] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T23:19:30.962056] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-25T23:19:32.465091] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T23:19:32.475209] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-25T23:19:34.106763] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-25T23:19:34.118005] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-25T23:19:35.695562] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T23:19:35.706556] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-25T23:19:37.307276] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T23:19:37.324272] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-25T23:19:39.034678] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-25T23:19:39.044173] [INFO ] [REMOTE ] LXP: Full fetch complete (72837 records). [2025-10-25T23:19:39.044449] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-25T23:19:39.430291] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-25T23:19:39.430420] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-25T23:19:39.431527] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-25T23:19:39.431626] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-25T23:19:39.433224] [DEBUG] [LOCAL ] LXP: Trimmed 72837 records to 51479 (keeping 200 days of data) [2025-10-25T23:19:39.726075] [DEBUG] [LOCAL ] LXP: Primary data saved (51479 records). [2025-10-25T23:19:39.726259] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-25T23:19:39.726473] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols. LXP took 17.3s. Estimated remaining time: 3h 39m 10s [2025-10-25T23:19:39.894379] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:19:39.894619] [DEBUG] [LOCAL ] LXU: No existing data file found in primary storage. [2025-10-25T23:19:39.894728] [WARN ] [MAIN ] LXU: No existing data found, performing full refresh instead. [2025-10-25T23:19:39.894886] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-25T23:19:39.894965] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-25T23:19:39.895068] [DEBUG] [LOCAL ] LXU: No primary data file found to delete. [2025-10-25T23:19:39.895145] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-25T23:19:40.259867] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:19:40.260339] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-25T23:19:41.502542] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-25T23:19:41.509514] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-25T23:19:42.736558] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T23:19:42.741985] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-25T23:19:43.981571] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-25T23:19:43.988577] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-25T23:19:45.526054] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-25T23:19:45.534502] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-25T23:19:46.700810] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-25T23:19:46.708345] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-25T23:19:47.980892] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T23:19:47.988550] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-25T23:19:49.358839] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T23:19:49.369191] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-25T23:19:50.646547] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T23:19:50.653765] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-25T23:19:51.804423] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T23:19:51.811804] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-25T23:19:53.066082] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T23:19:53.071579] [INFO ] [REMOTE ] LXU: Full fetch complete (45284 records). [2025-10-25T23:19:53.071708] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-25T23:19:53.457947] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-25T23:19:53.458081] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-25T23:19:53.458890] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-25T23:19:53.458967] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-25T23:19:53.460075] [DEBUG] [LOCAL ] LXU: Trimmed 45284 records to 31894 (keeping 200 days of data) [2025-10-25T23:19:53.628415] [DEBUG] [LOCAL ] LXU: Primary data saved (31894 records). [2025-10-25T23:19:53.628567] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-25T23:19:53.628734] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols. LXU took 13.9s. Estimated remaining time: 3h 38m 59s [2025-10-25T23:19:53.802150] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:19:53.802394] [DEBUG] [LOCAL ] LYB: No existing data file found in primary storage. [2025-10-25T23:19:53.802492] [WARN ] [MAIN ] LYB: No existing data found, performing full refresh instead. [2025-10-25T23:19:53.802665] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-25T23:19:53.802744] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-25T23:19:53.802827] [DEBUG] [LOCAL ] LYB: No primary data file found to delete. [2025-10-25T23:19:53.802899] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-25T23:19:54.171024] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:19:54.171423] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-25T23:19:56.082083] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T23:19:56.098332] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-25T23:19:57.841781] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T23:19:57.852482] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-25T23:19:59.773484] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-25T23:19:59.785484] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-25T23:20:01.788698] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-25T23:20:01.800085] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-25T23:20:03.797665] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-25T23:20:03.810404] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-25T23:20:06.126153] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-25T23:20:06.137097] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-25T23:20:08.248669] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-25T23:20:08.263279] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-25T23:20:10.402918] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-25T23:20:10.414174] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-25T23:20:11.231053] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-25T23:20:11.242568] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-25T23:20:11.989739] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T23:20:11.999955] [INFO ] [REMOTE ] LYB: Full fetch complete (77635 records). [2025-10-25T23:20:12.000157] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-25T23:20:12.424033] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-25T23:20:12.424159] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-25T23:20:12.425238] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-25T23:20:12.425321] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-25T23:20:12.426858] [DEBUG] [LOCAL ] LYB: Trimmed 77635 records to 54401 (keeping 200 days of data) [2025-10-25T23:20:12.746239] [DEBUG] [LOCAL ] LYB: Primary data saved (54401 records). [2025-10-25T23:20:12.746405] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-25T23:20:12.746562] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols. LYB took 19.1s. Estimated remaining time: 3h 38m 53s [2025-10-25T23:20:12.923334] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:20:12.923497] [DEBUG] [LOCAL ] LYG: No existing data file found in primary storage. [2025-10-25T23:20:12.923571] [WARN ] [MAIN ] LYG: No existing data found, performing full refresh instead. [2025-10-25T23:20:12.923716] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-25T23:20:12.923789] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-25T23:20:12.923869] [DEBUG] [LOCAL ] LYG: No primary data file found to delete. [2025-10-25T23:20:12.923939] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-25T23:20:13.299818] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:20:13.300195] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-25T23:20:15.035403] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-25T23:20:15.045629] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-25T23:20:16.785422] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T23:20:16.795153] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-25T23:20:18.748170] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-25T23:20:18.759430] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-25T23:20:20.698951] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-25T23:20:20.710447] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-25T23:20:22.378716] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-25T23:20:22.396105] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-25T23:20:24.531792] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-25T23:20:24.542467] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-25T23:20:26.299071] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-25T23:20:26.310918] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-25T23:20:28.165037] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-25T23:20:28.176214] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-25T23:20:29.964879] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-25T23:20:29.982734] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-25T23:20:31.862702] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-25T23:20:31.872103] [INFO ] [REMOTE ] LYG: Full fetch complete (76257 records). [2025-10-25T23:20:31.872304] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-25T23:20:32.280467] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-25T23:20:32.280580] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-25T23:20:32.281624] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-25T23:20:32.281722] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-25T23:20:32.283185] [DEBUG] [LOCAL ] LYG: Trimmed 76257 records to 53424 (keeping 200 days of data) [2025-10-25T23:20:32.581471] [DEBUG] [LOCAL ] LYG: Primary data saved (53424 records). [2025-10-25T23:20:32.581631] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-25T23:20:32.581798] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols. LYG took 19.8s. Estimated remaining time: 3h 38m 47s [2025-10-25T23:20:32.750751] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:20:32.750969] [DEBUG] [LOCAL ] LYV: No existing data file found in primary storage. [2025-10-25T23:20:32.751040] [WARN ] [MAIN ] LYV: No existing data found, performing full refresh instead. [2025-10-25T23:20:32.751152] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-25T23:20:32.751223] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-25T23:20:32.751302] [DEBUG] [LOCAL ] LYV: No primary data file found to delete. [2025-10-25T23:20:32.751375] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-25T23:20:33.118284] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:20:33.118621] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-25T23:20:34.786496] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T23:20:34.796179] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-25T23:20:36.420635] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T23:20:36.430427] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-25T23:20:38.219979] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T23:20:38.230785] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-25T23:20:39.930380] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T23:20:39.941733] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-25T23:20:41.560460] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T23:20:41.571139] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-25T23:20:43.218823] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T23:20:43.229475] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-25T23:20:44.798582] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T23:20:44.809766] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-25T23:20:46.464963] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T23:20:46.475538] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-25T23:20:47.798849] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-25T23:20:47.809811] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-25T23:20:49.416205] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-25T23:20:49.425677] [INFO ] [REMOTE ] LYV: Full fetch complete (74144 records). [2025-10-25T23:20:49.425823] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-25T23:20:49.814564] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-25T23:20:49.814700] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-25T23:20:49.815736] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-25T23:20:49.815814] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-25T23:20:49.817302] [DEBUG] [LOCAL ] LYV: Trimmed 74144 records to 51724 (keeping 200 days of data) [2025-10-25T23:20:50.116895] [DEBUG] [LOCAL ] LYV: Primary data saved (51724 records). [2025-10-25T23:20:50.117079] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-25T23:20:50.117251] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols. LYV took 17.5s. Estimated remaining time: 3h 38m 39s [2025-10-25T23:20:50.285788] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:20:50.286012] [DEBUG] [LOCAL ] LZB: No existing data file found in primary storage. [2025-10-25T23:20:50.286105] [WARN ] [MAIN ] LZB: No existing data found, performing full refresh instead. [2025-10-25T23:20:50.286260] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-25T23:20:50.286342] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-25T23:20:50.286447] [DEBUG] [LOCAL ] LZB: No primary data file found to delete. [2025-10-25T23:20:50.286526] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-25T23:20:50.641763] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:20:50.642233] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-25T23:20:51.869389] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-25T23:20:51.876273] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-25T23:20:53.384026] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T23:20:53.391445] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-25T23:20:54.737428] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T23:20:54.745151] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-25T23:20:56.523090] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T23:20:56.531060] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-25T23:20:57.856323] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-25T23:20:57.863467] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-25T23:20:59.180922] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-25T23:20:59.188778] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-25T23:21:00.487982] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T23:21:00.495984] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-25T23:21:02.757922] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-25T23:21:02.766284] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-25T23:21:04.450187] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-25T23:21:04.458317] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-25T23:21:05.710827] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-25T23:21:05.716997] [INFO ] [REMOTE ] LZB: Full fetch complete (51146 records). [2025-10-25T23:21:05.717121] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-25T23:21:06.111128] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-25T23:21:06.111246] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-25T23:21:06.112123] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-25T23:21:06.112203] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-25T23:21:06.113325] [DEBUG] [LOCAL ] LZB: Trimmed 51146 records to 35474 (keeping 200 days of data) [2025-10-25T23:21:06.322035] [DEBUG] [LOCAL ] LZB: Primary data saved (35474 records). [2025-10-25T23:21:06.322217] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-25T23:21:06.322375] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols. LZB took 16.2s. Estimated remaining time: 3h 38m 30s [2025-10-25T23:21:06.522311] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:21:06.522529] [DEBUG] [LOCAL ] LZM: No existing data file found in primary storage. [2025-10-25T23:21:06.522603] [WARN ] [MAIN ] LZM: No existing data found, performing full refresh instead. [2025-10-25T23:21:06.522748] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-25T23:21:06.522821] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-25T23:21:06.522903] [DEBUG] [LOCAL ] LZM: No primary data file found to delete. [2025-10-25T23:21:06.522972] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-25T23:21:06.900294] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:21:06.900667] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-25T23:21:07.718925] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T23:21:07.721265] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-25T23:21:08.494438] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-25T23:21:08.497130] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-25T23:21:09.395339] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T23:21:09.399013] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-25T23:21:10.348726] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-25T23:21:10.355706] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-25T23:21:11.111866] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T23:21:11.114849] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-25T23:21:11.909270] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T23:21:11.912133] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-25T23:21:12.659924] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-25T23:21:12.663348] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-25T23:21:13.476859] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-25T23:21:13.479881] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-25T23:21:14.414054] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-25T23:21:14.418862] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-25T23:21:15.491097] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-25T23:21:15.495519] [INFO ] [REMOTE ] LZM: Full fetch complete (20074 records). [2025-10-25T23:21:15.495618] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-25T23:21:15.868473] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-25T23:21:15.868579] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-25T23:21:15.869031] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-25T23:21:15.869108] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-25T23:21:15.869738] [DEBUG] [LOCAL ] LZM: Trimmed 20074 records to 15105 (keeping 200 days of data) [2025-10-25T23:21:15.949364] [DEBUG] [LOCAL ] LZM: Primary data saved (15105 records). [2025-10-25T23:21:15.949519] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-25T23:21:15.949688] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols. LZM took 9.6s. Estimated remaining time: 3h 38m 16s [2025-10-25T23:21:16.114639] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:21:16.114834] [DEBUG] [LOCAL ] M: No existing data file found in primary storage. [2025-10-25T23:21:16.114912] [WARN ] [MAIN ] M: No existing data found, performing full refresh instead. [2025-10-25T23:21:16.115028] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-25T23:21:16.115099] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-25T23:21:16.115163] [DEBUG] [LOCAL ] M: No primary data file found to delete. [2025-10-25T23:21:16.115223] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-25T23:21:16.467938] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:21:16.468278] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-25T23:21:18.272606] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T23:21:18.283389] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-25T23:21:20.065370] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-25T23:21:20.075376] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-25T23:21:21.815583] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-25T23:21:21.826852] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-25T23:21:23.672892] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-25T23:21:23.684207] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-25T23:21:25.557533] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-25T23:21:25.568982] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-25T23:21:27.317843] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-25T23:21:27.328674] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-25T23:21:28.844893] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T23:21:28.856549] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-25T23:21:30.854438] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-25T23:21:30.865958] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-25T23:21:32.797586] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-25T23:21:32.808895] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-25T23:21:34.278478] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-25T23:21:34.288197] [INFO ] [REMOTE ] M: Full fetch complete (77657 records). [2025-10-25T23:21:34.288357] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-25T23:21:34.673096] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-25T23:21:34.673216] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-25T23:21:34.674248] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-25T23:21:34.674344] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-25T23:21:34.675761] [DEBUG] [LOCAL ] M: Trimmed 77657 records to 54323 (keeping 200 days of data) [2025-10-25T23:21:34.991798] [DEBUG] [LOCAL ] M: Primary data saved (54323 records). [2025-10-25T23:21:34.991955] [INFO ] [MAIN ] M: Full history saved. [2025-10-25T23:21:34.992109] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols. M took 19.0s. Estimated remaining time: 3h 38m 9s [2025-10-25T23:21:35.156593] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:21:35.156800] [DEBUG] [LOCAL ] MA: No existing data file found in primary storage. [2025-10-25T23:21:35.156872] [WARN ] [MAIN ] MA: No existing data found, performing full refresh instead. [2025-10-25T23:21:35.156981] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-25T23:21:35.157052] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-25T23:21:35.157110] [DEBUG] [LOCAL ] MA: No primary data file found to delete. [2025-10-25T23:21:35.157170] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-25T23:21:35.502369] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:21:35.502679] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-25T23:21:39.183557] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (3.68 seconds). [2025-10-25T23:21:39.193857] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-25T23:21:41.028374] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-25T23:21:41.038523] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-25T23:21:43.097390] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T23:21:43.108472] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-25T23:21:45.354942] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-25T23:21:45.366319] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-25T23:21:47.180157] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T23:21:47.192545] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-25T23:21:49.253009] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-25T23:21:49.263372] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-25T23:21:51.143504] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-25T23:21:51.155249] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-25T23:21:53.375200] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-25T23:21:53.386318] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-25T23:21:55.340382] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-25T23:21:55.351320] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-25T23:21:57.336705] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-25T23:21:57.346366] [INFO ] [REMOTE ] MA: Full fetch complete (76382 records). [2025-10-25T23:21:57.346557] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-25T23:21:57.732275] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-25T23:21:57.732393] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-25T23:21:57.733436] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-25T23:21:57.733515] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-25T23:21:57.734955] [DEBUG] [LOCAL ] MA: Trimmed 76382 records to 53204 (keeping 200 days of data) [2025-10-25T23:21:58.073536] [DEBUG] [LOCAL ] MA: Primary data saved (53204 records). [2025-10-25T23:21:58.073762] [INFO ] [MAIN ] MA: Full history saved. [2025-10-25T23:21:58.073915] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols. MA took 23.1s. Estimated remaining time: 3h 38m 6s [2025-10-25T23:21:58.246775] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:21:58.246991] [DEBUG] [LOCAL ] MAA: No existing data file found in primary storage. [2025-10-25T23:21:58.247068] [WARN ] [MAIN ] MAA: No existing data found, performing full refresh instead. [2025-10-25T23:21:58.247182] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-25T23:21:58.247253] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-25T23:21:58.247334] [DEBUG] [LOCAL ] MAA: No primary data file found to delete. [2025-10-25T23:21:58.247404] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-25T23:21:58.609068] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:21:58.609401] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-25T23:22:00.159708] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T23:22:00.167941] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-25T23:22:01.927746] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-25T23:22:01.937795] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-25T23:22:04.890460] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-25T23:22:04.899760] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-25T23:22:06.654311] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-25T23:22:06.663626] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-25T23:22:08.187639] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-25T23:22:08.196100] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-25T23:22:09.804383] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-25T23:22:09.813770] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-25T23:22:11.416174] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T23:22:11.426027] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-25T23:22:13.148995] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-25T23:22:13.158414] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-25T23:22:14.669569] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-25T23:22:14.678483] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-25T23:22:16.304270] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T23:22:16.312149] [INFO ] [REMOTE ] MAA: Full fetch complete (61937 records). [2025-10-25T23:22:16.312285] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-25T23:22:16.705228] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-25T23:22:16.705354] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-25T23:22:16.706449] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-25T23:22:16.706544] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-25T23:22:16.708043] [DEBUG] [LOCAL ] MAA: Trimmed 61937 records to 43628 (keeping 200 days of data) [2025-10-25T23:22:16.971728] [DEBUG] [LOCAL ] MAA: Primary data saved (43628 records). [2025-10-25T23:22:16.971885] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-25T23:22:16.972033] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols. MAA took 18.9s. Estimated remaining time: 3h 37m 59s [2025-10-25T23:22:17.145311] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:22:17.145510] [DEBUG] [LOCAL ] MAC: No existing data file found in primary storage. [2025-10-25T23:22:17.145585] [WARN ] [MAIN ] MAC: No existing data found, performing full refresh instead. [2025-10-25T23:22:17.145725] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-25T23:22:17.145797] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-25T23:22:17.145879] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-25T23:22:17.145951] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-25T23:22:17.501870] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:22:17.502224] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-25T23:22:19.200908] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T23:22:19.210315] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-25T23:22:20.750817] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T23:22:20.759998] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-25T23:22:22.404621] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T23:22:22.414903] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-25T23:22:24.371117] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-25T23:22:24.381738] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-25T23:22:25.918529] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T23:22:25.936352] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-25T23:22:27.532194] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T23:22:27.543515] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-25T23:22:29.113493] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T23:22:29.124477] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-25T23:22:30.784090] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-25T23:22:30.794839] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-25T23:22:32.390694] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T23:22:32.401494] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-25T23:22:34.017943] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-25T23:22:34.026941] [INFO ] [REMOTE ] MAC: Full fetch complete (71527 records). [2025-10-25T23:22:34.027107] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-25T23:22:34.410341] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-25T23:22:34.410456] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-25T23:22:34.411447] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-25T23:22:34.411529] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-25T23:22:34.412884] [DEBUG] [LOCAL ] MAC: Trimmed 71527 records to 50284 (keeping 200 days of data) [2025-10-25T23:22:34.702710] [DEBUG] [LOCAL ] MAC: Primary data saved (50284 records). [2025-10-25T23:22:34.702867] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-25T23:22:34.703026] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols. MAC took 17.7s. Estimated remaining time: 3h 37m 52s [2025-10-25T23:22:34.882418] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:22:34.882614] [DEBUG] [LOCAL ] MAGN: No existing data file found in primary storage. [2025-10-25T23:22:34.882710] [WARN ] [MAIN ] MAGN: No existing data found, performing full refresh instead. [2025-10-25T23:22:34.882825] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-25T23:22:34.882897] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-25T23:22:34.882989] [DEBUG] [LOCAL ] MAGN: No primary data file found to delete. [2025-10-25T23:22:34.883060] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-25T23:22:35.238988] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:22:35.239354] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-25T23:22:36.715105] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T23:22:36.721837] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-25T23:22:37.983033] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T23:22:37.990626] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-25T23:22:39.245796] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-25T23:22:39.253158] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-25T23:22:40.566083] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T23:22:40.573612] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-25T23:22:42.104772] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T23:22:42.113419] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-25T23:22:43.534075] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T23:22:43.542840] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-25T23:22:44.888412] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-25T23:22:44.896526] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-25T23:22:46.180952] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T23:22:46.188981] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-25T23:22:47.515223] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-25T23:22:47.522703] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-25T23:22:48.868116] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-25T23:22:48.876169] [INFO ] [REMOTE ] MAGN: Full fetch complete (51879 records). [2025-10-25T23:22:48.876307] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-25T23:22:49.307017] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-25T23:22:49.307177] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-25T23:22:49.308209] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-25T23:22:49.308293] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-25T23:22:49.309592] [DEBUG] [LOCAL ] MAGN: Trimmed 51879 records to 36632 (keeping 200 days of data) [2025-10-25T23:22:49.523937] [DEBUG] [LOCAL ] MAGN: Primary data saved (36632 records). [2025-10-25T23:22:49.524113] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-25T23:22:49.524263] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols. MAGN took 14.8s. Estimated remaining time: 3h 37m 41s [2025-10-25T23:22:49.708020] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:22:49.708287] [DEBUG] [LOCAL ] MAIN: No existing data file found in primary storage. [2025-10-25T23:22:49.708364] [WARN ] [MAIN ] MAIN: No existing data found, performing full refresh instead. [2025-10-25T23:22:49.708487] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-25T23:22:49.708559] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-25T23:22:49.708664] [DEBUG] [LOCAL ] MAIN: No primary data file found to delete. [2025-10-25T23:22:49.708738] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-25T23:22:50.100477] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:22:50.100904] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-25T23:22:51.628689] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-25T23:22:51.636701] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-25T23:22:53.423976] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-25T23:22:53.432113] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-25T23:22:55.147064] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-25T23:22:55.155897] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-25T23:22:56.977622] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T23:22:56.986785] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-25T23:22:58.759893] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-25T23:22:58.769417] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-25T23:23:05.419475] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (6.65 seconds). [2025-10-25T23:23:05.428024] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-25T23:23:07.744962] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-25T23:23:07.754028] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-25T23:23:09.094932] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T23:23:09.108255] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-25T23:23:10.705273] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-25T23:23:10.714513] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-25T23:23:12.392131] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-25T23:23:12.400290] [INFO ] [REMOTE ] MAIN: Full fetch complete (60315 records). [2025-10-25T23:23:12.400419] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-25T23:23:12.784338] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-25T23:23:12.784455] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-25T23:23:12.785494] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-25T23:23:12.785577] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-25T23:23:12.786858] [DEBUG] [LOCAL ] MAIN: Trimmed 60315 records to 42512 (keeping 200 days of data) [2025-10-25T23:23:13.039973] [DEBUG] [LOCAL ] MAIN: Primary data saved (42512 records). [2025-10-25T23:23:13.040144] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-25T23:23:13.040291] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols. MAIN took 23.5s. Estimated remaining time: 3h 37m 38s [2025-10-25T23:23:13.210399] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:23:13.210676] [DEBUG] [LOCAL ] MAN: No existing data file found in primary storage. [2025-10-25T23:23:13.210762] [WARN ] [MAIN ] MAN: No existing data found, performing full refresh instead. [2025-10-25T23:23:13.210912] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-25T23:23:13.211003] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-25T23:23:13.211096] [DEBUG] [LOCAL ] MAN: No primary data file found to delete. [2025-10-25T23:23:13.211174] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-25T23:23:13.577600] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:23:13.577991] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-25T23:23:14.985102] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T23:23:14.994635] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-25T23:23:16.255315] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-25T23:23:16.262957] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-25T23:23:17.646834] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T23:23:17.655561] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-25T23:23:19.163743] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T23:23:19.173634] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-25T23:23:20.759389] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T23:23:20.768331] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-25T23:23:22.190101] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T23:23:22.198562] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-25T23:23:23.772450] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T23:23:23.782719] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-25T23:23:25.189023] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-25T23:23:25.198807] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-25T23:23:26.756550] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-25T23:23:26.766234] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-25T23:23:28.307248] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T23:23:28.315927] [INFO ] [REMOTE ] MAN: Full fetch complete (62947 records). [2025-10-25T23:23:28.316074] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-25T23:23:28.703674] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-25T23:23:28.703787] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-25T23:23:28.704764] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-25T23:23:28.704832] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-25T23:23:28.706087] [DEBUG] [LOCAL ] MAN: Trimmed 62947 records to 44967 (keeping 200 days of data) [2025-10-25T23:23:28.961015] [DEBUG] [LOCAL ] MAN: Primary data saved (44967 records). [2025-10-25T23:23:28.961177] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-25T23:23:28.961307] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols. MAN took 15.9s. Estimated remaining time: 3h 37m 29s [2025-10-25T23:23:29.129243] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:23:29.129416] [DEBUG] [LOCAL ] MANU: No existing data file found in primary storage. [2025-10-25T23:23:29.129486] [WARN ] [MAIN ] MANU: No existing data found, performing full refresh instead. [2025-10-25T23:23:29.129581] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-25T23:23:29.129668] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-25T23:23:29.129739] [DEBUG] [LOCAL ] MANU: No primary data file found to delete. [2025-10-25T23:23:29.129824] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-25T23:23:29.501672] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:23:29.502002] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-25T23:23:30.568016] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-25T23:23:30.572904] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-25T23:23:31.720583] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T23:23:31.726118] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-25T23:23:32.998451] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T23:23:33.005013] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-25T23:23:34.353078] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-25T23:23:34.358973] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-25T23:23:35.458337] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T23:23:35.463751] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-25T23:23:36.809963] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-25T23:23:36.817083] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-25T23:23:37.996608] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T23:23:38.003167] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-25T23:23:39.129601] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-25T23:23:39.134397] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-25T23:23:40.535895] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-25T23:23:40.542602] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-25T23:23:41.873232] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-25T23:23:41.881259] [INFO ] [REMOTE ] MANU: Full fetch complete (39413 records). [2025-10-25T23:23:41.881432] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-25T23:23:42.258940] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-25T23:23:42.259055] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-25T23:23:42.259867] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-25T23:23:42.259966] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-25T23:23:42.260994] [DEBUG] [LOCAL ] MANU: Trimmed 39413 records to 27474 (keeping 200 days of data) [2025-10-25T23:23:42.410204] [DEBUG] [LOCAL ] MANU: Primary data saved (27474 records). [2025-10-25T23:23:42.410376] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-25T23:23:42.410550] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols. MANU took 13.4s. Estimated remaining time: 3h 37m 18s [2025-10-25T23:23:42.580546] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:23:42.580801] [DEBUG] [LOCAL ] MAS: No existing data file found in primary storage. [2025-10-25T23:23:42.580888] [WARN ] [MAIN ] MAS: No existing data found, performing full refresh instead. [2025-10-25T23:23:42.581027] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-25T23:23:42.581118] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-25T23:23:42.581225] [DEBUG] [LOCAL ] MAS: No primary data file found to delete. [2025-10-25T23:23:42.581312] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-25T23:23:42.932335] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:23:42.932774] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-25T23:23:44.456696] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T23:23:44.466325] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-25T23:23:46.107717] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T23:23:46.121546] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-25T23:23:48.022927] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T23:23:48.033994] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-25T23:23:49.471487] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-25T23:23:49.482359] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-25T23:23:51.198420] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-25T23:23:51.209415] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-25T23:23:52.895286] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-25T23:23:52.905879] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-25T23:23:54.704468] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T23:23:54.715701] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-25T23:23:56.271204] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:23:56.282215] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-25T23:23:58.078213] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-25T23:23:58.089309] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-25T23:23:59.797571] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-25T23:23:59.807006] [INFO ] [REMOTE ] MAS: Full fetch complete (75405 records). [2025-10-25T23:23:59.807205] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-25T23:24:00.207039] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-25T23:24:00.207162] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-25T23:24:00.208319] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-25T23:24:00.208401] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-25T23:24:00.209843] [DEBUG] [LOCAL ] MAS: Trimmed 75405 records to 52954 (keeping 200 days of data) [2025-10-25T23:24:00.512779] [DEBUG] [LOCAL ] MAS: Primary data saved (52954 records). [2025-10-25T23:24:00.512940] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-25T23:24:00.513092] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols. MAS took 18.1s. Estimated remaining time: 3h 37m 10s [2025-10-25T23:24:00.684107] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:24:00.684305] [DEBUG] [LOCAL ] MATV: No existing data file found in primary storage. [2025-10-25T23:24:00.684375] [WARN ] [MAIN ] MATV: No existing data found, performing full refresh instead. [2025-10-25T23:24:00.684485] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-25T23:24:00.684555] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-25T23:24:00.684635] [DEBUG] [LOCAL ] MATV: No primary data file found to delete. [2025-10-25T23:24:00.684732] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-25T23:24:01.028308] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:24:01.028608] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-25T23:24:02.368607] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-25T23:24:02.374959] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-25T23:24:03.724278] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T23:24:03.731411] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-25T23:24:05.352639] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T23:24:05.362354] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-25T23:24:06.932765] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-25T23:24:06.941482] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-25T23:24:08.281185] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T23:24:08.292061] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-25T23:24:09.655225] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T23:24:09.663207] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-25T23:24:10.894583] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-25T23:24:10.903585] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-25T23:24:12.479259] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T23:24:12.488279] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-25T23:24:13.789434] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-25T23:24:13.797491] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-25T23:24:15.039681] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-25T23:24:15.046255] [INFO ] [REMOTE ] MATV: Full fetch complete (52074 records). [2025-10-25T23:24:15.046404] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-25T23:24:15.436100] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-25T23:24:15.436214] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-25T23:24:15.437049] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-25T23:24:15.437133] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-25T23:24:15.438227] [DEBUG] [LOCAL ] MATV: Trimmed 52074 records to 35439 (keeping 200 days of data) [2025-10-25T23:24:15.640299] [DEBUG] [LOCAL ] MATV: Primary data saved (35439 records). [2025-10-25T23:24:15.640476] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-25T23:24:15.640629] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols. MATV took 15.1s. Estimated remaining time: 3h 37m 1s [2025-10-25T23:24:15.812046] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:24:15.812281] [DEBUG] [LOCAL ] MATX: No existing data file found in primary storage. [2025-10-25T23:24:15.812355] [WARN ] [MAIN ] MATX: No existing data found, performing full refresh instead. [2025-10-25T23:24:15.812481] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-25T23:24:15.812559] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-25T23:24:15.812666] [DEBUG] [LOCAL ] MATX: No primary data file found to delete. [2025-10-25T23:24:15.812739] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-25T23:24:16.189846] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:24:16.190196] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-25T23:24:17.299289] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T23:24:17.304306] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-25T23:24:18.692867] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T23:24:18.698782] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-25T23:24:19.896444] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T23:24:19.902624] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-25T23:24:21.557320] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T23:24:21.565555] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-25T23:24:22.962601] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T23:24:22.970459] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-25T23:24:24.388502] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T23:24:24.395224] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-25T23:24:25.767709] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T23:24:25.774787] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-25T23:24:27.228216] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T23:24:27.235304] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-25T23:24:28.460438] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-25T23:24:28.467250] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-25T23:24:29.502192] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T23:24:29.508019] [INFO ] [REMOTE ] MATX: Full fetch complete (43891 records). [2025-10-25T23:24:29.508166] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-25T23:24:29.901045] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-25T23:24:29.901162] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-25T23:24:29.901955] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-25T23:24:29.902035] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-25T23:24:29.903021] [DEBUG] [LOCAL ] MATX: Trimmed 43891 records to 32268 (keeping 200 days of data) [2025-10-25T23:24:30.092083] [DEBUG] [LOCAL ] MATX: Primary data saved (32268 records). [2025-10-25T23:24:30.092241] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-25T23:24:30.092392] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols. MATX took 14.5s. Estimated remaining time: 3h 36m 50s [2025-10-25T23:24:30.264608] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:24:30.264883] [DEBUG] [LOCAL ] MAX: No existing data file found in primary storage. [2025-10-25T23:24:30.264955] [WARN ] [MAIN ] MAX: No existing data found, performing full refresh instead. [2025-10-25T23:24:30.265078] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-25T23:24:30.265157] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-25T23:24:30.265238] [DEBUG] [LOCAL ] MAX: No primary data file found to delete. [2025-10-25T23:24:30.265307] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-25T23:24:30.613073] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:24:30.613397] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-25T23:24:31.810322] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-25T23:24:31.818685] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-25T23:24:33.053383] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T23:24:33.059701] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-25T23:24:34.376766] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T23:24:34.384195] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-25T23:24:35.815572] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-25T23:24:35.826240] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-25T23:24:37.034399] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T23:24:37.041301] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-25T23:24:38.134624] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-25T23:24:38.140178] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-25T23:24:39.343597] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-25T23:24:39.349921] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-25T23:24:40.932483] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T23:24:40.939829] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-25T23:24:42.208603] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T23:24:42.216425] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-25T23:24:43.488327] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-25T23:24:43.494742] [INFO ] [REMOTE ] MAX: Full fetch complete (45004 records). [2025-10-25T23:24:43.494894] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-25T23:24:43.868304] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-25T23:24:43.868422] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-25T23:24:43.869358] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-25T23:24:43.869454] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-25T23:24:43.870503] [DEBUG] [LOCAL ] MAX: Trimmed 45004 records to 31092 (keeping 200 days of data) [2025-10-25T23:24:44.038740] [DEBUG] [LOCAL ] MAX: Primary data saved (31092 records). [2025-10-25T23:24:44.038923] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-25T23:24:44.039089] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols. MAX took 13.9s. Estimated remaining time: 3h 36m 39s [2025-10-25T23:24:44.205630] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:24:44.205886] [DEBUG] [LOCAL ] MBC: No existing data file found in primary storage. [2025-10-25T23:24:44.205974] [WARN ] [MAIN ] MBC: No existing data found, performing full refresh instead. [2025-10-25T23:24:44.206110] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-25T23:24:44.206198] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-25T23:24:44.206311] [DEBUG] [LOCAL ] MBC: No primary data file found to delete. [2025-10-25T23:24:44.206398] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-25T23:24:44.571779] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:24:44.572126] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-25T23:24:45.922746] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-25T23:24:45.931298] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-25T23:24:47.214611] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-25T23:24:47.222885] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-25T23:24:48.856132] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T23:24:48.865500] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-25T23:24:50.366888] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T23:24:50.376485] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-25T23:24:51.750793] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T23:24:51.759871] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-25T23:24:53.035047] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T23:24:53.043566] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-25T23:24:54.428559] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T23:24:54.437852] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-25T23:24:55.939224] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T23:24:55.948886] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-25T23:24:57.391927] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-25T23:24:57.405179] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-25T23:24:58.928702] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-25T23:24:58.937118] [INFO ] [REMOTE ] MBC: Full fetch complete (63090 records). [2025-10-25T23:24:58.937253] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-25T23:24:59.322332] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-25T23:24:59.322447] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-25T23:24:59.323405] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-25T23:24:59.323484] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-25T23:24:59.324747] [DEBUG] [LOCAL ] MBC: Trimmed 63090 records to 44511 (keeping 200 days of data) [2025-10-25T23:24:59.568067] [DEBUG] [LOCAL ] MBC: Primary data saved (44511 records). [2025-10-25T23:24:59.568219] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-25T23:24:59.568404] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols. MBC took 15.5s. Estimated remaining time: 3h 36m 30s [2025-10-25T23:24:59.742364] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:24:59.742559] [DEBUG] [LOCAL ] MBI: No existing data file found in primary storage. [2025-10-25T23:24:59.742620] [WARN ] [MAIN ] MBI: No existing data found, performing full refresh instead. [2025-10-25T23:24:59.742790] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-25T23:24:59.742877] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-25T23:24:59.742986] [DEBUG] [LOCAL ] MBI: No primary data file found to delete. [2025-10-25T23:24:59.743073] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-25T23:25:00.088734] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:25:00.089068] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-25T23:25:01.303463] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-25T23:25:01.310237] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-25T23:25:02.861389] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T23:25:02.866609] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-25T23:25:04.140874] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-25T23:25:04.148235] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-25T23:25:05.428514] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T23:25:05.434726] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-25T23:25:06.595852] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T23:25:06.601246] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-25T23:25:07.625195] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T23:25:07.629851] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-25T23:25:08.542364] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T23:25:08.547503] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-25T23:25:09.888510] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-25T23:25:09.895265] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-25T23:25:10.885028] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T23:25:10.890367] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-25T23:25:11.966856] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-25T23:25:11.971158] [INFO ] [REMOTE ] MBI: Full fetch complete (35673 records). [2025-10-25T23:25:11.971261] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-25T23:25:12.338586] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-25T23:25:12.338735] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-25T23:25:12.339481] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-25T23:25:12.339556] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-25T23:25:12.340445] [DEBUG] [LOCAL ] MBI: Trimmed 35673 records to 24183 (keeping 200 days of data) [2025-10-25T23:25:12.469866] [DEBUG] [LOCAL ] MBI: Primary data saved (24183 records). [2025-10-25T23:25:12.470023] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-25T23:25:12.470175] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols. MBI took 12.9s. Estimated remaining time: 3h 36m 18s [2025-10-25T23:25:12.636481] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:25:12.636690] [DEBUG] [LOCAL ] MC: No existing data file found in primary storage. [2025-10-25T23:25:12.636775] [WARN ] [MAIN ] MC: No existing data found, performing full refresh instead. [2025-10-25T23:25:12.636887] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-25T23:25:12.636956] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-25T23:25:12.637037] [DEBUG] [LOCAL ] MC: No primary data file found to delete. [2025-10-25T23:25:12.637103] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-25T23:25:13.005225] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:25:13.005627] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-25T23:25:14.434230] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T23:25:14.442770] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-25T23:25:15.953866] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T23:25:15.963577] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-25T23:25:17.549249] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-25T23:25:17.558997] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-25T23:25:19.189164] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-25T23:25:19.199534] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-25T23:25:20.758329] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-25T23:25:20.767879] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-25T23:25:22.316924] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T23:25:22.325612] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-25T23:25:24.013960] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-25T23:25:24.023755] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-25T23:25:25.563884] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-25T23:25:25.573266] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-25T23:25:27.142549] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-25T23:25:27.150997] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-25T23:25:28.687497] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-25T23:25:28.695222] [INFO ] [REMOTE ] MC: Full fetch complete (63161 records). [2025-10-25T23:25:28.695347] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-25T23:25:29.072596] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-25T23:25:29.072729] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-25T23:25:29.073665] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-25T23:25:29.073745] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-25T23:25:29.074971] [DEBUG] [LOCAL ] MC: Trimmed 63161 records to 44204 (keeping 200 days of data) [2025-10-25T23:25:29.327320] [DEBUG] [LOCAL ] MC: Primary data saved (44204 records). [2025-10-25T23:25:29.327470] [INFO ] [MAIN ] MC: Full history saved. [2025-10-25T23:25:29.327620] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols. MC took 16.9s. Estimated remaining time: 3h 36m 9s [2025-10-25T23:25:29.499563] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:25:29.499899] [DEBUG] [LOCAL ] MCB: No existing data file found in primary storage. [2025-10-25T23:25:29.499971] [WARN ] [MAIN ] MCB: No existing data found, performing full refresh instead. [2025-10-25T23:25:29.500083] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-25T23:25:29.500152] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-25T23:25:29.500231] [DEBUG] [LOCAL ] MCB: No primary data file found to delete. [2025-10-25T23:25:29.500300] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-25T23:25:29.853138] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:25:29.853471] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-25T23:25:30.764243] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T23:25:30.768104] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-25T23:25:31.537421] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-25T23:25:31.539951] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-25T23:25:32.482772] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-25T23:25:32.486114] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-25T23:25:33.483616] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T23:25:33.487566] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-25T23:25:34.290072] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T23:25:34.293091] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-25T23:25:35.058007] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T23:25:35.060711] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-25T23:25:35.989041] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-25T23:25:35.993110] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-25T23:25:36.768513] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T23:25:36.770980] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-25T23:25:37.597128] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-25T23:25:37.600149] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-25T23:25:38.363581] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:25:38.366425] [INFO ] [REMOTE ] MCB: Full fetch complete (16850 records). [2025-10-25T23:25:38.366523] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-25T23:25:38.725926] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-25T23:25:38.726041] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-25T23:25:38.726493] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-25T23:25:38.726585] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-25T23:25:38.727241] [DEBUG] [LOCAL ] MCB: Trimmed 16850 records to 11581 (keeping 200 days of data) [2025-10-25T23:25:38.793896] [DEBUG] [LOCAL ] MCB: Primary data saved (11581 records). [2025-10-25T23:25:38.794065] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-25T23:25:38.794278] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols. MCB took 9.5s. Estimated remaining time: 3h 35m 55s [2025-10-25T23:25:38.959558] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:25:38.959777] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-25T23:25:38.959866] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-25T23:25:38.960016] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-25T23:25:38.960097] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-25T23:25:38.960197] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-25T23:25:38.960279] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-25T23:25:39.314742] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:25:39.315193] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-25T23:25:41.238216] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T23:25:41.248969] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-25T23:25:43.169520] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-25T23:25:43.179587] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-25T23:25:45.243830] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-25T23:25:45.254847] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-25T23:25:47.484834] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-25T23:25:47.495888] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-25T23:25:49.457801] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-25T23:25:49.468974] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-25T23:25:51.378391] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-25T23:25:51.390234] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-25T23:25:53.422565] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-25T23:25:53.435536] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-25T23:25:55.543879] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-25T23:25:55.556461] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-25T23:25:57.016119] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T23:25:57.028040] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-25T23:25:59.142555] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-25T23:25:59.153202] [INFO ] [REMOTE ] MCD: Full fetch complete (77120 records). [2025-10-25T23:25:59.153456] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-25T23:25:59.367556] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T23:25:59.368348] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:25:59.368429] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:25:59.368523] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-25T23:25:59.368627] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-25T23:25:59.368744] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-25T23:25:59.368831] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-25T23:25:59.368940] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols. MCD took 20.6s. Estimated remaining time: 3h 35m 49s [2025-10-25T23:25:59.542337] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:25:59.542547] [DEBUG] [LOCAL ] MCI: No existing data file found in primary storage. [2025-10-25T23:25:59.542622] [WARN ] [MAIN ] MCI: No existing data found, performing full refresh instead. [2025-10-25T23:25:59.542772] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-25T23:25:59.542846] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-25T23:25:59.542931] [DEBUG] [LOCAL ] MCI: No primary data file found to delete. [2025-10-25T23:25:59.543004] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-25T23:25:59.913978] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:25:59.914371] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-25T23:26:00.737302] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T23:26:00.739836] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-25T23:26:01.653032] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T23:26:01.656131] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-25T23:26:02.415814] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T23:26:02.418363] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-25T23:26:03.045812] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-25T23:26:03.048469] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-25T23:26:03.812196] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T23:26:03.814629] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-25T23:26:04.606921] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T23:26:04.609583] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-25T23:26:05.183018] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T23:26:05.184952] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-25T23:26:05.766801] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-25T23:26:05.768619] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-25T23:26:06.452154] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-25T23:26:06.454430] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-25T23:26:07.056356] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T23:26:07.058188] [INFO ] [REMOTE ] MCI: Full fetch complete (9766 records). [2025-10-25T23:26:07.058304] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-25T23:26:07.458953] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-25T23:26:07.459080] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-25T23:26:07.459401] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-25T23:26:07.459481] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-25T23:26:07.460200] [DEBUG] [LOCAL ] MCI: Trimmed 9766 records to 6261 (keeping 200 days of data) [2025-10-25T23:26:07.500861] [DEBUG] [LOCAL ] MCI: Primary data saved (6261 records). [2025-10-25T23:26:07.501049] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-25T23:26:07.501233] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols. MCI took 8.1s. Estimated remaining time: 3h 35m 33s [2025-10-25T23:26:07.697206] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:26:07.697456] [DEBUG] [LOCAL ] MCK: No existing data file found in primary storage. [2025-10-25T23:26:07.697532] [WARN ] [MAIN ] MCK: No existing data found, performing full refresh instead. [2025-10-25T23:26:07.697665] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-25T23:26:07.697763] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-25T23:26:07.697850] [DEBUG] [LOCAL ] MCK: No primary data file found to delete. [2025-10-25T23:26:07.697920] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-25T23:26:08.086797] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:26:08.087202] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-25T23:26:09.476413] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T23:26:09.484206] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-25T23:26:11.037906] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T23:26:11.045945] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-25T23:26:12.711185] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T23:26:12.720043] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-25T23:26:14.324968] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T23:26:14.334587] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-25T23:26:15.927939] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T23:26:15.936961] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-25T23:26:17.412175] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-25T23:26:17.420093] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-25T23:26:18.781433] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T23:26:18.788601] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-25T23:26:20.288800] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-25T23:26:20.297603] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-25T23:26:21.827969] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-25T23:26:21.836229] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-25T23:26:23.198324] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-25T23:26:23.204443] [INFO ] [REMOTE ] MCK: Full fetch complete (56471 records). [2025-10-25T23:26:23.204559] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-25T23:26:23.587919] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-25T23:26:23.588029] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-25T23:26:23.588881] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-25T23:26:23.588958] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-25T23:26:23.590078] [DEBUG] [LOCAL ] MCK: Trimmed 56471 records to 38481 (keeping 200 days of data) [2025-10-25T23:26:23.821833] [DEBUG] [LOCAL ] MCK: Primary data saved (38481 records). [2025-10-25T23:26:23.822011] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-25T23:26:23.822231] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols. MCK took 16.3s. Estimated remaining time: 3h 35m 24s [2025-10-25T23:26:24.012172] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:26:24.012390] [DEBUG] [LOCAL ] MCN: No existing data file found in primary storage. [2025-10-25T23:26:24.012462] [WARN ] [MAIN ] MCN: No existing data found, performing full refresh instead. [2025-10-25T23:26:24.012574] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-25T23:26:24.012668] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-25T23:26:24.012755] [DEBUG] [LOCAL ] MCN: No primary data file found to delete. [2025-10-25T23:26:24.012824] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-25T23:26:24.367972] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:26:24.368300] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-25T23:26:25.087153] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T23:26:25.089367] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-25T23:26:25.788947] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-25T23:26:25.791228] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-25T23:26:26.407323] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-25T23:26:26.409672] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-25T23:26:27.144523] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T23:26:27.147282] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-25T23:26:27.713481] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T23:26:27.716064] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-25T23:26:28.437998] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T23:26:28.440540] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-25T23:26:29.132903] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-25T23:26:29.135221] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-25T23:26:29.663150] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-25T23:26:29.665259] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-25T23:26:30.373619] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T23:26:30.375806] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-25T23:26:31.000233] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T23:26:31.002063] [INFO ] [REMOTE ] MCN: Full fetch complete (11505 records). [2025-10-25T23:26:31.002158] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-25T23:26:31.360216] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-25T23:26:31.360330] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-25T23:26:31.360604] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-25T23:26:31.360695] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-25T23:26:31.361208] [DEBUG] [LOCAL ] MCN: Trimmed 11505 records to 8104 (keeping 200 days of data) [2025-10-25T23:26:31.406300] [DEBUG] [LOCAL ] MCN: Primary data saved (8104 records). [2025-10-25T23:26:31.406452] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-25T23:26:31.406604] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols. MCN took 7.6s. Estimated remaining time: 3h 35m 8s [2025-10-25T23:26:31.579359] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:26:31.579542] [DEBUG] [LOCAL ] MCO: No existing data file found in primary storage. [2025-10-25T23:26:31.579612] [WARN ] [MAIN ] MCO: No existing data found, performing full refresh instead. [2025-10-25T23:26:31.579743] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-25T23:26:31.579813] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-25T23:26:31.579893] [DEBUG] [LOCAL ] MCO: No primary data file found to delete. [2025-10-25T23:26:31.579962] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-25T23:26:31.928195] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:26:31.928815] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-25T23:26:33.453787] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-25T23:26:33.460948] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-25T23:26:34.987491] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T23:26:34.995623] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-25T23:26:36.854790] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T23:26:36.864736] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-25T23:26:38.779196] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-25T23:26:38.789490] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-25T23:26:40.252879] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T23:26:40.261165] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-25T23:26:41.675902] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T23:26:41.683491] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-25T23:26:43.185969] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T23:26:43.194899] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-25T23:26:44.640616] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T23:26:44.648740] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-25T23:26:46.235846] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T23:26:46.244916] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-25T23:26:47.989949] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-25T23:26:47.998885] [INFO ] [REMOTE ] MCO: Full fetch complete (58436 records). [2025-10-25T23:26:47.999066] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-25T23:26:48.379907] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-25T23:26:48.380050] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-25T23:26:48.380996] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-25T23:26:48.381094] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-25T23:26:48.382316] [DEBUG] [LOCAL ] MCO: Trimmed 58436 records to 40099 (keeping 200 days of data) [2025-10-25T23:26:48.626527] [DEBUG] [LOCAL ] MCO: Primary data saved (40099 records). [2025-10-25T23:26:48.626707] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-25T23:26:48.626861] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols. MCO took 17.2s. Estimated remaining time: 3h 35m 0s [2025-10-25T23:26:48.798834] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:26:48.799066] [DEBUG] [LOCAL ] MCR: No existing data file found in primary storage. [2025-10-25T23:26:48.799135] [WARN ] [MAIN ] MCR: No existing data found, performing full refresh instead. [2025-10-25T23:26:48.799269] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-25T23:26:48.799345] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-25T23:26:48.799424] [DEBUG] [LOCAL ] MCR: No primary data file found to delete. [2025-10-25T23:26:48.799491] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-25T23:26:49.150623] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:26:49.150991] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-25T23:26:49.977679] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-25T23:26:49.983224] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-25T23:26:50.564472] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T23:26:50.567103] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-25T23:26:51.400744] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-25T23:26:51.403487] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-25T23:26:52.191639] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T23:26:52.194491] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-25T23:26:52.960539] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-25T23:26:52.963098] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-25T23:26:53.717052] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T23:26:53.719473] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-25T23:26:54.463562] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T23:26:54.465827] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-25T23:26:55.264606] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T23:26:55.268114] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-25T23:26:55.925055] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T23:26:55.927132] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-25T23:26:56.669947] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T23:26:56.672331] [INFO ] [REMOTE ] MCR: Full fetch complete (13311 records). [2025-10-25T23:26:56.672473] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-25T23:26:57.075322] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-25T23:26:57.075531] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-25T23:26:57.075962] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-25T23:26:57.076042] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-25T23:26:57.076593] [DEBUG] [LOCAL ] MCR: Trimmed 13311 records to 8940 (keeping 200 days of data) [2025-10-25T23:26:57.130967] [DEBUG] [LOCAL ] MCR: Primary data saved (8940 records). [2025-10-25T23:26:57.131134] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-25T23:26:57.131299] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols. MCR took 8.5s. Estimated remaining time: 3h 34m 45s [2025-10-25T23:26:57.319191] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:26:57.319459] [DEBUG] [LOCAL ] MCS: No existing data file found in primary storage. [2025-10-25T23:26:57.319533] [WARN ] [MAIN ] MCS: No existing data found, performing full refresh instead. [2025-10-25T23:26:57.319676] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-25T23:26:57.319774] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-25T23:26:57.319890] [DEBUG] [LOCAL ] MCS: No primary data file found to delete. [2025-10-25T23:26:57.319990] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-25T23:26:57.709547] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:26:57.709955] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-25T23:26:58.716092] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-25T23:26:58.720380] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-25T23:26:59.720457] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-25T23:26:59.724764] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-25T23:27:00.822088] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T23:27:00.827629] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-25T23:27:02.158265] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-25T23:27:02.163261] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-25T23:27:03.325559] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-25T23:27:03.330346] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-25T23:27:04.340003] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T23:27:04.344134] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-25T23:27:05.453489] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-25T23:27:05.458833] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-25T23:27:06.665158] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-25T23:27:06.671085] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-25T23:27:07.700001] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-25T23:27:07.705187] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-25T23:27:08.832334] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-25T23:27:08.836842] [INFO ] [REMOTE ] MCS: Full fetch complete (30675 records). [2025-10-25T23:27:08.836939] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-25T23:27:09.209442] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-25T23:27:09.209558] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-25T23:27:09.210240] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-25T23:27:09.210324] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-25T23:27:09.211184] [DEBUG] [LOCAL ] MCS: Trimmed 30675 records to 21485 (keeping 200 days of data) [2025-10-25T23:27:09.332489] [DEBUG] [LOCAL ] MCS: Primary data saved (21485 records). [2025-10-25T23:27:09.332665] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-25T23:27:09.332829] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols. MCS took 12.2s. Estimated remaining time: 3h 34m 33s [2025-10-25T23:27:09.501167] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:27:09.501368] [DEBUG] [LOCAL ] MCY: No existing data file found in primary storage. [2025-10-25T23:27:09.501441] [WARN ] [MAIN ] MCY: No existing data found, performing full refresh instead. [2025-10-25T23:27:09.501530] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-25T23:27:09.501601] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-25T23:27:09.501690] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-10-25T23:27:09.501761] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-25T23:27:09.850888] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:27:09.851228] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-25T23:27:11.353935] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T23:27:11.362454] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-25T23:27:12.841891] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T23:27:12.849602] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-25T23:27:14.167063] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T23:27:14.174128] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-25T23:27:15.440383] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T23:27:15.446565] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-25T23:27:16.747207] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-25T23:27:16.753453] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-25T23:27:17.833904] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T23:27:17.838934] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-25T23:27:19.021276] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T23:27:19.027491] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-25T23:27:19.760500] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T23:27:19.765639] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-25T23:27:20.801592] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-25T23:27:20.806403] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-25T23:27:21.834451] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T23:27:21.838498] [INFO ] [REMOTE ] MCY: Full fetch complete (40614 records). [2025-10-25T23:27:21.838625] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-25T23:27:22.244385] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-25T23:27:22.244513] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-25T23:27:22.245307] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-25T23:27:22.245386] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-25T23:27:22.246258] [DEBUG] [LOCAL ] MCY: Trimmed 40614 records to 23761 (keeping 200 days of data) [2025-10-25T23:27:22.384169] [DEBUG] [LOCAL ] MCY: Primary data saved (23761 records). [2025-10-25T23:27:22.384331] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-25T23:27:22.384485] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols. MCY took 13.1s. Estimated remaining time: 3h 34m 21s [2025-10-25T23:27:22.552278] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:27:22.552454] [DEBUG] [LOCAL ] MD: No existing data file found in primary storage. [2025-10-25T23:27:22.552524] [WARN ] [MAIN ] MD: No existing data found, performing full refresh instead. [2025-10-25T23:27:22.552634] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-25T23:27:22.552727] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-25T23:27:22.552808] [DEBUG] [LOCAL ] MD: No primary data file found to delete. [2025-10-25T23:27:22.552877] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-25T23:27:22.904821] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:27:22.905175] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-25T23:27:24.313179] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T23:27:24.320552] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-25T23:27:25.743617] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T23:27:25.750865] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-25T23:27:27.327911] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T23:27:27.335862] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-25T23:27:28.803806] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T23:27:28.811989] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-25T23:27:30.257223] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-25T23:27:30.266396] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-25T23:27:31.602326] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T23:27:31.609828] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-25T23:27:33.094075] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T23:27:33.102466] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-25T23:27:34.727243] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T23:27:34.736223] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-25T23:27:36.074919] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-25T23:27:36.082712] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-25T23:27:36.325958] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-25T23:27:36.333065] [INFO ] [REMOTE ] MD: Full fetch complete (55250 records). [2025-10-25T23:27:36.333194] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-25T23:27:36.728833] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-25T23:27:36.728956] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-25T23:27:36.729861] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-25T23:27:36.729943] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-25T23:27:36.731168] [DEBUG] [LOCAL ] MD: Trimmed 55250 records to 39054 (keeping 200 days of data) [2025-10-25T23:27:36.945265] [DEBUG] [LOCAL ] MD: Primary data saved (39054 records). [2025-10-25T23:27:36.945430] [INFO ] [MAIN ] MD: Full history saved. [2025-10-25T23:27:36.945575] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols. MD took 14.6s. Estimated remaining time: 3h 34m 10s [2025-10-25T23:27:37.116974] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:27:37.117184] [DEBUG] [LOCAL ] MDST: No existing data file found in primary storage. [2025-10-25T23:27:37.117255] [WARN ] [MAIN ] MDST: No existing data found, performing full refresh instead. [2025-10-25T23:27:37.117386] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-25T23:27:37.117465] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-25T23:27:37.117544] [DEBUG] [LOCAL ] MDST: No primary data file found to delete. [2025-10-25T23:27:37.117613] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-25T23:27:37.462928] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:27:37.463272] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-25T23:27:37.883717] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-25T23:27:37.885588] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-25T23:27:38.646632] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T23:27:38.649203] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-25T23:27:39.247427] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T23:27:39.249390] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-25T23:27:39.898356] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-25T23:27:39.900015] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-25T23:27:40.509521] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-25T23:27:40.511301] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-25T23:27:41.072538] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T23:27:41.074326] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-25T23:27:41.488313] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-25T23:27:41.490504] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-25T23:27:42.133561] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-25T23:27:42.135706] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-25T23:27:42.863389] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-25T23:27:42.865857] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-25T23:27:43.628709] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:27:43.632531] [INFO ] [REMOTE ] MDST: Full fetch complete (8903 records). [2025-10-25T23:27:43.632715] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-25T23:27:44.105520] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-25T23:27:44.105670] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-25T23:27:44.105936] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-25T23:27:44.106011] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-25T23:27:44.106474] [DEBUG] [LOCAL ] MDST: Trimmed 8903 records to 6257 (keeping 200 days of data) [2025-10-25T23:27:44.144367] [DEBUG] [LOCAL ] MDST: Primary data saved (6257 records). [2025-10-25T23:27:44.144525] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-25T23:27:44.144698] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols. MDST took 7.2s. Estimated remaining time: 3h 33m 54s [2025-10-25T23:27:44.321522] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:27:44.321743] [DEBUG] [LOCAL ] MDT: No existing data file found in primary storage. [2025-10-25T23:27:44.321825] [WARN ] [MAIN ] MDT: No existing data found, performing full refresh instead. [2025-10-25T23:27:44.321952] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-25T23:27:44.322027] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-25T23:27:44.322107] [DEBUG] [LOCAL ] MDT: No primary data file found to delete. [2025-10-25T23:27:44.322179] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-25T23:27:44.689976] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:27:44.690358] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-25T23:27:46.394697] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T23:27:46.405096] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-25T23:27:48.133966] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T23:27:48.144003] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-25T23:27:50.209019] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T23:27:50.219968] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-25T23:27:52.527058] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-25T23:27:52.538329] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-25T23:27:54.523928] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-25T23:27:54.534947] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-25T23:27:56.658458] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-25T23:27:56.669127] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-25T23:27:58.740532] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-25T23:27:58.752378] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-25T23:28:00.424041] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T23:28:00.435554] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-25T23:28:02.372195] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-25T23:28:02.383630] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-25T23:28:03.145720] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:28:03.158828] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-25T23:28:03.159017] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-25T23:28:03.546749] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-25T23:28:03.546861] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-25T23:28:03.548450] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-25T23:28:03.548563] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-25T23:28:03.550188] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 54458 (keeping 200 days of data) [2025-10-25T23:28:03.873172] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-10-25T23:28:03.873329] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-25T23:28:03.873479] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols. MDT took 19.7s. Estimated remaining time: 3h 33m 48s [2025-10-25T23:28:04.042124] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:28:04.042329] [DEBUG] [LOCAL ] MDU: No existing data file found in primary storage. [2025-10-25T23:28:04.042401] [WARN ] [MAIN ] MDU: No existing data found, performing full refresh instead. [2025-10-25T23:28:04.042519] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-25T23:28:04.042590] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-25T23:28:04.042703] [DEBUG] [LOCAL ] MDU: No primary data file found to delete. [2025-10-25T23:28:04.042775] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-25T23:28:04.387029] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:28:04.387365] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-25T23:28:06.059233] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T23:28:06.069339] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-25T23:28:07.555468] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T23:28:07.564960] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-25T23:28:09.140833] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-25T23:28:09.151412] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-25T23:28:10.874044] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-25T23:28:10.884559] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-25T23:28:12.375795] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-25T23:28:12.386625] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-25T23:28:14.071462] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-25T23:28:14.081609] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-25T23:28:15.685680] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T23:28:15.700110] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-25T23:28:17.441796] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-25T23:28:17.451928] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-25T23:28:19.071874] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T23:28:19.082351] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-25T23:28:19.848256] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T23:28:19.857635] [INFO ] [REMOTE ] MDU: Full fetch complete (70693 records). [2025-10-25T23:28:19.857880] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-25T23:28:20.237238] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-25T23:28:20.237353] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-25T23:28:20.238455] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-25T23:28:20.238541] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-25T23:28:20.240015] [DEBUG] [LOCAL ] MDU: Trimmed 70693 records to 48743 (keeping 200 days of data) [2025-10-25T23:28:20.522739] [DEBUG] [LOCAL ] MDU: Primary data saved (48743 records). [2025-10-25T23:28:20.523002] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-25T23:28:20.523226] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols. MDU took 16.6s. Estimated remaining time: 3h 33m 39s [2025-10-25T23:28:20.692254] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:28:20.692457] [DEBUG] [LOCAL ] MDV: No existing data file found in primary storage. [2025-10-25T23:28:20.692530] [WARN ] [MAIN ] MDV: No existing data found, performing full refresh instead. [2025-10-25T23:28:20.692663] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-25T23:28:20.692739] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-25T23:28:20.692820] [DEBUG] [LOCAL ] MDV: No primary data file found to delete. [2025-10-25T23:28:20.692890] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-25T23:28:21.034931] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:28:21.035275] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-25T23:28:21.657062] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-25T23:28:21.658974] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-25T23:28:22.267296] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T23:28:22.269326] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-25T23:28:22.976136] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-25T23:28:22.978881] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-25T23:28:23.748156] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-25T23:28:23.750731] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-25T23:28:24.461975] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-25T23:28:24.464692] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-25T23:28:25.307922] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T23:28:25.310569] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-25T23:28:26.132218] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T23:28:26.134836] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-25T23:28:26.845460] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T23:28:26.848533] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-25T23:28:27.452024] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-25T23:28:27.453944] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-25T23:28:28.070437] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T23:28:28.072207] [INFO ] [REMOTE ] MDV: Full fetch complete (11668 records). [2025-10-25T23:28:28.072296] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-25T23:28:28.436975] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-25T23:28:28.437113] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-25T23:28:28.437400] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-25T23:28:28.437473] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-25T23:28:28.438043] [DEBUG] [LOCAL ] MDV: Trimmed 11668 records to 8375 (keeping 200 days of data) [2025-10-25T23:28:28.487071] [DEBUG] [LOCAL ] MDV: Primary data saved (8375 records). [2025-10-25T23:28:28.487213] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-25T23:28:28.487360] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols. MDV took 8.0s. Estimated remaining time: 3h 33m 23s [2025-10-25T23:28:28.653778] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:28:28.653982] [DEBUG] [LOCAL ] MEC: No existing data file found in primary storage. [2025-10-25T23:28:28.654055] [WARN ] [MAIN ] MEC: No existing data found, performing full refresh instead. [2025-10-25T23:28:28.654176] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-25T23:28:28.654228] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-25T23:28:28.654283] [DEBUG] [LOCAL ] MEC: No primary data file found to delete. [2025-10-25T23:28:28.654348] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-25T23:28:29.055385] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:28:29.055837] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-25T23:28:29.957131] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-25T23:28:29.960772] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-25T23:28:30.684505] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T23:28:30.687183] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-25T23:28:31.676793] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T23:28:31.681260] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-25T23:28:32.698278] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T23:28:32.702123] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-25T23:28:33.483573] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-25T23:28:33.487622] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-25T23:28:34.470440] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T23:28:34.474623] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-25T23:28:35.382518] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T23:28:35.386354] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-25T23:28:36.463825] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T23:28:36.468538] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-25T23:28:37.483338] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T23:28:37.487383] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-25T23:28:38.505010] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-25T23:28:38.508960] [INFO ] [REMOTE ] MEC: Full fetch complete (23151 records). [2025-10-25T23:28:38.509095] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-25T23:28:38.878128] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-25T23:28:38.878288] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-25T23:28:38.878887] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-25T23:28:38.878973] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-25T23:28:38.879770] [DEBUG] [LOCAL ] MEC: Trimmed 23151 records to 17160 (keeping 200 days of data) [2025-10-25T23:28:38.978462] [DEBUG] [LOCAL ] MEC: Primary data saved (17160 records). [2025-10-25T23:28:38.978637] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-25T23:28:38.978813] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols. MEC took 10.5s. Estimated remaining time: 3h 33m 10s [2025-10-25T23:28:39.162124] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:28:39.162319] [DEBUG] [LOCAL ] MED: No existing data file found in primary storage. [2025-10-25T23:28:39.162390] [WARN ] [MAIN ] MED: No existing data found, performing full refresh instead. [2025-10-25T23:28:39.162504] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-25T23:28:39.162575] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-25T23:28:39.162682] [DEBUG] [LOCAL ] MED: No primary data file found to delete. [2025-10-25T23:28:39.162752] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-25T23:28:39.540484] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:28:39.540957] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-25T23:28:40.640141] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-25T23:28:40.645214] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-25T23:28:41.538347] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T23:28:41.543628] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-25T23:28:42.640896] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T23:28:42.646041] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-25T23:28:43.740897] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T23:28:43.746885] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-25T23:28:44.841223] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T23:28:44.846123] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-25T23:28:45.927340] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T23:28:45.932402] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-25T23:28:47.114211] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-25T23:28:47.119544] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-25T23:28:48.137822] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T23:28:48.142434] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-25T23:28:49.193957] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T23:28:49.198289] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-25T23:28:50.237035] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-25T23:28:50.241117] [INFO ] [REMOTE ] MED: Full fetch complete (31838 records). [2025-10-25T23:28:50.241268] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-25T23:28:50.607165] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-25T23:28:50.607276] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-25T23:28:50.607998] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-25T23:28:50.608077] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-25T23:28:50.608921] [DEBUG] [LOCAL ] MED: Trimmed 31838 records to 21277 (keeping 200 days of data) [2025-10-25T23:28:50.727251] [DEBUG] [LOCAL ] MED: Primary data saved (21277 records). [2025-10-25T23:28:50.727410] [INFO ] [MAIN ] MED: Full history saved. [2025-10-25T23:28:50.727539] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols. MED took 11.7s. Estimated remaining time: 3h 32m 57s [2025-10-25T23:28:50.895291] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:28:50.895481] [DEBUG] [LOCAL ] MEG: No existing data file found in primary storage. [2025-10-25T23:28:50.895551] [WARN ] [MAIN ] MEG: No existing data found, performing full refresh instead. [2025-10-25T23:28:50.895686] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-25T23:28:50.895755] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-25T23:28:50.895834] [DEBUG] [LOCAL ] MEG: No primary data file found to delete. [2025-10-25T23:28:50.895907] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-25T23:28:51.273189] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:28:51.273515] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-25T23:28:52.587990] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-25T23:28:52.595384] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-25T23:28:53.941020] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T23:28:53.947399] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-25T23:28:55.263336] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-25T23:28:55.271955] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-25T23:28:56.616079] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-25T23:28:56.625391] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-25T23:28:57.718270] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T23:28:57.725859] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-25T23:28:58.952156] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-25T23:28:58.959961] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-25T23:29:00.176181] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T23:29:00.182957] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-25T23:29:01.746826] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:29:01.756894] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-25T23:29:03.251100] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T23:29:03.259236] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-25T23:29:04.624530] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-25T23:29:04.632238] [INFO ] [REMOTE ] MEG: Full fetch complete (47351 records). [2025-10-25T23:29:04.632512] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-25T23:29:05.030608] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-25T23:29:05.030779] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-25T23:29:05.031626] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-25T23:29:05.031732] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-25T23:29:05.032719] [DEBUG] [LOCAL ] MEG: Trimmed 47351 records to 32046 (keeping 200 days of data) [2025-10-25T23:29:05.211099] [DEBUG] [LOCAL ] MEG: Primary data saved (32046 records). [2025-10-25T23:29:05.211288] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-25T23:29:05.211447] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols. MEG took 14.5s. Estimated remaining time: 3h 32m 46s [2025-10-25T23:29:05.380585] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:29:05.380827] [DEBUG] [LOCAL ] MEGI: No existing data file found in primary storage. [2025-10-25T23:29:05.380901] [WARN ] [MAIN ] MEGI: No existing data found, performing full refresh instead. [2025-10-25T23:29:05.381016] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-25T23:29:05.381090] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-25T23:29:05.381172] [DEBUG] [LOCAL ] MEGI: No primary data file found to delete. [2025-10-25T23:29:05.381243] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-25T23:29:05.733173] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:29:05.733548] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-25T23:29:06.752855] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T23:29:06.758343] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-25T23:29:07.820840] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-25T23:29:07.825524] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-25T23:29:08.978090] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T23:29:08.984434] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-25T23:29:09.946744] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T23:29:09.951938] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-25T23:29:10.882061] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T23:29:10.886342] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-25T23:29:11.841384] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-25T23:29:11.845460] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-25T23:29:13.011983] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T23:29:13.018056] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-25T23:29:14.129242] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-25T23:29:14.135268] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-25T23:29:14.852872] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T23:29:14.857935] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-25T23:29:15.826456] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T23:29:15.830129] [INFO ] [REMOTE ] MEGI: Full fetch complete (28974 records). [2025-10-25T23:29:15.830235] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-25T23:29:16.194524] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-25T23:29:16.194634] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-25T23:29:16.195323] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-25T23:29:16.195402] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-25T23:29:16.196152] [DEBUG] [LOCAL ] MEGI: Trimmed 28974 records to 19980 (keeping 200 days of data) [2025-10-25T23:29:16.311711] [DEBUG] [LOCAL ] MEGI: Primary data saved (19980 records). [2025-10-25T23:29:16.311869] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-25T23:29:16.312018] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols. MEGI took 11.1s. Estimated remaining time: 3h 32m 33s [2025-10-25T23:29:16.477180] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:29:16.477387] [DEBUG] [LOCAL ] MEI: No existing data file found in primary storage. [2025-10-25T23:29:16.477457] [WARN ] [MAIN ] MEI: No existing data found, performing full refresh instead. [2025-10-25T23:29:16.477569] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-25T23:29:16.477665] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-25T23:29:16.477747] [DEBUG] [LOCAL ] MEI: No primary data file found to delete. [2025-10-25T23:29:16.477835] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-25T23:29:16.829666] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:29:16.829957] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-25T23:29:18.054354] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T23:29:18.060622] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-25T23:29:19.186434] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T23:29:19.193527] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-25T23:29:20.553505] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T23:29:20.561753] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-25T23:29:21.949330] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T23:29:21.956964] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-25T23:29:22.772952] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T23:29:22.778853] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-25T23:29:23.616256] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-25T23:29:23.622377] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-25T23:29:24.667589] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T23:29:24.676142] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-25T23:29:25.709859] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-25T23:29:25.717968] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-25T23:29:27.109794] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-25T23:29:27.117479] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-25T23:29:28.267580] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T23:29:28.273201] [INFO ] [REMOTE ] MEI: Full fetch complete (45368 records). [2025-10-25T23:29:28.273339] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-25T23:29:28.643007] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-25T23:29:28.643115] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-25T23:29:28.643957] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-25T23:29:28.644037] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-25T23:29:28.645132] [DEBUG] [LOCAL ] MEI: Trimmed 45368 records to 31676 (keeping 200 days of data) [2025-10-25T23:29:28.824895] [DEBUG] [LOCAL ] MEI: Primary data saved (31676 records). [2025-10-25T23:29:28.825055] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-25T23:29:28.825216] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols. MEI took 12.5s. Estimated remaining time: 3h 32m 21s [2025-10-25T23:29:28.998301] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:29:28.998491] [DEBUG] [LOCAL ] MET: No existing data file found in primary storage. [2025-10-25T23:29:28.998561] [WARN ] [MAIN ] MET: No existing data found, performing full refresh instead. [2025-10-25T23:29:28.998694] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-25T23:29:28.998767] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-25T23:29:28.998848] [DEBUG] [LOCAL ] MET: No primary data file found to delete. [2025-10-25T23:29:28.998917] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-25T23:29:29.373539] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:29:29.373925] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-25T23:29:31.474001] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-25T23:29:31.484509] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-25T23:29:33.023214] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-25T23:29:33.033069] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-25T23:29:34.802454] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-25T23:29:34.813445] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-25T23:29:36.624732] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-25T23:29:36.640999] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-25T23:29:38.262511] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T23:29:38.273463] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-25T23:29:39.930088] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-25T23:29:39.943177] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-25T23:29:41.876966] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-25T23:29:41.888849] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-25T23:29:43.240219] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T23:29:43.251759] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-25T23:29:44.973692] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T23:29:44.986352] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-25T23:29:45.828377] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-25T23:29:45.838059] [INFO ] [REMOTE ] MET: Full fetch complete (77358 records). [2025-10-25T23:29:45.838217] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-25T23:29:46.228009] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-25T23:29:46.228134] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-25T23:29:46.229304] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-25T23:29:46.229387] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-25T23:29:46.230904] [DEBUG] [LOCAL ] MET: Trimmed 77358 records to 54064 (keeping 200 days of data) [2025-10-25T23:29:46.549758] [DEBUG] [LOCAL ] MET: Primary data saved (54064 records). [2025-10-25T23:29:46.549952] [INFO ] [MAIN ] MET: Full history saved. [2025-10-25T23:29:46.550106] [INFO ] [MAIN ] Update Progress: 1329/2366 symbols. MET took 17.7s. Estimated remaining time: 3h 32m 13s [2025-10-25T23:29:46.718351] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:29:46.718566] [DEBUG] [LOCAL ] MFA: No existing data file found in primary storage. [2025-10-25T23:29:46.718685] [WARN ] [MAIN ] MFA: No existing data found, performing full refresh instead. [2025-10-25T23:29:46.718812] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-25T23:29:46.718885] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-25T23:29:46.718969] [DEBUG] [LOCAL ] MFA: No primary data file found to delete. [2025-10-25T23:29:46.719041] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-25T23:29:47.075844] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:29:47.076189] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-25T23:29:48.551625] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T23:29:48.560072] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-25T23:29:49.990186] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-25T23:29:49.998812] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-25T23:29:51.304397] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-25T23:29:51.313875] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-25T23:29:53.046152] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T23:29:53.056355] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-25T23:29:54.658911] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T23:29:54.668457] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-25T23:29:56.081072] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-25T23:29:56.090016] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-25T23:29:57.773993] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T23:29:57.783915] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-25T23:29:59.339041] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:29:59.348713] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-25T23:30:01.091870] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-25T23:30:01.101975] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-25T23:30:02.838150] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-25T23:30:02.853532] [INFO ] [REMOTE ] MFA: Full fetch complete (65199 records). [2025-10-25T23:30:02.853868] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-25T23:30:03.302173] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-25T23:30:03.303359] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-25T23:30:03.305412] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-25T23:30:03.305518] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-25T23:30:03.307799] [DEBUG] [LOCAL ] MFA: Trimmed 65199 records to 46167 (keeping 200 days of data) [2025-10-25T23:30:03.597700] [DEBUG] [LOCAL ] MFA: Primary data saved (46167 records). [2025-10-25T23:30:03.597960] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-25T23:30:03.598167] [INFO ] [MAIN ] Update Progress: 1330/2366 symbols. MFA took 17.0s. Estimated remaining time: 3h 32m 4s [2025-10-25T23:30:03.784279] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:30:03.784566] [DEBUG] [LOCAL ] MFAN: No existing data file found in primary storage. [2025-10-25T23:30:03.784666] [WARN ] [MAIN ] MFAN: No existing data found, performing full refresh instead. [2025-10-25T23:30:03.784808] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-25T23:30:03.784909] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-25T23:30:03.784998] [DEBUG] [LOCAL ] MFAN: No primary data file found to delete. [2025-10-25T23:30:03.785071] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-25T23:30:04.184576] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:30:04.185353] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-25T23:30:04.540604] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-25T23:30:04.542478] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-25T23:30:05.037048] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-25T23:30:05.038562] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-25T23:30:05.642109] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T23:30:05.643809] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-25T23:30:06.325386] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-25T23:30:06.327322] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-25T23:30:06.920237] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T23:30:06.922146] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-25T23:30:07.482620] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T23:30:07.484358] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-25T23:30:08.141804] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-25T23:30:08.143718] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-25T23:30:08.648434] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-25T23:30:08.650063] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-25T23:30:09.310056] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T23:30:09.312069] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-25T23:30:09.887416] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:30:09.889493] [INFO ] [REMOTE ] MFAN: Full fetch complete (6014 records). [2025-10-25T23:30:09.889599] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-25T23:30:10.284476] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-25T23:30:10.284604] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-25T23:30:10.284833] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-25T23:30:10.284911] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-25T23:30:10.285315] [DEBUG] [LOCAL ] MFAN: Trimmed 6014 records to 4371 (keeping 200 days of data) [2025-10-25T23:30:10.310498] [DEBUG] [LOCAL ] MFAN: Primary data saved (4371 records). [2025-10-25T23:30:10.310608] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-25T23:30:10.310776] [INFO ] [MAIN ] Update Progress: 1331/2366 symbols. MFAN took 6.7s. Estimated remaining time: 3h 31m 48s [2025-10-25T23:30:10.480155] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:30:10.480392] [DEBUG] [LOCAL ] MFAO: No existing data file found in primary storage. [2025-10-25T23:30:10.480468] [WARN ] [MAIN ] MFAO: No existing data found, performing full refresh instead. [2025-10-25T23:30:10.480584] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-25T23:30:10.480682] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-25T23:30:10.480767] [DEBUG] [LOCAL ] MFAO: No primary data file found to delete. [2025-10-25T23:30:10.480839] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-25T23:30:10.826108] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:30:10.826473] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-25T23:30:11.419325] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-25T23:30:11.420942] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-25T23:30:11.981093] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-25T23:30:11.982537] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-25T23:30:12.455518] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-25T23:30:12.456894] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-25T23:30:13.128064] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-25T23:30:13.129997] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-25T23:30:13.622691] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-25T23:30:13.624573] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-25T23:30:14.193721] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T23:30:14.195217] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-25T23:30:14.746375] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-25T23:30:14.748001] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-25T23:30:15.306082] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-25T23:30:15.307681] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-25T23:30:15.763095] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-25T23:30:15.764557] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-25T23:30:16.353143] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T23:30:16.354471] [INFO ] [REMOTE ] MFAO: Full fetch complete (5461 records). [2025-10-25T23:30:16.354582] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-25T23:30:16.750396] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-25T23:30:16.750557] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-25T23:30:16.750848] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-25T23:30:16.750945] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-25T23:30:16.751562] [DEBUG] [LOCAL ] MFAO: Trimmed 5461 records to 3917 (keeping 200 days of data) [2025-10-25T23:30:16.781178] [DEBUG] [LOCAL ] MFAO: Primary data saved (3917 records). [2025-10-25T23:30:16.781361] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-25T23:30:16.781516] [INFO ] [MAIN ] Update Progress: 1332/2366 symbols. MFAO took 6.5s. Estimated remaining time: 3h 31m 31s [2025-10-25T23:30:16.952061] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:30:16.952270] [DEBUG] [LOCAL ] MFC: No existing data file found in primary storage. [2025-10-25T23:30:16.952344] [WARN ] [MAIN ] MFC: No existing data found, performing full refresh instead. [2025-10-25T23:30:16.952458] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-25T23:30:16.952528] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-25T23:30:16.952616] [DEBUG] [LOCAL ] MFC: No primary data file found to delete. [2025-10-25T23:30:16.952708] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-25T23:30:17.320089] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:30:17.320449] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-25T23:30:19.035337] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T23:30:19.045724] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-25T23:30:20.727767] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T23:30:20.737618] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-25T23:30:22.502518] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-25T23:30:22.513548] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-25T23:30:24.150506] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T23:30:24.161910] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-25T23:30:25.803063] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-25T23:30:25.813962] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-25T23:30:27.557740] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-25T23:30:27.570067] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-25T23:30:29.346890] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T23:30:29.359123] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-25T23:30:30.925743] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T23:30:30.936589] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-25T23:30:32.700028] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-25T23:30:32.710963] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-25T23:30:34.566528] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-25T23:30:34.575904] [INFO ] [REMOTE ] MFC: Full fetch complete (74361 records). [2025-10-25T23:30:34.576120] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-25T23:30:34.974033] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-25T23:30:34.974155] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-25T23:30:34.975230] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-25T23:30:34.975311] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-25T23:30:34.976750] [DEBUG] [LOCAL ] MFC: Trimmed 74361 records to 51713 (keeping 200 days of data) [2025-10-25T23:30:35.278021] [DEBUG] [LOCAL ] MFC: Primary data saved (51713 records). [2025-10-25T23:30:35.278237] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-25T23:30:35.278468] [INFO ] [MAIN ] Update Progress: 1333/2366 symbols. MFC took 18.5s. Estimated remaining time: 3h 31m 24s [2025-10-25T23:30:35.466041] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:30:35.466279] [DEBUG] [LOCAL ] MFG: No existing data file found in primary storage. [2025-10-25T23:30:35.466351] [WARN ] [MAIN ] MFG: No existing data found, performing full refresh instead. [2025-10-25T23:30:35.466466] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-25T23:30:35.466536] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-25T23:30:35.466617] [DEBUG] [LOCAL ] MFG: No primary data file found to delete. [2025-10-25T23:30:35.466717] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-25T23:30:35.822589] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:30:35.823015] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-25T23:30:37.377608] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-25T23:30:37.386444] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-25T23:30:38.772564] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-25T23:30:38.781282] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-25T23:30:40.406726] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-25T23:30:40.416337] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-25T23:30:42.146691] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T23:30:42.157976] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-25T23:30:44.002973] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-25T23:30:44.013795] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-25T23:30:45.740002] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-25T23:30:45.749945] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-25T23:30:47.609547] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-25T23:30:47.621352] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-25T23:30:49.194131] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-25T23:30:49.205244] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-25T23:30:50.894168] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T23:30:50.905023] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-25T23:30:52.625975] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-25T23:30:52.636210] [INFO ] [REMOTE ] MFG: Full fetch complete (69970 records). [2025-10-25T23:30:52.636455] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-25T23:30:53.022314] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-25T23:30:53.022465] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-25T23:30:53.023540] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-25T23:30:53.023627] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-25T23:30:53.025230] [DEBUG] [LOCAL ] MFG: Trimmed 69970 records to 50211 (keeping 200 days of data) [2025-10-25T23:30:53.298504] [DEBUG] [LOCAL ] MFG: Primary data saved (50211 records). [2025-10-25T23:30:53.298712] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-25T23:30:53.298869] [INFO ] [MAIN ] Update Progress: 1334/2366 symbols. MFG took 18.0s. Estimated remaining time: 3h 31m 16s [2025-10-25T23:30:53.464958] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:30:53.465172] [DEBUG] [LOCAL ] MFM: No existing data file found in primary storage. [2025-10-25T23:30:53.465247] [WARN ] [MAIN ] MFM: No existing data found, performing full refresh instead. [2025-10-25T23:30:53.465364] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-25T23:30:53.465469] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-25T23:30:53.465556] [DEBUG] [LOCAL ] MFM: No primary data file found to delete. [2025-10-25T23:30:53.465627] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-25T23:30:53.817029] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:30:53.817415] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-25T23:30:54.603930] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-25T23:30:54.606110] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-25T23:30:55.495401] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T23:30:55.498581] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-25T23:30:56.312264] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T23:30:56.315498] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-25T23:30:57.384238] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-25T23:30:57.392456] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-25T23:30:58.212425] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-25T23:30:58.217509] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-25T23:30:59.067003] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T23:30:59.071414] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-25T23:31:00.118598] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T23:31:00.122684] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-25T23:31:00.688030] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-25T23:31:00.690911] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-25T23:31:01.560156] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T23:31:01.565460] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-25T23:31:02.347639] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T23:31:02.350721] [INFO ] [REMOTE ] MFM: Full fetch complete (19452 records). [2025-10-25T23:31:02.350864] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-25T23:31:02.740208] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-25T23:31:02.740351] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-25T23:31:02.740880] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-25T23:31:02.740966] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-25T23:31:02.741844] [DEBUG] [LOCAL ] MFM: Trimmed 19452 records to 14207 (keeping 200 days of data) [2025-10-25T23:31:02.823694] [DEBUG] [LOCAL ] MFM: Primary data saved (14207 records). [2025-10-25T23:31:02.823902] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-25T23:31:02.824067] [INFO ] [MAIN ] Update Progress: 1335/2366 symbols. MFM took 9.5s. Estimated remaining time: 3h 31m 1s [2025-10-25T23:31:03.005804] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:03.006041] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-25T23:31:03.006116] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-25T23:31:03.006237] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-25T23:31:03.006311] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-25T23:31:03.006393] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-25T23:31:03.006464] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-25T23:31:03.360585] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:03.361077] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-25T23:31:03.765736] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-25T23:31:03.766675] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-25T23:31:04.009936] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-25T23:31:04.010863] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-25T23:31:04.334206] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-25T23:31:04.335165] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-25T23:31:04.661278] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-25T23:31:04.662240] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-25T23:31:04.913067] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-25T23:31:04.914248] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-25T23:31:05.239771] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-25T23:31:05.240923] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-25T23:31:05.584808] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-25T23:31:05.585868] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-25T23:31:06.056113] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-25T23:31:06.057577] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-25T23:31:06.666857] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T23:31:06.668632] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-25T23:31:07.261256] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T23:31:07.262882] [INFO ] [REMOTE ] MFSB: Full fetch complete (2120 records). [2025-10-25T23:31:07.262987] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-25T23:31:07.456350] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-25T23:31:07.456565] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:31:07.456637] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:31:07.456737] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-25T23:31:07.456843] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-25T23:31:07.456891] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-25T23:31:07.456980] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-25T23:31:07.457140] [INFO ] [MAIN ] Update Progress: 1336/2366 symbols. MFSB took 4.6s. Estimated remaining time: 3h 30m 43s [2025-10-25T23:31:07.629675] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:07.629879] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-10-25T23:31:07.629949] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-10-25T23:31:07.630063] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-25T23:31:07.630132] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-25T23:31:07.630210] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-10-25T23:31:07.630279] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-25T23:31:07.980239] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:07.980583] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-25T23:31:08.426265] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-25T23:31:08.427386] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-25T23:31:08.841859] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-25T23:31:08.843393] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-25T23:31:09.288829] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-25T23:31:09.290192] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-25T23:31:09.866686] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-25T23:31:09.872185] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-25T23:31:10.469366] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T23:31:10.471016] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-25T23:31:11.052251] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-25T23:31:11.054202] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-25T23:31:11.683510] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-25T23:31:11.685369] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-25T23:31:12.284272] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-25T23:31:12.286412] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-25T23:31:13.005151] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T23:31:13.008040] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-25T23:31:13.718802] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T23:31:13.720971] [INFO ] [REMOTE ] MFSG: Full fetch complete (6849 records). [2025-10-25T23:31:13.721066] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-25T23:31:14.082384] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-25T23:31:14.082505] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-25T23:31:14.082735] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-25T23:31:14.082839] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-25T23:31:14.083286] [DEBUG] [LOCAL ] MFSG: Trimmed 6849 records to 6020 (keeping 200 days of data) [2025-10-25T23:31:14.118082] [DEBUG] [LOCAL ] MFSG: Primary data saved (6020 records). [2025-10-25T23:31:14.118212] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-25T23:31:14.118373] [INFO ] [MAIN ] Update Progress: 1337/2366 symbols. MFSG took 6.7s. Estimated remaining time: 3h 30m 27s [2025-10-25T23:31:14.321554] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:14.321798] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-10-25T23:31:14.321892] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-10-25T23:31:14.322000] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-25T23:31:14.322069] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-25T23:31:14.322133] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-10-25T23:31:14.322196] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-25T23:31:14.691069] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:14.691487] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-25T23:31:15.334546] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T23:31:15.336282] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-25T23:31:15.915610] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T23:31:15.917393] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-25T23:31:16.495850] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T23:31:16.497972] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-25T23:31:17.289617] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T23:31:17.291789] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-25T23:31:18.020877] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-25T23:31:18.023490] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-25T23:31:18.810597] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T23:31:18.813770] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-25T23:31:19.782127] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T23:31:19.788499] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-25T23:31:20.745584] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T23:31:20.750381] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-25T23:31:21.645595] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-25T23:31:21.649851] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-25T23:31:22.643263] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T23:31:22.646820] [INFO ] [REMOTE ] MFSI: Full fetch complete (15122 records). [2025-10-25T23:31:22.646921] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-25T23:31:23.017795] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-25T23:31:23.017963] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-25T23:31:23.018378] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-25T23:31:23.018457] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-25T23:31:23.019154] [DEBUG] [LOCAL ] MFSI: Trimmed 15122 records to 12878 (keeping 200 days of data) [2025-10-25T23:31:23.094986] [DEBUG] [LOCAL ] MFSI: Primary data saved (12878 records). [2025-10-25T23:31:23.095167] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-25T23:31:23.095379] [INFO ] [MAIN ] Update Progress: 1338/2366 symbols. MFSI took 9.0s. Estimated remaining time: 3h 30m 12s [2025-10-25T23:31:23.267378] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:23.267626] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-10-25T23:31:23.267724] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-10-25T23:31:23.267865] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-25T23:31:23.267970] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-25T23:31:23.268059] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-10-25T23:31:23.268146] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-25T23:31:23.619796] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:23.620135] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-25T23:31:24.060746] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-25T23:31:24.061839] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-25T23:31:24.478065] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T23:31:24.479225] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-25T23:31:24.988861] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-25T23:31:24.990317] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-25T23:31:25.415256] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-25T23:31:25.416562] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-25T23:31:25.832083] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-25T23:31:25.833208] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-25T23:31:26.382884] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T23:31:26.384217] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-25T23:31:26.647126] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-25T23:31:26.648440] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-25T23:31:27.242827] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T23:31:27.244445] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-25T23:31:27.860592] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T23:31:27.862483] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-25T23:31:28.441099] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:31:28.442768] [INFO ] [REMOTE ] MFSV: Full fetch complete (3743 records). [2025-10-25T23:31:28.442879] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-25T23:31:28.799539] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-25T23:31:28.799678] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-25T23:31:28.799849] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-25T23:31:28.799963] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-25T23:31:28.800423] [DEBUG] [LOCAL ] MFSV: Trimmed 3743 records to 3038 (keeping 200 days of data) [2025-10-25T23:31:28.818579] [DEBUG] [LOCAL ] MFSV: Primary data saved (3038 records). [2025-10-25T23:31:28.818686] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-25T23:31:28.818826] [INFO ] [MAIN ] Update Progress: 1339/2366 symbols. MFSV took 5.7s. Estimated remaining time: 3h 29m 55s [2025-10-25T23:31:28.987610] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:28.987856] [DEBUG] [LOCAL ] MG: No existing data file found in primary storage. [2025-10-25T23:31:28.987928] [WARN ] [MAIN ] MG: No existing data found, performing full refresh instead. [2025-10-25T23:31:28.988041] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-25T23:31:28.988145] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-25T23:31:28.988236] [DEBUG] [LOCAL ] MG: No primary data file found to delete. [2025-10-25T23:31:28.988306] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-25T23:31:29.344671] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:29.345057] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-25T23:31:30.311030] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-25T23:31:30.314771] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-25T23:31:31.115403] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-25T23:31:31.118454] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-25T23:31:32.268878] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T23:31:32.274053] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-25T23:31:33.242635] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-25T23:31:33.247242] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-25T23:31:34.319896] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T23:31:34.324204] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-25T23:31:35.191232] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-25T23:31:35.195726] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-25T23:31:36.108338] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-25T23:31:36.112564] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-25T23:31:37.014915] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T23:31:37.022047] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-25T23:31:37.889845] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T23:31:37.893632] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-25T23:31:38.476113] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:31:38.480156] [INFO ] [REMOTE ] MG: Full fetch complete (23191 records). [2025-10-25T23:31:38.480300] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-25T23:31:38.849829] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-25T23:31:38.849961] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-25T23:31:38.850556] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-25T23:31:38.850637] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-25T23:31:38.851383] [DEBUG] [LOCAL ] MG: Trimmed 23191 records to 15521 (keeping 200 days of data) [2025-10-25T23:31:38.933875] [DEBUG] [LOCAL ] MG: Primary data saved (15521 records). [2025-10-25T23:31:38.934051] [INFO ] [MAIN ] MG: Full history saved. [2025-10-25T23:31:38.934209] [INFO ] [MAIN ] Update Progress: 1340/2366 symbols. MG took 10.1s. Estimated remaining time: 3h 29m 41s [2025-10-25T23:31:39.103637] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:39.103945] [DEBUG] [LOCAL ] MGA: No existing data file found in primary storage. [2025-10-25T23:31:39.104018] [WARN ] [MAIN ] MGA: No existing data found, performing full refresh instead. [2025-10-25T23:31:39.104133] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-25T23:31:39.104199] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-25T23:31:39.104280] [DEBUG] [LOCAL ] MGA: No primary data file found to delete. [2025-10-25T23:31:39.104349] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-25T23:31:39.456727] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:39.457142] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-25T23:31:41.014514] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T23:31:41.024516] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-25T23:31:42.372019] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-25T23:31:42.381900] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-25T23:31:44.005076] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T23:31:44.016370] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-25T23:31:45.741660] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T23:31:45.752800] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-25T23:31:47.604315] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-25T23:31:47.615149] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-25T23:31:49.006720] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-25T23:31:49.016982] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-25T23:31:50.306421] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-25T23:31:50.317238] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-25T23:31:51.645950] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-25T23:31:51.656440] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-25T23:31:53.530008] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-25T23:31:53.541316] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-25T23:31:55.167519] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-25T23:31:55.176870] [INFO ] [REMOTE ] MGA: Full fetch complete (73687 records). [2025-10-25T23:31:55.177125] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-25T23:31:55.561952] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-25T23:31:55.562074] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-25T23:31:55.563106] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-25T23:31:55.563186] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-25T23:31:55.564539] [DEBUG] [LOCAL ] MGA: Trimmed 73687 records to 51109 (keeping 200 days of data) [2025-10-25T23:31:55.855524] [DEBUG] [LOCAL ] MGA: Primary data saved (51109 records). [2025-10-25T23:31:55.855710] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-25T23:31:55.855864] [INFO ] [MAIN ] Update Progress: 1341/2366 symbols. MGA took 16.9s. Estimated remaining time: 3h 29m 32s [2025-10-25T23:31:56.022944] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:31:56.023168] [DEBUG] [LOCAL ] MGF: No existing data file found in primary storage. [2025-10-25T23:31:56.023220] [WARN ] [MAIN ] MGF: No existing data found, performing full refresh instead. [2025-10-25T23:31:56.023296] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-25T23:31:56.023362] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-25T23:31:56.023442] [DEBUG] [LOCAL ] MGF: No primary data file found to delete. [2025-10-25T23:31:56.023510] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-25T23:31:56.398119] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:31:56.398474] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-25T23:31:56.951707] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-25T23:31:56.953161] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-25T23:31:57.490229] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-25T23:31:57.491619] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-25T23:31:58.068842] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-25T23:31:58.071178] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-25T23:31:58.682256] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T23:31:58.683911] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-25T23:31:59.285602] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-25T23:31:59.287299] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-25T23:31:59.933888] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-25T23:31:59.935552] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-25T23:32:00.504490] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-25T23:32:00.506120] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-25T23:32:02.127617] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-25T23:32:02.129618] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-25T23:32:02.755306] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T23:32:02.757029] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-25T23:32:03.346796] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T23:32:03.348159] [INFO ] [REMOTE ] MGF: Full fetch complete (5720 records). [2025-10-25T23:32:03.348268] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-25T23:32:03.703949] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-25T23:32:03.704103] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-25T23:32:03.704344] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-25T23:32:03.704472] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-25T23:32:03.704966] [DEBUG] [LOCAL ] MGF: Trimmed 5720 records to 4168 (keeping 200 days of data) [2025-10-25T23:32:03.728545] [DEBUG] [LOCAL ] MGF: Primary data saved (4168 records). [2025-10-25T23:32:03.728741] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-25T23:32:03.728910] [INFO ] [MAIN ] Update Progress: 1342/2366 symbols. MGF took 7.9s. Estimated remaining time: 3h 29m 16s [2025-10-25T23:32:03.897179] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:32:03.897437] [DEBUG] [LOCAL ] MGM: No existing data file found in primary storage. [2025-10-25T23:32:03.897525] [WARN ] [MAIN ] MGM: No existing data found, performing full refresh instead. [2025-10-25T23:32:03.897687] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-25T23:32:03.897800] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-25T23:32:03.897903] [DEBUG] [LOCAL ] MGM: No primary data file found to delete. [2025-10-25T23:32:03.897993] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-25T23:32:04.247959] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:32:04.248291] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-25T23:32:06.131932] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T23:32:06.142432] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-25T23:32:08.112448] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-25T23:32:08.129434] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-25T23:32:10.030784] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T23:32:10.041855] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-25T23:32:11.723103] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-25T23:32:11.735208] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-25T23:32:13.446340] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-25T23:32:13.457703] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-25T23:32:15.056415] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-25T23:32:15.067357] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-25T23:32:16.915745] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-25T23:32:16.927609] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-25T23:32:18.720552] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-25T23:32:18.732362] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-25T23:32:20.643858] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-25T23:32:20.655482] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-25T23:32:21.418798] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:32:21.428886] [INFO ] [REMOTE ] MGM: Full fetch complete (77758 records). [2025-10-25T23:32:21.429100] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-25T23:32:21.824451] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-25T23:32:21.824614] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-25T23:32:21.825739] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-25T23:32:21.825824] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-25T23:32:21.827405] [DEBUG] [LOCAL ] MGM: Trimmed 77758 records to 54382 (keeping 200 days of data) [2025-10-25T23:32:22.136364] [DEBUG] [LOCAL ] MGM: Primary data saved (54382 records). [2025-10-25T23:32:22.136553] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-25T23:32:22.136709] [INFO ] [MAIN ] Update Progress: 1343/2366 symbols. MGM took 18.4s. Estimated remaining time: 3h 29m 9s [2025-10-25T23:32:22.303971] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:32:22.304193] [DEBUG] [LOCAL ] MGR: No existing data file found in primary storage. [2025-10-25T23:32:22.304269] [WARN ] [MAIN ] MGR: No existing data found, performing full refresh instead. [2025-10-25T23:32:22.304386] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-25T23:32:22.304458] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-25T23:32:22.304525] [DEBUG] [LOCAL ] MGR: No primary data file found to delete. [2025-10-25T23:32:22.304590] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-25T23:32:22.654586] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:32:22.654951] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-25T23:32:23.242847] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-25T23:32:23.244789] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-25T23:32:23.829158] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T23:32:23.830814] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-25T23:32:24.447374] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-25T23:32:24.449824] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-25T23:32:25.128187] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-25T23:32:25.130513] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-25T23:32:25.641230] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-25T23:32:25.643373] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-25T23:32:26.229787] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T23:32:26.232329] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-25T23:32:27.022420] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-25T23:32:27.025096] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-25T23:32:27.625736] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-25T23:32:27.627694] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-25T23:32:28.318634] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T23:32:28.320536] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-25T23:32:28.937421] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T23:32:28.939321] [INFO ] [REMOTE ] MGR: Full fetch complete (7786 records). [2025-10-25T23:32:28.939627] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-25T23:32:29.337898] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-25T23:32:29.338041] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-25T23:32:29.338353] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-25T23:32:29.338433] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-25T23:32:29.338978] [DEBUG] [LOCAL ] MGR: Trimmed 7786 records to 5578 (keeping 200 days of data) [2025-10-25T23:32:29.379158] [DEBUG] [LOCAL ] MGR: Primary data saved (5578 records). [2025-10-25T23:32:29.379367] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-25T23:32:29.379544] [INFO ] [MAIN ] Update Progress: 1344/2366 symbols. MGR took 7.2s. Estimated remaining time: 3h 28m 53s [2025-10-25T23:32:29.544107] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:32:29.544342] [DEBUG] [LOCAL ] MGRB: No existing data file found in primary storage. [2025-10-25T23:32:29.544416] [WARN ] [MAIN ] MGRB: No existing data found, performing full refresh instead. [2025-10-25T23:32:29.544504] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-25T23:32:29.544571] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-25T23:32:29.544630] [DEBUG] [LOCAL ] MGRB: No primary data file found to delete. [2025-10-25T23:32:29.544719] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-25T23:32:29.893969] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:32:29.894330] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-25T23:32:30.393639] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-25T23:32:30.395066] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-25T23:32:30.957028] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-25T23:32:30.959404] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-25T23:32:31.385918] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-25T23:32:31.387342] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-25T23:32:32.046251] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-25T23:32:32.048369] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-25T23:32:33.551148] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T23:32:33.554077] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-25T23:32:34.113402] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-25T23:32:34.115065] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-25T23:32:34.531442] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-25T23:32:34.533087] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-25T23:32:35.109479] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-25T23:32:35.111127] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-25T23:32:35.551532] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-25T23:32:35.552845] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-25T23:32:35.989814] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-25T23:32:35.990903] [INFO ] [REMOTE ] MGRB: Full fetch complete (5495 records). [2025-10-25T23:32:35.991017] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-25T23:32:36.353107] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-25T23:32:36.353255] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-25T23:32:36.353490] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-25T23:32:36.353583] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-25T23:32:36.354091] [DEBUG] [LOCAL ] MGRB: Trimmed 5495 records to 4017 (keeping 200 days of data) [2025-10-25T23:32:36.378577] [DEBUG] [LOCAL ] MGRB: Primary data saved (4017 records). [2025-10-25T23:32:36.378787] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-25T23:32:36.378967] [INFO ] [MAIN ] Update Progress: 1345/2366 symbols. MGRB took 7.0s. Estimated remaining time: 3h 28m 36s [2025-10-25T23:32:36.548224] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:32:36.548467] [DEBUG] [LOCAL ] MGRD: No existing data file found in primary storage. [2025-10-25T23:32:36.548554] [WARN ] [MAIN ] MGRD: No existing data found, performing full refresh instead. [2025-10-25T23:32:36.548735] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-25T23:32:36.548836] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-25T23:32:36.548943] [DEBUG] [LOCAL ] MGRD: No primary data file found to delete. [2025-10-25T23:32:36.549029] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-25T23:32:36.899669] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:32:36.900013] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-25T23:32:37.361575] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-25T23:32:37.362882] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-25T23:32:37.812078] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-25T23:32:37.813342] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-25T23:32:38.252536] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-25T23:32:38.253803] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-25T23:32:38.725204] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-25T23:32:38.727324] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-25T23:32:39.051539] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-25T23:32:39.052929] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-25T23:32:39.483278] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-25T23:32:39.484583] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-25T23:32:39.856507] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-25T23:32:39.857849] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-25T23:32:40.300448] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-25T23:32:40.301784] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-25T23:32:40.801264] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-25T23:32:40.802425] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-25T23:32:41.236074] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-25T23:32:41.237114] [INFO ] [REMOTE ] MGRD: Full fetch complete (3285 records). [2025-10-25T23:32:41.237207] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-25T23:32:41.630686] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-25T23:32:41.630852] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-25T23:32:41.631004] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-25T23:32:41.631106] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-25T23:32:41.631557] [DEBUG] [LOCAL ] MGRD: Trimmed 3285 records to 2219 (keeping 200 days of data) [2025-10-25T23:32:41.645231] [DEBUG] [LOCAL ] MGRD: Primary data saved (2219 records). [2025-10-25T23:32:41.645325] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-25T23:32:41.645494] [INFO ] [MAIN ] Update Progress: 1346/2366 symbols. MGRD took 5.3s. Estimated remaining time: 3h 28m 19s [2025-10-25T23:32:41.860419] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:32:41.860678] [DEBUG] [LOCAL ] MGRE: No existing data file found in primary storage. [2025-10-25T23:32:41.860753] [WARN ] [MAIN ] MGRE: No existing data found, performing full refresh instead. [2025-10-25T23:32:41.860868] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-25T23:32:41.860938] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-25T23:32:41.861068] [DEBUG] [LOCAL ] MGRE: No primary data file found to delete. [2025-10-25T23:32:41.861139] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-25T23:32:42.209924] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:32:42.210324] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-25T23:32:42.847702] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-25T23:32:42.849622] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-25T23:32:43.509228] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-25T23:32:43.511286] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-25T23:32:44.082058] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T23:32:44.083876] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-25T23:32:44.787456] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-25T23:32:44.789969] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-25T23:32:45.377258] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T23:32:45.379315] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-25T23:32:45.981302] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-25T23:32:45.983473] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-25T23:32:46.690141] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T23:32:46.692298] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-25T23:32:47.299709] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T23:32:47.301994] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-25T23:32:47.923359] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T23:32:47.925982] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-25T23:32:48.498180] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T23:32:48.499744] [INFO ] [REMOTE ] MGRE: Full fetch complete (9156 records). [2025-10-25T23:32:48.499837] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-25T23:32:48.890709] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-25T23:32:48.890854] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-25T23:32:48.891174] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-25T23:32:48.891252] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-25T23:32:48.891755] [DEBUG] [LOCAL ] MGRE: Trimmed 9156 records to 6475 (keeping 200 days of data) [2025-10-25T23:32:48.930393] [DEBUG] [LOCAL ] MGRE: Primary data saved (6475 records). [2025-10-25T23:32:48.930552] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-25T23:32:48.930731] [INFO ] [MAIN ] Update Progress: 1347/2366 symbols. MGRE took 7.3s. Estimated remaining time: 3h 28m 3s [2025-10-25T23:32:49.096779] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:32:49.096990] [DEBUG] [LOCAL ] MGY: No existing data file found in primary storage. [2025-10-25T23:32:49.097067] [WARN ] [MAIN ] MGY: No existing data found, performing full refresh instead. [2025-10-25T23:32:49.097184] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-25T23:32:49.097258] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-25T23:32:49.097342] [DEBUG] [LOCAL ] MGY: No primary data file found to delete. [2025-10-25T23:32:49.097412] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-25T23:32:49.466603] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:32:49.468155] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-25T23:32:51.024623] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-25T23:32:51.034701] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-25T23:32:52.648739] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-25T23:32:52.658846] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-25T23:32:54.295344] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-25T23:32:54.307256] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-25T23:32:56.010223] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T23:32:56.021585] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-25T23:32:57.751517] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T23:32:57.763062] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-25T23:32:59.277212] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T23:32:59.287698] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-25T23:33:01.592222] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-25T23:33:01.604262] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-25T23:33:03.794969] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-25T23:33:03.805905] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-25T23:33:05.793886] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-25T23:33:05.804927] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-25T23:33:06.563279] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:33:06.572829] [INFO ] [REMOTE ] MGY: Full fetch complete (75969 records). [2025-10-25T23:33:06.572996] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-25T23:33:06.966855] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-25T23:33:06.966984] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-25T23:33:06.968070] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-25T23:33:06.968151] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-25T23:33:06.969808] [DEBUG] [LOCAL ] MGY: Trimmed 75969 records to 53190 (keeping 200 days of data) [2025-10-25T23:33:07.277898] [DEBUG] [LOCAL ] MGY: Primary data saved (53190 records). [2025-10-25T23:33:07.278081] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-25T23:33:07.278232] [INFO ] [MAIN ] Update Progress: 1348/2366 symbols. MGY took 18.3s. Estimated remaining time: 3h 27m 55s [2025-10-25T23:33:07.447197] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:07.447444] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-25T23:33:07.447530] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-25T23:33:07.447692] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-25T23:33:07.447763] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-25T23:33:07.447862] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-25T23:33:07.447930] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-25T23:33:07.796181] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:07.796532] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-10-25T23:33:07.995129] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:33:07.995570] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-10-25T23:33:07.995686] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:33:07.995767] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-25T23:33:07.995836] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:33:07.995908] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-25T23:33:07.996015] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-25T23:33:07.996092] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-25T23:33:07.996174] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-25T23:33:07.996304] [INFO ] [MAIN ] Update Progress: 1349/2366 symbols. MH took 0.7s. Estimated remaining time: 3h 27m 34s [2025-10-25T23:33:08.174417] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:08.174680] [DEBUG] [LOCAL ] MHD: No existing data file found in primary storage. [2025-10-25T23:33:08.174755] [WARN ] [MAIN ] MHD: No existing data found, performing full refresh instead. [2025-10-25T23:33:08.174871] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-25T23:33:08.174942] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-25T23:33:08.175023] [DEBUG] [LOCAL ] MHD: No primary data file found to delete. [2025-10-25T23:33:08.175090] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-25T23:33:08.573020] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:08.573461] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-25T23:33:09.525315] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T23:33:09.529120] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-25T23:33:10.386586] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T23:33:10.390164] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-25T23:33:11.289915] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T23:33:11.293387] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-25T23:33:12.230609] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T23:33:12.234354] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-25T23:33:12.804562] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T23:33:12.807722] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-25T23:33:13.592075] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-25T23:33:13.595932] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-25T23:33:14.378171] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T23:33:14.381434] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-25T23:33:15.155476] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-25T23:33:15.158542] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-25T23:33:16.182934] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-25T23:33:16.186446] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-25T23:33:16.990749] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T23:33:16.996102] [INFO ] [REMOTE ] MHD: Full fetch complete (17974 records). [2025-10-25T23:33:16.996354] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-25T23:33:17.577062] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-25T23:33:17.577222] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-25T23:33:17.577976] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-25T23:33:17.578077] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-25T23:33:17.579171] [DEBUG] [LOCAL ] MHD: Trimmed 17974 records to 12010 (keeping 200 days of data) [2025-10-25T23:33:17.675379] [DEBUG] [LOCAL ] MHD: Primary data saved (12010 records). [2025-10-25T23:33:17.675578] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-25T23:33:17.675780] [INFO ] [MAIN ] Update Progress: 1350/2366 symbols. MHD took 9.7s. Estimated remaining time: 3h 27m 20s [2025-10-25T23:33:17.853950] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:17.854199] [DEBUG] [LOCAL ] MHF: No existing data file found in primary storage. [2025-10-25T23:33:17.854270] [WARN ] [MAIN ] MHF: No existing data found, performing full refresh instead. [2025-10-25T23:33:17.854387] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-25T23:33:17.854457] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-25T23:33:17.854539] [DEBUG] [LOCAL ] MHF: No primary data file found to delete. [2025-10-25T23:33:17.854608] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-25T23:33:18.245848] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:18.246227] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-25T23:33:18.974127] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T23:33:18.976811] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-25T23:33:19.835344] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T23:33:19.838325] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-25T23:33:20.586007] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T23:33:20.588168] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-25T23:33:21.322549] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-25T23:33:21.325093] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-25T23:33:21.809232] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T23:33:21.811213] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-25T23:33:22.587464] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-25T23:33:22.591968] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-25T23:33:23.180463] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-25T23:33:23.183360] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-25T23:33:23.892528] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T23:33:23.895097] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-25T23:33:24.600075] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T23:33:24.602950] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-25T23:33:25.382014] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T23:33:25.384390] [INFO ] [REMOTE ] MHF: Full fetch complete (12846 records). [2025-10-25T23:33:25.384481] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-25T23:33:25.739733] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-25T23:33:25.739849] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-25T23:33:25.740201] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-25T23:33:25.740278] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-25T23:33:25.740851] [DEBUG] [LOCAL ] MHF: Trimmed 12846 records to 9173 (keeping 200 days of data) [2025-10-25T23:33:25.791420] [DEBUG] [LOCAL ] MHF: Primary data saved (9173 records). [2025-10-25T23:33:25.791576] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-25T23:33:25.791747] [INFO ] [MAIN ] Update Progress: 1351/2366 symbols. MHF took 8.1s. Estimated remaining time: 3h 27m 5s [2025-10-25T23:33:25.959299] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:25.959495] [DEBUG] [LOCAL ] MHK: No existing data file found in primary storage. [2025-10-25T23:33:25.959567] [WARN ] [MAIN ] MHK: No existing data found, performing full refresh instead. [2025-10-25T23:33:25.959724] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-25T23:33:25.959807] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-25T23:33:25.959888] [DEBUG] [LOCAL ] MHK: No primary data file found to delete. [2025-10-25T23:33:25.959962] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-25T23:33:26.313077] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:26.313420] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-25T23:33:27.933936] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-25T23:33:27.942629] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-25T23:33:29.657507] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T23:33:29.665944] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-25T23:33:31.465709] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-25T23:33:31.475609] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-25T23:33:33.149936] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-25T23:33:33.159385] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-25T23:33:34.526101] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-25T23:33:34.534950] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-25T23:33:36.039375] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T23:33:36.048200] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-25T23:33:37.976257] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-25T23:33:37.986265] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-25T23:33:39.433777] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T23:33:39.442900] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-25T23:33:40.918893] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-25T23:33:40.927795] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-25T23:33:41.661225] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T23:33:41.669298] [INFO ] [REMOTE ] MHK: Full fetch complete (61451 records). [2025-10-25T23:33:41.669509] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-25T23:33:42.062858] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-25T23:33:42.063014] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-25T23:33:42.064194] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-25T23:33:42.064289] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-25T23:33:42.065808] [DEBUG] [LOCAL ] MHK: Trimmed 61451 records to 42711 (keeping 200 days of data) [2025-10-25T23:33:42.323490] [DEBUG] [LOCAL ] MHK: Primary data saved (42711 records). [2025-10-25T23:33:42.323737] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-25T23:33:42.323955] [INFO ] [MAIN ] Update Progress: 1352/2366 symbols. MHK took 16.5s. Estimated remaining time: 3h 26m 56s [2025-10-25T23:33:42.504158] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:42.504364] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-25T23:33:42.504434] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-25T23:33:42.504546] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-25T23:33:42.504615] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-25T23:33:42.504714] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-25T23:33:42.504782] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-25T23:33:42.847105] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:42.847459] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-25T23:33:43.174616] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-25T23:33:43.175752] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-25T23:33:43.515158] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-25T23:33:43.516095] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-25T23:33:43.845931] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-25T23:33:43.847033] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-25T23:33:44.191801] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-25T23:33:44.192927] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-25T23:33:44.734215] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-25T23:33:44.735699] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-25T23:33:45.069400] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-25T23:33:45.070452] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-25T23:33:45.382915] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-25T23:33:45.383845] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-25T23:33:45.861771] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-25T23:33:45.862678] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-25T23:33:46.209397] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-25T23:33:46.210436] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-25T23:33:46.521890] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-25T23:33:46.522695] [INFO ] [REMOTE ] MHLA: Full fetch complete (1485 records). [2025-10-25T23:33:46.522806] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-25T23:33:46.716857] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-25T23:33:46.717069] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:33:46.717119] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:33:46.717163] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-25T23:33:46.717259] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-25T23:33:46.717329] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-25T23:33:46.717396] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-25T23:33:46.717555] [INFO ] [MAIN ] Update Progress: 1353/2366 symbols. MHLA took 4.4s. Estimated remaining time: 3h 26m 38s [2025-10-25T23:33:46.915600] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:46.915850] [DEBUG] [LOCAL ] MHN: No existing data file found in primary storage. [2025-10-25T23:33:46.915920] [WARN ] [MAIN ] MHN: No existing data found, performing full refresh instead. [2025-10-25T23:33:46.916033] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-25T23:33:46.916103] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-25T23:33:46.916181] [DEBUG] [LOCAL ] MHN: No primary data file found to delete. [2025-10-25T23:33:46.916250] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-25T23:33:47.286401] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:47.286906] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-25T23:33:48.145734] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-25T23:33:48.148411] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-25T23:33:48.937116] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-25T23:33:48.939886] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-25T23:33:49.712762] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T23:33:49.715270] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-25T23:33:50.514409] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-25T23:33:50.517744] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-25T23:33:51.207025] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-25T23:33:51.209451] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-25T23:33:51.682709] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T23:33:51.685078] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-25T23:33:52.428567] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T23:33:52.431465] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-25T23:33:53.160998] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-25T23:33:53.163453] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-25T23:33:53.908878] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T23:33:53.912245] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-25T23:33:54.583814] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T23:33:54.585775] [INFO ] [REMOTE ] MHN: Full fetch complete (11169 records). [2025-10-25T23:33:54.585876] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-25T23:33:54.996931] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-25T23:33:54.997080] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-25T23:33:54.997561] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-25T23:33:54.997665] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-25T23:33:54.998374] [DEBUG] [LOCAL ] MHN: Trimmed 11169 records to 7435 (keeping 200 days of data) [2025-10-25T23:33:55.047191] [DEBUG] [LOCAL ] MHN: Primary data saved (7435 records). [2025-10-25T23:33:55.047402] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-25T23:33:55.047600] [INFO ] [MAIN ] Update Progress: 1354/2366 symbols. MHN took 8.3s. Estimated remaining time: 3h 26m 22s [2025-10-25T23:33:55.221974] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:33:55.222254] [DEBUG] [LOCAL ] MHO: No existing data file found in primary storage. [2025-10-25T23:33:55.222370] [WARN ] [MAIN ] MHO: No existing data found, performing full refresh instead. [2025-10-25T23:33:55.222548] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-25T23:33:55.222639] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-25T23:33:55.222768] [DEBUG] [LOCAL ] MHO: No primary data file found to delete. [2025-10-25T23:33:55.222857] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-25T23:33:55.603713] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:33:55.604162] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-25T23:33:56.710400] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-25T23:33:56.717268] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-25T23:33:58.053801] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-25T23:33:58.060674] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-25T23:33:59.289128] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-25T23:33:59.295860] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-25T23:34:00.565130] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-25T23:34:00.571094] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-25T23:34:02.000017] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-25T23:34:02.006774] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-25T23:34:03.111731] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-25T23:34:03.116877] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-25T23:34:04.277979] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-25T23:34:04.289032] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-25T23:34:05.528301] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T23:34:05.534562] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-25T23:34:06.687536] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T23:34:06.693666] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-25T23:34:07.263532] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T23:34:07.268439] [INFO ] [REMOTE ] MHO: Full fetch complete (36514 records). [2025-10-25T23:34:07.268579] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-25T23:34:07.672699] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-25T23:34:07.672864] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-25T23:34:07.674409] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-25T23:34:07.674500] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-25T23:34:07.675949] [DEBUG] [LOCAL ] MHO: Trimmed 36514 records to 24039 (keeping 200 days of data) [2025-10-25T23:34:07.827068] [DEBUG] [LOCAL ] MHO: Primary data saved (24039 records). [2025-10-25T23:34:07.827277] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-25T23:34:07.827476] [INFO ] [MAIN ] Update Progress: 1355/2366 symbols. MHO took 12.8s. Estimated remaining time: 3h 26m 11s [2025-10-25T23:34:08.014403] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:08.014735] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-25T23:34:08.014809] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-25T23:34:08.014939] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-25T23:34:08.015011] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-25T23:34:08.015154] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-25T23:34:08.015228] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-25T23:34:08.384630] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:08.385332] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-10-25T23:34:08.587527] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:34:08.588047] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-10-25T23:34:08.588141] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:34:08.588216] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-25T23:34:08.588284] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:34:08.588362] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-25T23:34:08.588461] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-25T23:34:08.588534] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-25T23:34:08.588615] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-25T23:34:08.588816] [INFO ] [MAIN ] Update Progress: 1356/2366 symbols. MIAX took 0.8s. Estimated remaining time: 3h 25m 50s [2025-10-25T23:34:08.788033] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:08.788319] [DEBUG] [LOCAL ] MIN: No existing data file found in primary storage. [2025-10-25T23:34:08.788394] [WARN ] [MAIN ] MIN: No existing data found, performing full refresh instead. [2025-10-25T23:34:08.788523] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-25T23:34:08.788595] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-25T23:34:08.788706] [DEBUG] [LOCAL ] MIN: No primary data file found to delete. [2025-10-25T23:34:08.788786] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-25T23:34:09.188152] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:09.188752] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-25T23:34:10.018977] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-25T23:34:10.021802] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-25T23:34:10.801360] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T23:34:10.803851] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-25T23:34:11.374305] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-25T23:34:11.377063] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-25T23:34:12.255154] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-25T23:34:12.259870] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-25T23:34:13.119481] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-25T23:34:13.123020] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-25T23:34:14.044013] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-25T23:34:14.048107] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-25T23:34:15.164740] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T23:34:15.170306] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-25T23:34:16.079140] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T23:34:16.083433] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-25T23:34:16.897004] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-25T23:34:16.900172] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-25T23:34:17.776282] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-25T23:34:17.781197] [INFO ] [REMOTE ] MIN: Full fetch complete (17716 records). [2025-10-25T23:34:17.781384] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-25T23:34:18.212519] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-25T23:34:18.212702] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-25T23:34:18.213464] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-25T23:34:18.213553] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-25T23:34:18.214415] [DEBUG] [LOCAL ] MIN: Trimmed 17716 records to 14084 (keeping 200 days of data) [2025-10-25T23:34:18.301342] [DEBUG] [LOCAL ] MIN: Primary data saved (14084 records). [2025-10-25T23:34:18.301581] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-25T23:34:18.301834] [INFO ] [MAIN ] Update Progress: 1357/2366 symbols. MIN took 9.7s. Estimated remaining time: 3h 25m 36s [2025-10-25T23:34:18.487316] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:18.487690] [DEBUG] [LOCAL ] MIR: No existing data file found in primary storage. [2025-10-25T23:34:18.487769] [WARN ] [MAIN ] MIR: No existing data found, performing full refresh instead. [2025-10-25T23:34:18.487927] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-25T23:34:18.488005] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-25T23:34:18.488092] [DEBUG] [LOCAL ] MIR: No primary data file found to delete. [2025-10-25T23:34:18.488175] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-25T23:34:18.874626] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:18.875155] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-25T23:34:20.465586] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T23:34:20.476270] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-25T23:34:22.272275] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-25T23:34:22.282355] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-25T23:34:23.971769] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-25T23:34:23.983153] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-25T23:34:25.479846] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T23:34:25.490941] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-25T23:34:27.016813] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T23:34:27.028167] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-25T23:34:28.736134] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T23:34:28.747514] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-25T23:34:30.524968] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T23:34:30.536739] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-25T23:34:32.161961] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-25T23:34:32.172531] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-25T23:34:33.868085] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-25T23:34:33.879889] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-25T23:34:35.690395] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-25T23:34:35.700177] [INFO ] [REMOTE ] MIR: Full fetch complete (74017 records). [2025-10-25T23:34:35.700343] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-25T23:34:36.099243] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-25T23:34:36.099366] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-25T23:34:36.100441] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-25T23:34:36.100521] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-25T23:34:36.101957] [DEBUG] [LOCAL ] MIR: Trimmed 74017 records to 52162 (keeping 200 days of data) [2025-10-25T23:34:36.392774] [DEBUG] [LOCAL ] MIR: Primary data saved (52162 records). [2025-10-25T23:34:36.392946] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-25T23:34:36.393100] [INFO ] [MAIN ] Update Progress: 1358/2366 symbols. MIR took 18.1s. Estimated remaining time: 3h 25m 28s [2025-10-25T23:34:36.569474] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:36.569740] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-25T23:34:36.569815] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-25T23:34:36.569930] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-25T23:34:36.570007] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-25T23:34:36.570087] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-25T23:34:36.570153] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-25T23:34:36.933266] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:36.933605] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-25T23:34:37.280936] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-25T23:34:37.281975] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-25T23:34:37.700255] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T23:34:37.701387] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-25T23:34:38.228898] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-25T23:34:38.230556] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-25T23:34:38.834340] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-25T23:34:38.836007] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-25T23:34:39.318927] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-25T23:34:39.320027] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-25T23:34:39.637347] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-25T23:34:39.638478] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-25T23:34:39.958229] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-25T23:34:39.959629] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-25T23:34:40.360343] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-25T23:34:40.361948] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-25T23:34:40.614371] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-25T23:34:40.615453] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-25T23:34:40.954188] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-25T23:34:40.955166] [INFO ] [REMOTE ] MITN: Full fetch complete (2333 records). [2025-10-25T23:34:40.955256] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-25T23:34:41.157161] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T23:34:41.157407] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:34:41.157480] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:34:41.157530] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-25T23:34:41.157617] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-25T23:34:41.157716] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-25T23:34:41.157818] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-25T23:34:41.157956] [INFO ] [MAIN ] Update Progress: 1359/2366 symbols. MITN took 4.8s. Estimated remaining time: 3h 25m 10s [2025-10-25T23:34:41.354764] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:41.354997] [DEBUG] [LOCAL ] MITP: No existing data file found in primary storage. [2025-10-25T23:34:41.355068] [WARN ] [MAIN ] MITP: No existing data found, performing full refresh instead. [2025-10-25T23:34:41.355184] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-25T23:34:41.355255] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-25T23:34:41.355336] [DEBUG] [LOCAL ] MITP: No primary data file found to delete. [2025-10-25T23:34:41.355405] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-25T23:34:41.708398] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:41.708777] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-25T23:34:42.135107] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-25T23:34:42.136630] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-25T23:34:42.502408] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-25T23:34:42.504081] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-25T23:34:42.950386] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-25T23:34:42.952198] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-25T23:34:43.358432] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-25T23:34:43.360518] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-25T23:34:43.916989] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-25T23:34:43.918782] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-25T23:34:44.386562] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-25T23:34:44.387966] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-25T23:34:44.805985] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-25T23:34:44.807496] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-25T23:34:45.152030] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-25T23:34:45.153487] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-25T23:34:45.501443] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-25T23:34:45.503206] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-25T23:34:45.835460] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-25T23:34:45.836360] [INFO ] [REMOTE ] MITP: Full fetch complete (3204 records). [2025-10-25T23:34:45.836451] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-25T23:34:46.229776] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-25T23:34:46.229941] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-25T23:34:46.230113] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-25T23:34:46.230189] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-25T23:34:46.230548] [DEBUG] [LOCAL ] MITP: Trimmed 3204 records to 2211 (keeping 200 days of data) [2025-10-25T23:34:46.243248] [DEBUG] [LOCAL ] MITP: Primary data saved (2211 records). [2025-10-25T23:34:46.243335] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-25T23:34:46.243461] [INFO ] [MAIN ] Update Progress: 1360/2366 symbols. MITP took 5.1s. Estimated remaining time: 3h 24m 53s [2025-10-25T23:34:46.432036] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:46.432290] [DEBUG] [LOCAL ] MITT: No existing data file found in primary storage. [2025-10-25T23:34:46.432375] [WARN ] [MAIN ] MITT: No existing data found, performing full refresh instead. [2025-10-25T23:34:46.432513] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-25T23:34:46.432597] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-25T23:34:46.432720] [DEBUG] [LOCAL ] MITT: No primary data file found to delete. [2025-10-25T23:34:46.432809] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-25T23:34:46.806546] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:46.806911] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-25T23:34:48.083955] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T23:34:48.089469] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-25T23:34:48.931009] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-25T23:34:48.935844] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-25T23:34:50.069589] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-25T23:34:50.075664] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-25T23:34:51.296874] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T23:34:51.303637] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-25T23:34:52.299273] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-25T23:34:52.304094] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-25T23:34:53.387511] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T23:34:53.393089] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-25T23:34:54.565122] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T23:34:54.570016] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-25T23:34:55.714364] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-25T23:34:55.721897] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-25T23:34:56.784579] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-25T23:34:56.790027] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-25T23:34:57.882460] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-25T23:34:57.887290] [INFO ] [REMOTE ] MITT: Full fetch complete (33220 records). [2025-10-25T23:34:57.887516] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-25T23:34:58.350680] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-25T23:34:58.350818] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-25T23:34:58.351672] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-25T23:34:58.351760] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-25T23:34:58.352872] [DEBUG] [LOCAL ] MITT: Trimmed 33220 records to 22491 (keeping 200 days of data) [2025-10-25T23:34:58.479638] [DEBUG] [LOCAL ] MITT: Primary data saved (22491 records). [2025-10-25T23:34:58.479844] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-25T23:34:58.479999] [INFO ] [MAIN ] Update Progress: 1361/2366 symbols. MITT took 12.2s. Estimated remaining time: 3h 24m 40s [2025-10-25T23:34:58.648776] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:34:58.649009] [DEBUG] [LOCAL ] MIY: No existing data file found in primary storage. [2025-10-25T23:34:58.649085] [WARN ] [MAIN ] MIY: No existing data found, performing full refresh instead. [2025-10-25T23:34:58.649198] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-25T23:34:58.649270] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-25T23:34:58.649351] [DEBUG] [LOCAL ] MIY: No primary data file found to delete. [2025-10-25T23:34:58.649420] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-25T23:34:58.999703] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:34:59.000080] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-25T23:34:59.610156] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T23:34:59.612054] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-25T23:35:00.159473] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-25T23:35:00.161201] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-25T23:35:00.947314] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-25T23:35:00.949286] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-25T23:35:02.330190] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-25T23:35:02.332472] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-25T23:35:02.964207] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T23:35:02.966244] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-25T23:35:03.726981] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T23:35:03.729442] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-25T23:35:04.473102] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-25T23:35:04.476599] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-25T23:35:05.131983] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-25T23:35:05.134311] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-25T23:35:05.760398] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-25T23:35:05.762573] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-25T23:35:06.535381] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T23:35:06.537819] [INFO ] [REMOTE ] MIY: Full fetch complete (8669 records). [2025-10-25T23:35:06.537947] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-25T23:35:06.920745] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-25T23:35:06.920915] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-25T23:35:06.921337] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-25T23:35:06.921424] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-25T23:35:06.922279] [DEBUG] [LOCAL ] MIY: Trimmed 8669 records to 6308 (keeping 200 days of data) [2025-10-25T23:35:06.967330] [DEBUG] [LOCAL ] MIY: Primary data saved (6308 records). [2025-10-25T23:35:06.967619] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-25T23:35:06.968005] [INFO ] [MAIN ] Update Progress: 1362/2366 symbols. MIY took 8.5s. Estimated remaining time: 3h 24m 25s [2025-10-25T23:35:07.162517] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:35:07.162849] [DEBUG] [LOCAL ] MKC: No existing data file found in primary storage. [2025-10-25T23:35:07.162925] [WARN ] [MAIN ] MKC: No existing data found, performing full refresh instead. [2025-10-25T23:35:07.163056] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-25T23:35:07.163131] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-25T23:35:07.163216] [DEBUG] [LOCAL ] MKC: No primary data file found to delete. [2025-10-25T23:35:07.163289] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-25T23:35:07.541157] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:35:07.541616] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-25T23:35:09.419309] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-25T23:35:09.430098] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-25T23:35:11.278958] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-25T23:35:11.290829] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-25T23:35:13.285537] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-25T23:35:13.297849] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-25T23:35:15.226527] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-25T23:35:15.237890] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-25T23:35:17.292090] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-25T23:35:17.305005] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-25T23:35:19.060791] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-25T23:35:19.071263] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-25T23:35:20.979618] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-25T23:35:20.991058] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-25T23:35:22.772368] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T23:35:22.783636] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-25T23:35:24.624999] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-25T23:35:24.636013] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-25T23:35:25.435730] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T23:35:25.445238] [INFO ] [REMOTE ] MKC: Full fetch complete (76006 records). [2025-10-25T23:35:25.445419] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-25T23:35:25.830313] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-25T23:35:25.830430] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-25T23:35:25.831474] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-25T23:35:25.831555] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-25T23:35:25.833010] [DEBUG] [LOCAL ] MKC: Trimmed 76006 records to 53293 (keeping 200 days of data) [2025-10-25T23:35:26.156612] [DEBUG] [LOCAL ] MKC: Primary data saved (53293 records). [2025-10-25T23:35:26.156824] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-25T23:35:26.156992] [INFO ] [MAIN ] Update Progress: 1363/2366 symbols. MKC took 19.2s. Estimated remaining time: 3h 24m 18s [2025-10-25T23:35:26.328809] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:35:26.329029] [DEBUG] [LOCAL ] MKL: No existing data file found in primary storage. [2025-10-25T23:35:26.329101] [WARN ] [MAIN ] MKL: No existing data found, performing full refresh instead. [2025-10-25T23:35:26.329215] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-25T23:35:26.329284] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-25T23:35:26.329363] [DEBUG] [LOCAL ] MKL: No primary data file found to delete. [2025-10-25T23:35:26.329431] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-25T23:35:26.712528] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:35:26.712942] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-25T23:35:28.100874] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T23:35:28.107940] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-25T23:35:29.554621] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-25T23:35:29.562225] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-25T23:35:31.091725] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-25T23:35:31.099222] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-25T23:35:32.599029] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T23:35:32.607129] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-25T23:35:34.110809] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T23:35:34.119092] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-25T23:35:35.451371] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-25T23:35:35.458464] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-25T23:35:36.814110] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T23:35:36.821846] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-25T23:35:38.224159] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T23:35:38.231464] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-25T23:35:39.652325] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-25T23:35:39.659350] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-25T23:35:41.043489] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-25T23:35:41.049820] [INFO ] [REMOTE ] MKL: Full fetch complete (49833 records). [2025-10-25T23:35:41.050027] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-25T23:35:41.435727] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-25T23:35:41.435876] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-25T23:35:41.436869] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-25T23:35:41.436968] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-25T23:35:41.438294] [DEBUG] [LOCAL ] MKL: Trimmed 49833 records to 34164 (keeping 200 days of data) [2025-10-25T23:35:41.641499] [DEBUG] [LOCAL ] MKL: Primary data saved (34164 records). [2025-10-25T23:35:41.641734] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-25T23:35:41.641938] [INFO ] [MAIN ] Update Progress: 1364/2366 symbols. MKL took 15.5s. Estimated remaining time: 3h 24m 8s [2025-10-25T23:35:41.822394] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:35:41.822626] [DEBUG] [LOCAL ] MLI: No existing data file found in primary storage. [2025-10-25T23:35:41.822737] [WARN ] [MAIN ] MLI: No existing data found, performing full refresh instead. [2025-10-25T23:35:41.822887] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-25T23:35:41.823000] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-25T23:35:41.823103] [DEBUG] [LOCAL ] MLI: No primary data file found to delete. [2025-10-25T23:35:41.823186] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-25T23:35:42.190900] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:35:42.191287] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-25T23:35:43.759740] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-25T23:35:43.769173] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-25T23:35:45.300489] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-25T23:35:45.309465] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-25T23:35:46.966939] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-25T23:35:46.976879] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-25T23:35:48.793885] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T23:35:48.804150] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-25T23:35:50.466776] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-25T23:35:50.475336] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-25T23:35:52.052306] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T23:35:52.061860] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-25T23:35:53.662200] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T23:35:53.672186] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-25T23:35:55.147599] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-25T23:35:55.156984] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-25T23:35:56.794565] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-25T23:35:56.803898] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-25T23:35:57.476394] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T23:35:57.484178] [INFO ] [REMOTE ] MLI: Full fetch complete (63341 records). [2025-10-25T23:35:57.484320] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-25T23:35:57.867095] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-25T23:35:57.867228] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-25T23:35:57.868302] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-25T23:35:57.868389] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-25T23:35:57.869797] [DEBUG] [LOCAL ] MLI: Trimmed 63341 records to 44061 (keeping 200 days of data) [2025-10-25T23:35:58.146153] [DEBUG] [LOCAL ] MLI: Primary data saved (44061 records). [2025-10-25T23:35:58.146335] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-25T23:35:58.146491] [INFO ] [MAIN ] Update Progress: 1365/2366 symbols. MLI took 16.5s. Estimated remaining time: 3h 23m 59s [2025-10-25T23:35:58.316570] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:35:58.316818] [DEBUG] [LOCAL ] MLM: No existing data file found in primary storage. [2025-10-25T23:35:58.316888] [WARN ] [MAIN ] MLM: No existing data found, performing full refresh instead. [2025-10-25T23:35:58.317007] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-25T23:35:58.317076] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-25T23:35:58.317154] [DEBUG] [LOCAL ] MLM: No primary data file found to delete. [2025-10-25T23:35:58.317223] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-25T23:35:58.669833] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:35:58.670182] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-25T23:36:00.113198] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-25T23:36:00.120060] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-25T23:36:01.585344] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T23:36:01.593476] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-25T23:36:04.254756] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-25T23:36:04.263673] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-25T23:36:05.923781] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T23:36:05.931337] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-25T23:36:07.054276] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-25T23:36:07.061802] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-25T23:36:08.406213] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-25T23:36:08.412341] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-25T23:36:09.636902] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-25T23:36:09.643253] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-25T23:36:10.922445] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T23:36:10.929545] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-25T23:36:12.138019] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-25T23:36:12.143999] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-25T23:36:12.711763] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T23:36:12.716735] [INFO ] [REMOTE ] MLM: Full fetch complete (45036 records). [2025-10-25T23:36:12.716869] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-25T23:36:13.094670] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-25T23:36:13.094792] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-25T23:36:13.095608] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-25T23:36:13.095705] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-25T23:36:13.096685] [DEBUG] [LOCAL ] MLM: Trimmed 45036 records to 28997 (keeping 200 days of data) [2025-10-25T23:36:13.274822] [DEBUG] [LOCAL ] MLM: Primary data saved (28997 records). [2025-10-25T23:36:13.275008] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-25T23:36:13.275189] [INFO ] [MAIN ] Update Progress: 1366/2366 symbols. MLM took 15.1s. Estimated remaining time: 3h 23m 49s [2025-10-25T23:36:13.447074] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:36:13.447281] [DEBUG] [LOCAL ] MLP: No existing data file found in primary storage. [2025-10-25T23:36:13.447355] [WARN ] [MAIN ] MLP: No existing data found, performing full refresh instead. [2025-10-25T23:36:13.447472] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-25T23:36:13.447544] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-25T23:36:13.447627] [DEBUG] [LOCAL ] MLP: No primary data file found to delete. [2025-10-25T23:36:13.447722] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-25T23:36:13.821076] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:36:13.821460] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-25T23:36:14.423329] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-25T23:36:14.424967] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-25T23:36:14.894633] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-25T23:36:14.896008] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-25T23:36:15.356167] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T23:36:15.357422] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-25T23:36:15.966266] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T23:36:15.967904] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-25T23:36:16.579344] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-25T23:36:16.581022] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-25T23:36:17.126833] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-25T23:36:17.128510] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-25T23:36:17.639518] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-25T23:36:17.640893] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-25T23:36:18.189212] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T23:36:18.190630] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-25T23:36:18.515550] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-25T23:36:18.517202] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-25T23:36:18.990856] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-25T23:36:18.991933] [INFO ] [REMOTE ] MLP: Full fetch complete (4297 records). [2025-10-25T23:36:18.992023] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-25T23:36:19.364099] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-25T23:36:19.364222] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-25T23:36:19.364397] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-25T23:36:19.364474] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-25T23:36:19.364958] [DEBUG] [LOCAL ] MLP: Trimmed 4297 records to 3020 (keeping 200 days of data) [2025-10-25T23:36:19.383080] [DEBUG] [LOCAL ] MLP: Primary data saved (3020 records). [2025-10-25T23:36:19.383251] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-25T23:36:19.383406] [INFO ] [MAIN ] Update Progress: 1367/2366 symbols. MLP took 6.1s. Estimated remaining time: 3h 23m 33s [2025-10-25T23:36:19.566277] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:36:19.566499] [DEBUG] [LOCAL ] MLR: No existing data file found in primary storage. [2025-10-25T23:36:19.566570] [WARN ] [MAIN ] MLR: No existing data found, performing full refresh instead. [2025-10-25T23:36:19.566707] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-25T23:36:19.566777] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-25T23:36:19.566857] [DEBUG] [LOCAL ] MLR: No primary data file found to delete. [2025-10-25T23:36:19.566925] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-25T23:36:19.943387] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:36:19.943790] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-25T23:36:20.753521] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-25T23:36:20.756370] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-25T23:36:21.577873] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-25T23:36:21.581070] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-25T23:36:22.680554] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T23:36:22.685418] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-25T23:36:23.722454] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T23:36:23.727574] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-25T23:36:24.490139] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T23:36:24.492922] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-25T23:36:25.209356] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T23:36:25.212055] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-25T23:36:26.030731] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-25T23:36:26.033783] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-25T23:36:26.982851] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T23:36:26.988410] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-25T23:36:27.978224] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T23:36:27.982147] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-25T23:36:28.794215] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T23:36:28.797160] [INFO ] [REMOTE ] MLR: Full fetch complete (18893 records). [2025-10-25T23:36:28.797280] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-25T23:36:29.183637] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-25T23:36:29.183789] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-25T23:36:29.184300] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-25T23:36:29.184409] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-25T23:36:29.185154] [DEBUG] [LOCAL ] MLR: Trimmed 18893 records to 12216 (keeping 200 days of data) [2025-10-25T23:36:29.257631] [DEBUG] [LOCAL ] MLR: Primary data saved (12216 records). [2025-10-25T23:36:29.257867] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-25T23:36:29.258028] [INFO ] [MAIN ] Update Progress: 1368/2366 symbols. MLR took 9.9s. Estimated remaining time: 3h 23m 19s [2025-10-25T23:36:29.443852] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:36:29.444110] [DEBUG] [LOCAL ] MMC: No existing data file found in primary storage. [2025-10-25T23:36:29.444190] [WARN ] [MAIN ] MMC: No existing data found, performing full refresh instead. [2025-10-25T23:36:29.444340] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-25T23:36:29.444415] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-25T23:36:29.444498] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-10-25T23:36:29.444568] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-25T23:36:29.848845] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:36:29.849204] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-25T23:36:31.672988] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-25T23:36:31.683293] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-25T23:36:33.311301] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T23:36:33.321063] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-25T23:36:35.040379] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T23:36:35.051059] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-25T23:36:40.725102] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (5.67 seconds). [2025-10-25T23:36:40.736137] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-25T23:36:42.091263] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-25T23:36:42.105371] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-25T23:36:43.659358] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-25T23:36:43.669830] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-25T23:36:45.592677] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-25T23:36:45.604408] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-25T23:36:48.353010] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-25T23:36:48.364340] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-25T23:36:50.260509] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-25T23:36:50.271802] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-25T23:36:50.986017] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T23:36:50.997951] [INFO ] [REMOTE ] MMC: Full fetch complete (75232 records). [2025-10-25T23:36:50.998156] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-25T23:36:51.460125] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-25T23:36:51.460275] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-25T23:36:51.461329] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-25T23:36:51.461411] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-25T23:36:51.462893] [DEBUG] [LOCAL ] MMC: Trimmed 75232 records to 52683 (keeping 200 days of data) [2025-10-25T23:36:51.783206] [DEBUG] [LOCAL ] MMC: Primary data saved (52683 records). [2025-10-25T23:36:51.783384] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-25T23:36:51.783517] [INFO ] [MAIN ] Update Progress: 1369/2366 symbols. MMC took 22.5s. Estimated remaining time: 3h 23m 14s [2025-10-25T23:36:51.956044] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:36:51.956246] [DEBUG] [LOCAL ] MMD: No existing data file found in primary storage. [2025-10-25T23:36:51.956314] [WARN ] [MAIN ] MMD: No existing data found, performing full refresh instead. [2025-10-25T23:36:51.956425] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-25T23:36:51.956496] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-25T23:36:51.956556] [DEBUG] [LOCAL ] MMD: No primary data file found to delete. [2025-10-25T23:36:51.956617] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-25T23:36:52.306799] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:36:52.307139] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-25T23:36:53.264679] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-25T23:36:53.268189] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-25T23:36:54.043366] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T23:36:54.046762] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-25T23:36:54.842711] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-25T23:36:54.846140] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-25T23:36:55.836288] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-25T23:36:55.841075] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-25T23:36:56.521170] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-25T23:36:56.523957] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-25T23:36:57.170143] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-25T23:36:57.172778] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-25T23:36:57.903085] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-25T23:36:57.905787] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-25T23:36:58.602571] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-25T23:36:58.605913] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-25T23:36:59.410662] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-25T23:36:59.413823] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-25T23:37:00.166876] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T23:37:00.169373] [INFO ] [REMOTE ] MMD: Full fetch complete (16930 records). [2025-10-25T23:37:00.169475] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-25T23:37:00.567262] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-25T23:37:00.567430] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-25T23:37:00.568151] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-25T23:37:00.568236] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-25T23:37:00.569395] [DEBUG] [LOCAL ] MMD: Trimmed 16930 records to 10857 (keeping 200 days of data) [2025-10-25T23:37:00.637951] [DEBUG] [LOCAL ] MMD: Primary data saved (10857 records). [2025-10-25T23:37:00.638174] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-25T23:37:00.638395] [INFO ] [MAIN ] Update Progress: 1370/2366 symbols. MMD took 8.9s. Estimated remaining time: 3h 22m 59s [2025-10-25T23:37:00.811684] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:00.811958] [DEBUG] [LOCAL ] MMI: No existing data file found in primary storage. [2025-10-25T23:37:00.812030] [WARN ] [MAIN ] MMI: No existing data found, performing full refresh instead. [2025-10-25T23:37:00.812153] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-25T23:37:00.812225] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-25T23:37:00.812304] [DEBUG] [LOCAL ] MMI: No primary data file found to delete. [2025-10-25T23:37:00.812376] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-25T23:37:01.175761] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:01.176236] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-25T23:37:02.238179] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-25T23:37:02.241352] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-25T23:37:03.138123] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T23:37:03.141837] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-25T23:37:04.106999] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T23:37:04.110992] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-25T23:37:05.133198] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T23:37:05.138286] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-25T23:37:06.162528] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T23:37:06.166442] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-25T23:37:07.192876] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T23:37:07.196864] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-25T23:37:07.963668] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T23:37:07.967330] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-25T23:37:08.745818] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T23:37:08.750713] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-25T23:37:09.373154] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-25T23:37:09.376973] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-25T23:37:09.859030] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T23:37:09.863008] [INFO ] [REMOTE ] MMI: Full fetch complete (21962 records). [2025-10-25T23:37:09.863148] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-25T23:37:10.250866] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-25T23:37:10.251024] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-25T23:37:10.251718] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-25T23:37:10.251799] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-25T23:37:10.252700] [DEBUG] [LOCAL ] MMI: Trimmed 21962 records to 15642 (keeping 200 days of data) [2025-10-25T23:37:10.347684] [DEBUG] [LOCAL ] MMI: Primary data saved (15642 records). [2025-10-25T23:37:10.347945] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-25T23:37:10.348144] [INFO ] [MAIN ] Update Progress: 1371/2366 symbols. MMI took 9.7s. Estimated remaining time: 3h 22m 45s [2025-10-25T23:37:10.526994] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:10.527286] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-25T23:37:10.527361] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-25T23:37:10.527491] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-25T23:37:10.527565] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-25T23:37:10.527672] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-25T23:37:10.527749] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-25T23:37:10.910898] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:10.911331] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-10-25T23:37:11.142890] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:37:11.143397] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-10-25T23:37:11.143490] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:37:11.143572] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-25T23:37:11.143662] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:37:11.143745] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-25T23:37:11.143847] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-25T23:37:11.143921] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-25T23:37:11.144004] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-25T23:37:11.144177] [INFO ] [MAIN ] Update Progress: 1372/2366 symbols. MMID took 0.8s. Estimated remaining time: 3h 22m 25s [2025-10-25T23:37:11.330250] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:11.330634] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-25T23:37:11.330736] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-25T23:37:11.330899] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-25T23:37:11.330973] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-25T23:37:11.331057] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-25T23:37:11.331129] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-25T23:37:11.710559] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:11.710985] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-25T23:37:12.253576] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-25T23:37:12.254882] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-25T23:37:12.678758] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T23:37:12.679988] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-25T23:37:13.141515] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-25T23:37:13.142964] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-25T23:37:13.656731] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-25T23:37:13.658192] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-25T23:37:14.088612] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-25T23:37:14.089701] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-25T23:37:14.428973] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-25T23:37:14.430064] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-25T23:37:14.770365] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-25T23:37:14.771380] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-25T23:37:15.360068] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-25T23:37:15.361311] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-25T23:37:15.720035] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-25T23:37:15.721182] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-25T23:37:16.166681] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-25T23:37:16.167697] [INFO ] [REMOTE ] MMKT: Full fetch complete (2140 records). [2025-10-25T23:37:16.167836] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-25T23:37:16.366212] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-25T23:37:16.366424] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:37:16.366498] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:37:16.366575] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-25T23:37:16.366703] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-25T23:37:16.366779] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-25T23:37:16.366873] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-25T23:37:16.367088] [INFO ] [MAIN ] Update Progress: 1373/2366 symbols. MMKT took 5.2s. Estimated remaining time: 3h 22m 7s [2025-10-25T23:37:16.553126] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:16.553336] [DEBUG] [LOCAL ] MMM: No existing data file found in primary storage. [2025-10-25T23:37:16.553409] [WARN ] [MAIN ] MMM: No existing data found, performing full refresh instead. [2025-10-25T23:37:16.553525] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-25T23:37:16.553639] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-25T23:37:16.553750] [DEBUG] [LOCAL ] MMM: No primary data file found to delete. [2025-10-25T23:37:16.553819] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-25T23:37:16.902116] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:16.902483] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-25T23:37:18.743362] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-25T23:37:18.753990] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-25T23:37:20.455680] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-25T23:37:20.465745] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-25T23:37:22.443869] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-25T23:37:22.455527] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-25T23:37:24.462465] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-25T23:37:24.478074] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-25T23:37:26.453863] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-25T23:37:26.466289] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-25T23:37:28.171404] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-25T23:37:28.182750] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-25T23:37:30.184989] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-25T23:37:30.197517] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-25T23:37:32.911821] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-25T23:37:32.923452] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-25T23:37:34.965935] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-25T23:37:34.977200] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-25T23:37:35.698833] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:37:35.708819] [INFO ] [REMOTE ] MMM: Full fetch complete (77221 records). [2025-10-25T23:37:35.709029] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-25T23:37:36.104434] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-25T23:37:36.104563] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-25T23:37:36.105637] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-25T23:37:36.105746] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-25T23:37:36.107207] [DEBUG] [LOCAL ] MMM: Trimmed 77221 records to 53891 (keeping 200 days of data) [2025-10-25T23:37:36.432270] [DEBUG] [LOCAL ] MMM: Primary data saved (53891 records). [2025-10-25T23:37:36.432442] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-25T23:37:36.432597] [INFO ] [MAIN ] Update Progress: 1374/2366 symbols. MMM took 20.1s. Estimated remaining time: 3h 22m 1s [2025-10-25T23:37:36.598086] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:36.598321] [DEBUG] [LOCAL ] MMS: No existing data file found in primary storage. [2025-10-25T23:37:36.598394] [WARN ] [MAIN ] MMS: No existing data found, performing full refresh instead. [2025-10-25T23:37:36.598510] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-25T23:37:36.598581] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-25T23:37:36.598664] [DEBUG] [LOCAL ] MMS: No primary data file found to delete. [2025-10-25T23:37:36.598737] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-25T23:37:36.970226] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:36.970574] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-25T23:37:38.475998] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-25T23:37:38.483823] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-25T23:37:39.943722] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T23:37:39.952064] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-25T23:37:41.017713] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T23:37:41.025589] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-25T23:37:42.337230] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T23:37:42.345610] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-25T23:37:43.655952] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-25T23:37:43.662916] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-25T23:37:44.929384] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-25T23:37:44.938833] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-25T23:37:46.420176] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T23:37:46.428059] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-25T23:37:47.801945] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-25T23:37:47.812136] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-25T23:37:49.183041] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-25T23:37:49.191740] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-25T23:37:49.783347] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T23:37:49.789773] [INFO ] [REMOTE ] MMS: Full fetch complete (51014 records). [2025-10-25T23:37:49.789959] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-25T23:37:50.168468] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-25T23:37:50.168593] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-25T23:37:50.169435] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-25T23:37:50.169515] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-25T23:37:50.170546] [DEBUG] [LOCAL ] MMS: Trimmed 51014 records to 33822 (keeping 200 days of data) [2025-10-25T23:37:50.363138] [DEBUG] [LOCAL ] MMS: Primary data saved (33822 records). [2025-10-25T23:37:50.363301] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-25T23:37:50.363455] [INFO ] [MAIN ] Update Progress: 1375/2366 symbols. MMS took 13.9s. Estimated remaining time: 3h 21m 50s [2025-10-25T23:37:50.528796] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:50.529016] [DEBUG] [LOCAL ] MMT: No existing data file found in primary storage. [2025-10-25T23:37:50.529095] [WARN ] [MAIN ] MMT: No existing data found, performing full refresh instead. [2025-10-25T23:37:50.529230] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-25T23:37:50.529325] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-25T23:37:50.529415] [DEBUG] [LOCAL ] MMT: No primary data file found to delete. [2025-10-25T23:37:50.529483] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-25T23:37:50.909966] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:50.910380] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-25T23:37:51.619470] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-25T23:37:51.623402] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-25T23:37:52.347700] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T23:37:52.350788] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-25T23:37:53.379824] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T23:37:53.383824] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-25T23:37:54.152904] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-25T23:37:54.156031] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-25T23:37:54.961147] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T23:37:54.963950] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-25T23:37:55.686433] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-25T23:37:55.689196] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-25T23:37:56.415873] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-25T23:37:56.420205] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-25T23:37:57.183740] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-25T23:37:57.186775] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-25T23:37:57.899622] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T23:37:57.902051] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-25T23:37:58.601182] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T23:37:58.603197] [INFO ] [REMOTE ] MMT: Full fetch complete (15920 records). [2025-10-25T23:37:58.603298] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-25T23:37:58.989160] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-25T23:37:58.989304] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-25T23:37:58.989810] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-25T23:37:58.989892] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-25T23:37:58.990434] [DEBUG] [LOCAL ] MMT: Trimmed 15920 records to 10225 (keeping 200 days of data) [2025-10-25T23:37:59.051284] [DEBUG] [LOCAL ] MMT: Primary data saved (10225 records). [2025-10-25T23:37:59.051471] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-25T23:37:59.051632] [INFO ] [MAIN ] Update Progress: 1376/2366 symbols. MMT took 8.7s. Estimated remaining time: 3h 21m 35s [2025-10-25T23:37:59.235569] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:37:59.235810] [DEBUG] [LOCAL ] MMU: No existing data file found in primary storage. [2025-10-25T23:37:59.235885] [WARN ] [MAIN ] MMU: No existing data found, performing full refresh instead. [2025-10-25T23:37:59.236015] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-25T23:37:59.236095] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-25T23:37:59.236192] [DEBUG] [LOCAL ] MMU: No primary data file found to delete. [2025-10-25T23:37:59.236290] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-25T23:37:59.583287] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:37:59.583618] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-25T23:38:00.615119] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T23:38:00.621400] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-25T23:38:02.166597] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T23:38:02.171054] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-25T23:38:04.416084] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-25T23:38:04.420339] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-25T23:38:05.619242] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-25T23:38:05.624183] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-25T23:38:06.559378] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-25T23:38:06.562966] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-25T23:38:07.511767] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T23:38:07.515764] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-25T23:38:08.394150] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T23:38:08.397928] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-25T23:38:09.442314] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-25T23:38:09.447134] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-25T23:38:10.419022] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T23:38:10.423522] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-25T23:38:11.240951] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T23:38:11.244746] [INFO ] [REMOTE ] MMU: Full fetch complete (24982 records). [2025-10-25T23:38:11.244877] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-25T23:38:11.619679] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-25T23:38:11.619809] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-25T23:38:11.620451] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-25T23:38:11.620535] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-25T23:38:11.621687] [DEBUG] [LOCAL ] MMU: Trimmed 24982 records to 16972 (keeping 200 days of data) [2025-10-25T23:38:11.724089] [DEBUG] [LOCAL ] MMU: Primary data saved (16972 records). [2025-10-25T23:38:11.724305] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-25T23:38:11.724531] [INFO ] [MAIN ] Update Progress: 1377/2366 symbols. MMU took 12.7s. Estimated remaining time: 3h 21m 23s [2025-10-25T23:38:11.899555] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:38:11.899818] [DEBUG] [LOCAL ] MNR: No existing data file found in primary storage. [2025-10-25T23:38:11.899909] [WARN ] [MAIN ] MNR: No existing data found, performing full refresh instead. [2025-10-25T23:38:11.900052] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-25T23:38:11.900143] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-25T23:38:11.900250] [DEBUG] [LOCAL ] MNR: No primary data file found to delete. [2025-10-25T23:38:11.900339] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-25T23:38:12.255454] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:38:12.255838] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-25T23:38:13.348792] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T23:38:13.353680] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-25T23:38:14.669917] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-25T23:38:14.677265] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-25T23:38:15.783097] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-25T23:38:15.788519] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-25T23:38:16.911791] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-25T23:38:16.916885] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-25T23:38:18.130244] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-25T23:38:18.136418] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-25T23:38:19.264337] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-25T23:38:19.271107] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-25T23:38:20.570469] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-25T23:38:20.576596] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-25T23:38:21.569709] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T23:38:21.575245] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-25T23:38:22.623921] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T23:38:22.629123] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-25T23:38:23.678214] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-25T23:38:23.683411] [INFO ] [REMOTE ] MNR: Full fetch complete (37010 records). [2025-10-25T23:38:23.683596] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-25T23:38:24.058797] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-25T23:38:24.058942] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-25T23:38:24.059771] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-25T23:38:24.059857] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-25T23:38:24.060914] [DEBUG] [LOCAL ] MNR: Trimmed 37010 records to 25351 (keeping 200 days of data) [2025-10-25T23:38:24.212041] [DEBUG] [LOCAL ] MNR: Primary data saved (25351 records). [2025-10-25T23:38:24.212224] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-25T23:38:24.212464] [INFO ] [MAIN ] Update Progress: 1378/2366 symbols. MNR took 12.5s. Estimated remaining time: 3h 21m 11s [2025-10-25T23:38:24.381827] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:38:24.382057] [DEBUG] [LOCAL ] MNSO: No existing data file found in primary storage. [2025-10-25T23:38:24.382144] [WARN ] [MAIN ] MNSO: No existing data found, performing full refresh instead. [2025-10-25T23:38:24.382304] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-25T23:38:24.382387] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-25T23:38:24.382499] [DEBUG] [LOCAL ] MNSO: No primary data file found to delete. [2025-10-25T23:38:24.382583] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-25T23:38:24.730096] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:38:24.730485] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-25T23:38:26.215001] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-25T23:38:26.224161] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-25T23:38:27.736050] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-25T23:38:27.744921] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-25T23:38:29.649777] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-25T23:38:29.659639] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-25T23:38:31.130593] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-25T23:38:31.140770] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-25T23:38:32.758460] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-25T23:38:32.768520] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-25T23:38:34.269438] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-25T23:38:34.278446] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-25T23:38:35.753750] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-25T23:38:35.769361] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-25T23:38:37.364459] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T23:38:37.373247] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-25T23:38:38.832081] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T23:38:38.844386] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-25T23:38:40.343522] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-25T23:38:40.351902] [INFO ] [REMOTE ] MNSO: Full fetch complete (64457 records). [2025-10-25T23:38:40.352061] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-25T23:38:40.741261] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-25T23:38:40.741391] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-25T23:38:40.742570] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-25T23:38:40.742681] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-25T23:38:40.744056] [DEBUG] [LOCAL ] MNSO: Trimmed 64457 records to 44552 (keeping 200 days of data) [2025-10-25T23:38:41.003854] [DEBUG] [LOCAL ] MNSO: Primary data saved (44552 records). [2025-10-25T23:38:41.004070] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-25T23:38:41.004233] [INFO ] [MAIN ] Update Progress: 1379/2366 symbols. MNSO took 16.8s. Estimated remaining time: 3h 21m 2s [2025-10-25T23:38:41.169332] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:38:41.169556] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-25T23:38:41.169631] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-25T23:38:41.169783] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-25T23:38:41.169855] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-25T23:38:41.169934] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-25T23:38:41.170003] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-25T23:38:41.533686] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:38:41.534061] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-10-25T23:38:41.744531] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:38:41.745006] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-10-25T23:38:41.745119] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:38:41.745219] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-25T23:38:41.745307] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:38:41.745402] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-25T23:38:41.745518] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-25T23:38:41.745608] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-25T23:38:41.745734] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-25T23:38:41.745934] [INFO ] [MAIN ] Update Progress: 1380/2366 symbols. MNTN took 0.7s. Estimated remaining time: 3h 20m 42s [2025-10-25T23:38:41.946592] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:38:41.946831] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-25T23:38:41.946887] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-25T23:38:41.947001] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-25T23:38:41.947073] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-25T23:38:41.947156] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-25T23:38:41.947227] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-25T23:38:42.306766] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:38:42.307117] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-25T23:38:44.368329] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-25T23:38:44.378939] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-25T23:38:46.659547] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-25T23:38:46.671130] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-25T23:38:49.089970] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-25T23:38:49.100934] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-25T23:38:51.237950] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-25T23:38:51.249380] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-25T23:38:53.557117] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-25T23:38:53.572816] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-25T23:38:55.600483] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-25T23:38:55.611412] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-25T23:38:58.034434] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-25T23:38:58.046440] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-25T23:39:00.200159] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-25T23:39:00.211845] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-25T23:39:02.350227] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-25T23:39:02.361959] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-25T23:39:03.151334] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T23:39:03.161426] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-25T23:39:03.161604] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-25T23:39:03.356667] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T23:39:03.357420] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:39:03.357494] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:39:03.357546] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-25T23:39:03.357635] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-25T23:39:03.357723] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-25T23:39:03.357784] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-25T23:39:03.357929] [INFO ] [MAIN ] Update Progress: 1381/2366 symbols. MO took 21.6s. Estimated remaining time: 3h 20m 36s [2025-10-25T23:39:03.529747] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:39:03.529993] [DEBUG] [LOCAL ] MOD: No existing data file found in primary storage. [2025-10-25T23:39:03.530068] [WARN ] [MAIN ] MOD: No existing data found, performing full refresh instead. [2025-10-25T23:39:03.530186] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-25T23:39:03.530259] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-25T23:39:03.530341] [DEBUG] [LOCAL ] MOD: No primary data file found to delete. [2025-10-25T23:39:03.530413] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-25T23:39:03.887151] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:39:03.887503] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-25T23:39:05.673917] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-25T23:39:05.682859] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-25T23:39:07.313373] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-25T23:39:07.322984] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-25T23:39:08.941976] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T23:39:08.952087] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-25T23:39:10.588734] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T23:39:10.599254] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-25T23:39:13.114385] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-25T23:39:13.124625] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-25T23:39:14.540555] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T23:39:14.549414] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-25T23:39:16.109184] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-25T23:39:16.119910] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-25T23:39:17.203181] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T23:39:17.212702] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-25T23:39:18.485948] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T23:39:18.495601] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-25T23:39:20.061950] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-25T23:39:20.069725] [INFO ] [REMOTE ] MOD: Full fetch complete (66457 records). [2025-10-25T23:39:20.069904] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-25T23:39:20.459546] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-25T23:39:20.459715] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-25T23:39:20.460739] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-25T23:39:20.460843] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-25T23:39:20.462422] [DEBUG] [LOCAL ] MOD: Trimmed 66457 records to 45103 (keeping 200 days of data) [2025-10-25T23:39:20.720172] [DEBUG] [LOCAL ] MOD: Primary data saved (45103 records). [2025-10-25T23:39:20.720324] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-25T23:39:20.720491] [INFO ] [MAIN ] Update Progress: 1382/2366 symbols. MOD took 17.4s. Estimated remaining time: 3h 20m 28s [2025-10-25T23:39:20.890266] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:39:20.890447] [DEBUG] [LOCAL ] MODG: No existing data file found in primary storage. [2025-10-25T23:39:20.890516] [WARN ] [MAIN ] MODG: No existing data found, performing full refresh instead. [2025-10-25T23:39:20.890632] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-25T23:39:20.890751] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-25T23:39:20.890816] [DEBUG] [LOCAL ] MODG: No primary data file found to delete. [2025-10-25T23:39:20.890877] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-25T23:39:21.240590] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:39:21.240964] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-25T23:39:22.989943] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-25T23:39:23.006213] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-25T23:39:24.674100] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-25T23:39:24.683921] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-25T23:39:26.294875] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T23:39:26.305383] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-25T23:39:27.880963] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-25T23:39:27.892862] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-25T23:39:29.576956] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-25T23:39:29.587836] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-25T23:39:32.208386] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-25T23:39:32.218743] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-25T23:39:34.903924] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-25T23:39:34.915088] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-25T23:39:36.681631] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T23:39:36.693094] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-25T23:39:38.434031] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-25T23:39:38.445221] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-25T23:39:39.147605] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T23:39:39.159908] [INFO ] [REMOTE ] MODG: Full fetch complete (74784 records). [2025-10-25T23:39:39.160166] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-25T23:39:39.550113] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-25T23:39:39.550238] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-25T23:39:39.551322] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-25T23:39:39.551413] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-25T23:39:39.552909] [DEBUG] [LOCAL ] MODG: Trimmed 74784 records to 52270 (keeping 200 days of data) [2025-10-25T23:39:39.836792] [DEBUG] [LOCAL ] MODG: Primary data saved (52270 records). [2025-10-25T23:39:39.836961] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-25T23:39:39.837193] [INFO ] [MAIN ] Update Progress: 1383/2366 symbols. MODG took 19.1s. Estimated remaining time: 3h 20m 20s [2025-10-25T23:39:40.004553] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:39:40.004731] [DEBUG] [LOCAL ] MOH: No existing data file found in primary storage. [2025-10-25T23:39:40.004802] [WARN ] [MAIN ] MOH: No existing data found, performing full refresh instead. [2025-10-25T23:39:40.004922] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-25T23:39:40.004992] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-25T23:39:40.005073] [DEBUG] [LOCAL ] MOH: No primary data file found to delete. [2025-10-25T23:39:40.005158] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-25T23:39:40.362211] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:39:40.362521] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-25T23:39:41.749813] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-25T23:39:41.756372] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-25T23:39:43.220145] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-25T23:39:43.228279] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-25T23:39:44.678861] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T23:39:44.687293] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-25T23:39:46.286567] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-25T23:39:46.295931] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-25T23:39:47.823114] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-25T23:39:47.830866] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-25T23:39:49.127984] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T23:39:49.135521] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-25T23:39:51.150630] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-25T23:39:51.162203] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-25T23:39:52.835432] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-25T23:39:52.846511] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-25T23:39:54.272418] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T23:39:54.283511] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-25T23:39:55.009776] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T23:39:55.019270] [INFO ] [REMOTE ] MOH: Full fetch complete (60217 records). [2025-10-25T23:39:55.019489] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-25T23:39:55.428749] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-25T23:39:55.428875] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-25T23:39:55.429833] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-25T23:39:55.429912] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-25T23:39:55.431166] [DEBUG] [LOCAL ] MOH: Trimmed 60217 records to 43812 (keeping 200 days of data) [2025-10-25T23:39:55.682747] [DEBUG] [LOCAL ] MOH: Primary data saved (43812 records). [2025-10-25T23:39:55.682908] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-25T23:39:55.683073] [INFO ] [MAIN ] Update Progress: 1384/2366 symbols. MOH took 15.8s. Estimated remaining time: 3h 20m 11s [2025-10-25T23:39:55.850603] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:39:55.850833] [DEBUG] [LOCAL ] MOS: No existing data file found in primary storage. [2025-10-25T23:39:55.850906] [WARN ] [MAIN ] MOS: No existing data found, performing full refresh instead. [2025-10-25T23:39:55.851025] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-25T23:39:55.851111] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-25T23:39:55.851207] [DEBUG] [LOCAL ] MOS: No primary data file found to delete. [2025-10-25T23:39:55.851277] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-25T23:39:56.204310] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:39:56.204666] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-25T23:39:57.918209] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T23:39:57.928946] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-25T23:39:59.499945] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-25T23:39:59.510411] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-25T23:40:01.373240] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T23:40:01.384189] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-25T23:40:05.065747] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (3.68 seconds). [2025-10-25T23:40:05.076954] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-25T23:40:07.074982] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-25T23:40:07.086422] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-25T23:40:08.937879] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-25T23:40:08.948947] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-25T23:40:10.982376] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-25T23:40:10.994116] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-25T23:40:13.022431] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-25T23:40:13.036338] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-25T23:40:14.935364] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-25T23:40:14.946954] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-25T23:40:15.683779] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T23:40:15.693513] [INFO ] [REMOTE ] MOS: Full fetch complete (77631 records). [2025-10-25T23:40:15.693721] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-25T23:40:16.078377] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-25T23:40:16.078505] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-25T23:40:16.079688] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-25T23:40:16.079773] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-25T23:40:16.081294] [DEBUG] [LOCAL ] MOS: Trimmed 77631 records to 54290 (keeping 200 days of data) [2025-10-25T23:40:16.393136] [DEBUG] [LOCAL ] MOS: Primary data saved (54290 records). [2025-10-25T23:40:16.393302] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-25T23:40:16.393458] [INFO ] [MAIN ] Update Progress: 1385/2366 symbols. MOS took 20.7s. Estimated remaining time: 3h 20m 5s [2025-10-25T23:40:16.564282] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:40:16.564536] [DEBUG] [LOCAL ] MOV: No existing data file found in primary storage. [2025-10-25T23:40:16.564607] [WARN ] [MAIN ] MOV: No existing data found, performing full refresh instead. [2025-10-25T23:40:16.564743] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-25T23:40:16.564815] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-25T23:40:16.564901] [DEBUG] [LOCAL ] MOV: No primary data file found to delete. [2025-10-25T23:40:16.564968] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-25T23:40:16.916785] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:40:16.917113] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-25T23:40:17.524944] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T23:40:17.528913] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-25T23:40:18.647396] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T23:40:18.651847] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-25T23:40:19.729845] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-25T23:40:19.735181] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-25T23:40:21.046404] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T23:40:21.053514] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-25T23:40:22.152485] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T23:40:22.158096] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-25T23:40:23.239571] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-25T23:40:23.244835] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-25T23:40:24.300833] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T23:40:24.305084] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-25T23:40:25.530577] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T23:40:25.535174] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-25T23:40:26.513842] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-25T23:40:26.519159] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-25T23:40:26.981361] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-25T23:40:26.984865] [INFO ] [REMOTE ] MOV: Full fetch complete (30450 records). [2025-10-25T23:40:26.984994] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-25T23:40:27.353099] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-25T23:40:27.353222] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-25T23:40:27.353854] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-25T23:40:27.353936] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-25T23:40:27.354670] [DEBUG] [LOCAL ] MOV: Trimmed 30450 records to 21343 (keeping 200 days of data) [2025-10-25T23:40:27.475443] [DEBUG] [LOCAL ] MOV: Primary data saved (21343 records). [2025-10-25T23:40:27.475591] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-25T23:40:27.475763] [INFO ] [MAIN ] Update Progress: 1386/2366 symbols. MOV took 11.1s. Estimated remaining time: 3h 19m 51s [2025-10-25T23:40:27.640995] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:40:27.641159] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-10-25T23:40:27.641226] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-10-25T23:40:27.641336] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-25T23:40:27.641406] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-25T23:40:27.641486] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-25T23:40:27.641532] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-25T23:40:27.991811] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:40:27.992167] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-25T23:40:29.919673] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-25T23:40:29.930047] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-25T23:40:32.529333] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-25T23:40:32.539604] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-25T23:40:34.263859] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-25T23:40:34.275141] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-25T23:40:36.587478] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-25T23:40:36.599757] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-25T23:40:38.740129] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-25T23:40:38.751637] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-25T23:40:40.930608] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-25T23:40:40.941413] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-25T23:40:43.219457] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-25T23:40:43.231188] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-25T23:40:45.549962] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-25T23:40:45.561598] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-25T23:40:47.809524] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-25T23:40:47.821240] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-25T23:40:48.559851] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-25T23:40:48.570007] [INFO ] [REMOTE ] MP: Full fetch complete (77589 records). [2025-10-25T23:40:48.570250] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-25T23:40:48.983476] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-25T23:40:48.983602] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-25T23:40:48.984637] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-25T23:40:48.984770] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-25T23:40:48.986260] [DEBUG] [LOCAL ] MP: Trimmed 77589 records to 54524 (keeping 200 days of data) [2025-10-25T23:40:49.308286] [DEBUG] [LOCAL ] MP: Primary data saved (54524 records). [2025-10-25T23:40:49.308458] [INFO ] [MAIN ] MP: Full history saved. [2025-10-25T23:40:49.308613] [INFO ] [MAIN ] Update Progress: 1387/2366 symbols. MP took 21.8s. Estimated remaining time: 3h 19m 46s [2025-10-25T23:40:49.479303] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:40:49.479539] [DEBUG] [LOCAL ] MPA: No existing data file found in primary storage. [2025-10-25T23:40:49.479612] [WARN ] [MAIN ] MPA: No existing data found, performing full refresh instead. [2025-10-25T23:40:49.479754] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-25T23:40:49.479826] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-25T23:40:49.479884] [DEBUG] [LOCAL ] MPA: No primary data file found to delete. [2025-10-25T23:40:49.479948] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-25T23:40:49.825933] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:40:49.826286] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-25T23:40:50.278086] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-25T23:40:50.279280] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-25T23:40:50.888292] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T23:40:50.890448] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-25T23:40:51.519261] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-25T23:40:51.520794] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-25T23:40:52.285564] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T23:40:52.287916] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-25T23:40:52.921860] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T23:40:52.923982] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-25T23:40:53.525172] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-25T23:40:53.527188] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-25T23:40:54.160504] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-25T23:40:54.163396] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-25T23:40:54.715252] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-25T23:40:54.717317] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-25T23:40:55.304829] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-25T23:40:55.306457] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-25T23:40:55.935478] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-25T23:40:55.937038] [INFO ] [REMOTE ] MPA: Full fetch complete (7081 records). [2025-10-25T23:40:55.937149] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-25T23:40:56.316307] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-25T23:40:56.316434] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-25T23:40:56.316670] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-25T23:40:56.316748] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-25T23:40:56.317266] [DEBUG] [LOCAL ] MPA: Trimmed 7081 records to 5235 (keeping 200 days of data) [2025-10-25T23:40:56.349424] [DEBUG] [LOCAL ] MPA: Primary data saved (5235 records). [2025-10-25T23:40:56.349608] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-25T23:40:56.349797] [INFO ] [MAIN ] Update Progress: 1388/2366 symbols. MPA took 7.0s. Estimated remaining time: 3h 19m 30s [2025-10-25T23:40:56.523537] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:40:56.523772] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-25T23:40:56.523845] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-25T23:40:56.523957] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-25T23:40:56.524031] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-25T23:40:56.524114] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-25T23:40:56.524184] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-25T23:40:56.888894] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:40:56.889279] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-25T23:40:58.743405] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-25T23:40:58.754220] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-25T23:41:00.370734] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T23:41:00.381239] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-25T23:41:02.361280] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-25T23:41:02.377305] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-25T23:41:04.407708] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-25T23:41:04.419202] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-25T23:41:06.896862] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-25T23:41:06.907893] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-25T23:41:08.787561] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-25T23:41:08.798094] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-25T23:41:10.474439] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-25T23:41:10.485696] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-25T23:41:12.137559] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-25T23:41:12.148807] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-25T23:41:13.866999] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-25T23:41:13.878148] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-25T23:41:14.611175] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T23:41:14.620725] [INFO ] [REMOTE ] MPC: Full fetch complete (75674 records). [2025-10-25T23:41:14.620926] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-25T23:41:15.026861] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-25T23:41:15.027017] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-25T23:41:15.028104] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-25T23:41:15.028188] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-25T23:41:15.029701] [DEBUG] [LOCAL ] MPC: Trimmed 75674 records to 52630 (keeping 200 days of data) [2025-10-25T23:41:15.354859] [DEBUG] [LOCAL ] MPC: Primary data saved (52630 records). [2025-10-25T23:41:15.355034] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-25T23:41:15.355194] [INFO ] [MAIN ] Update Progress: 1389/2366 symbols. MPC took 19.0s. Estimated remaining time: 3h 19m 23s [2025-10-25T23:41:15.523250] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:41:15.523442] [DEBUG] [LOCAL ] MPLX: No existing data file found in primary storage. [2025-10-25T23:41:15.523515] [WARN ] [MAIN ] MPLX: No existing data found, performing full refresh instead. [2025-10-25T23:41:15.523629] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-25T23:41:15.523723] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-25T23:41:15.523805] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-25T23:41:15.523877] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-25T23:41:15.873517] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:41:15.873884] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-25T23:41:17.699781] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-25T23:41:17.709887] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-25T23:41:19.415767] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-25T23:41:19.428816] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-25T23:41:21.176313] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-25T23:41:21.188236] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-25T23:41:22.923946] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-25T23:41:22.935137] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-25T23:41:24.696755] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T23:41:24.708017] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-25T23:41:26.220073] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-25T23:41:26.230300] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-25T23:41:28.063344] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-25T23:41:28.074176] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-25T23:41:29.764869] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T23:41:29.775855] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-25T23:41:31.445940] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T23:41:31.456840] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-25T23:41:33.150603] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T23:41:33.160121] [INFO ] [REMOTE ] MPLX: Full fetch complete (74363 records). [2025-10-25T23:41:33.160287] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-25T23:41:33.542985] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-25T23:41:33.543114] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-25T23:41:33.544181] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-25T23:41:33.544261] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-25T23:41:33.545673] [DEBUG] [LOCAL ] MPLX: Trimmed 74363 records to 51542 (keeping 200 days of data) [2025-10-25T23:41:33.840972] [DEBUG] [LOCAL ] MPLX: Primary data saved (51542 records). [2025-10-25T23:41:33.841157] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-25T23:41:33.841317] [INFO ] [MAIN ] Update Progress: 1390/2366 symbols. MPLX took 18.5s. Estimated remaining time: 3h 19m 15s [2025-10-25T23:41:34.006628] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:41:34.006862] [DEBUG] [LOCAL ] MPV: No existing data file found in primary storage. [2025-10-25T23:41:34.006932] [WARN ] [MAIN ] MPV: No existing data found, performing full refresh instead. [2025-10-25T23:41:34.007046] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-25T23:41:34.007112] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-25T23:41:34.007190] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-10-25T23:41:34.007259] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-25T23:41:34.359861] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:41:34.360288] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-25T23:41:34.962757] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-25T23:41:34.964569] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-25T23:41:35.477115] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-25T23:41:35.479298] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-25T23:41:36.225857] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T23:41:36.228285] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-25T23:41:36.836580] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-25T23:41:36.838925] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-25T23:41:37.431319] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-25T23:41:37.433460] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-25T23:41:38.045299] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-25T23:41:38.047265] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-25T23:41:38.612076] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-25T23:41:38.613559] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-25T23:41:39.154470] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-25T23:41:39.156098] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-25T23:41:39.814364] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T23:41:39.816123] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-25T23:41:40.303545] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T23:41:40.304977] [INFO ] [REMOTE ] MPV: Full fetch complete (7597 records). [2025-10-25T23:41:40.305136] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-25T23:41:40.723597] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-25T23:41:40.723740] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-25T23:41:40.723989] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-25T23:41:40.724064] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-25T23:41:40.724497] [DEBUG] [LOCAL ] MPV: Trimmed 7597 records to 4410 (keeping 200 days of data) [2025-10-25T23:41:40.750528] [DEBUG] [LOCAL ] MPV: Primary data saved (4410 records). [2025-10-25T23:41:40.750678] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-25T23:41:40.750829] [INFO ] [MAIN ] Update Progress: 1391/2366 symbols. MPV took 6.9s. Estimated remaining time: 3h 18m 59s [2025-10-25T23:41:40.924320] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:41:40.924539] [DEBUG] [LOCAL ] MPW: No existing data file found in primary storage. [2025-10-25T23:41:40.924611] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-10-25T23:41:40.924746] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-25T23:41:40.924817] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-25T23:41:40.924905] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-25T23:41:40.924972] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-25T23:41:41.290635] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:41:41.291006] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-25T23:41:43.210088] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-25T23:41:43.220604] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-25T23:41:44.883773] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T23:41:44.894110] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-25T23:41:46.760538] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T23:41:46.771839] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-25T23:41:48.428037] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-25T23:41:48.439285] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-25T23:41:50.478591] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-25T23:41:50.490039] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-25T23:41:52.130582] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T23:41:52.141495] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-25T23:41:54.321438] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-25T23:41:54.333901] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-25T23:41:56.340838] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-25T23:41:56.353446] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-25T23:41:58.303476] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-25T23:41:58.314697] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-25T23:41:59.035553] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:41:59.045203] [INFO ] [REMOTE ] MPW: Full fetch complete (77573 records). [2025-10-25T23:41:59.045377] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-25T23:41:59.438003] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-25T23:41:59.438134] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-25T23:41:59.439318] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-25T23:41:59.439404] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-25T23:41:59.441020] [DEBUG] [LOCAL ] MPW: Trimmed 77573 records to 54261 (keeping 200 days of data) [2025-10-25T23:41:59.741781] [DEBUG] [LOCAL ] MPW: Primary data saved (54261 records). [2025-10-25T23:41:59.741944] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-25T23:41:59.742101] [INFO ] [MAIN ] Update Progress: 1392/2366 symbols. MPW took 19.0s. Estimated remaining time: 3h 18m 51s [2025-10-25T23:41:59.915595] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:41:59.915834] [DEBUG] [LOCAL ] MPX: No existing data file found in primary storage. [2025-10-25T23:41:59.915907] [WARN ] [MAIN ] MPX: No existing data found, performing full refresh instead. [2025-10-25T23:41:59.916029] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-25T23:41:59.916108] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-25T23:41:59.916188] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-25T23:41:59.916261] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-25T23:42:00.288237] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:42:00.288605] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-25T23:42:01.202187] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T23:42:01.203913] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-25T23:42:02.315329] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-25T23:42:02.318232] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-25T23:42:02.915963] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-25T23:42:02.917916] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-25T23:42:03.704412] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T23:42:03.706376] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-25T23:42:04.334422] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T23:42:04.336230] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-25T23:42:04.925171] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-25T23:42:04.926747] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-25T23:42:05.527257] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-25T23:42:05.529074] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-25T23:42:06.135540] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-25T23:42:06.137275] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-25T23:42:06.799270] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-25T23:42:06.800772] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-25T23:42:07.397992] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-25T23:42:07.399802] [INFO ] [REMOTE ] MPX: Full fetch complete (6466 records). [2025-10-25T23:42:07.399921] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-25T23:42:07.755925] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-25T23:42:07.756057] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-25T23:42:07.756312] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-25T23:42:07.756388] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-25T23:42:07.756850] [DEBUG] [LOCAL ] MPX: Trimmed 6466 records to 4001 (keeping 200 days of data) [2025-10-25T23:42:07.779423] [DEBUG] [LOCAL ] MPX: Primary data saved (4001 records). [2025-10-25T23:42:07.779525] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-25T23:42:07.779694] [INFO ] [MAIN ] Update Progress: 1393/2366 symbols. MPX took 8.0s. Estimated remaining time: 3h 18m 36s [2025-10-25T23:42:07.984844] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:42:07.985280] [DEBUG] [LOCAL ] MQT: No existing data file found in primary storage. [2025-10-25T23:42:07.985361] [WARN ] [MAIN ] MQT: No existing data found, performing full refresh instead. [2025-10-25T23:42:07.985484] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-25T23:42:07.985569] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-25T23:42:07.985684] [DEBUG] [LOCAL ] MQT: No primary data file found to delete. [2025-10-25T23:42:07.985760] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-25T23:42:08.399583] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:42:08.399973] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-25T23:42:09.184593] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T23:42:09.188788] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-25T23:42:09.919324] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T23:42:09.922080] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-25T23:42:10.732467] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T23:42:10.734980] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-25T23:42:11.751108] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-25T23:42:11.756515] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-25T23:42:12.371879] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-25T23:42:12.374950] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-25T23:42:13.014809] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-25T23:42:13.017277] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-25T23:42:13.813051] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-25T23:42:13.815982] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-25T23:42:14.445216] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-25T23:42:14.447409] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-25T23:42:15.187943] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-25T23:42:15.190780] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-25T23:42:15.955597] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:42:15.957768] [INFO ] [REMOTE ] MQT: Full fetch complete (13024 records). [2025-10-25T23:42:15.957891] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-25T23:42:16.336146] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-25T23:42:16.336463] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-25T23:42:16.337011] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-25T23:42:16.337107] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-25T23:42:16.337767] [DEBUG] [LOCAL ] MQT: Trimmed 13024 records to 8175 (keeping 200 days of data) [2025-10-25T23:42:16.389507] [DEBUG] [LOCAL ] MQT: Primary data saved (8175 records). [2025-10-25T23:42:16.389757] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-25T23:42:16.389961] [INFO ] [MAIN ] Update Progress: 1394/2366 symbols. MQT took 8.6s. Estimated remaining time: 3h 18m 21s [2025-10-25T23:42:16.572873] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:42:16.573199] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-25T23:42:16.573277] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-25T23:42:16.573407] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-25T23:42:16.573481] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-25T23:42:16.573566] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-25T23:42:16.573665] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-25T23:42:16.936271] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:42:16.936726] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-25T23:42:17.930279] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T23:42:17.935847] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-25T23:42:18.942352] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-25T23:42:18.946787] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-25T23:42:20.013697] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T23:42:20.018370] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-25T23:42:21.046282] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-25T23:42:21.051035] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-25T23:42:21.981536] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-25T23:42:21.984973] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-25T23:42:22.973514] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-25T23:42:22.977273] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-25T23:42:23.558958] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-25T23:42:23.562794] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-25T23:42:24.474437] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-25T23:42:24.480612] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-25T23:42:25.559846] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T23:42:25.564668] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-25T23:42:26.574185] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T23:42:26.578206] [INFO ] [REMOTE ] MQY: Full fetch complete (25722 records). [2025-10-25T23:42:26.578330] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-25T23:42:26.935301] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-25T23:42:26.935416] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-25T23:42:26.935979] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-25T23:42:26.936057] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-25T23:42:26.936766] [DEBUG] [LOCAL ] MQY: Trimmed 25722 records to 16808 (keeping 200 days of data) [2025-10-25T23:42:27.031693] [DEBUG] [LOCAL ] MQY: Primary data saved (16808 records). [2025-10-25T23:42:27.031855] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-25T23:42:27.032007] [INFO ] [MAIN ] Update Progress: 1395/2366 symbols. MQY took 10.6s. Estimated remaining time: 3h 18m 8s [2025-10-25T23:42:27.196915] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:42:27.197083] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-25T23:42:27.197154] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-25T23:42:27.197264] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-25T23:42:27.197335] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-25T23:42:27.197415] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-25T23:42:27.197484] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-25T23:42:27.546324] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:42:27.546631] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-25T23:42:28.904970] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-25T23:42:28.913091] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-25T23:42:30.331241] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-25T23:42:30.339431] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-25T23:42:31.816077] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-25T23:42:31.824697] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-25T23:42:33.211629] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-25T23:42:33.220437] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-25T23:42:34.684182] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T23:42:34.692150] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-25T23:42:36.049039] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T23:42:36.056705] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-25T23:42:38.086050] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-25T23:42:38.095498] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-25T23:42:39.552623] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-25T23:42:39.560598] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-25T23:42:41.017870] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T23:42:41.025821] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-25T23:42:42.321874] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-25T23:42:42.331907] [INFO ] [REMOTE ] MRC: Full fetch complete (55002 records). [2025-10-25T23:42:42.332129] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-25T23:42:42.710605] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-25T23:42:42.710739] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-25T23:42:42.711621] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-25T23:42:42.711719] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-25T23:42:42.712933] [DEBUG] [LOCAL ] MRC: Trimmed 55002 records to 37565 (keeping 200 days of data) [2025-10-25T23:42:42.918604] [DEBUG] [LOCAL ] MRC: Primary data saved (37565 records). [2025-10-25T23:42:42.918784] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-25T23:42:42.918939] [INFO ] [MAIN ] Update Progress: 1396/2366 symbols. MRC took 15.9s. Estimated remaining time: 3h 17m 58s [2025-10-25T23:42:43.088746] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:42:43.088981] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-25T23:42:43.089074] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-25T23:42:43.089186] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-25T23:42:43.089257] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-25T23:42:43.089321] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-25T23:42:43.089384] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-25T23:42:43.433520] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:42:43.433873] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-25T23:42:45.336255] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-25T23:42:45.347441] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-25T23:42:47.665434] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-25T23:42:47.676190] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-25T23:42:49.656750] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-25T23:42:49.667984] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-25T23:42:52.025695] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-25T23:42:52.036947] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-25T23:42:54.241202] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-25T23:42:54.252639] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-25T23:42:56.185135] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-25T23:42:56.201182] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-25T23:42:58.739820] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-25T23:42:58.754732] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-25T23:43:00.986919] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-25T23:43:00.999174] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-25T23:43:03.679024] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-25T23:43:03.691381] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-25T23:43:04.468470] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-25T23:43:04.478895] [INFO ] [REMOTE ] MRK: Full fetch complete (77968 records). [2025-10-25T23:43:04.479092] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-25T23:43:04.872837] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-10-25T23:43:04.873016] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-10-25T23:43:04.874595] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-10-25T23:43:04.874703] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-10-25T23:43:04.876693] [DEBUG] [LOCAL ] MRK: Trimmed 77968 records to 54570 (keeping 200 days of data) [2025-10-25T23:43:05.228054] [DEBUG] [LOCAL ] MRK: Primary data saved (54570 records). [2025-10-25T23:43:05.228297] [INFO ] [MAIN ] MRK: Full history saved. [2025-10-25T23:43:05.228504] [INFO ] [MAIN ] Update Progress: 1397/2366 symbols. MRK took 22.3s. Estimated remaining time: 3h 17m 53s [2025-10-25T23:43:05.405635] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:43:05.405927] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-25T23:43:05.406007] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-25T23:43:05.406138] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-25T23:43:05.406214] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-25T23:43:05.406368] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-25T23:43:05.406448] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-25T23:43:05.763181] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:43:05.763611] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-10-25T23:43:05.992448] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:43:05.992826] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-10-25T23:43:05.992911] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:43:05.992987] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-25T23:43:05.993053] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:43:05.993126] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-25T23:43:05.993219] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-25T23:43:05.993287] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-25T23:43:05.993365] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-25T23:43:05.993495] [INFO ] [MAIN ] Update Progress: 1398/2366 symbols. MRP took 0.8s. Estimated remaining time: 3h 17m 33s [2025-10-25T23:43:06.167111] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:43:06.167380] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-25T23:43:06.167473] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-25T23:43:06.167618] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-25T23:43:06.167742] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-25T23:43:06.167866] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-25T23:43:06.167958] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-25T23:43:06.547266] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:43:06.547699] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-25T23:43:08.642283] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-25T23:43:08.652826] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-25T23:43:10.379802] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-25T23:43:10.390034] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-25T23:43:12.580149] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-25T23:43:12.591267] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-25T23:43:14.854061] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-25T23:43:14.865514] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-25T23:43:16.734336] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-25T23:43:16.745718] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-25T23:43:18.646412] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-25T23:43:18.657392] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-25T23:43:20.814292] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-25T23:43:20.826061] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-25T23:43:22.695198] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-25T23:43:22.706868] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-25T23:43:24.599938] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-25T23:43:24.612149] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-25T23:43:25.322741] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T23:43:25.333314] [INFO ] [REMOTE ] MS: Full fetch complete (77858 records). [2025-10-25T23:43:25.333546] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-25T23:43:25.741384] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-25T23:43:25.741548] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-25T23:43:25.743141] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-25T23:43:25.743234] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-25T23:43:25.745371] [DEBUG] [LOCAL ] MS: Trimmed 77858 records to 54467 (keeping 200 days of data) [2025-10-25T23:43:26.099004] [DEBUG] [LOCAL ] MS: Primary data saved (54467 records). [2025-10-25T23:43:26.099235] [INFO ] [MAIN ] MS: Full history saved. [2025-10-25T23:43:26.099434] [INFO ] [MAIN ] Update Progress: 1399/2366 symbols. MS took 20.1s. Estimated remaining time: 3h 17m 26s [2025-10-25T23:43:26.285916] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:43:26.286233] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-25T23:43:26.286323] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-25T23:43:26.286460] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-25T23:43:26.286536] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-25T23:43:26.286621] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-25T23:43:26.286717] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-25T23:43:26.661869] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:43:26.662303] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-25T23:43:27.616935] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-25T23:43:27.620719] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-25T23:43:28.564237] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-25T23:43:28.567905] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-25T23:43:29.561802] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T23:43:29.565752] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-25T23:43:30.805179] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T23:43:30.811398] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-25T23:43:31.918741] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T23:43:31.923577] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-25T23:43:32.974885] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-25T23:43:32.979531] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-25T23:43:33.922855] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-25T23:43:33.927787] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-25T23:43:34.945508] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-25T23:43:34.950424] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-25T23:43:35.941497] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-25T23:43:35.946869] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-25T23:43:36.513566] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T23:43:36.517551] [INFO ] [REMOTE ] MSA: Full fetch complete (25915 records). [2025-10-25T23:43:36.517715] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-25T23:43:36.961580] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-25T23:43:36.961742] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-25T23:43:36.962841] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-25T23:43:36.962924] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-25T23:43:36.963868] [DEBUG] [LOCAL ] MSA: Trimmed 25915 records to 19085 (keeping 200 days of data) [2025-10-25T23:43:37.088551] [DEBUG] [LOCAL ] MSA: Primary data saved (19085 records). [2025-10-25T23:43:37.088810] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-25T23:43:37.089048] [INFO ] [MAIN ] Update Progress: 1400/2366 symbols. MSA took 11.0s. Estimated remaining time: 3h 17m 13s [2025-10-25T23:43:37.273767] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:43:37.274083] [DEBUG] [LOCAL ] MSB: No existing data file found in primary storage. [2025-10-25T23:43:37.274161] [WARN ] [MAIN ] MSB: No existing data found, performing full refresh instead. [2025-10-25T23:43:37.274285] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-25T23:43:37.274356] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-25T23:43:37.274440] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-25T23:43:37.274512] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-25T23:43:37.646735] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:43:37.647144] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-25T23:43:38.638687] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-25T23:43:38.642374] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-25T23:43:39.437468] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-25T23:43:39.440765] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-25T23:43:40.200771] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-25T23:43:40.203943] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-25T23:43:40.979921] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-25T23:43:40.982542] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-25T23:43:41.705355] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T23:43:41.708043] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-25T23:43:42.434855] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-25T23:43:42.437378] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-25T23:43:43.204779] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T23:43:43.207865] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-25T23:43:43.960712] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-25T23:43:43.963377] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-25T23:43:44.662180] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-25T23:43:44.665159] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-25T23:43:45.414602] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T23:43:45.417815] [INFO ] [REMOTE ] MSB: Full fetch complete (13203 records). [2025-10-25T23:43:45.417956] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-25T23:43:45.802709] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-25T23:43:45.802882] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-25T23:43:45.803339] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-25T23:43:45.803419] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-25T23:43:45.804017] [DEBUG] [LOCAL ] MSB: Trimmed 13203 records to 8092 (keeping 200 days of data) [2025-10-25T23:43:45.853238] [DEBUG] [LOCAL ] MSB: Primary data saved (8092 records). [2025-10-25T23:43:45.853441] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-25T23:43:45.853639] [INFO ] [MAIN ] Update Progress: 1401/2366 symbols. MSB took 8.8s. Estimated remaining time: 3h 16m 58s [2025-10-25T23:43:46.022508] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:43:46.022793] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-25T23:43:46.022867] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-25T23:43:46.022993] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-25T23:43:46.023065] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-25T23:43:46.023148] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-25T23:43:46.023221] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-25T23:43:46.381513] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:43:46.381975] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-25T23:43:46.824862] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-25T23:43:46.826333] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-25T23:43:47.275698] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-25T23:43:47.277448] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-25T23:43:47.730601] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-25T23:43:47.731867] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-25T23:43:48.089009] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-25T23:43:48.090070] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-25T23:43:48.444445] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-25T23:43:48.445622] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-25T23:43:48.779957] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-25T23:43:48.781219] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-25T23:43:49.219866] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-25T23:43:49.221167] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-25T23:43:49.568241] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-25T23:43:49.569478] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-25T23:43:50.098327] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-25T23:43:50.099908] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-25T23:43:50.454943] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-25T23:43:50.455909] [INFO ] [REMOTE ] MSC: Full fetch complete (2460 records). [2025-10-25T23:43:50.456004] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-25T23:43:50.635874] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-25T23:43:50.636122] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:43:50.636193] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:43:50.636300] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-25T23:43:50.636404] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-25T23:43:50.636480] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-25T23:43:50.636560] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-25T23:43:50.636755] [INFO ] [MAIN ] Update Progress: 1402/2366 symbols. MSC took 4.8s. Estimated remaining time: 3h 16m 41s [2025-10-25T23:43:50.811781] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:43:50.812071] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-25T23:43:50.812143] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-25T23:43:50.812265] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-25T23:43:50.812337] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-25T23:43:50.812417] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-25T23:43:50.812486] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-25T23:43:51.180907] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:43:51.181354] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-25T23:43:52.483815] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-25T23:43:52.492096] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-25T23:43:53.976534] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T23:43:53.984615] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-25T23:43:55.538685] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T23:43:55.546632] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-25T23:43:57.071755] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T23:43:57.080771] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-25T23:43:58.588669] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T23:43:58.595820] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-25T23:43:59.742973] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T23:43:59.751028] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-25T23:44:01.402201] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-25T23:44:01.411416] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-25T23:44:03.123181] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T23:44:03.131470] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-25T23:44:04.592139] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T23:44:04.601593] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-25T23:44:05.196327] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-25T23:44:05.202595] [INFO ] [REMOTE ] MSCI: Full fetch complete (50473 records). [2025-10-25T23:44:05.202765] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-25T23:44:05.594092] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-25T23:44:05.594238] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-25T23:44:05.595701] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-25T23:44:05.595790] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-25T23:44:05.597164] [DEBUG] [LOCAL ] MSCI: Trimmed 50473 records to 34551 (keeping 200 days of data) [2025-10-25T23:44:05.817793] [DEBUG] [LOCAL ] MSCI: Primary data saved (34551 records). [2025-10-25T23:44:05.818037] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-25T23:44:05.818236] [INFO ] [MAIN ] Update Progress: 1403/2366 symbols. MSCI took 15.2s. Estimated remaining time: 3h 16m 31s [2025-10-25T23:44:05.991967] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:44:05.992309] [DEBUG] [LOCAL ] MSD: No existing data file found in primary storage. [2025-10-25T23:44:05.992387] [WARN ] [MAIN ] MSD: No existing data found, performing full refresh instead. [2025-10-25T23:44:05.992514] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-25T23:44:05.992590] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-25T23:44:05.992724] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-25T23:44:05.992800] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-25T23:44:06.359162] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:44:06.359585] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-25T23:44:07.179533] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T23:44:07.183379] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-25T23:44:08.134556] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T23:44:08.140582] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-25T23:44:09.164973] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T23:44:09.168736] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-25T23:44:09.983732] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T23:44:09.987114] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-25T23:44:10.724088] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T23:44:10.728175] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-25T23:44:11.223763] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-25T23:44:11.226492] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-25T23:44:12.279527] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T23:44:12.283902] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-25T23:44:13.260969] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-25T23:44:13.266473] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-25T23:44:14.238823] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-25T23:44:14.243281] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-25T23:44:15.340906] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T23:44:15.345217] [INFO ] [REMOTE ] MSD: Full fetch complete (23181 records). [2025-10-25T23:44:15.345324] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-25T23:44:15.734953] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-25T23:44:15.735073] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-25T23:44:15.735667] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-25T23:44:15.735752] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-25T23:44:15.736471] [DEBUG] [LOCAL ] MSD: Trimmed 23181 records to 16816 (keeping 200 days of data) [2025-10-25T23:44:15.831093] [DEBUG] [LOCAL ] MSD: Primary data saved (16816 records). [2025-10-25T23:44:15.831259] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-25T23:44:15.831419] [INFO ] [MAIN ] Update Progress: 1404/2366 symbols. MSD took 10.0s. Estimated remaining time: 3h 16m 17s [2025-10-25T23:44:16.002981] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:44:16.003228] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-25T23:44:16.003299] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-25T23:44:16.003413] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-25T23:44:16.003482] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-25T23:44:16.003561] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-25T23:44:16.003628] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-25T23:44:16.362587] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:44:16.362978] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-25T23:44:17.765207] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-25T23:44:17.772598] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-25T23:44:19.273583] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-25T23:44:19.281491] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-25T23:44:20.946966] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-25T23:44:20.960450] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-25T23:44:22.366035] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-25T23:44:22.374362] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-25T23:44:23.727439] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-25T23:44:23.734950] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-25T23:44:25.098928] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-25T23:44:25.106243] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-25T23:44:26.574859] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-25T23:44:26.582829] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-25T23:44:28.168730] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-25T23:44:28.181361] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-25T23:44:29.760244] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-25T23:44:29.769405] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-25T23:44:31.425206] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-25T23:44:31.433521] [INFO ] [REMOTE ] MSDL: Full fetch complete (56576 records). [2025-10-25T23:44:31.433666] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-25T23:44:31.816196] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-25T23:44:31.816312] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-25T23:44:31.817215] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-25T23:44:31.817293] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-25T23:44:31.818468] [DEBUG] [LOCAL ] MSDL: Trimmed 56576 records to 39231 (keeping 200 days of data) [2025-10-25T23:44:32.047276] [DEBUG] [LOCAL ] MSDL: Primary data saved (39231 records). [2025-10-25T23:44:32.047444] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-25T23:44:32.047602] [INFO ] [MAIN ] Update Progress: 1405/2366 symbols. MSDL took 16.2s. Estimated remaining time: 3h 16m 7s [2025-10-25T23:44:32.215124] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:44:32.215325] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-25T23:44:32.215419] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-25T23:44:32.215532] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-25T23:44:32.215607] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-25T23:44:32.215701] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-25T23:44:32.215770] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-25T23:44:32.571191] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:44:32.571517] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-25T23:44:33.834959] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T23:44:33.844742] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-25T23:44:35.005051] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T23:44:35.010762] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-25T23:44:36.370840] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-25T23:44:36.377577] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-25T23:44:37.474800] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T23:44:37.480925] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-25T23:44:38.572134] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T23:44:38.579763] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-25T23:44:39.839468] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-25T23:44:39.845589] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-25T23:44:40.897229] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-25T23:44:40.903365] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-25T23:44:42.131994] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-25T23:44:42.137999] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-25T23:44:43.420315] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-25T23:44:43.426799] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-25T23:44:44.411231] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T23:44:44.417244] [INFO ] [REMOTE ] MSGE: Full fetch complete (39876 records). [2025-10-25T23:44:44.417388] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-25T23:44:44.795280] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-25T23:44:44.795399] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-25T23:44:44.796225] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-25T23:44:44.796310] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-25T23:44:44.797169] [DEBUG] [LOCAL ] MSGE: Trimmed 39876 records to 27409 (keeping 200 days of data) [2025-10-25T23:44:44.947773] [DEBUG] [LOCAL ] MSGE: Primary data saved (27409 records). [2025-10-25T23:44:44.947954] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-25T23:44:44.948115] [INFO ] [MAIN ] Update Progress: 1406/2366 symbols. MSGE took 12.9s. Estimated remaining time: 3h 15m 55s [2025-10-25T23:44:45.115507] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:44:45.115721] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-25T23:44:45.115783] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-25T23:44:45.115908] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-25T23:44:45.116003] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-25T23:44:45.116127] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-25T23:44:45.116198] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-25T23:44:45.467732] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:44:45.468065] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-25T23:44:46.274021] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-25T23:44:46.276952] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-25T23:44:47.180971] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-25T23:44:47.184566] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-25T23:44:48.104505] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-25T23:44:48.108996] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-25T23:44:49.201662] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-25T23:44:49.205374] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-25T23:44:50.199548] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-25T23:44:50.203133] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-25T23:44:51.227878] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T23:44:51.232374] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-25T23:44:51.935035] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-25T23:44:51.939190] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-25T23:44:52.894386] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T23:44:52.898562] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-25T23:44:54.025590] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T23:44:54.031884] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-25T23:44:54.582747] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-25T23:44:54.586466] [INFO ] [REMOTE ] MSGS: Full fetch complete (23762 records). [2025-10-25T23:44:54.586564] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-25T23:44:54.978595] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-25T23:44:54.978788] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-25T23:44:54.979377] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-25T23:44:54.979458] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-25T23:44:54.980321] [DEBUG] [LOCAL ] MSGS: Trimmed 23762 records to 17404 (keeping 200 days of data) [2025-10-25T23:44:55.088557] [DEBUG] [LOCAL ] MSGS: Primary data saved (17404 records). [2025-10-25T23:44:55.088957] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-25T23:44:55.089118] [INFO ] [MAIN ] Update Progress: 1407/2366 symbols. MSGS took 10.1s. Estimated remaining time: 3h 15m 42s [2025-10-25T23:44:55.288947] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:44:55.289228] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-25T23:44:55.289318] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-25T23:44:55.289461] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-25T23:44:55.289547] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-25T23:44:55.289672] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-25T23:44:55.289759] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-25T23:44:55.767966] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:44:55.768461] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-25T23:44:57.268212] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-25T23:44:57.275996] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-25T23:44:58.895941] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T23:44:58.903946] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-25T23:45:00.522467] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-25T23:45:00.531301] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-25T23:45:02.375122] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T23:45:02.384316] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-25T23:45:04.360109] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-25T23:45:04.369934] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-25T23:45:06.007286] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-25T23:45:06.015520] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-25T23:45:07.620394] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-25T23:45:07.629016] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-25T23:45:09.320870] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T23:45:09.330288] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-25T23:45:10.947966] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T23:45:10.956435] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-25T23:45:11.617929] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-25T23:45:11.625183] [INFO ] [REMOTE ] MSI: Full fetch complete (58013 records). [2025-10-25T23:45:11.625391] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-25T23:45:12.016269] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-25T23:45:12.016403] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-25T23:45:12.017355] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-25T23:45:12.017463] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-25T23:45:12.018786] [DEBUG] [LOCAL ] MSI: Trimmed 58013 records to 40175 (keeping 200 days of data) [2025-10-25T23:45:12.268356] [DEBUG] [LOCAL ] MSI: Primary data saved (40175 records). [2025-10-25T23:45:12.268531] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-25T23:45:12.268716] [INFO ] [MAIN ] Update Progress: 1408/2366 symbols. MSI took 17.2s. Estimated remaining time: 3h 15m 33s [2025-10-25T23:45:12.447582] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:45:12.447837] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-25T23:45:12.447930] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-25T23:45:12.448046] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-25T23:45:12.448120] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-25T23:45:12.448203] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-25T23:45:12.448274] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-25T23:45:12.818521] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:45:12.819936] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-10-25T23:45:13.252316] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-25T23:45:13.253840] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-10-25T23:45:14.163878] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-25T23:45:14.167183] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-10-25T23:45:15.050221] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-25T23:45:15.053180] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-10-25T23:45:15.870554] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T23:45:15.872916] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-10-25T23:45:16.575559] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-25T23:45:16.577463] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-10-25T23:45:17.548024] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T23:45:17.551975] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-10-25T23:45:18.387162] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-25T23:45:18.390423] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-10-25T23:45:19.561718] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T23:45:19.567190] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-10-25T23:45:20.686393] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T23:45:20.691504] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-10. [2025-10-25T23:45:21.800179] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T23:45:21.804426] [INFO ] [REMOTE ] MSIF: Full fetch complete (19554 records). [2025-10-25T23:45:21.804574] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-10-25T23:45:21.987574] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-10-25T23:45:21.988052] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:45:21.988132] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:45:21.988208] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-25T23:45:21.988318] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-25T23:45:21.988390] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-25T23:45:21.988469] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-25T23:45:21.988632] [INFO ] [MAIN ] Update Progress: 1409/2366 symbols. MSIF took 9.7s. Estimated remaining time: 3h 15m 19s [2025-10-25T23:45:22.161527] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:45:22.161782] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-25T23:45:22.161852] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-25T23:45:22.161964] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-25T23:45:22.162041] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-25T23:45:22.162164] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-25T23:45:22.162233] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-25T23:45:22.518870] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:45:22.519219] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-25T23:45:23.977132] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-25T23:45:23.985282] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-25T23:45:25.272460] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T23:45:25.279007] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-25T23:45:26.731435] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-25T23:45:26.739044] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-25T23:45:28.267445] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T23:45:28.279426] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-25T23:45:29.702805] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T23:45:29.709919] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-25T23:45:30.993722] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-25T23:45:31.000799] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-25T23:45:32.497824] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-25T23:45:32.507000] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-25T23:45:33.854687] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T23:45:33.861638] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-25T23:45:35.352995] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-25T23:45:35.361345] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-25T23:45:36.021184] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-25T23:45:36.028386] [INFO ] [REMOTE ] MSM: Full fetch complete (51871 records). [2025-10-25T23:45:36.028547] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-25T23:45:36.438791] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-25T23:45:36.438913] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-25T23:45:36.439909] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-25T23:45:36.439993] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-25T23:45:36.441243] [DEBUG] [LOCAL ] MSM: Trimmed 51871 records to 36054 (keeping 200 days of data) [2025-10-25T23:45:36.659624] [DEBUG] [LOCAL ] MSM: Primary data saved (36054 records). [2025-10-25T23:45:36.659806] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-25T23:45:36.659954] [INFO ] [MAIN ] Update Progress: 1410/2366 symbols. MSM took 14.7s. Estimated remaining time: 3h 15m 8s [2025-10-25T23:45:36.841701] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:45:36.841893] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-25T23:45:36.841972] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-25T23:45:36.842094] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-25T23:45:36.842165] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-25T23:45:36.842227] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-25T23:45:36.842288] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-25T23:45:37.230285] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:45:37.230845] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-25T23:45:38.937397] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T23:45:38.948481] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-25T23:45:40.685967] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-25T23:45:40.700097] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-25T23:45:42.739974] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T23:45:42.751231] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-25T23:45:44.566453] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-25T23:45:44.577442] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-25T23:45:46.309403] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T23:45:46.319826] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-25T23:45:47.739752] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-25T23:45:47.750494] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-25T23:45:49.549272] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T23:45:49.560895] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-25T23:45:51.343030] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-25T23:45:51.354025] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-25T23:45:53.135462] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-25T23:45:53.146456] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-25T23:45:55.003912] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-25T23:45:55.013412] [INFO ] [REMOTE ] MT: Full fetch complete (73694 records). [2025-10-25T23:45:55.013617] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-25T23:45:55.418478] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-25T23:45:55.418620] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-25T23:45:55.419943] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-25T23:45:55.420034] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-25T23:45:55.421491] [DEBUG] [LOCAL ] MT: Trimmed 73694 records to 51084 (keeping 200 days of data) [2025-10-25T23:45:55.710698] [DEBUG] [LOCAL ] MT: Primary data saved (51084 records). [2025-10-25T23:45:55.710873] [INFO ] [MAIN ] MT: Full history saved. [2025-10-25T23:45:55.711051] [INFO ] [MAIN ] Update Progress: 1411/2366 symbols. MT took 19.1s. Estimated remaining time: 3h 15m 1s [2025-10-25T23:45:55.880436] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:45:55.880633] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-25T23:45:55.880742] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-25T23:45:55.880855] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-25T23:45:55.880929] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-25T23:45:55.881011] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-25T23:45:55.881083] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-25T23:45:56.231763] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:45:56.232109] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-25T23:45:57.830174] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-25T23:45:57.840215] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-25T23:45:59.461631] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T23:45:59.470813] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-25T23:46:01.428620] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-25T23:46:01.438975] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-25T23:46:03.205123] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-25T23:46:03.215382] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-25T23:46:04.809448] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-25T23:46:04.819451] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-25T23:46:06.454388] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-25T23:46:06.464787] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-25T23:46:08.238140] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-25T23:46:08.248721] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-25T23:46:09.825364] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-25T23:46:09.839043] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-25T23:46:11.456716] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-25T23:46:11.466510] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-25T23:46:12.265533] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T23:46:12.274241] [INFO ] [REMOTE ] MTB: Full fetch complete (68280 records). [2025-10-25T23:46:12.274402] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-25T23:46:12.660812] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-25T23:46:12.660938] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-25T23:46:12.661955] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-25T23:46:12.662033] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-25T23:46:12.663385] [DEBUG] [LOCAL ] MTB: Trimmed 68280 records to 47303 (keeping 200 days of data) [2025-10-25T23:46:12.951584] [DEBUG] [LOCAL ] MTB: Primary data saved (47303 records). [2025-10-25T23:46:12.951773] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-25T23:46:12.951967] [INFO ] [MAIN ] Update Progress: 1412/2366 symbols. MTB took 17.2s. Estimated remaining time: 3h 14m 52s [2025-10-25T23:46:13.122587] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:46:13.122807] [DEBUG] [LOCAL ] MTD: No existing data file found in primary storage. [2025-10-25T23:46:13.122879] [WARN ] [MAIN ] MTD: No existing data found, performing full refresh instead. [2025-10-25T23:46:13.122998] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-25T23:46:13.123070] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-25T23:46:13.123132] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-25T23:46:13.123195] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-25T23:46:13.484630] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:46:13.485000] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-25T23:46:14.420483] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T23:46:14.423621] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-25T23:46:15.299878] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-25T23:46:15.303396] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-25T23:46:16.156704] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-25T23:46:16.160037] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-25T23:46:17.396431] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T23:46:17.401685] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-25T23:46:18.496620] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-25T23:46:18.503527] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-25T23:46:19.500752] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-25T23:46:19.504389] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-25T23:46:20.541807] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-25T23:46:20.545989] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-25T23:46:21.445833] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-25T23:46:21.449259] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-25T23:46:22.320299] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-25T23:46:22.323221] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-25T23:46:22.698698] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-25T23:46:22.701730] [INFO ] [REMOTE ] MTD: Full fetch complete (21462 records). [2025-10-25T23:46:22.701841] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-25T23:46:23.066085] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-25T23:46:23.066206] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-25T23:46:23.066772] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-25T23:46:23.066853] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-25T23:46:23.067489] [DEBUG] [LOCAL ] MTD: Trimmed 21462 records to 15336 (keeping 200 days of data) [2025-10-25T23:46:23.161665] [DEBUG] [LOCAL ] MTD: Primary data saved (15336 records). [2025-10-25T23:46:23.161847] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-25T23:46:23.162007] [INFO ] [MAIN ] Update Progress: 1413/2366 symbols. MTD took 10.2s. Estimated remaining time: 3h 14m 38s [2025-10-25T23:46:23.327684] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:46:23.327910] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-25T23:46:23.327991] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-25T23:46:23.328102] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-25T23:46:23.328172] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-25T23:46:23.328232] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-25T23:46:23.328296] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-25T23:46:23.692052] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:46:23.692441] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-25T23:46:25.348355] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-25T23:46:25.358122] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-25T23:46:26.996091] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-25T23:46:27.005888] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-25T23:46:28.873450] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-25T23:46:28.884088] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-25T23:46:30.928416] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-25T23:46:30.939356] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-25T23:46:32.745217] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-25T23:46:32.755945] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-25T23:46:34.583428] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-25T23:46:34.595243] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-25T23:46:36.336222] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-25T23:46:36.349276] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-25T23:46:38.122909] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-25T23:46:38.134103] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-25T23:46:39.845512] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T23:46:39.856250] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-25T23:46:40.581627] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-25T23:46:40.591226] [INFO ] [REMOTE ] MTDR: Full fetch complete (74375 records). [2025-10-25T23:46:40.591383] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-25T23:46:40.973094] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-25T23:46:40.973228] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-25T23:46:40.974290] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-25T23:46:40.974371] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-25T23:46:40.975832] [DEBUG] [LOCAL ] MTDR: Trimmed 74375 records to 52538 (keeping 200 days of data) [2025-10-25T23:46:41.278070] [DEBUG] [LOCAL ] MTDR: Primary data saved (52538 records). [2025-10-25T23:46:41.278282] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-25T23:46:41.278471] [INFO ] [MAIN ] Update Progress: 1414/2366 symbols. MTDR took 18.1s. Estimated remaining time: 3h 14m 30s [2025-10-25T23:46:41.442802] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:46:41.443038] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-25T23:46:41.443110] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-25T23:46:41.443224] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-25T23:46:41.443294] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-25T23:46:41.443375] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-25T23:46:41.443443] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-25T23:46:41.792794] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:46:41.793224] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-25T23:46:43.459282] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T23:46:43.469180] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-25T23:46:44.939304] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-25T23:46:44.949171] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-25T23:46:46.494489] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-25T23:46:46.505521] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-25T23:46:48.231124] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-25T23:46:48.242347] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-25T23:46:49.949867] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-25T23:46:49.960437] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-25T23:46:51.612367] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-25T23:46:51.622446] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-25T23:46:53.407856] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-25T23:46:53.419379] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-25T23:46:55.144468] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-25T23:46:55.155544] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-25T23:46:56.820908] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-25T23:46:56.831684] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-25T23:46:57.480121] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T23:46:57.489736] [INFO ] [REMOTE ] MTG: Full fetch complete (74319 records). [2025-10-25T23:46:57.489931] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-25T23:46:57.872604] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-25T23:46:57.872761] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-25T23:46:57.874552] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-25T23:46:57.874634] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-25T23:46:57.876063] [DEBUG] [LOCAL ] MTG: Trimmed 74319 records to 51803 (keeping 200 days of data) [2025-10-25T23:46:58.173362] [DEBUG] [LOCAL ] MTG: Primary data saved (51803 records). [2025-10-25T23:46:58.173533] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-25T23:46:58.173709] [INFO ] [MAIN ] Update Progress: 1415/2366 symbols. MTG took 16.9s. Estimated remaining time: 3h 14m 21s [2025-10-25T23:46:58.343437] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:46:58.343630] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-25T23:46:58.343719] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-25T23:46:58.343833] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-25T23:46:58.343904] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-25T23:46:58.343986] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-25T23:46:58.344060] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-25T23:46:58.702948] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:46:58.703365] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-25T23:47:00.335157] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-25T23:47:00.344120] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-25T23:47:01.820211] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-25T23:47:01.829483] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-25T23:47:03.585798] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-25T23:47:03.595199] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-25T23:47:05.375218] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-25T23:47:05.385191] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-25T23:47:06.986554] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-25T23:47:06.995803] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-25T23:47:08.513233] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-25T23:47:08.522243] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-25T23:47:10.157322] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-25T23:47:10.168146] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-25T23:47:11.572599] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T23:47:11.582244] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-25T23:47:13.189319] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T23:47:13.199508] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-25T23:47:13.912865] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-25T23:47:13.921088] [INFO ] [REMOTE ] MTH: Full fetch complete (64115 records). [2025-10-25T23:47:13.921244] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-25T23:47:14.317033] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-25T23:47:14.317158] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-25T23:47:14.318261] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-25T23:47:14.318346] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-25T23:47:14.319698] [DEBUG] [LOCAL ] MTH: Trimmed 64115 records to 44421 (keeping 200 days of data) [2025-10-25T23:47:14.579933] [DEBUG] [LOCAL ] MTH: Primary data saved (44421 records). [2025-10-25T23:47:14.580102] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-25T23:47:14.580258] [INFO ] [MAIN ] Update Progress: 1416/2366 symbols. MTH took 16.4s. Estimated remaining time: 3h 14m 11s [2025-10-25T23:47:14.748414] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:47:14.748696] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-25T23:47:14.748773] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-25T23:47:14.748895] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-25T23:47:14.748969] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-25T23:47:14.749054] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-25T23:47:14.749127] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-25T23:47:15.101696] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:47:15.102028] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-25T23:47:16.690219] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-25T23:47:16.698201] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-25T23:47:18.188956] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T23:47:18.196223] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-25T23:47:19.807595] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-25T23:47:19.816587] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-25T23:47:21.461086] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-25T23:47:21.469826] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-25T23:47:22.969455] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-25T23:47:22.977497] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-25T23:47:24.607368] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-25T23:47:24.616380] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-25T23:47:26.132821] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T23:47:26.141555] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-25T23:47:27.592393] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T23:47:27.600021] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-25T23:47:29.116943] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-25T23:47:29.125836] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-25T23:47:29.891353] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T23:47:29.898942] [INFO ] [REMOTE ] MTN: Full fetch complete (56708 records). [2025-10-25T23:47:29.899084] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-25T23:47:30.286914] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-25T23:47:30.287064] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-25T23:47:30.288065] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-25T23:47:30.288148] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-25T23:47:30.289354] [DEBUG] [LOCAL ] MTN: Trimmed 56708 records to 39805 (keeping 200 days of data) [2025-10-25T23:47:30.535726] [DEBUG] [LOCAL ] MTN: Primary data saved (39805 records). [2025-10-25T23:47:30.535892] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-25T23:47:30.536047] [INFO ] [MAIN ] Update Progress: 1417/2366 symbols. MTN took 16.0s. Estimated remaining time: 3h 14m 1s [2025-10-25T23:47:30.711217] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:47:30.711459] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-25T23:47:30.711541] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-25T23:47:30.711684] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-25T23:47:30.711762] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-25T23:47:30.711843] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-25T23:47:30.711893] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-25T23:47:31.068528] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:47:31.068879] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-25T23:47:31.511993] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-25T23:47:31.513111] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-25T23:47:31.850546] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-25T23:47:31.851896] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-25T23:47:32.275085] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-25T23:47:32.276091] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-25T23:47:32.945439] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-25T23:47:32.946450] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-25T23:47:33.321480] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-25T23:47:33.322477] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-25T23:47:34.071252] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T23:47:34.073430] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-25T23:47:34.536867] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-25T23:47:34.538080] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-25T23:47:34.891107] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-25T23:47:34.892178] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-25T23:47:35.229011] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-25T23:47:35.230046] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-25T23:47:35.512462] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-25T23:47:35.513400] [INFO ] [REMOTE ] MTR: Full fetch complete (2417 records). [2025-10-25T23:47:35.513506] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-25T23:47:35.693542] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-25T23:47:35.693752] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:47:35.693822] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:47:35.693921] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-25T23:47:35.694022] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-25T23:47:35.694070] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-25T23:47:35.694142] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-25T23:47:35.694255] [INFO ] [MAIN ] Update Progress: 1418/2366 symbols. MTR took 5.2s. Estimated remaining time: 3h 13m 44s [2025-10-25T23:47:35.860457] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:47:35.860670] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-25T23:47:35.860750] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-25T23:47:35.860869] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-25T23:47:35.860939] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-25T23:47:35.860998] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-25T23:47:35.861059] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-25T23:47:36.212811] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:47:36.213148] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-25T23:47:37.122151] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-25T23:47:37.125339] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-25T23:47:37.982246] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-25T23:47:37.985281] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-25T23:47:38.955442] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-25T23:47:38.959054] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-25T23:47:40.056949] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T23:47:40.061161] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-25T23:47:41.195554] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-25T23:47:41.200448] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-25T23:47:42.175404] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T23:47:42.181279] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-25T23:47:43.271302] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-25T23:47:43.276902] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-25T23:47:44.237797] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-25T23:47:44.242319] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-25T23:47:45.195026] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T23:47:45.200790] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-25T23:47:45.751872] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-25T23:47:45.755459] [INFO ] [REMOTE ] MTRN: Full fetch complete (24133 records). [2025-10-25T23:47:45.755697] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-25T23:47:46.120337] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-25T23:47:46.120449] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-25T23:47:46.121067] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-25T23:47:46.121164] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-25T23:47:46.121923] [DEBUG] [LOCAL ] MTRN: Trimmed 24133 records to 18322 (keeping 200 days of data) [2025-10-25T23:47:46.234414] [DEBUG] [LOCAL ] MTRN: Primary data saved (18322 records). [2025-10-25T23:47:46.234581] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-25T23:47:46.234759] [INFO ] [MAIN ] Update Progress: 1419/2366 symbols. MTRN took 10.5s. Estimated remaining time: 3h 13m 31s [2025-10-25T23:47:46.402718] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:47:46.402894] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-25T23:47:46.402971] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-25T23:47:46.403088] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-25T23:47:46.403163] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-25T23:47:46.403242] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-25T23:47:46.403311] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-25T23:47:46.775858] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:47:46.776265] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-25T23:47:47.979708] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-25T23:47:47.985814] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-25T23:47:49.228144] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-25T23:47:49.234605] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-25T23:47:50.574691] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-25T23:47:50.581965] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-25T23:47:51.888392] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-25T23:47:51.895340] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-25T23:47:53.095212] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-25T23:47:53.102201] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-25T23:47:54.325287] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T23:47:54.331956] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-25T23:47:55.707183] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-25T23:47:55.713680] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-25T23:47:56.781848] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T23:47:56.787573] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-25T23:47:57.864086] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T23:47:57.869956] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-25T23:47:58.452039] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:47:58.456872] [INFO ] [REMOTE ] MTUS: Full fetch complete (41020 records). [2025-10-25T23:47:58.457012] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-25T23:47:58.835529] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-25T23:47:58.835670] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-25T23:47:58.836573] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-25T23:47:58.836685] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-25T23:47:58.837741] [DEBUG] [LOCAL ] MTUS: Trimmed 41020 records to 27733 (keeping 200 days of data) [2025-10-25T23:47:58.996108] [DEBUG] [LOCAL ] MTUS: Primary data saved (27733 records). [2025-10-25T23:47:58.996294] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-25T23:47:58.996434] [INFO ] [MAIN ] Update Progress: 1420/2366 symbols. MTUS took 12.8s. Estimated remaining time: 3h 13m 19s [2025-10-25T23:47:59.163917] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:47:59.164137] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-25T23:47:59.164209] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-25T23:47:59.164329] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-25T23:47:59.164412] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-25T23:47:59.164501] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-25T23:47:59.164571] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-25T23:47:59.532026] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:47:59.532356] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-25T23:48:00.727345] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-25T23:48:00.732463] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-25T23:48:01.901411] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-25T23:48:01.907307] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-25T23:48:03.050818] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T23:48:03.057253] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-25T23:48:04.308303] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-25T23:48:04.314696] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-25T23:48:05.602803] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-25T23:48:05.609139] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-25T23:48:06.796094] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-25T23:48:06.801741] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-25T23:48:07.749138] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T23:48:07.755195] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-25T23:48:09.033276] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-25T23:48:09.039802] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-25T23:48:10.219818] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-25T23:48:10.227532] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-25T23:48:11.268286] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-25T23:48:11.273048] [INFO ] [REMOTE ] MTW: Full fetch complete (38209 records). [2025-10-25T23:48:11.273166] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-25T23:48:11.639329] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-25T23:48:11.639449] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-25T23:48:11.640240] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-25T23:48:11.640319] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-25T23:48:11.641210] [DEBUG] [LOCAL ] MTW: Trimmed 38209 records to 26782 (keeping 200 days of data) [2025-10-25T23:48:11.791749] [DEBUG] [LOCAL ] MTW: Primary data saved (26782 records). [2025-10-25T23:48:11.791940] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-25T23:48:11.792111] [INFO ] [MAIN ] Update Progress: 1421/2366 symbols. MTW took 12.8s. Estimated remaining time: 3h 13m 7s [2025-10-25T23:48:11.957774] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:48:11.957994] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-25T23:48:11.958085] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-25T23:48:11.958198] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-25T23:48:11.958267] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-25T23:48:11.958348] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-25T23:48:11.958417] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-25T23:48:12.314970] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:48:12.315310] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-25T23:48:13.295957] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-25T23:48:13.299836] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-25T23:48:14.438672] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-25T23:48:14.443629] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-25T23:48:15.508022] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-25T23:48:15.512393] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-25T23:48:16.756566] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-25T23:48:16.762526] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-25T23:48:17.843076] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T23:48:17.848472] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-25T23:48:18.876719] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-25T23:48:18.881469] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-25T23:48:20.128812] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-25T23:48:20.134951] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-25T23:48:21.338366] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T23:48:21.343410] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-25T23:48:22.347177] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T23:48:22.351871] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-25T23:48:22.893503] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T23:48:22.897076] [INFO ] [REMOTE ] MTX: Full fetch complete (31404 records). [2025-10-25T23:48:22.897175] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-25T23:48:23.266313] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-25T23:48:23.266430] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-25T23:48:23.267162] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-25T23:48:23.267243] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-25T23:48:23.268106] [DEBUG] [LOCAL ] MTX: Trimmed 31404 records to 22853 (keeping 200 days of data) [2025-10-25T23:48:23.399786] [DEBUG] [LOCAL ] MTX: Primary data saved (22853 records). [2025-10-25T23:48:23.399943] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-25T23:48:23.400102] [INFO ] [MAIN ] Update Progress: 1422/2366 symbols. MTX took 11.6s. Estimated remaining time: 3h 12m 54s [2025-10-25T23:48:23.573600] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:48:23.573891] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-25T23:48:23.573964] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-25T23:48:23.574058] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-25T23:48:23.574125] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-25T23:48:23.574205] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-25T23:48:23.574271] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-25T23:48:23.918015] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:48:23.918379] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-25T23:48:25.603256] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T23:48:25.612611] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-25T23:48:27.158146] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-25T23:48:27.167107] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-25T23:48:28.628545] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-25T23:48:28.638559] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-25T23:48:30.338317] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-25T23:48:30.347392] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-25T23:48:32.058639] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-25T23:48:32.069092] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-25T23:48:33.663554] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-25T23:48:33.671874] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-25T23:48:35.331886] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-25T23:48:35.341623] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-25T23:48:37.154670] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-25T23:48:37.164510] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-25T23:48:38.591818] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-25T23:48:38.600932] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-25T23:48:39.275874] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-25T23:48:39.284140] [INFO ] [REMOTE ] MTZ: Full fetch complete (63607 records). [2025-10-25T23:48:39.284342] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-25T23:48:39.676026] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-25T23:48:39.676173] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-25T23:48:39.677197] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-25T23:48:39.677300] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-25T23:48:39.678717] [DEBUG] [LOCAL ] MTZ: Trimmed 63607 records to 43305 (keeping 200 days of data) [2025-10-25T23:48:39.932199] [DEBUG] [LOCAL ] MTZ: Primary data saved (43305 records). [2025-10-25T23:48:39.932376] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-25T23:48:39.932551] [INFO ] [MAIN ] Update Progress: 1423/2366 symbols. MTZ took 16.5s. Estimated remaining time: 3h 12m 45s [2025-10-25T23:48:40.103151] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:48:40.103366] [DEBUG] [LOCAL ] MUA: No existing data file found in primary storage. [2025-10-25T23:48:40.103439] [WARN ] [MAIN ] MUA: No existing data found, performing full refresh instead. [2025-10-25T23:48:40.103555] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-25T23:48:40.103627] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-25T23:48:40.103727] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-25T23:48:40.103797] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-25T23:48:40.458997] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:48:40.459408] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-25T23:48:41.311110] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-25T23:48:41.314600] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-25T23:48:42.198288] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-25T23:48:42.201876] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-25T23:48:43.127242] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-25T23:48:43.131191] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-25T23:48:44.044685] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-25T23:48:44.048203] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-25T23:48:44.862672] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T23:48:44.865187] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-25T23:48:45.722723] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-25T23:48:45.726242] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-25T23:48:46.510061] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T23:48:46.514301] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-25T23:48:47.284320] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-25T23:48:47.287534] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-25T23:48:48.136336] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T23:48:48.139351] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-25T23:48:48.949791] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-25T23:48:48.952381] [INFO ] [REMOTE ] MUA: Full fetch complete (18226 records). [2025-10-25T23:48:48.952474] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-25T23:48:49.314990] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-25T23:48:49.315110] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-25T23:48:49.315545] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-25T23:48:49.315664] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-25T23:48:49.316230] [DEBUG] [LOCAL ] MUA: Trimmed 18226 records to 11725 (keeping 200 days of data) [2025-10-25T23:48:49.384159] [DEBUG] [LOCAL ] MUA: Primary data saved (11725 records). [2025-10-25T23:48:49.384325] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-25T23:48:49.384479] [INFO ] [MAIN ] Update Progress: 1424/2366 symbols. MUA took 9.5s. Estimated remaining time: 3h 12m 31s [2025-10-25T23:48:49.550606] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:48:49.550856] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-25T23:48:49.550927] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-25T23:48:49.551012] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-25T23:48:49.551080] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-25T23:48:49.551161] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-25T23:48:49.551230] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-25T23:48:49.928695] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:48:49.929092] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-25T23:48:50.944217] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T23:48:50.949379] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-25T23:48:51.902298] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T23:48:51.908084] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-25T23:48:52.958750] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-25T23:48:52.963662] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-25T23:48:54.014724] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-25T23:48:54.019431] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-25T23:48:55.201713] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-25T23:48:55.207210] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-25T23:48:56.223631] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T23:48:56.228093] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-25T23:48:57.303195] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-25T23:48:57.308552] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-25T23:48:58.481788] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-25T23:48:58.487037] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-25T23:48:59.501316] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T23:48:59.506895] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-25T23:49:00.518389] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-25T23:49:00.522600] [INFO ] [REMOTE ] MUC: Full fetch complete (29539 records). [2025-10-25T23:49:00.522741] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-25T23:49:00.889250] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-25T23:49:00.889396] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-25T23:49:00.890160] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-25T23:49:00.890242] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-25T23:49:00.891256] [DEBUG] [LOCAL ] MUC: Trimmed 29539 records to 20880 (keeping 200 days of data) [2025-10-25T23:49:01.033825] [DEBUG] [LOCAL ] MUC: Primary data saved (20880 records). [2025-10-25T23:49:01.034016] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-25T23:49:01.034190] [INFO ] [MAIN ] Update Progress: 1425/2366 symbols. MUC took 11.6s. Estimated remaining time: 3h 12m 18s [2025-10-25T23:49:01.207362] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:49:01.207559] [DEBUG] [LOCAL ] MUE: No existing data file found in primary storage. [2025-10-25T23:49:01.207633] [WARN ] [MAIN ] MUE: No existing data found, performing full refresh instead. [2025-10-25T23:49:01.207761] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-25T23:49:01.207832] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-25T23:49:01.207968] [DEBUG] [LOCAL ] MUE: No primary data file found to delete. [2025-10-25T23:49:01.208040] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-25T23:49:01.568225] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:49:01.568564] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-25T23:49:02.411568] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-25T23:49:02.414970] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-25T23:49:03.144378] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T23:49:03.146461] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-25T23:49:03.969024] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-25T23:49:03.971851] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-25T23:49:04.782956] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-25T23:49:04.785964] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-25T23:49:05.564180] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-25T23:49:05.567208] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-25T23:49:06.463961] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-25T23:49:06.467686] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-25T23:49:07.242900] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T23:49:07.245725] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-25T23:49:08.236042] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T23:49:08.239929] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-25T23:49:09.031834] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T23:49:09.035991] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-25T23:49:09.897624] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T23:49:09.900689] [INFO ] [REMOTE ] MUE: Full fetch complete (15948 records). [2025-10-25T23:49:09.900793] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-25T23:49:10.299818] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-25T23:49:10.299960] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-25T23:49:10.300460] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-25T23:49:10.300563] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-25T23:49:10.301231] [DEBUG] [LOCAL ] MUE: Trimmed 15948 records to 12306 (keeping 200 days of data) [2025-10-25T23:49:10.378550] [DEBUG] [LOCAL ] MUE: Primary data saved (12306 records). [2025-10-25T23:49:10.378747] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-25T23:49:10.378936] [INFO ] [MAIN ] Update Progress: 1426/2366 symbols. MUE took 9.3s. Estimated remaining time: 3h 12m 4s [2025-10-25T23:49:10.570410] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:49:10.570674] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-25T23:49:10.570754] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-25T23:49:10.570897] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-25T23:49:10.570981] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-25T23:49:10.571080] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-25T23:49:10.571148] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-25T23:49:10.938786] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:49:10.939190] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-25T23:49:12.753187] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-25T23:49:12.763703] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-25T23:49:14.342219] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-25T23:49:14.353328] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-25T23:49:16.213705] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-25T23:49:16.225508] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-25T23:49:18.061381] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-25T23:49:18.073294] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-25T23:49:19.894754] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-25T23:49:19.907281] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-25T23:49:21.786103] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-25T23:49:21.797358] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-25T23:49:23.576200] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-25T23:49:23.588276] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-25T23:49:25.294458] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-25T23:49:25.306354] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-25T23:49:27.565600] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-25T23:49:27.577904] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-25T23:49:29.946055] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-25T23:49:29.956464] [INFO ] [REMOTE ] MUFG: Full fetch complete (75865 records). [2025-10-25T23:49:29.956734] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-25T23:49:30.358035] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-25T23:49:30.358195] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-25T23:49:30.359718] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-25T23:49:30.359822] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-25T23:49:30.361923] [DEBUG] [LOCAL ] MUFG: Trimmed 75865 records to 53183 (keeping 200 days of data) [2025-10-25T23:49:30.685481] [DEBUG] [LOCAL ] MUFG: Primary data saved (53183 records). [2025-10-25T23:49:30.685822] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-25T23:49:30.686066] [INFO ] [MAIN ] Update Progress: 1427/2366 symbols. MUFG took 20.3s. Estimated remaining time: 3h 11m 57s [2025-10-25T23:49:30.857842] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:49:30.858149] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-25T23:49:30.858240] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-25T23:49:30.858390] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-25T23:49:30.858480] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-25T23:49:30.858591] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-25T23:49:30.858700] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-25T23:49:31.214245] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:49:31.214670] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-25T23:49:33.411153] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-25T23:49:33.415215] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-25T23:49:35.313611] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-25T23:49:35.316883] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-25T23:49:36.184345] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-25T23:49:36.187074] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-25T23:49:37.741184] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-25T23:49:37.744310] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-25T23:49:38.462205] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T23:49:38.465150] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-25T23:49:39.370904] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-25T23:49:39.374732] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-25T23:49:40.367521] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-25T23:49:40.373070] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-25T23:49:41.324568] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-25T23:49:41.328500] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-25T23:49:42.287011] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-25T23:49:42.292301] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-25T23:49:43.148674] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-25T23:49:43.151926] [INFO ] [REMOTE ] MUJ: Full fetch complete (19352 records). [2025-10-25T23:49:43.152031] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-25T23:49:43.538304] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-25T23:49:43.538428] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-25T23:49:43.538971] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-25T23:49:43.539058] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-25T23:49:43.539669] [DEBUG] [LOCAL ] MUJ: Trimmed 19352 records to 13994 (keeping 200 days of data) [2025-10-25T23:49:43.625743] [DEBUG] [LOCAL ] MUJ: Primary data saved (13994 records). [2025-10-25T23:49:43.625992] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-25T23:49:43.626160] [INFO ] [MAIN ] Update Progress: 1428/2366 symbols. MUJ took 12.9s. Estimated remaining time: 3h 11m 45s [2025-10-25T23:49:43.793481] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:49:43.793759] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-25T23:49:43.793838] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-25T23:49:43.793955] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-25T23:49:43.794027] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-25T23:49:43.794110] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-25T23:49:43.794180] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-25T23:49:44.147128] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:49:44.147479] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-25T23:49:45.907017] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-25T23:49:45.917505] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-25T23:49:47.563185] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-25T23:49:47.573129] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-25T23:49:49.364425] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-25T23:49:49.380902] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-25T23:49:51.287480] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-25T23:49:51.299422] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-25T23:49:53.199251] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-25T23:49:53.211041] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-25T23:49:55.031521] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-25T23:49:55.042531] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-25T23:49:57.033796] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-25T23:49:57.045081] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-25T23:49:58.471170] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-25T23:49:58.482328] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-25T23:50:00.191815] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-25T23:50:00.203821] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-25T23:50:01.140828] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-25T23:50:01.150318] [INFO ] [REMOTE ] MUR: Full fetch complete (76818 records). [2025-10-25T23:50:01.150464] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-25T23:50:01.547734] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-25T23:50:01.547854] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-25T23:50:01.549161] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-25T23:50:01.549249] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-25T23:50:01.550802] [DEBUG] [LOCAL ] MUR: Trimmed 76818 records to 53620 (keeping 200 days of data) [2025-10-25T23:50:01.892585] [DEBUG] [LOCAL ] MUR: Primary data saved (53620 records). [2025-10-25T23:50:01.892818] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-25T23:50:01.892990] [INFO ] [MAIN ] Update Progress: 1429/2366 symbols. MUR took 18.3s. Estimated remaining time: 3h 11m 37s [2025-10-25T23:50:02.074665] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:02.074901] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-25T23:50:02.074973] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-25T23:50:02.075086] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-25T23:50:02.075156] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-25T23:50:02.075236] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-25T23:50:02.075306] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-25T23:50:02.434174] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:02.434574] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-25T23:50:03.659688] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-25T23:50:03.664170] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-25T23:50:04.983551] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-25T23:50:04.989746] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-25T23:50:06.271189] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-25T23:50:06.276580] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-25T23:50:07.574044] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T23:50:07.579471] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-25T23:50:08.804807] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-25T23:50:08.811046] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-25T23:50:10.030991] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-25T23:50:10.037224] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-25T23:50:11.208511] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T23:50:11.214349] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-25T23:50:12.410356] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T23:50:12.415898] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-25T23:50:13.497858] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-25T23:50:13.503672] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-25T23:50:14.261747] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-25T23:50:14.266185] [INFO ] [REMOTE ] MUSA: Full fetch complete (35686 records). [2025-10-25T23:50:14.266291] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-25T23:50:14.650410] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-25T23:50:14.650523] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-25T23:50:14.651238] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-25T23:50:14.651315] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-25T23:50:14.652141] [DEBUG] [LOCAL ] MUSA: Trimmed 35686 records to 24946 (keeping 200 days of data) [2025-10-25T23:50:14.799806] [DEBUG] [LOCAL ] MUSA: Primary data saved (24946 records). [2025-10-25T23:50:14.799958] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-25T23:50:14.800105] [INFO ] [MAIN ] Update Progress: 1430/2366 symbols. MUSA took 12.9s. Estimated remaining time: 3h 11m 25s [2025-10-25T23:50:14.965790] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:14.965984] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-25T23:50:14.966054] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-25T23:50:14.966161] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-25T23:50:14.966230] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-25T23:50:14.966308] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-25T23:50:14.966386] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-25T23:50:15.310129] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:15.310473] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-25T23:50:15.524740] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-25T23:50:15.525129] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-25T23:50:15.525227] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-25T23:50:15.525319] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-25T23:50:15.525404] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-25T23:50:15.525495] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-25T23:50:15.525614] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-25T23:50:15.525724] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-25T23:50:15.525824] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-25T23:50:15.526017] [INFO ] [MAIN ] Update Progress: 1431/2366 symbols. MUSE took 0.7s. Estimated remaining time: 3h 11m 5s [2025-10-25T23:50:15.693978] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:15.694225] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-25T23:50:15.694321] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-25T23:50:15.694470] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-25T23:50:15.694557] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-25T23:50:15.694688] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-25T23:50:15.694815] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-25T23:50:16.041254] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:16.041611] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-25T23:50:17.306172] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-25T23:50:17.312948] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-25T23:50:18.708871] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-25T23:50:18.716430] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-25T23:50:20.206247] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-25T23:50:20.216289] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-25T23:50:21.748351] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-25T23:50:21.757510] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-25T23:50:23.270094] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-25T23:50:23.278164] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-25T23:50:24.740486] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T23:50:24.749571] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-25T23:50:26.319185] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-25T23:50:26.328620] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-25T23:50:27.893438] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:50:27.903875] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-25T23:50:29.760751] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-25T23:50:29.771194] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-25T23:50:31.549195] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-25T23:50:31.559445] [INFO ] [REMOTE ] MUX: Full fetch complete (61751 records). [2025-10-25T23:50:31.559680] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-25T23:50:31.967269] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-25T23:50:31.967437] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-25T23:50:31.969552] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-25T23:50:31.969938] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-25T23:50:31.972227] [DEBUG] [LOCAL ] MUX: Trimmed 61751 records to 44548 (keeping 200 days of data) [2025-10-25T23:50:32.246553] [DEBUG] [LOCAL ] MUX: Primary data saved (44548 records). [2025-10-25T23:50:32.246751] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-25T23:50:32.246909] [INFO ] [MAIN ] Update Progress: 1432/2366 symbols. MUX took 16.7s. Estimated remaining time: 3h 10m 56s [2025-10-25T23:50:32.419032] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:32.419239] [DEBUG] [LOCAL ] MVF: No existing data file found in primary storage. [2025-10-25T23:50:32.419312] [WARN ] [MAIN ] MVF: No existing data found, performing full refresh instead. [2025-10-25T23:50:32.419404] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-25T23:50:32.419471] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-25T23:50:32.419558] [DEBUG] [LOCAL ] MVF: No primary data file found to delete. [2025-10-25T23:50:32.419608] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-25T23:50:32.771233] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:32.771585] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-25T23:50:33.546699] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T23:50:33.549519] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-25T23:50:34.399291] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-25T23:50:34.402343] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-25T23:50:35.313810] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-25T23:50:35.317305] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-25T23:50:36.358755] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-25T23:50:36.362745] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-25T23:50:37.120769] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T23:50:37.123440] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-25T23:50:37.971272] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-25T23:50:37.974554] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-25T23:50:38.769018] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-25T23:50:38.772758] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-25T23:50:39.575870] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T23:50:39.579402] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-25T23:50:40.302994] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-25T23:50:40.306891] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-25T23:50:41.161875] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-25T23:50:41.164903] [INFO ] [REMOTE ] MVF: Full fetch complete (18614 records). [2025-10-25T23:50:41.165013] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-25T23:50:41.522718] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-25T23:50:41.522837] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-25T23:50:41.523301] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-25T23:50:41.523383] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-25T23:50:41.524028] [DEBUG] [LOCAL ] MVF: Trimmed 18614 records to 12890 (keeping 200 days of data) [2025-10-25T23:50:41.595141] [DEBUG] [LOCAL ] MVF: Primary data saved (12890 records). [2025-10-25T23:50:41.595297] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-25T23:50:41.595451] [INFO ] [MAIN ] Update Progress: 1433/2366 symbols. MVF took 9.3s. Estimated remaining time: 3h 10m 42s [2025-10-25T23:50:41.768586] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:41.768794] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-25T23:50:41.768865] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-25T23:50:41.768977] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-25T23:50:41.769047] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-25T23:50:41.769126] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-25T23:50:41.769196] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-25T23:50:42.150933] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:42.151303] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-25T23:50:43.180066] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-25T23:50:43.183772] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-25T23:50:43.934248] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T23:50:43.937449] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-25T23:50:44.751272] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-25T23:50:44.754125] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-25T23:50:45.695604] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-25T23:50:45.698581] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-25T23:50:46.386001] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-25T23:50:46.388162] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-25T23:50:47.147999] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-25T23:50:47.150685] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-25T23:50:48.001719] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-25T23:50:48.004935] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-25T23:50:48.668292] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-25T23:50:48.670602] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-25T23:50:49.432617] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-25T23:50:49.435150] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-25T23:50:50.267415] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-25T23:50:50.269803] [INFO ] [REMOTE ] MVO: Full fetch complete (14674 records). [2025-10-25T23:50:50.269897] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-25T23:50:50.624971] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-25T23:50:50.625092] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-25T23:50:50.625442] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-25T23:50:50.625512] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-25T23:50:50.626044] [DEBUG] [LOCAL ] MVO: Trimmed 14674 records to 9169 (keeping 200 days of data) [2025-10-25T23:50:50.677334] [DEBUG] [LOCAL ] MVO: Primary data saved (9169 records). [2025-10-25T23:50:50.677495] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-25T23:50:50.677628] [INFO ] [MAIN ] Update Progress: 1434/2366 symbols. MVO took 9.1s. Estimated remaining time: 3h 10m 27s [2025-10-25T23:50:50.843765] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:50.843987] [DEBUG] [LOCAL ] MVT: No existing data file found in primary storage. [2025-10-25T23:50:50.844058] [WARN ] [MAIN ] MVT: No existing data found, performing full refresh instead. [2025-10-25T23:50:50.844152] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-25T23:50:50.844218] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-25T23:50:50.844301] [DEBUG] [LOCAL ] MVT: No primary data file found to delete. [2025-10-25T23:50:50.844369] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-25T23:50:51.186536] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:51.186907] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-25T23:50:52.004445] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-25T23:50:52.006992] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-25T23:50:52.613391] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-25T23:50:52.615339] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-25T23:50:53.638805] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-25T23:50:53.641427] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-25T23:50:54.428687] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-25T23:50:54.431762] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-25T23:50:55.196416] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-25T23:50:55.199042] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-25T23:50:56.029758] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-25T23:50:56.033045] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-25T23:50:56.803750] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T23:50:56.806004] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-25T23:50:57.577743] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-25T23:50:57.580365] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-25T23:50:58.330002] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-25T23:50:58.332981] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-25T23:50:58.978357] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T23:50:58.980269] [INFO ] [REMOTE ] MVT: Full fetch complete (13645 records). [2025-10-25T23:50:58.980374] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-25T23:50:59.337051] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-25T23:50:59.337166] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-25T23:50:59.337496] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-25T23:50:59.337582] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-25T23:50:59.338200] [DEBUG] [LOCAL ] MVT: Trimmed 13645 records to 9894 (keeping 200 days of data) [2025-10-25T23:50:59.394281] [DEBUG] [LOCAL ] MVT: Primary data saved (9894 records). [2025-10-25T23:50:59.394431] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-25T23:50:59.394739] [INFO ] [MAIN ] Update Progress: 1435/2366 symbols. MVT took 8.7s. Estimated remaining time: 3h 10m 13s [2025-10-25T23:50:59.564341] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:50:59.564553] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-25T23:50:59.564668] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-25T23:50:59.564815] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-25T23:50:59.564903] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-25T23:50:59.565011] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-25T23:50:59.565095] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-25T23:50:59.924771] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:50:59.925172] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-25T23:51:01.638824] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-25T23:51:01.647920] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-25T23:51:03.309034] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-25T23:51:03.318870] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-25T23:51:05.096892] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T23:51:05.107816] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-25T23:51:06.720407] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-25T23:51:06.731075] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-25T23:51:08.376973] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-25T23:51:08.387201] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-25T23:51:09.966262] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-25T23:51:09.976138] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-25T23:51:11.701044] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-25T23:51:11.711038] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-25T23:51:13.177213] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-25T23:51:13.186853] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-25T23:51:14.643110] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-25T23:51:14.656565] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-25T23:51:15.359796] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-25T23:51:15.367957] [INFO ] [REMOTE ] MWA: Full fetch complete (68155 records). [2025-10-25T23:51:15.368106] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-25T23:51:15.758586] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-25T23:51:15.758724] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-25T23:51:15.759722] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-25T23:51:15.759801] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-25T23:51:15.761118] [DEBUG] [LOCAL ] MWA: Trimmed 68155 records to 46357 (keeping 200 days of data) [2025-10-25T23:51:16.025692] [DEBUG] [LOCAL ] MWA: Primary data saved (46357 records). [2025-10-25T23:51:16.025849] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-25T23:51:16.026005] [INFO ] [MAIN ] Update Progress: 1436/2366 symbols. MWA took 16.6s. Estimated remaining time: 3h 10m 3s [2025-10-25T23:51:16.197911] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:51:16.198117] [DEBUG] [LOCAL ] MX: No existing data file found in primary storage. [2025-10-25T23:51:16.198189] [WARN ] [MAIN ] MX: No existing data found, performing full refresh instead. [2025-10-25T23:51:16.198308] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-25T23:51:16.198379] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-25T23:51:16.198460] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-25T23:51:16.198531] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-25T23:51:16.553518] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:51:16.553872] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-25T23:51:17.471413] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-25T23:51:17.474924] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-25T23:51:18.451195] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-25T23:51:18.455720] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-25T23:51:19.494069] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-25T23:51:19.499580] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-25T23:51:20.648225] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T23:51:20.653804] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-25T23:51:21.755802] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T23:51:21.761468] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-25T23:51:22.769753] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-25T23:51:22.774186] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-25T23:51:23.834945] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-25T23:51:23.839537] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-25T23:51:25.219720] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-25T23:51:25.226854] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-25T23:51:26.238021] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T23:51:26.243269] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-25T23:51:27.230550] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T23:51:27.234602] [INFO ] [REMOTE ] MX: Full fetch complete (31645 records). [2025-10-25T23:51:27.234762] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-25T23:51:27.602054] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-25T23:51:27.602166] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-25T23:51:27.602833] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-25T23:51:27.602913] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-25T23:51:27.603680] [DEBUG] [LOCAL ] MX: Trimmed 31645 records to 22536 (keeping 200 days of data) [2025-10-25T23:51:27.721961] [DEBUG] [LOCAL ] MX: Primary data saved (22536 records). [2025-10-25T23:51:27.722116] [INFO ] [MAIN ] MX: Full history saved. [2025-10-25T23:51:27.722270] [INFO ] [MAIN ] Update Progress: 1437/2366 symbols. MX took 11.7s. Estimated remaining time: 3h 9m 51s [2025-10-25T23:51:27.888759] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:51:27.888940] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-25T23:51:27.889010] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-25T23:51:27.889121] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-25T23:51:27.889190] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-25T23:51:27.889269] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-25T23:51:27.889338] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-25T23:51:28.240634] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:51:28.241079] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-25T23:51:28.773977] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-25T23:51:28.775264] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-25T23:51:29.206958] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-25T23:51:29.208222] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-25T23:51:29.642553] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-25T23:51:29.643684] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-25T23:51:30.100786] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-25T23:51:30.101900] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-25T23:51:30.503499] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-25T23:51:30.504626] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-25T23:51:30.867009] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-25T23:51:30.868143] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-25T23:51:31.334045] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-25T23:51:31.335373] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-25T23:51:31.784893] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-25T23:51:31.786052] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-25T23:51:32.258758] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-25T23:51:32.260021] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-25T23:51:32.728615] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-25T23:51:32.729534] [INFO ] [REMOTE ] MXE: Full fetch complete (2543 records). [2025-10-25T23:51:32.729623] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-25T23:51:32.914461] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-25T23:51:32.914690] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-25T23:51:32.914769] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-25T23:51:32.914847] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-25T23:51:32.914943] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-25T23:51:32.915018] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-25T23:51:32.915101] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-25T23:51:32.915243] [INFO ] [MAIN ] Update Progress: 1438/2366 symbols. MXE took 5.2s. Estimated remaining time: 3h 9m 34s [2025-10-25T23:51:33.094202] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:51:33.094437] [DEBUG] [LOCAL ] MXF: No existing data file found in primary storage. [2025-10-25T23:51:33.094527] [WARN ] [MAIN ] MXF: No existing data found, performing full refresh instead. [2025-10-25T23:51:33.094668] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-25T23:51:33.094760] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-25T23:51:33.094848] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-25T23:51:33.094917] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-25T23:51:33.464374] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:51:33.464795] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-25T23:51:34.244201] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-25T23:51:34.247161] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-25T23:51:34.975091] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T23:51:34.977495] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-25T23:51:35.770917] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-25T23:51:35.773142] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-25T23:51:36.519503] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-25T23:51:36.522293] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-25T23:51:37.323177] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T23:51:37.325758] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-25T23:51:37.895560] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-25T23:51:37.897523] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-25T23:51:38.505479] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-25T23:51:38.507390] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-25T23:51:39.019552] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-25T23:51:39.020947] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-25T23:51:39.479259] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-25T23:51:39.480544] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-25T23:51:40.118359] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-25T23:51:40.120081] [INFO ] [REMOTE ] MXF: Full fetch complete (9761 records). [2025-10-25T23:51:40.120176] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-25T23:51:40.502783] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-25T23:51:40.502933] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-25T23:51:40.503239] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-25T23:51:40.503316] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-25T23:51:40.503834] [DEBUG] [LOCAL ] MXF: Trimmed 9761 records to 5612 (keeping 200 days of data) [2025-10-25T23:51:40.537683] [DEBUG] [LOCAL ] MXF: Primary data saved (5612 records). [2025-10-25T23:51:40.537808] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-25T23:51:40.537969] [INFO ] [MAIN ] Update Progress: 1439/2366 symbols. MXF took 7.6s. Estimated remaining time: 3h 9m 19s [2025-10-25T23:51:40.715245] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:51:40.715444] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-25T23:51:40.715518] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-25T23:51:40.715636] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-25T23:51:40.715748] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-25T23:51:40.715841] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-25T23:51:40.715911] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-25T23:51:41.086176] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:51:41.086512] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-25T23:51:41.798918] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-25T23:51:41.802005] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-25T23:51:42.883313] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T23:51:42.886978] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-25T23:51:43.878080] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-25T23:51:43.882601] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-25T23:51:44.878929] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-25T23:51:44.883409] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-25T23:51:45.620180] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T23:51:45.623561] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-25T23:51:46.402950] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-25T23:51:46.406236] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-25T23:51:47.295353] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-25T23:51:47.298612] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-25T23:51:48.078208] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-25T23:51:48.081059] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-25T23:51:48.958929] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-25T23:51:48.964035] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-25T23:51:49.542591] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:51:49.545614] [INFO ] [REMOTE ] MYD: Full fetch complete (19975 records). [2025-10-25T23:51:49.545894] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-25T23:51:49.927370] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-25T23:51:49.927481] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-25T23:51:49.927951] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-25T23:51:49.928029] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-25T23:51:49.928597] [DEBUG] [LOCAL ] MYD: Trimmed 19975 records to 13321 (keeping 200 days of data) [2025-10-25T23:51:50.004306] [DEBUG] [LOCAL ] MYD: Primary data saved (13321 records). [2025-10-25T23:51:50.004483] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-25T23:51:50.004663] [INFO ] [MAIN ] Update Progress: 1440/2366 symbols. MYD took 9.5s. Estimated remaining time: 3h 9m 5s [2025-10-25T23:51:50.173397] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:51:50.173611] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-25T23:51:50.173702] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-25T23:51:50.173825] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-25T23:51:50.173898] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-25T23:51:50.173976] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-25T23:51:50.174045] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-25T23:51:50.525077] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:51:50.525474] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-25T23:51:51.546818] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-25T23:51:51.551850] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-25T23:51:52.630194] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T23:51:52.635100] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-25T23:51:53.495447] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-25T23:51:53.502512] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-25T23:51:54.732163] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-25T23:51:54.741928] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-25T23:51:55.820505] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T23:51:55.825954] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-25T23:51:56.892789] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T23:51:56.898772] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-25T23:51:57.969796] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-25T23:51:57.975028] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-25T23:51:59.246154] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-25T23:51:59.253390] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-25T23:52:00.381354] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-25T23:52:00.386465] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-25T23:52:01.209937] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-25T23:52:01.214546] [INFO ] [REMOTE ] MYE: Full fetch complete (35938 records). [2025-10-25T23:52:01.214695] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-25T23:52:01.598715] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-25T23:52:01.598863] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-25T23:52:01.599733] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-25T23:52:01.599818] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-25T23:52:01.601018] [DEBUG] [LOCAL ] MYE: Trimmed 35938 records to 24336 (keeping 200 days of data) [2025-10-25T23:52:01.744334] [DEBUG] [LOCAL ] MYE: Primary data saved (24336 records). [2025-10-25T23:52:01.744496] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-25T23:52:01.744676] [INFO ] [MAIN ] Update Progress: 1441/2366 symbols. MYE took 11.7s. Estimated remaining time: 3h 8m 52s [2025-10-25T23:52:01.921529] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:52:01.921773] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-25T23:52:01.921847] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-25T23:52:01.921991] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-25T23:52:01.922069] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-25T23:52:01.922152] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-25T23:52:01.922224] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-25T23:52:02.282464] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:52:02.282893] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-25T23:52:03.458949] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-25T23:52:03.463390] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-25T23:52:04.497732] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-25T23:52:04.502526] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-25T23:52:05.597398] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-25T23:52:05.602233] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-25T23:52:06.786156] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-25T23:52:06.791867] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-25T23:52:07.692036] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-25T23:52:07.695708] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-25T23:52:08.718439] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T23:52:08.723057] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-25T23:52:09.670592] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-25T23:52:09.677323] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-25T23:52:10.558966] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-25T23:52:10.563496] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-25T23:52:11.612446] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-25T23:52:11.617536] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-25T23:52:12.594720] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-25T23:52:12.599207] [INFO ] [REMOTE ] MYI: Full fetch complete (29119 records). [2025-10-25T23:52:12.599307] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-25T23:52:12.963917] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-25T23:52:12.964047] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-25T23:52:12.964636] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-25T23:52:12.964736] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-25T23:52:12.965468] [DEBUG] [LOCAL ] MYI: Trimmed 29119 records to 19678 (keeping 200 days of data) [2025-10-25T23:52:13.077050] [DEBUG] [LOCAL ] MYI: Primary data saved (19678 records). [2025-10-25T23:52:13.077214] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-25T23:52:13.077375] [INFO ] [MAIN ] Update Progress: 1442/2366 symbols. MYI took 11.3s. Estimated remaining time: 3h 8m 39s [2025-10-25T23:52:13.240480] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:52:13.240690] [DEBUG] [LOCAL ] MYN: No existing data file found in primary storage. [2025-10-25T23:52:13.240765] [WARN ] [MAIN ] MYN: No existing data found, performing full refresh instead. [2025-10-25T23:52:13.240884] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-25T23:52:13.240957] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-25T23:52:13.241035] [DEBUG] [LOCAL ] MYN: No primary data file found to delete. [2025-10-25T23:52:13.241100] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-25T23:52:13.587175] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:52:13.587480] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-25T23:52:14.355177] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-25T23:52:14.358090] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-25T23:52:15.088988] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-25T23:52:15.091806] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-25T23:52:15.845405] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T23:52:15.848402] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-25T23:52:16.615456] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-25T23:52:16.618161] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-25T23:52:17.354102] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-25T23:52:17.356479] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-25T23:52:18.137060] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-25T23:52:18.139961] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-25T23:52:18.845032] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-25T23:52:18.847933] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-25T23:52:19.701441] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T23:52:19.704225] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-25T23:52:20.544140] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-25T23:52:20.547029] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-25T23:52:21.269014] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:52:21.271311] [INFO ] [REMOTE ] MYN: Full fetch complete (14998 records). [2025-10-25T23:52:21.271420] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-25T23:52:21.630574] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-25T23:52:21.630714] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-25T23:52:21.631122] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-25T23:52:21.631219] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-25T23:52:21.631819] [DEBUG] [LOCAL ] MYN: Trimmed 14998 records to 10114 (keeping 200 days of data) [2025-10-25T23:52:21.694349] [DEBUG] [LOCAL ] MYN: Primary data saved (10114 records). [2025-10-25T23:52:21.694524] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-25T23:52:21.694763] [INFO ] [MAIN ] Update Progress: 1443/2366 symbols. MYN took 8.6s. Estimated remaining time: 3h 8m 25s [2025-10-25T23:52:21.865082] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:52:21.865261] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-25T23:52:21.865330] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-25T23:52:21.865443] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-25T23:52:21.865515] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-25T23:52:21.865593] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-25T23:52:21.865683] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-25T23:52:22.211225] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:52:22.211541] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-25T23:52:23.427454] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T23:52:23.434707] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-25T23:52:24.665830] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T23:52:24.673216] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-25T23:52:26.057443] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-25T23:52:26.066790] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-25T23:52:27.578764] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-25T23:52:27.587555] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-25T23:52:29.043732] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-25T23:52:29.053225] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-25T23:52:30.516091] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-25T23:52:30.524599] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-25T23:52:31.928590] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-25T23:52:31.936743] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-25T23:52:33.173912] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-25T23:52:33.182293] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-25T23:52:34.452617] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-25T23:52:34.460889] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-25T23:52:35.112798] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-25T23:52:35.119509] [INFO ] [REMOTE ] NABL: Full fetch complete (56795 records). [2025-10-25T23:52:35.119664] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-25T23:52:35.521481] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-25T23:52:35.521601] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-25T23:52:35.522685] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-25T23:52:35.522768] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-25T23:52:35.524183] [DEBUG] [LOCAL ] NABL: Trimmed 56795 records to 39285 (keeping 200 days of data) [2025-10-25T23:52:35.750906] [DEBUG] [LOCAL ] NABL: Primary data saved (39285 records). [2025-10-25T23:52:35.751095] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-25T23:52:35.751268] [INFO ] [MAIN ] Update Progress: 1444/2366 symbols. NABL took 14.1s. Estimated remaining time: 3h 8m 14s [2025-10-25T23:52:35.933224] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:52:35.933465] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-25T23:52:35.933538] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-25T23:52:35.933681] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-25T23:52:35.933755] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-25T23:52:35.933838] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-25T23:52:35.933911] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-25T23:52:36.324815] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:52:36.325189] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-25T23:52:37.468947] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-25T23:52:37.474005] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-25T23:52:38.600211] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-25T23:52:38.605031] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-25T23:52:39.798923] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-25T23:52:39.804898] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-25T23:52:41.062753] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-25T23:52:41.069153] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-25T23:52:42.088974] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T23:52:42.094138] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-25T23:52:43.247047] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-25T23:52:43.252771] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-25T23:52:44.396855] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-25T23:52:44.402924] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-25T23:52:45.482279] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T23:52:45.487253] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-25T23:52:46.632866] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-25T23:52:46.639500] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-25T23:52:47.751148] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-25T23:52:47.755821] [INFO ] [REMOTE ] NAC: Full fetch complete (35401 records). [2025-10-25T23:52:47.755932] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-25T23:52:48.136686] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-25T23:52:48.136818] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-25T23:52:48.137631] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-25T23:52:48.137749] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-25T23:52:48.138611] [DEBUG] [LOCAL ] NAC: Trimmed 35401 records to 24900 (keeping 200 days of data) [2025-10-25T23:52:48.286727] [DEBUG] [LOCAL ] NAC: Primary data saved (24900 records). [2025-10-25T23:52:48.286956] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-25T23:52:48.287160] [INFO ] [MAIN ] Update Progress: 1445/2366 symbols. NAC took 12.5s. Estimated remaining time: 3h 8m 2s [2025-10-25T23:52:48.458672] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:52:48.458899] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-25T23:52:48.458973] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-25T23:52:48.459120] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-25T23:52:48.459191] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-25T23:52:48.459274] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-25T23:52:48.459342] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-25T23:52:48.801795] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:52:48.802140] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-25T23:52:50.215757] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-25T23:52:50.222947] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-25T23:52:51.456188] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-25T23:52:51.462766] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-25T23:52:52.813334] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-25T23:52:52.820513] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-25T23:52:54.381247] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-25T23:52:54.389959] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-25T23:52:55.813550] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-25T23:52:55.820556] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-25T23:52:57.120632] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-25T23:52:57.127629] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-25T23:52:58.586256] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T23:52:58.594576] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-25T23:52:59.997779] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-25T23:53:00.005086] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-25T23:53:01.611009] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-25T23:53:01.618502] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-25T23:53:03.036898] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-25T23:53:03.042557] [INFO ] [REMOTE ] NAD: Full fetch complete (48394 records). [2025-10-25T23:53:03.042709] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-25T23:53:03.413814] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-25T23:53:03.413923] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-25T23:53:03.414757] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-25T23:53:03.414847] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-25T23:53:03.415934] [DEBUG] [LOCAL ] NAD: Trimmed 48394 records to 33974 (keeping 200 days of data) [2025-10-25T23:53:03.613903] [DEBUG] [LOCAL ] NAD: Primary data saved (33974 records). [2025-10-25T23:53:03.614082] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-25T23:53:03.614269] [INFO ] [MAIN ] Update Progress: 1446/2366 symbols. NAD took 15.3s. Estimated remaining time: 3h 7m 51s [2025-10-25T23:53:03.781191] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:53:03.781446] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-25T23:53:03.781540] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-25T23:53:03.781715] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-25T23:53:03.781801] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-25T23:53:03.781902] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-25T23:53:03.782004] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-25T23:53:04.127938] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:53:04.128332] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-25T23:53:04.941712] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-25T23:53:04.944215] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-25T23:53:05.763638] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-25T23:53:05.766694] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-25T23:53:06.712932] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-25T23:53:06.717463] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-25T23:53:07.475313] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T23:53:07.477927] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-25T23:53:08.353096] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-25T23:53:08.356057] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-25T23:53:08.805092] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-25T23:53:08.807033] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-25T23:53:09.634975] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-25T23:53:09.637619] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-25T23:53:10.404440] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-25T23:53:10.407014] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-25T23:53:11.196930] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T23:53:11.199705] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-25T23:53:11.999987] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-25T23:53:12.002165] [INFO ] [REMOTE ] NAN: Full fetch complete (13592 records). [2025-10-25T23:53:12.002256] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-25T23:53:12.420445] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-25T23:53:12.420637] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-25T23:53:12.421615] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-25T23:53:12.421729] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-25T23:53:12.422767] [DEBUG] [LOCAL ] NAN: Trimmed 13592 records to 8612 (keeping 200 days of data) [2025-10-25T23:53:12.476196] [DEBUG] [LOCAL ] NAN: Primary data saved (8612 records). [2025-10-25T23:53:12.476446] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-25T23:53:12.476668] [INFO ] [MAIN ] Update Progress: 1447/2366 symbols. NAN took 8.9s. Estimated remaining time: 3h 7m 37s [2025-10-25T23:53:12.648777] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:53:12.649008] [DEBUG] [LOCAL ] NAT: No existing data file found in primary storage. [2025-10-25T23:53:12.649081] [WARN ] [MAIN ] NAT: No existing data found, performing full refresh instead. [2025-10-25T23:53:12.649184] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-25T23:53:12.649253] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-25T23:53:12.649317] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-25T23:53:12.649359] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-25T23:53:13.001075] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:53:13.001448] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-25T23:53:14.869562] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-25T23:53:14.879454] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-25T23:53:16.564147] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-25T23:53:16.574267] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-25T23:53:18.358711] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-25T23:53:18.369289] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-25T23:53:20.410164] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-25T23:53:20.420518] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-25T23:53:21.956809] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-25T23:53:21.968294] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-25T23:53:23.671307] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T23:53:23.685398] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-25T23:53:25.480796] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-25T23:53:25.490896] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-25T23:53:27.184145] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-25T23:53:27.194249] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-25T23:53:28.888574] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-25T23:53:28.902699] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-25T23:53:30.590122] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-25T23:53:30.599849] [INFO ] [REMOTE ] NAT: Full fetch complete (72203 records). [2025-10-25T23:53:30.600014] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-25T23:53:30.985865] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-25T23:53:30.985997] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-25T23:53:30.987073] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-25T23:53:30.987164] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-25T23:53:30.988735] [DEBUG] [LOCAL ] NAT: Trimmed 72203 records to 49954 (keeping 200 days of data) [2025-10-25T23:53:31.265741] [DEBUG] [LOCAL ] NAT: Primary data saved (49954 records). [2025-10-25T23:53:31.265937] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-25T23:53:31.266152] [INFO ] [MAIN ] Update Progress: 1448/2366 symbols. NAT took 18.8s. Estimated remaining time: 3h 7m 29s [2025-10-25T23:53:31.433500] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:53:31.433730] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-25T23:53:31.433827] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-25T23:53:31.433973] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-25T23:53:31.434049] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-25T23:53:31.434152] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-25T23:53:31.434235] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-25T23:53:31.782071] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:53:31.782405] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-25T23:53:32.905553] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T23:53:32.911153] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-25T23:53:34.072243] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-25T23:53:34.077414] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-25T23:53:35.378714] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-25T23:53:35.385557] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-25T23:53:36.710772] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-25T23:53:36.717965] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-25T23:53:37.827860] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-25T23:53:37.834185] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-25T23:53:39.073557] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-25T23:53:39.079532] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-25T23:53:40.538388] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-25T23:53:40.546185] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-25T23:53:42.150174] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-25T23:53:42.158982] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-25T23:53:43.535246] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-25T23:53:43.542762] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-25T23:53:44.110129] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T23:53:44.115200] [INFO ] [REMOTE ] NATL: Full fetch complete (44844 records). [2025-10-25T23:53:44.115311] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-25T23:53:44.481771] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-25T23:53:44.481886] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-25T23:53:44.482708] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-25T23:53:44.482785] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-25T23:53:44.483744] [DEBUG] [LOCAL ] NATL: Trimmed 44844 records to 32382 (keeping 200 days of data) [2025-10-25T23:53:44.661804] [DEBUG] [LOCAL ] NATL: Primary data saved (32382 records). [2025-10-25T23:53:44.661959] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-25T23:53:44.662112] [INFO ] [MAIN ] Update Progress: 1449/2366 symbols. NATL took 13.4s. Estimated remaining time: 3h 7m 17s [2025-10-25T23:53:44.827592] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:53:44.827816] [DEBUG] [LOCAL ] NAZ: No existing data file found in primary storage. [2025-10-25T23:53:44.827888] [WARN ] [MAIN ] NAZ: No existing data found, performing full refresh instead. [2025-10-25T23:53:44.828013] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-25T23:53:44.828092] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-25T23:53:44.828187] [DEBUG] [LOCAL ] NAZ: No primary data file found to delete. [2025-10-25T23:53:44.828260] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-25T23:53:45.173969] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:53:45.174302] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-25T23:53:45.716295] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-25T23:53:45.717547] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-25T23:53:46.133861] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-25T23:53:46.135272] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-25T23:53:46.694378] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-25T23:53:46.695896] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-25T23:53:47.108207] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-25T23:53:47.109593] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-25T23:53:47.552094] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-25T23:53:47.553242] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-25T23:53:48.047271] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-25T23:53:48.048553] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-25T23:53:48.691542] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-25T23:53:48.693015] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-25T23:53:49.149482] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-25T23:53:49.151272] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-25T23:53:49.642193] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-25T23:53:49.644559] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-25T23:53:50.200584] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-25T23:53:50.202230] [INFO ] [REMOTE ] NAZ: Full fetch complete (4075 records). [2025-10-25T23:53:50.202367] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-25T23:53:50.598453] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-25T23:53:50.598574] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-25T23:53:50.598797] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-25T23:53:50.598877] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-25T23:53:50.599314] [DEBUG] [LOCAL ] NAZ: Trimmed 4075 records to 2708 (keeping 200 days of data) [2025-10-25T23:53:50.616126] [DEBUG] [LOCAL ] NAZ: Primary data saved (2708 records). [2025-10-25T23:53:50.616252] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-25T23:53:50.616384] [INFO ] [MAIN ] Update Progress: 1450/2366 symbols. NAZ took 6.0s. Estimated remaining time: 3h 7m 1s [2025-10-25T23:53:50.785732] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:53:50.785963] [DEBUG] [LOCAL ] NBB: No existing data file found in primary storage. [2025-10-25T23:53:50.786033] [WARN ] [MAIN ] NBB: No existing data found, performing full refresh instead. [2025-10-25T23:53:50.786122] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-25T23:53:50.786188] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-25T23:53:50.786248] [DEBUG] [LOCAL ] NBB: No primary data file found to delete. [2025-10-25T23:53:50.786288] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-25T23:53:51.148070] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:53:51.148373] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-25T23:53:51.950816] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-25T23:53:51.953837] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-25T23:53:52.663060] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-25T23:53:52.665338] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-25T23:53:53.170120] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-25T23:53:53.172417] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-25T23:53:53.940383] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-25T23:53:53.943282] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-25T23:53:54.514209] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-25T23:53:54.516598] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-25T23:53:55.266689] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-25T23:53:55.269051] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-25T23:53:55.988593] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-25T23:53:55.990972] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-25T23:53:56.787352] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T23:53:56.790217] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-25T23:53:57.600426] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-25T23:53:57.603132] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-25T23:53:58.354977] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T23:53:58.357419] [INFO ] [REMOTE ] NBB: Full fetch complete (12919 records). [2025-10-25T23:53:58.357536] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-25T23:53:58.741312] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-25T23:53:58.741424] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-25T23:53:58.741778] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-25T23:53:58.741857] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-25T23:53:58.742345] [DEBUG] [LOCAL ] NBB: Trimmed 12919 records to 9144 (keeping 200 days of data) [2025-10-25T23:53:58.805103] [DEBUG] [LOCAL ] NBB: Primary data saved (9144 records). [2025-10-25T23:53:58.805407] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-25T23:53:58.805591] [INFO ] [MAIN ] Update Progress: 1451/2366 symbols. NBB took 8.2s. Estimated remaining time: 3h 6m 46s [2025-10-25T23:53:58.978410] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:53:58.978688] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-25T23:53:58.978751] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-25T23:53:58.978870] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-25T23:53:58.978951] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-25T23:53:58.979032] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-25T23:53:58.979101] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-25T23:53:59.323135] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:53:59.323497] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-25T23:54:00.367146] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-25T23:54:00.371846] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-25T23:54:01.735062] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-25T23:54:01.741462] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-25T23:54:02.842851] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-25T23:54:02.847959] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-25T23:54:04.146277] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-25T23:54:04.152312] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-25T23:54:05.340725] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-25T23:54:05.346580] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-25T23:54:06.419184] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-25T23:54:06.423674] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-25T23:54:07.594206] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-25T23:54:07.603374] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-25T23:54:08.724729] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-25T23:54:08.730143] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-25T23:54:09.887521] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-25T23:54:09.893266] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-25T23:54:10.467776] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-25T23:54:10.473420] [INFO ] [REMOTE ] NBHC: Full fetch complete (33463 records). [2025-10-25T23:54:10.473571] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-25T23:54:10.842092] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-25T23:54:10.842216] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-25T23:54:10.843012] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-25T23:54:10.843102] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-25T23:54:10.844212] [DEBUG] [LOCAL ] NBHC: Trimmed 33463 records to 24147 (keeping 200 days of data) [2025-10-25T23:54:10.981636] [DEBUG] [LOCAL ] NBHC: Primary data saved (24147 records). [2025-10-25T23:54:10.981814] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-25T23:54:10.982029] [INFO ] [MAIN ] Update Progress: 1452/2366 symbols. NBHC took 12.2s. Estimated remaining time: 3h 6m 34s [2025-10-25T23:54:11.150150] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:54:11.150393] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-25T23:54:11.150485] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-25T23:54:11.150663] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-25T23:54:11.150745] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-25T23:54:11.150848] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-25T23:54:11.150928] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-25T23:54:11.505967] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:54:11.506386] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-25T23:54:12.789714] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-25T23:54:12.795802] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-25T23:54:14.165006] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-25T23:54:14.171537] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-25T23:54:15.586688] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-25T23:54:15.594193] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-25T23:54:16.883708] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-25T23:54:16.891132] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-25T23:54:18.290100] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-25T23:54:18.297664] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-25T23:54:19.496803] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-25T23:54:19.504038] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-25T23:54:21.019392] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-25T23:54:21.027695] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-25T23:54:22.452459] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-25T23:54:22.460418] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-25T23:54:23.811122] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-25T23:54:23.819879] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-25T23:54:24.402828] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-25T23:54:24.408423] [INFO ] [REMOTE ] NBR: Full fetch complete (49186 records). [2025-10-25T23:54:24.408571] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-25T23:54:24.791750] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-25T23:54:24.791868] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-25T23:54:24.792764] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-25T23:54:24.792859] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-25T23:54:24.793891] [DEBUG] [LOCAL ] NBR: Trimmed 49186 records to 34896 (keeping 200 days of data) [2025-10-25T23:54:24.989113] [DEBUG] [LOCAL ] NBR: Primary data saved (34896 records). [2025-10-25T23:54:24.989269] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-25T23:54:24.989426] [INFO ] [MAIN ] Update Progress: 1453/2366 symbols. NBR took 14.0s. Estimated remaining time: 3h 6m 23s [2025-10-25T23:54:25.162590] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:54:25.162807] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-25T23:54:25.162860] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-25T23:54:25.162967] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-25T23:54:25.163036] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-25T23:54:25.163119] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-25T23:54:25.163190] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-25T23:54:25.520942] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:54:25.521334] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-25T23:54:26.609451] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-25T23:54:26.614074] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-25T23:54:27.738579] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T23:54:27.743559] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-25T23:54:28.773040] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T23:54:28.778864] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-25T23:54:29.906718] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-25T23:54:29.912523] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-25T23:54:31.012234] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-25T23:54:31.017399] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-25T23:54:31.991848] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-25T23:54:31.996430] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-25T23:54:33.125534] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-25T23:54:33.131360] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-25T23:54:34.211956] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-25T23:54:34.217001] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-25T23:54:35.212101] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-25T23:54:35.216890] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-25T23:54:36.367414] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-25T23:54:36.371488] [INFO ] [REMOTE ] NBXG: Full fetch complete (32388 records). [2025-10-25T23:54:36.371619] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-25T23:54:36.758689] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-25T23:54:36.758809] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-25T23:54:36.759457] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-25T23:54:36.759528] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-25T23:54:36.760397] [DEBUG] [LOCAL ] NBXG: Trimmed 32388 records to 21883 (keeping 200 days of data) [2025-10-25T23:54:36.887547] [DEBUG] [LOCAL ] NBXG: Primary data saved (21883 records). [2025-10-25T23:54:36.887721] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-25T23:54:36.887877] [INFO ] [MAIN ] Update Progress: 1454/2366 symbols. NBXG took 11.9s. Estimated remaining time: 3h 6m 10s [2025-10-25T23:54:37.057757] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:54:37.058009] [DEBUG] [LOCAL ] NC: No existing data file found in primary storage. [2025-10-25T23:54:37.058082] [WARN ] [MAIN ] NC: No existing data found, performing full refresh instead. [2025-10-25T23:54:37.058172] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-25T23:54:37.058239] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-25T23:54:37.058326] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-25T23:54:37.058393] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-25T23:54:37.414704] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:54:37.415043] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-25T23:54:37.896956] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-25T23:54:37.898134] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-25T23:54:38.312480] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-25T23:54:38.313526] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-25T23:54:38.763549] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-25T23:54:38.764747] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-25T23:54:39.337735] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-25T23:54:39.339394] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-25T23:54:39.803607] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-25T23:54:39.804829] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-25T23:54:40.231357] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-25T23:54:40.232551] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-25T23:54:40.734205] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-25T23:54:40.735290] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-25T23:54:41.086345] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-25T23:54:41.087417] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-25T23:54:41.580548] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-25T23:54:41.581743] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-25T23:54:42.059335] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-25T23:54:42.060434] [INFO ] [REMOTE ] NC: Full fetch complete (2744 records). [2025-10-25T23:54:42.060529] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-25T23:54:42.422683] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-25T23:54:42.422804] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-25T23:54:42.423001] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-25T23:54:42.423089] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-25T23:54:42.423570] [DEBUG] [LOCAL ] NC: Trimmed 2744 records to 2014 (keeping 200 days of data) [2025-10-25T23:54:42.435930] [DEBUG] [LOCAL ] NC: Primary data saved (2014 records). [2025-10-25T23:54:42.436024] [INFO ] [MAIN ] NC: Full history saved. [2025-10-25T23:54:42.436241] [INFO ] [MAIN ] Update Progress: 1455/2366 symbols. NC took 5.5s. Estimated remaining time: 3h 5m 54s [2025-10-25T23:54:42.607523] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:54:42.607748] [DEBUG] [LOCAL ] NCA: No existing data file found in primary storage. [2025-10-25T23:54:42.607854] [WARN ] [MAIN ] NCA: No existing data found, performing full refresh instead. [2025-10-25T23:54:42.608015] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-25T23:54:42.608095] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-25T23:54:42.608197] [DEBUG] [LOCAL ] NCA: No primary data file found to delete. [2025-10-25T23:54:42.608278] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-25T23:54:42.965562] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:54:42.965908] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-25T23:54:43.715785] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-25T23:54:43.718401] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-25T23:54:44.479824] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-25T23:54:44.482521] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-25T23:54:45.251883] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T23:54:45.254511] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-25T23:54:46.142027] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-25T23:54:46.145314] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-25T23:54:46.955471] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-25T23:54:46.958238] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-25T23:54:47.749437] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-25T23:54:47.752706] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-25T23:54:48.518165] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-25T23:54:48.521096] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-25T23:54:49.185314] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-25T23:54:49.187625] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-25T23:54:49.974803] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-25T23:54:49.977707] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-25T23:54:50.611672] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-25T23:54:50.613320] [INFO ] [REMOTE ] NCA: Full fetch complete (14263 records). [2025-10-25T23:54:50.613415] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-25T23:54:50.970084] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-25T23:54:50.970218] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-25T23:54:50.970592] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-25T23:54:50.970691] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-25T23:54:50.971275] [DEBUG] [LOCAL ] NCA: Trimmed 14263 records to 9865 (keeping 200 days of data) [2025-10-25T23:54:51.030262] [DEBUG] [LOCAL ] NCA: Primary data saved (9865 records). [2025-10-25T23:54:51.030433] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-25T23:54:51.030662] [INFO ] [MAIN ] Update Progress: 1456/2366 symbols. NCA took 8.6s. Estimated remaining time: 3h 5m 39s [2025-10-25T23:54:51.196703] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:54:51.196905] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-25T23:54:51.196978] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-25T23:54:51.197100] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-25T23:54:51.197170] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-25T23:54:51.197250] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-25T23:54:51.197319] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-25T23:54:51.543164] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:54:51.543493] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-25T23:54:52.663999] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-25T23:54:52.669438] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-25T23:54:53.694310] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-25T23:54:53.700533] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-25T23:54:54.895953] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-25T23:54:54.905115] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-25T23:54:56.053969] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-25T23:54:56.059670] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-25T23:54:57.125506] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-25T23:54:57.130476] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-25T23:54:58.292732] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T23:54:58.301259] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-25T23:54:59.306721] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T23:54:59.311424] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-25T23:55:00.242345] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-25T23:55:00.248471] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-25T23:55:01.422052] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-25T23:55:01.426678] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-25T23:55:03.489891] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-25T23:55:03.495281] [INFO ] [REMOTE ] NCDL: Full fetch complete (32999 records). [2025-10-25T23:55:03.495494] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-25T23:55:03.869404] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-25T23:55:03.869525] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-25T23:55:03.870333] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-25T23:55:03.870424] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-25T23:55:03.871372] [DEBUG] [LOCAL ] NCDL: Trimmed 32999 records to 22019 (keeping 200 days of data) [2025-10-25T23:55:04.004191] [DEBUG] [LOCAL ] NCDL: Primary data saved (22019 records). [2025-10-25T23:55:04.004425] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-25T23:55:04.004682] [INFO ] [MAIN ] Update Progress: 1457/2366 symbols. NCDL took 13.0s. Estimated remaining time: 3h 5m 28s [2025-10-25T23:55:04.174177] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:55:04.174386] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-25T23:55:04.174476] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-25T23:55:04.174627] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-25T23:55:04.174734] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-25T23:55:04.174838] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-25T23:55:04.174920] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-25T23:55:04.534242] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:55:04.534736] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-25T23:55:06.880503] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-25T23:55:06.891158] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-25T23:55:08.888284] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-25T23:55:08.898536] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-25T23:55:10.711746] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T23:55:10.722830] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-25T23:55:12.805321] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-25T23:55:12.816540] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-25T23:55:14.964601] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-25T23:55:14.976363] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-25T23:55:16.998490] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-25T23:55:17.009862] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-25T23:55:19.240830] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-25T23:55:19.252384] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-25T23:55:21.262319] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-25T23:55:21.273741] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-25T23:55:23.291104] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-25T23:55:23.303354] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-25T23:55:24.074781] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T23:55:24.086191] [INFO ] [REMOTE ] NCLH: Full fetch complete (77933 records). [2025-10-25T23:55:24.086439] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-25T23:55:24.511298] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-10-25T23:55:24.511456] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-10-25T23:55:24.513065] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-10-25T23:55:24.513152] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-10-25T23:55:24.515087] [DEBUG] [LOCAL ] NCLH: Trimmed 77933 records to 54533 (keeping 200 days of data) [2025-10-25T23:55:24.856945] [DEBUG] [LOCAL ] NCLH: Primary data saved (54533 records). [2025-10-25T23:55:24.857210] [INFO ] [MAIN ] NCLH: Full history saved. [2025-10-25T23:55:24.857478] [INFO ] [MAIN ] Update Progress: 1458/2366 symbols. NCLH took 20.9s. Estimated remaining time: 3h 5m 21s [2025-10-25T23:55:25.046487] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:55:25.046726] [DEBUG] [LOCAL ] NCV: No existing data file found in primary storage. [2025-10-25T23:55:25.046840] [WARN ] [MAIN ] NCV: No existing data found, performing full refresh instead. [2025-10-25T23:55:25.046963] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-25T23:55:25.047038] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-25T23:55:25.047122] [DEBUG] [LOCAL ] NCV: No primary data file found to delete. [2025-10-25T23:55:25.047195] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-25T23:55:25.421399] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:55:25.421852] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-25T23:55:26.643307] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-25T23:55:26.648719] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-25T23:55:27.594897] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T23:55:27.598907] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-25T23:55:28.583799] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T23:55:28.587347] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-25T23:55:29.403159] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T23:55:29.407016] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-25T23:55:30.250266] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-25T23:55:30.253552] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-25T23:55:31.058595] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-25T23:55:31.061394] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-25T23:55:32.028627] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-25T23:55:32.032859] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-25T23:55:33.096376] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-25T23:55:33.099921] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-25T23:55:34.050827] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-25T23:55:34.054637] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-25T23:55:34.827782] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-25T23:55:34.831785] [INFO ] [REMOTE ] NCV: Full fetch complete (22516 records). [2025-10-25T23:55:34.831908] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-25T23:55:35.228051] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-25T23:55:35.228171] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-25T23:55:35.228817] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-25T23:55:35.228900] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-25T23:55:35.229604] [DEBUG] [LOCAL ] NCV: Trimmed 22516 records to 14194 (keeping 200 days of data) [2025-10-25T23:55:35.314012] [DEBUG] [LOCAL ] NCV: Primary data saved (14194 records). [2025-10-25T23:55:35.314180] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-25T23:55:35.314340] [INFO ] [MAIN ] Update Progress: 1459/2366 symbols. NCV took 10.5s. Estimated remaining time: 3h 5m 7s [2025-10-25T23:55:35.493245] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:55:35.493531] [DEBUG] [LOCAL ] NCZ: No existing data file found in primary storage. [2025-10-25T23:55:35.493624] [WARN ] [MAIN ] NCZ: No existing data found, performing full refresh instead. [2025-10-25T23:55:35.493781] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-25T23:55:35.493856] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-25T23:55:35.493939] [DEBUG] [LOCAL ] NCZ: No primary data file found to delete. [2025-10-25T23:55:35.494010] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-25T23:55:35.867028] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:55:35.867445] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-25T23:55:36.786628] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-25T23:55:36.792939] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-25T23:55:37.681224] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-25T23:55:37.685074] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-25T23:55:38.662833] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-25T23:55:38.666187] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-25T23:55:39.628559] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-25T23:55:39.632237] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-25T23:55:40.430636] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-25T23:55:40.433793] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-25T23:55:40.967737] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-25T23:55:40.970378] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-25T23:55:41.929825] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-25T23:55:41.933356] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-25T23:55:42.705709] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-25T23:55:42.708468] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-25T23:55:43.560460] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-25T23:55:43.563894] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-25T23:55:44.530969] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-25T23:55:44.534672] [INFO ] [REMOTE ] NCZ: Full fetch complete (20854 records). [2025-10-25T23:55:44.534782] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-25T23:55:44.943608] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-25T23:55:44.943746] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-25T23:55:44.944272] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-25T23:55:44.944370] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-25T23:55:44.945122] [DEBUG] [LOCAL ] NCZ: Trimmed 20854 records to 12475 (keeping 200 days of data) [2025-10-25T23:55:45.023236] [DEBUG] [LOCAL ] NCZ: Primary data saved (12475 records). [2025-10-25T23:55:45.023415] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-25T23:55:45.023576] [INFO ] [MAIN ] Update Progress: 1460/2366 symbols. NCZ took 9.7s. Estimated remaining time: 3h 4m 53s [2025-10-25T23:55:45.194926] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:55:45.195149] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-25T23:55:45.195222] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-25T23:55:45.195336] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-25T23:55:45.195464] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-25T23:55:45.195553] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-25T23:55:45.195623] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-25T23:55:45.552467] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:55:45.552866] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-25T23:55:46.497842] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-25T23:55:46.501592] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-25T23:55:47.446916] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-25T23:55:47.452741] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-25T23:55:48.320137] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-25T23:55:48.324982] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-25T23:55:49.380799] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-25T23:55:49.385407] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-25T23:55:50.335057] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-25T23:55:50.338779] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-25T23:55:51.152959] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-25T23:55:51.156266] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-25T23:55:52.169754] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T23:55:52.174313] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-25T23:55:53.142842] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-25T23:55:53.147540] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-25T23:55:54.160636] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T23:55:54.165177] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-25T23:55:54.787555] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-25T23:55:54.791007] [INFO ] [REMOTE ] NDMO: Full fetch complete (23318 records). [2025-10-25T23:55:54.791107] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-25T23:55:55.157273] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-25T23:55:55.157402] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-25T23:55:55.157963] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-25T23:55:55.158049] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-25T23:55:55.158741] [DEBUG] [LOCAL ] NDMO: Trimmed 23318 records to 17206 (keeping 200 days of data) [2025-10-25T23:55:55.257087] [DEBUG] [LOCAL ] NDMO: Primary data saved (17206 records). [2025-10-25T23:55:55.257264] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-25T23:55:55.257422] [INFO ] [MAIN ] Update Progress: 1461/2366 symbols. NDMO took 10.2s. Estimated remaining time: 3h 4m 40s [2025-10-25T23:55:55.427435] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:55:55.427630] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-25T23:55:55.427714] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-25T23:55:55.427823] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-25T23:55:55.427893] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-25T23:55:55.428002] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-25T23:55:55.428072] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-25T23:55:55.775942] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:55:55.776295] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-25T23:55:57.455516] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-25T23:55:57.465714] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-25T23:55:58.984229] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-25T23:55:58.994266] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-25T23:56:00.805887] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-25T23:56:00.817465] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-25T23:56:03.230064] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-25T23:56:03.241243] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-25T23:56:04.973395] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-25T23:56:04.984302] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-25T23:56:06.686944] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-25T23:56:06.697448] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-25T23:56:08.412289] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-25T23:56:08.424535] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-25T23:56:10.037281] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-25T23:56:10.048067] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-25T23:56:11.890658] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-25T23:56:11.902088] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-25T23:56:13.497352] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-25T23:56:13.506682] [INFO ] [REMOTE ] NE: Full fetch complete (75767 records). [2025-10-25T23:56:13.506846] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-25T23:56:13.911841] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-25T23:56:13.911979] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-25T23:56:13.913242] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-25T23:56:13.913325] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-25T23:56:13.914876] [DEBUG] [LOCAL ] NE: Trimmed 75767 records to 53060 (keeping 200 days of data) [2025-10-25T23:56:14.229842] [DEBUG] [LOCAL ] NE: Primary data saved (53060 records). [2025-10-25T23:56:14.230016] [INFO ] [MAIN ] NE: Full history saved. [2025-10-25T23:56:14.230187] [INFO ] [MAIN ] Update Progress: 1462/2366 symbols. NE took 19.0s. Estimated remaining time: 3h 4m 32s [2025-10-25T23:56:14.399678] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:56:14.399886] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-25T23:56:14.399964] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-25T23:56:14.400098] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-25T23:56:14.400178] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-25T23:56:14.400258] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-25T23:56:14.400328] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-25T23:56:14.761373] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:56:14.761810] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-25T23:56:16.177746] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-25T23:56:16.185157] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-25T23:56:17.477717] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-25T23:56:17.484783] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-25T23:56:18.876463] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T23:56:18.883530] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-25T23:56:20.335045] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-25T23:56:20.343495] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-25T23:56:21.683566] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-25T23:56:21.692823] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-25T23:56:22.980635] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-25T23:56:22.987906] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-25T23:56:24.344291] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-25T23:56:24.352106] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-25T23:56:25.803350] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-25T23:56:25.811054] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-25T23:56:27.312993] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-25T23:56:27.322966] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-25T23:56:28.606855] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-25T23:56:28.613287] [INFO ] [REMOTE ] NEA: Full fetch complete (50885 records). [2025-10-25T23:56:28.613434] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-25T23:56:29.028076] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-25T23:56:29.028199] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-25T23:56:29.029176] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-25T23:56:29.029259] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-25T23:56:29.030525] [DEBUG] [LOCAL ] NEA: Trimmed 50885 records to 35611 (keeping 200 days of data) [2025-10-25T23:56:29.251213] [DEBUG] [LOCAL ] NEA: Primary data saved (35611 records). [2025-10-25T23:56:29.251417] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-25T23:56:29.251588] [INFO ] [MAIN ] Update Progress: 1463/2366 symbols. NEA took 15.0s. Estimated remaining time: 3h 4m 21s [2025-10-25T23:56:29.420101] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:56:29.420291] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-25T23:56:29.420362] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-25T23:56:29.420474] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-25T23:56:29.420545] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-25T23:56:29.420627] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-25T23:56:29.420719] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-25T23:56:29.786862] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:56:29.787229] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-25T23:56:31.699377] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-25T23:56:31.710074] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-25T23:56:33.570315] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-25T23:56:33.580467] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-25T23:56:35.422262] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-25T23:56:35.433497] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-25T23:56:37.657386] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-25T23:56:37.668718] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-25T23:56:39.873732] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-25T23:56:39.887193] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-25T23:56:41.776695] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-25T23:56:41.787707] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-25T23:56:44.033697] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-25T23:56:44.045251] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-25T23:56:46.107799] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-25T23:56:46.119625] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-25T23:56:48.358984] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-25T23:56:48.370267] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-25T23:56:49.085302] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:56:49.095164] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-25T23:56:49.095369] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-25T23:56:49.482032] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-25T23:56:49.482145] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-25T23:56:49.483242] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-25T23:56:49.483322] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-25T23:56:49.484847] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 54487 (keeping 200 days of data) [2025-10-25T23:56:49.816845] [DEBUG] [LOCAL ] NEE: Primary data saved (54487 records). [2025-10-25T23:56:49.817019] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-25T23:56:49.817219] [INFO ] [MAIN ] Update Progress: 1464/2366 symbols. NEE took 20.6s. Estimated remaining time: 3h 4m 14s [2025-10-25T23:56:50.004069] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:56:50.004287] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-25T23:56:50.004361] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-25T23:56:50.004455] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-25T23:56:50.004544] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-25T23:56:50.004636] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-25T23:56:50.004745] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-25T23:56:50.357335] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:56:50.357679] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-25T23:56:52.244460] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-25T23:56:52.254885] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-25T23:56:54.362594] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-25T23:56:54.373304] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-25T23:56:56.413542] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-25T23:56:56.424563] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-25T23:56:58.566928] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-25T23:56:58.578150] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-25T23:57:00.835037] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-25T23:57:00.846319] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-25T23:57:03.080335] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-25T23:57:03.091073] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-25T23:57:05.430261] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-25T23:57:05.441953] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-25T23:57:07.559873] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-25T23:57:07.571095] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-25T23:57:10.006745] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-25T23:57:10.018169] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-25T23:57:10.323832] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-25T23:57:10.334167] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-25T23:57:10.334393] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-25T23:57:10.726024] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-25T23:57:10.726143] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-25T23:57:10.727220] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-25T23:57:10.727301] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-25T23:57:10.728800] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 54488 (keeping 200 days of data) [2025-10-25T23:57:11.053358] [DEBUG] [LOCAL ] NEM: Primary data saved (54488 records). [2025-10-25T23:57:11.053526] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-25T23:57:11.053701] [INFO ] [MAIN ] Update Progress: 1465/2366 symbols. NEM took 21.2s. Estimated remaining time: 3h 4m 7s [2025-10-25T23:57:11.226693] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:57:11.226888] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-25T23:57:11.226960] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-25T23:57:11.227072] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-25T23:57:11.227143] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-25T23:57:11.227225] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-25T23:57:11.227296] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-25T23:57:11.589898] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:57:11.590265] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-25T23:57:13.391404] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-25T23:57:13.402008] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-25T23:57:15.342059] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-25T23:57:15.354547] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-25T23:57:17.425549] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-25T23:57:17.437195] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-25T23:57:19.683607] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-25T23:57:19.694966] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-25T23:57:21.955082] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-25T23:57:21.966286] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-25T23:57:24.083252] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-25T23:57:24.094090] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-25T23:57:26.151896] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-25T23:57:26.163740] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-25T23:57:28.184109] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-25T23:57:28.197679] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-25T23:57:30.150717] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-25T23:57:30.162105] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-25T23:57:32.217220] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-25T23:57:32.226765] [INFO ] [REMOTE ] NET: Full fetch complete (76803 records). [2025-10-25T23:57:32.226943] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-25T23:57:32.628584] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-25T23:57:32.628723] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-25T23:57:32.630169] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-25T23:57:32.630248] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-25T23:57:32.631772] [DEBUG] [LOCAL ] NET: Trimmed 76803 records to 53510 (keeping 200 days of data) [2025-10-25T23:57:32.964133] [DEBUG] [LOCAL ] NET: Primary data saved (53510 records). [2025-10-25T23:57:32.964289] [INFO ] [MAIN ] NET: Full history saved. [2025-10-25T23:57:32.964455] [INFO ] [MAIN ] Update Progress: 1466/2366 symbols. NET took 21.9s. Estimated remaining time: 3h 4m 1s [2025-10-25T23:57:33.130114] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:57:33.130288] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-25T23:57:33.130357] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-25T23:57:33.130445] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-25T23:57:33.130511] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-25T23:57:33.130569] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-25T23:57:33.130631] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-25T23:57:33.487858] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:57:33.489540] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-25T23:57:34.211505] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-25T23:57:34.213023] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-25T23:57:34.928886] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-25T23:57:34.930616] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-25T23:57:35.523408] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-25T23:57:35.525182] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-25T23:57:36.266931] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-25T23:57:36.268783] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-25T23:57:36.900294] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-25T23:57:36.901980] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-25T23:57:37.878825] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-25T23:57:37.882864] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-25T23:57:38.759275] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-25T23:57:38.761870] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-25T23:57:39.556995] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-25T23:57:39.559530] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-25T23:57:40.173481] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-25T23:57:40.175858] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-25T23:57:40.548740] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-25T23:57:40.550588] [INFO ] [REMOTE ] NEU: Full fetch complete (10816 records). [2025-10-25T23:57:40.550699] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-25T23:57:40.908938] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-25T23:57:40.909057] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-25T23:57:40.909351] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-25T23:57:40.909424] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-25T23:57:40.909934] [DEBUG] [LOCAL ] NEU: Trimmed 10816 records to 8692 (keeping 200 days of data) [2025-10-25T23:57:40.963523] [DEBUG] [LOCAL ] NEU: Primary data saved (8692 records). [2025-10-25T23:57:40.963683] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-25T23:57:40.963876] [INFO ] [MAIN ] Update Progress: 1467/2366 symbols. NEU took 8.0s. Estimated remaining time: 3h 3m 46s [2025-10-25T23:57:41.131234] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:57:41.131391] [DEBUG] [LOCAL ] NEXA: No existing data file found in primary storage. [2025-10-25T23:57:41.131459] [WARN ] [MAIN ] NEXA: No existing data found, performing full refresh instead. [2025-10-25T23:57:41.131572] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-25T23:57:41.131659] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-25T23:57:41.131736] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-25T23:57:41.131802] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-25T23:57:41.482536] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:57:41.482880] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-25T23:57:42.217823] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-25T23:57:42.220282] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-25T23:57:42.797576] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-25T23:57:42.799364] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-25T23:57:43.413462] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-25T23:57:43.414985] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-25T23:57:43.901698] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-25T23:57:43.903026] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-25T23:57:44.467628] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-25T23:57:44.469307] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-25T23:57:45.049494] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-25T23:57:45.051966] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-25T23:57:45.703996] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-25T23:57:45.705990] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-25T23:57:46.157074] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-25T23:57:46.158439] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-25T23:57:46.864378] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-25T23:57:46.866565] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-25T23:57:47.653973] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-25T23:57:47.657213] [INFO ] [REMOTE ] NEXA: Full fetch complete (8055 records). [2025-10-25T23:57:47.657302] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-25T23:57:48.020191] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-25T23:57:48.020338] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-25T23:57:48.020622] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-25T23:57:48.020742] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-25T23:57:48.021209] [DEBUG] [LOCAL ] NEXA: Trimmed 8055 records to 5882 (keeping 200 days of data) [2025-10-25T23:57:48.052509] [DEBUG] [LOCAL ] NEXA: Primary data saved (5882 records). [2025-10-25T23:57:48.052626] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-25T23:57:48.052848] [INFO ] [MAIN ] Update Progress: 1468/2366 symbols. NEXA took 7.1s. Estimated remaining time: 3h 3m 31s [2025-10-25T23:57:48.225205] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:57:48.225434] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-25T23:57:48.225509] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-25T23:57:48.225632] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-25T23:57:48.225717] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-25T23:57:48.225797] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-25T23:57:48.225868] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-25T23:57:48.579247] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:57:48.579613] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-25T23:57:50.007493] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-25T23:57:50.016143] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-25T23:57:51.636423] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-25T23:57:51.644377] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-25T23:57:53.029683] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-25T23:57:53.038375] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-25T23:57:54.537216] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-25T23:57:54.546394] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-25T23:57:55.956844] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-25T23:57:55.965149] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-25T23:57:57.272094] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-25T23:57:57.279262] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-25T23:57:58.937992] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-25T23:57:58.947618] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-25T23:58:00.021429] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T23:58:00.030486] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-25T23:58:01.580468] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-25T23:58:01.588717] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-25T23:58:02.268355] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-25T23:58:02.275863] [INFO ] [REMOTE ] NFG: Full fetch complete (57227 records). [2025-10-25T23:58:02.276007] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-25T23:58:02.664979] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-25T23:58:02.665128] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-25T23:58:02.666196] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-25T23:58:02.666315] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-25T23:58:02.668048] [DEBUG] [LOCAL ] NFG: Trimmed 57227 records to 38712 (keeping 200 days of data) [2025-10-25T23:58:02.900341] [DEBUG] [LOCAL ] NFG: Primary data saved (38712 records). [2025-10-25T23:58:02.900505] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-25T23:58:02.900698] [INFO ] [MAIN ] Update Progress: 1469/2366 symbols. NFG took 14.8s. Estimated remaining time: 3h 3m 20s [2025-10-25T23:58:03.081051] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:58:03.081259] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-25T23:58:03.081330] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-25T23:58:03.081460] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-25T23:58:03.081533] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-25T23:58:03.081615] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-25T23:58:03.081703] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-25T23:58:03.437774] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:58:03.438177] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-25T23:58:04.605473] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-25T23:58:04.610682] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-25T23:58:05.528096] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-25T23:58:05.532279] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-25T23:58:06.301408] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-25T23:58:06.306451] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-25T23:58:07.411126] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-25T23:58:07.416312] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-25T23:58:08.498045] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-25T23:58:08.502690] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-25T23:58:09.520032] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-25T23:58:09.524726] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-25T23:58:10.534326] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-25T23:58:10.539739] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-25T23:58:11.527868] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-25T23:58:11.532256] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-25T23:58:12.541778] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T23:58:12.546407] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-25T23:58:13.571560] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-25T23:58:13.575481] [INFO ] [REMOTE ] NFJ: Full fetch complete (29440 records). [2025-10-25T23:58:13.575675] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-25T23:58:13.938816] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-25T23:58:13.938924] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-25T23:58:13.939526] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-25T23:58:13.939603] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-25T23:58:13.940311] [DEBUG] [LOCAL ] NFJ: Trimmed 29440 records to 20025 (keeping 200 days of data) [2025-10-25T23:58:14.059697] [DEBUG] [LOCAL ] NFJ: Primary data saved (20025 records). [2025-10-25T23:58:14.059902] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-25T23:58:14.060064] [INFO ] [MAIN ] Update Progress: 1470/2366 symbols. NFJ took 11.2s. Estimated remaining time: 3h 3m 7s [2025-10-25T23:58:14.227536] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:58:14.227786] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-25T23:58:14.227861] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-25T23:58:14.228000] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-25T23:58:14.228072] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-25T23:58:14.228154] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-25T23:58:14.228226] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-25T23:58:14.593473] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:58:14.593857] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-25T23:58:16.268172] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-25T23:58:16.277472] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-25T23:58:17.868267] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-25T23:58:17.876844] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-25T23:58:19.343806] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-25T23:58:19.352794] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-25T23:58:21.182701] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-25T23:58:21.193597] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-25T23:58:22.974823] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-25T23:58:22.984884] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-25T23:58:24.769601] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-25T23:58:24.779559] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-25T23:58:26.547476] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-25T23:58:26.557786] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-25T23:58:28.120806] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-25T23:58:28.129875] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-25T23:58:29.716276] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-25T23:58:29.725962] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-25T23:58:31.362129] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-25T23:58:31.370964] [INFO ] [REMOTE ] NGG: Full fetch complete (66657 records). [2025-10-25T23:58:31.371151] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-25T23:58:31.759520] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-25T23:58:31.759638] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-25T23:58:31.760776] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-25T23:58:31.760887] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-25T23:58:31.762238] [DEBUG] [LOCAL ] NGG: Trimmed 66657 records to 47367 (keeping 200 days of data) [2025-10-25T23:58:32.037158] [DEBUG] [LOCAL ] NGG: Primary data saved (47367 records). [2025-10-25T23:58:32.037320] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-25T23:58:32.037506] [INFO ] [MAIN ] Update Progress: 1471/2366 symbols. NGG took 18.0s. Estimated remaining time: 3h 2m 58s [2025-10-25T23:58:32.210293] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:58:32.210478] [DEBUG] [LOCAL ] NGL: No existing data file found in primary storage. [2025-10-25T23:58:32.210549] [WARN ] [MAIN ] NGL: No existing data found, performing full refresh instead. [2025-10-25T23:58:32.210698] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-25T23:58:32.210769] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-25T23:58:32.210830] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-25T23:58:32.210892] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-25T23:58:32.574090] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:58:32.574441] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-25T23:58:33.623705] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-25T23:58:33.628911] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-25T23:58:34.710190] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-25T23:58:34.715688] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-25T23:58:35.870505] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-25T23:58:35.876631] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-25T23:58:37.153911] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-25T23:58:37.160319] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-25T23:58:38.143270] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-25T23:58:38.149003] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-25T23:58:39.544082] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-25T23:58:39.551767] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-25T23:58:40.925335] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-25T23:58:40.933480] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-25T23:58:42.286728] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-25T23:58:42.293755] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-25T23:58:43.599306] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-25T23:58:43.606935] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-25T23:58:44.707900] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-25T23:58:44.713206] [INFO ] [REMOTE ] NGL: Full fetch complete (41646 records). [2025-10-25T23:58:44.713402] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-25T23:58:45.133334] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-25T23:58:45.133469] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-25T23:58:45.134582] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-25T23:58:45.134692] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-25T23:58:45.135729] [DEBUG] [LOCAL ] NGL: Trimmed 41646 records to 30251 (keeping 200 days of data) [2025-10-25T23:58:45.303674] [DEBUG] [LOCAL ] NGL: Primary data saved (30251 records). [2025-10-25T23:58:45.303869] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-25T23:58:45.304033] [INFO ] [MAIN ] Update Progress: 1472/2366 symbols. NGL took 13.3s. Estimated remaining time: 3h 2m 47s [2025-10-25T23:58:45.478142] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:58:45.478333] [DEBUG] [LOCAL ] NGS: No existing data file found in primary storage. [2025-10-25T23:58:45.478403] [WARN ] [MAIN ] NGS: No existing data found, performing full refresh instead. [2025-10-25T23:58:45.478511] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-25T23:58:45.478580] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-25T23:58:45.478659] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-25T23:58:45.478723] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-25T23:58:45.825667] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:58:45.826030] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-25T23:58:46.804392] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-25T23:58:46.808513] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-25T23:58:47.563191] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-25T23:58:47.565677] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-25T23:58:48.598564] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-25T23:58:48.602196] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-25T23:58:49.417982] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-25T23:58:49.422528] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-25T23:58:50.295485] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-25T23:58:50.298530] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-25T23:58:51.174409] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-25T23:58:51.177598] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-25T23:58:51.960499] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-25T23:58:51.963251] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-25T23:58:52.816341] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-25T23:58:52.819234] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-25T23:58:53.511123] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-25T23:58:53.513869] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-25T23:58:54.261732] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-25T23:58:54.263906] [INFO ] [REMOTE ] NGS: Full fetch complete (16549 records). [2025-10-25T23:58:54.264009] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-25T23:58:54.631928] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-25T23:58:54.632054] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-25T23:58:54.632446] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-25T23:58:54.632519] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-25T23:58:54.633079] [DEBUG] [LOCAL ] NGS: Trimmed 16549 records to 10957 (keeping 200 days of data) [2025-10-25T23:58:54.695801] [DEBUG] [LOCAL ] NGS: Primary data saved (10957 records). [2025-10-25T23:58:54.695946] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-25T23:58:54.696099] [INFO ] [MAIN ] Update Progress: 1473/2366 symbols. NGS took 9.4s. Estimated remaining time: 3h 2m 33s [2025-10-25T23:58:54.863939] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:58:54.864114] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-25T23:58:54.864192] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-25T23:58:54.864326] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-25T23:58:54.864411] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-25T23:58:54.864520] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-25T23:58:54.864606] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-25T23:58:55.227561] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:58:55.227896] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-25T23:58:55.840043] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-25T23:58:55.843407] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-25T23:58:56.990343] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-25T23:58:56.994864] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-25T23:58:57.893940] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-25T23:58:57.898431] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-25T23:58:59.062558] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-25T23:58:59.067528] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-25T23:59:00.101681] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-25T23:59:00.106898] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-25T23:59:01.532989] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-25T23:59:01.538503] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-25T23:59:02.638150] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-25T23:59:02.643805] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-25T23:59:03.797213] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-25T23:59:03.802798] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-25T23:59:04.922836] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T23:59:04.928174] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-25T23:59:05.916478] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-25T23:59:05.920762] [INFO ] [REMOTE ] NGVC: Full fetch complete (31144 records). [2025-10-25T23:59:05.920903] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-25T23:59:06.322912] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-25T23:59:06.323057] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-25T23:59:06.323823] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-25T23:59:06.323904] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-25T23:59:06.324846] [DEBUG] [LOCAL ] NGVC: Trimmed 31144 records to 23038 (keeping 200 days of data) [2025-10-25T23:59:06.460174] [DEBUG] [LOCAL ] NGVC: Primary data saved (23038 records). [2025-10-25T23:59:06.460329] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-25T23:59:06.460491] [INFO ] [MAIN ] Update Progress: 1474/2366 symbols. NGVC took 11.8s. Estimated remaining time: 3h 2m 20s [2025-10-25T23:59:06.631073] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:59:06.631301] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-25T23:59:06.631391] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-25T23:59:06.631503] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-25T23:59:06.631572] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-25T23:59:06.631675] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-25T23:59:06.631745] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-25T23:59:06.988969] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:59:06.989431] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-25T23:59:08.142032] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-25T23:59:08.146585] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-25T23:59:09.269116] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-25T23:59:09.274045] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-25T23:59:10.341863] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-25T23:59:10.347565] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-25T23:59:11.716260] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-25T23:59:11.722862] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-25T23:59:12.745066] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-25T23:59:12.751347] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-25T23:59:13.702587] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-25T23:59:13.707383] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-25T23:59:14.705954] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-25T23:59:14.711664] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-25T23:59:15.913122] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-25T23:59:15.919073] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-25T23:59:17.035495] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-25T23:59:17.040692] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-25T23:59:17.579587] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-25T23:59:17.583585] [INFO ] [REMOTE ] NGVT: Full fetch complete (34219 records). [2025-10-25T23:59:17.583714] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-25T23:59:17.951946] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-25T23:59:17.952062] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-25T23:59:17.952916] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-25T23:59:17.952996] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-25T23:59:17.953793] [DEBUG] [LOCAL ] NGVT: Trimmed 34219 records to 23996 (keeping 200 days of data) [2025-10-25T23:59:18.106449] [DEBUG] [LOCAL ] NGVT: Primary data saved (23996 records). [2025-10-25T23:59:18.106623] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-25T23:59:18.106807] [INFO ] [MAIN ] Update Progress: 1475/2366 symbols. NGVT took 11.6s. Estimated remaining time: 3h 2m 8s [2025-10-25T23:59:18.295207] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:59:18.295439] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-25T23:59:18.295514] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-25T23:59:18.295628] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-25T23:59:18.295728] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-25T23:59:18.295833] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-25T23:59:18.295905] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-25T23:59:18.652176] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:59:18.652518] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-25T23:59:19.783705] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-25T23:59:19.788482] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-25T23:59:20.956193] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-25T23:59:20.960424] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-25T23:59:22.101773] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-25T23:59:22.106524] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-25T23:59:23.327110] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-25T23:59:23.332369] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-25T23:59:24.475737] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-25T23:59:24.480734] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-25T23:59:25.645270] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-25T23:59:25.651931] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-25T23:59:26.768292] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-25T23:59:26.773876] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-25T23:59:27.846308] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-25T23:59:27.851389] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-25T23:59:28.859355] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-25T23:59:28.864285] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-25T23:59:29.899900] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-25T23:59:29.903802] [INFO ] [REMOTE ] NHI: Full fetch complete (30991 records). [2025-10-25T23:59:29.903904] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-25T23:59:30.284510] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-25T23:59:30.284631] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-25T23:59:30.285388] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-25T23:59:30.285479] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-25T23:59:30.286380] [DEBUG] [LOCAL ] NHI: Trimmed 30991 records to 22055 (keeping 200 days of data) [2025-10-25T23:59:30.420279] [DEBUG] [LOCAL ] NHI: Primary data saved (22055 records). [2025-10-25T23:59:30.420448] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-25T23:59:30.420703] [INFO ] [MAIN ] Update Progress: 1476/2366 symbols. NHI took 12.3s. Estimated remaining time: 3h 1m 55s [2025-10-25T23:59:30.594671] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:59:30.594930] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-25T23:59:30.595025] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-25T23:59:30.595177] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-25T23:59:30.595256] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-25T23:59:30.595362] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-25T23:59:30.595439] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-25T23:59:30.963012] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:59:30.963471] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-25T23:59:32.660329] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-25T23:59:32.670755] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-25T23:59:34.157159] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-25T23:59:34.167133] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-25T23:59:35.925512] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-25T23:59:35.937448] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-25T23:59:37.590410] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-25T23:59:37.608338] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-25T23:59:39.371302] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-25T23:59:39.383233] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-25T23:59:41.078069] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-25T23:59:41.089715] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-25T23:59:42.906621] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-25T23:59:42.919731] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-25T23:59:44.616482] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-25T23:59:44.628046] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-25T23:59:46.393875] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-25T23:59:46.405222] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-25T23:59:47.124855] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-25T23:59:47.134766] [INFO ] [REMOTE ] NI: Full fetch complete (77514 records). [2025-10-25T23:59:47.134944] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-25T23:59:47.519753] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-25T23:59:47.519868] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-25T23:59:47.520948] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-25T23:59:47.521028] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-25T23:59:47.522396] [DEBUG] [LOCAL ] NI: Trimmed 77514 records to 54181 (keeping 200 days of data) [2025-10-25T23:59:47.831215] [DEBUG] [LOCAL ] NI: Primary data saved (54181 records). [2025-10-25T23:59:47.831372] [INFO ] [MAIN ] NI: Full history saved. [2025-10-25T23:59:47.831527] [INFO ] [MAIN ] Update Progress: 1477/2366 symbols. NI took 17.4s. Estimated remaining time: 3h 1m 46s [2025-10-25T23:59:47.996577] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:59:47.996789] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-25T23:59:47.996862] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-25T23:59:47.996980] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-25T23:59:47.997050] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-25T23:59:47.997111] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-25T23:59:47.997173] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-25T23:59:48.345503] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:59:48.345865] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-25T23:59:49.002190] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-25T23:59:49.004171] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-25T23:59:49.780274] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-25T23:59:49.782389] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-25T23:59:50.534026] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-25T23:59:50.536974] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-25T23:59:51.292274] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-25T23:59:51.294787] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-25T23:59:52.009977] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-25T23:59:52.012493] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-25T23:59:52.750793] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-25T23:59:52.753633] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-25T23:59:53.620933] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-25T23:59:53.625110] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-25T23:59:54.333081] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-25T23:59:54.335884] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-25T23:59:55.017763] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-25T23:59:55.020717] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-25T23:59:55.508740] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-25T23:59:55.511242] [INFO ] [REMOTE ] NIC: Full fetch complete (12777 records). [2025-10-25T23:59:55.511335] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-25T23:59:55.872708] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-25T23:59:55.872835] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-25T23:59:55.873164] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-25T23:59:55.873241] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-25T23:59:55.873786] [DEBUG] [LOCAL ] NIC: Trimmed 12777 records to 9157 (keeping 200 days of data) [2025-10-25T23:59:55.929246] [DEBUG] [LOCAL ] NIC: Primary data saved (9157 records). [2025-10-25T23:59:55.929401] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-25T23:59:55.929558] [INFO ] [MAIN ] Update Progress: 1478/2366 symbols. NIC took 8.1s. Estimated remaining time: 3h 1m 31s [2025-10-25T23:59:56.101563] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-25T23:59:56.101772] [DEBUG] [LOCAL ] NIE: No existing data file found in primary storage. [2025-10-25T23:59:56.101843] [WARN ] [MAIN ] NIE: No existing data found, performing full refresh instead. [2025-10-25T23:59:56.101957] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-25T23:59:56.102028] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-25T23:59:56.102108] [DEBUG] [LOCAL ] NIE: No primary data file found to delete. [2025-10-25T23:59:56.102179] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-25T23:59:56.479626] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2025-01-08 to 2025-10-24 (requires 10 months of data pull). [2025-10-25T23:59:56.479986] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-25T23:59:57.244974] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-25T23:59:57.250952] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-25T23:59:57.991403] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-25T23:59:57.993762] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-25T23:59:58.770046] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-25T23:59:58.773361] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-25T23:59:59.615215] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-25T23:59:59.618833] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-26T00:00:00.399251] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-26T00:00:00.402440] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-26T00:00:01.219214] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-26T00:00:01.222173] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-26T00:00:02.347215] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-26T00:00:02.352096] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-26T00:00:03.350120] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-26T00:00:03.354805] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-26T00:00:04.253002] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-26T00:00:04.257035] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-26T00:00:05.161676] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-26T00:00:05.164892] [INFO ] [REMOTE ] NIE: Full fetch complete (16918 records). [2025-10-26T00:00:05.164983] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-26T00:00:05.552965] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-26T00:00:05.553137] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-26T00:00:05.553925] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-26T00:00:05.554010] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-26T00:00:05.554783] [DEBUG] [LOCAL ] NIE: Trimmed 16918 records to 12003 (keeping 200 days of data) [2025-10-26T00:00:05.639626] [DEBUG] [LOCAL ] NIE: Primary data saved (12003 records). [2025-10-26T00:00:05.640305] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-26T00:00:05.640666] [INFO ] [MAIN ] Update Progress: 1479/2366 symbols. NIE took 9.7s. Estimated remaining time: 3h 1m 18s [2025-10-26T00:00:05.825388] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:00:05.825696] [DEBUG] [LOCAL ] NIM: No existing data file found in primary storage. [2025-10-26T00:00:05.825774] [WARN ] [MAIN ] NIM: No existing data found, performing full refresh instead. [2025-10-26T00:00:05.825907] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-26T00:00:05.825984] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-26T00:00:05.826069] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-26T00:00:05.826143] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-26T00:00:13.298964] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-26T00:00:13.666304] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-26T00:00:13.666466] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-26T00:00:13.666839] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-26T00:00:13.666925] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-26T00:00:13.667398] [DEBUG] [LOCAL ] NIM: Trimmed 6111 records to 3564 (keeping 200 days of data) [2025-10-26T00:00:13.689265] [DEBUG] [LOCAL ] NIM: Primary data saved (3564 records). [2025-10-26T00:00:13.689450] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-26T00:00:13.689688] [INFO ] [MAIN ] Update Progress: 1480/2366 symbols. NIM took 8.0s. Estimated remaining time: 3h 1m 3s [2025-10-26T00:00:13.869255] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:00:13.869588] [DEBUG] [LOCAL ] NINE: No existing data file found in primary storage. [2025-10-26T00:00:13.869687] [WARN ] [MAIN ] NINE: No existing data found, performing full refresh instead. [2025-10-26T00:00:13.869817] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-26T00:00:13.869893] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-26T00:00:13.869976] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-26T00:00:13.870050] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-26T00:00:28.211990] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-26T00:00:28.610181] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-26T00:00:28.610312] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-26T00:00:28.611220] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-26T00:00:28.611301] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-26T00:00:28.612403] [DEBUG] [LOCAL ] NINE: Trimmed 43305 records to 29361 (keeping 200 days of data) [2025-10-26T00:00:28.782261] [DEBUG] [LOCAL ] NINE: Primary data saved (29361 records). [2025-10-26T00:00:28.782428] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-26T00:00:28.782589] [INFO ] [MAIN ] Update Progress: 1481/2366 symbols. NINE took 15.1s. Estimated remaining time: 3h 0m 52s [2025-10-26T00:00:28.972752] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:00:28.972938] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-10-26T00:00:28.973012] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-10-26T00:00:28.973103] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-26T00:00:28.973172] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-26T00:00:28.973234] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-26T00:00:28.973308] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-26T00:00:53.741782] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-26T00:00:54.145227] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-26T00:00:54.145347] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-26T00:00:54.146430] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-26T00:00:54.146514] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-26T00:00:54.148037] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 54582 (keeping 200 days of data) [2025-10-26T00:00:54.448098] [DEBUG] [LOCAL ] NIO: Primary data saved (54582 records). [2025-10-26T00:00:54.448294] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-26T00:00:54.448468] [INFO ] [MAIN ] Update Progress: 1482/2366 symbols. NIO took 25.7s. Estimated remaining time: 3h 0m 48s [2025-10-26T00:00:54.618270] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:00:54.618467] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-26T00:00:54.618541] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-26T00:00:54.618634] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-26T00:00:54.618730] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-26T00:00:54.618789] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-26T00:00:54.618856] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-26T00:00:55.177284] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-26T00:00:55.177355] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:00:55.177429] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-26T00:00:55.177521] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-26T00:00:55.177616] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-26T00:00:55.177724] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-26T00:00:55.177862] [INFO ] [MAIN ] Update Progress: 1483/2366 symbols. NIQ took 0.7s. Estimated remaining time: 3h 0m 29s [2025-10-26T00:00:55.343627] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:00:55.343820] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-26T00:00:55.343869] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-26T00:00:55.343944] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-26T00:00:55.344015] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-26T00:00:55.344070] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-26T00:00:55.344131] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-26T00:01:10.881387] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-26T00:01:11.263176] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-26T00:01:11.263313] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-26T00:01:11.264314] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-26T00:01:11.264397] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-26T00:01:11.265707] [DEBUG] [LOCAL ] NJR: Trimmed 54768 records to 38321 (keeping 200 days of data) [2025-10-26T00:01:11.492923] [DEBUG] [LOCAL ] NJR: Primary data saved (38321 records). [2025-10-26T00:01:11.493106] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-26T00:01:11.493291] [INFO ] [MAIN ] Update Progress: 1484/2366 symbols. NJR took 16.3s. Estimated remaining time: 3h 0m 19s [2025-10-26T00:01:11.659766] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:01:11.659973] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-26T00:01:11.660045] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-26T00:01:11.660159] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-26T00:01:11.660238] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-26T00:01:11.660321] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-26T00:01:11.660392] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-26T00:01:34.332712] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-26T00:01:34.543435] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-26T00:01:34.544227] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:01:34.544319] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:01:34.544396] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-26T00:01:34.544500] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-26T00:01:34.544575] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-26T00:01:34.544680] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-26T00:01:34.544790] [INFO ] [MAIN ] Update Progress: 1485/2366 symbols. NKE took 23.1s. Estimated remaining time: 3h 0m 13s [2025-10-26T00:01:34.725625] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:01:34.725834] [DEBUG] [LOCAL ] NKX: No existing data file found in primary storage. [2025-10-26T00:01:34.725914] [WARN ] [MAIN ] NKX: No existing data found, performing full refresh instead. [2025-10-26T00:01:34.726024] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-26T00:01:34.726103] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-26T00:01:34.726201] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-26T00:01:34.726287] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-26T00:01:43.937899] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-26T00:01:44.335276] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-26T00:01:44.335404] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-26T00:01:44.335864] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-26T00:01:44.335944] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-26T00:01:44.336706] [DEBUG] [LOCAL ] NKX: Trimmed 19027 records to 13823 (keeping 200 days of data) [2025-10-26T00:01:44.418483] [DEBUG] [LOCAL ] NKX: Primary data saved (13823 records). [2025-10-26T00:01:44.418676] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-26T00:01:44.418855] [INFO ] [MAIN ] Update Progress: 1486/2366 symbols. NKX took 9.9s. Estimated remaining time: 2h 59m 59s [2025-10-26T00:01:44.589360] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:01:44.589570] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-26T00:01:44.589664] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-26T00:01:44.589786] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-26T00:01:44.589865] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-26T00:01:44.589944] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-26T00:01:44.590013] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-26T00:01:51.048730] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-26T00:01:51.225000] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:01:51.225239] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:01:51.225313] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:01:51.225391] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-26T00:01:51.225485] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-26T00:01:51.225555] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-26T00:01:51.225635] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-26T00:01:51.225825] [INFO ] [MAIN ] Update Progress: 1487/2366 symbols. NL took 6.8s. Estimated remaining time: 2h 59m 44s [2025-10-26T00:01:51.395213] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:01:51.395463] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-26T00:01:51.395535] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-26T00:01:51.395668] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-26T00:01:51.395740] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-26T00:01:51.395820] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-26T00:01:51.395890] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-26T00:02:00.352509] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-26T00:02:00.732883] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-26T00:02:00.733002] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-26T00:02:00.733448] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-26T00:02:00.733526] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-26T00:02:00.734142] [DEBUG] [LOCAL ] NLOP: Trimmed 17585 records to 11588 (keeping 200 days of data) [2025-10-26T00:02:00.800599] [DEBUG] [LOCAL ] NLOP: Primary data saved (11588 records). [2025-10-26T00:02:00.800800] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-26T00:02:00.801011] [INFO ] [MAIN ] Update Progress: 1488/2366 symbols. NLOP took 9.6s. Estimated remaining time: 2h 59m 30s [2025-10-26T00:02:00.967920] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:00.968112] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-26T00:02:00.968217] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-26T00:02:00.968355] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-26T00:02:00.968446] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-26T00:02:00.968551] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-26T00:02:00.968664] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-26T00:02:20.867851] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-26T00:02:21.256181] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-26T00:02:21.256301] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-26T00:02:21.257500] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-26T00:02:21.257583] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-26T00:02:21.259171] [DEBUG] [LOCAL ] NLY: Trimmed 77699 records to 54343 (keeping 200 days of data) [2025-10-26T00:02:21.586458] [DEBUG] [LOCAL ] NLY: Primary data saved (54343 records). [2025-10-26T00:02:21.586706] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-26T00:02:21.586892] [INFO ] [MAIN ] Update Progress: 1489/2366 symbols. NLY took 20.8s. Estimated remaining time: 2h 59m 23s [2025-10-26T00:02:21.780454] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:21.780672] [DEBUG] [LOCAL ] NMAI: No existing data file found in primary storage. [2025-10-26T00:02:21.780744] [WARN ] [MAIN ] NMAI: No existing data found, performing full refresh instead. [2025-10-26T00:02:21.780884] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-26T00:02:21.780961] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-26T00:02:21.781019] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-26T00:02:21.781084] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-26T00:02:30.960405] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-26T00:02:31.318055] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-26T00:02:31.318168] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-26T00:02:31.318632] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-26T00:02:31.318738] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-26T00:02:31.319366] [DEBUG] [LOCAL ] NMAI: Trimmed 19428 records to 12720 (keeping 200 days of data) [2025-10-26T00:02:31.393560] [DEBUG] [LOCAL ] NMAI: Primary data saved (12720 records). [2025-10-26T00:02:31.393759] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-26T00:02:31.394015] [INFO ] [MAIN ] Update Progress: 1490/2366 symbols. NMAI took 9.8s. Estimated remaining time: 2h 59m 9s [2025-10-26T00:02:31.563312] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:31.563511] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-26T00:02:31.563610] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-26T00:02:31.563781] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-26T00:02:31.563877] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-26T00:02:31.563972] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-26T00:02:31.564053] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-26T00:02:32.122261] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-26T00:02:32.122361] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:02:32.122478] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-26T00:02:32.122598] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-26T00:02:32.122711] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-26T00:02:32.122812] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-26T00:02:32.123012] [INFO ] [MAIN ] Update Progress: 1491/2366 symbols. NMAX took 0.7s. Estimated remaining time: 2h 58m 50s [2025-10-26T00:02:32.290776] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:32.290960] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-26T00:02:32.291047] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-26T00:02:32.291187] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-26T00:02:32.291269] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-26T00:02:32.291376] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-26T00:02:32.291457] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-26T00:02:41.798428] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-26T00:02:42.166689] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-26T00:02:42.166797] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-26T00:02:42.167344] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-26T00:02:42.167419] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-26T00:02:42.168118] [DEBUG] [LOCAL ] NMCO: Trimmed 22841 records to 16843 (keeping 200 days of data) [2025-10-26T00:02:42.265822] [DEBUG] [LOCAL ] NMCO: Primary data saved (16843 records). [2025-10-26T00:02:42.265978] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-26T00:02:42.266148] [INFO ] [MAIN ] Update Progress: 1492/2366 symbols. NMCO took 10.1s. Estimated remaining time: 2h 58m 37s [2025-10-26T00:02:42.439240] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:42.439473] [DEBUG] [LOCAL ] NMG: No existing data file found in primary storage. [2025-10-26T00:02:42.439560] [WARN ] [MAIN ] NMG: No existing data found, performing full refresh instead. [2025-10-26T00:02:42.439728] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-26T00:02:42.439819] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-26T00:02:42.439924] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-26T00:02:42.440012] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-26T00:02:50.570903] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-26T00:02:50.928315] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-26T00:02:50.928437] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-26T00:02:50.928850] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-26T00:02:50.928938] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-26T00:02:50.929512] [DEBUG] [LOCAL ] NMG: Trimmed 16259 records to 12587 (keeping 200 days of data) [2025-10-26T00:02:50.997087] [DEBUG] [LOCAL ] NMG: Primary data saved (12587 records). [2025-10-26T00:02:50.997246] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-26T00:02:50.997414] [INFO ] [MAIN ] Update Progress: 1493/2366 symbols. NMG took 8.7s. Estimated remaining time: 2h 58m 22s [2025-10-26T00:02:51.173025] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:51.173253] [DEBUG] [LOCAL ] NMI: No existing data file found in primary storage. [2025-10-26T00:02:51.173315] [WARN ] [MAIN ] NMI: No existing data found, performing full refresh instead. [2025-10-26T00:02:51.173417] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-26T00:02:51.173505] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-26T00:02:51.173585] [DEBUG] [LOCAL ] NMI: No primary data file found to delete. [2025-10-26T00:02:51.173674] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-26T00:02:57.115287] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-26T00:02:57.493146] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-26T00:02:57.493260] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-26T00:02:57.493458] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-26T00:02:57.493539] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-26T00:02:57.494044] [DEBUG] [LOCAL ] NMI: Trimmed 5638 records to 4077 (keeping 200 days of data) [2025-10-26T00:02:57.519110] [DEBUG] [LOCAL ] NMI: Primary data saved (4077 records). [2025-10-26T00:02:57.519280] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-26T00:02:57.519472] [INFO ] [MAIN ] Update Progress: 1494/2366 symbols. NMI took 6.5s. Estimated remaining time: 2h 58m 7s [2025-10-26T00:02:57.692427] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:02:57.692692] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-26T00:02:57.692771] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-26T00:02:57.692881] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-26T00:02:57.692951] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-26T00:02:57.693030] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-26T00:02:57.693097] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-26T00:03:07.915371] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-26T00:03:08.281460] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-26T00:03:08.281590] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-26T00:03:08.282116] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-26T00:03:08.282194] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-26T00:03:08.282998] [DEBUG] [LOCAL ] NMM: Trimmed 21561 records to 14410 (keeping 200 days of data) [2025-10-26T00:03:08.368395] [DEBUG] [LOCAL ] NMM: Primary data saved (14410 records). [2025-10-26T00:03:08.368573] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-26T00:03:08.368733] [INFO ] [MAIN ] Update Progress: 1495/2366 symbols. NMM took 10.8s. Estimated remaining time: 2h 57m 54s [2025-10-26T00:03:08.545559] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:03:08.545849] [DEBUG] [LOCAL ] NMR: No existing data file found in primary storage. [2025-10-26T00:03:08.545938] [WARN ] [MAIN ] NMR: No existing data found, performing full refresh instead. [2025-10-26T00:03:08.546078] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-26T00:03:08.546168] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-26T00:03:08.546278] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-26T00:03:08.546365] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-26T00:03:23.293672] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-26T00:03:23.659768] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-26T00:03:23.659892] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-26T00:03:23.660802] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-26T00:03:23.660883] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-26T00:03:23.661985] [DEBUG] [LOCAL ] NMR: Trimmed 51352 records to 35957 (keeping 200 days of data) [2025-10-26T00:03:23.851982] [DEBUG] [LOCAL ] NMR: Primary data saved (35957 records). [2025-10-26T00:03:23.852156] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-26T00:03:23.852315] [INFO ] [MAIN ] Update Progress: 1496/2366 symbols. NMR took 15.5s. Estimated remaining time: 2h 57m 43s [2025-10-26T00:03:24.020026] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:03:24.020248] [DEBUG] [LOCAL ] NMS: No existing data file found in primary storage. [2025-10-26T00:03:24.020322] [WARN ] [MAIN ] NMS: No existing data found, performing full refresh instead. [2025-10-26T00:03:24.020449] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-26T00:03:24.020522] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-26T00:03:24.020583] [DEBUG] [LOCAL ] NMS: No primary data file found to delete. [2025-10-26T00:03:24.020670] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-26T00:03:29.022292] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-26T00:03:29.404489] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-26T00:03:29.404660] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-26T00:03:29.404914] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-26T00:03:29.404997] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-26T00:03:29.405462] [DEBUG] [LOCAL ] NMS: Trimmed 4068 records to 2947 (keeping 200 days of data) [2025-10-26T00:03:29.424013] [DEBUG] [LOCAL ] NMS: Primary data saved (2947 records). [2025-10-26T00:03:29.424142] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-26T00:03:29.424321] [INFO ] [MAIN ] Update Progress: 1497/2366 symbols. NMS took 5.6s. Estimated remaining time: 2h 57m 27s [2025-10-26T00:03:29.602392] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:03:29.602696] [DEBUG] [LOCAL ] NMT: No existing data file found in primary storage. [2025-10-26T00:03:29.602777] [WARN ] [MAIN ] NMT: No existing data found, performing full refresh instead. [2025-10-26T00:03:29.602922] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-26T00:03:29.603000] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-26T00:03:29.603086] [DEBUG] [LOCAL ] NMT: No primary data file found to delete. [2025-10-26T00:03:29.603181] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-26T00:03:34.761788] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-26T00:03:35.128342] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-26T00:03:35.128469] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-26T00:03:35.128676] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-26T00:03:35.128775] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-26T00:03:35.129206] [DEBUG] [LOCAL ] NMT: Trimmed 3867 records to 2832 (keeping 200 days of data) [2025-10-26T00:03:35.146910] [DEBUG] [LOCAL ] NMT: Primary data saved (2832 records). [2025-10-26T00:03:35.147046] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-26T00:03:35.147206] [INFO ] [MAIN ] Update Progress: 1498/2366 symbols. NMT took 5.7s. Estimated remaining time: 2h 57m 11s [2025-10-26T00:03:35.328808] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:03:35.329010] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-26T00:03:35.329083] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-26T00:03:35.329199] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-26T00:03:35.329271] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-26T00:03:35.329354] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-26T00:03:35.329437] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-26T00:03:46.197426] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-26T00:03:46.583025] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-26T00:03:46.583142] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-26T00:03:46.583851] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-26T00:03:46.583936] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-26T00:03:46.584854] [DEBUG] [LOCAL ] NMZ: Trimmed 30935 records to 21603 (keeping 200 days of data) [2025-10-26T00:03:46.709736] [DEBUG] [LOCAL ] NMZ: Primary data saved (21603 records). [2025-10-26T00:03:46.709894] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-26T00:03:46.710105] [INFO ] [MAIN ] Update Progress: 1499/2366 symbols. NMZ took 11.6s. Estimated remaining time: 2h 56m 58s [2025-10-26T00:03:46.884628] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:03:46.884844] [DEBUG] [LOCAL ] NNI: No existing data file found in primary storage. [2025-10-26T00:03:46.884937] [WARN ] [MAIN ] NNI: No existing data found, performing full refresh instead. [2025-10-26T00:03:46.885078] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-26T00:03:46.885162] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-26T00:03:46.885267] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-26T00:03:46.885355] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-26T00:03:55.397416] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-26T00:03:55.752382] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-26T00:03:55.752491] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-26T00:03:55.752855] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-26T00:03:55.752956] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-26T00:03:55.753472] [DEBUG] [LOCAL ] NNI: Trimmed 13142 records to 10574 (keeping 200 days of data) [2025-10-26T00:03:55.816335] [DEBUG] [LOCAL ] NNI: Primary data saved (10574 records). [2025-10-26T00:03:55.816501] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-26T00:03:55.816705] [INFO ] [MAIN ] Update Progress: 1500/2366 symbols. NNI took 9.1s. Estimated remaining time: 2h 56m 44s [2025-10-26T00:03:55.989737] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:03:55.989920] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-26T00:03:55.990006] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-26T00:03:55.990140] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-26T00:03:55.990238] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-26T00:03:55.990343] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-26T00:03:55.990430] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-26T00:04:13.652951] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-26T00:04:14.065500] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-26T00:04:14.065696] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-26T00:04:14.067341] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-26T00:04:14.067634] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-26T00:04:14.069355] [DEBUG] [LOCAL ] NNN: Trimmed 70282 records to 48874 (keeping 200 days of data) [2025-10-26T00:04:14.359832] [DEBUG] [LOCAL ] NNN: Primary data saved (48874 records). [2025-10-26T00:04:14.360032] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-26T00:04:14.360236] [INFO ] [MAIN ] Update Progress: 1501/2366 symbols. NNN took 18.5s. Estimated remaining time: 2h 56m 36s [2025-10-26T00:04:14.532918] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:04:14.533108] [DEBUG] [LOCAL ] NNY: No existing data file found in primary storage. [2025-10-26T00:04:14.533199] [WARN ] [MAIN ] NNY: No existing data found, performing full refresh instead. [2025-10-26T00:04:14.533311] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-26T00:04:14.533380] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-26T00:04:14.533461] [DEBUG] [LOCAL ] NNY: No primary data file found to delete. [2025-10-26T00:04:14.533530] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-26T00:04:21.913055] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-26T00:04:22.281493] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-26T00:04:22.281614] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-26T00:04:22.281912] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-26T00:04:22.281990] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-26T00:04:22.282478] [DEBUG] [LOCAL ] NNY: Trimmed 8420 records to 5872 (keeping 200 days of data) [2025-10-26T00:04:22.317261] [DEBUG] [LOCAL ] NNY: Primary data saved (5872 records). [2025-10-26T00:04:22.317460] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-26T00:04:22.317669] [INFO ] [MAIN ] Update Progress: 1502/2366 symbols. NNY took 8.0s. Estimated remaining time: 2h 56m 21s [2025-10-26T00:04:22.493378] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:04:22.493619] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-26T00:04:22.493712] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-26T00:04:22.493832] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-26T00:04:22.493913] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-26T00:04:22.493975] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-26T00:04:22.494041] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-26T00:04:32.078875] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-26T00:04:32.475289] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-26T00:04:32.475410] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-26T00:04:32.475958] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-26T00:04:32.476037] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-26T00:04:32.476729] [DEBUG] [LOCAL ] NOA: Trimmed 22609 records to 15951 (keeping 200 days of data) [2025-10-26T00:04:32.568086] [DEBUG] [LOCAL ] NOA: Primary data saved (15951 records). [2025-10-26T00:04:32.568267] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-26T00:04:32.568428] [INFO ] [MAIN ] Update Progress: 1503/2366 symbols. NOA took 10.3s. Estimated remaining time: 2h 56m 8s [2025-10-26T00:04:32.736405] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:04:32.736623] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-26T00:04:32.736720] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-26T00:04:32.736834] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-26T00:04:32.736905] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-26T00:04:32.736988] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-26T00:04:32.737057] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-26T00:04:43.249244] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-26T00:04:43.644104] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-26T00:04:43.644284] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-26T00:04:43.645150] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-26T00:04:43.645249] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-26T00:04:43.646204] [DEBUG] [LOCAL ] NOAH: Trimmed 27060 records to 19993 (keeping 200 days of data) [2025-10-26T00:04:43.762875] [DEBUG] [LOCAL ] NOAH: Primary data saved (19993 records). [2025-10-26T00:04:43.763038] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-26T00:04:43.763195] [INFO ] [MAIN ] Update Progress: 1504/2366 symbols. NOAH took 11.2s. Estimated remaining time: 2h 55m 55s [2025-10-26T00:04:43.928867] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:04:43.929037] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-26T00:04:43.929109] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-26T00:04:43.929221] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-26T00:04:43.929292] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-26T00:04:43.929375] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-26T00:04:43.929445] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-26T00:04:59.724202] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-26T00:05:00.109197] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-26T00:05:00.109335] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-26T00:05:00.110303] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-26T00:05:00.110398] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-26T00:05:00.111622] [DEBUG] [LOCAL ] NOC: Trimmed 61943 records to 42190 (keeping 200 days of data) [2025-10-26T00:05:00.368686] [DEBUG] [LOCAL ] NOC: Primary data saved (42190 records). [2025-10-26T00:05:00.368870] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-26T00:05:00.369047] [INFO ] [MAIN ] Update Progress: 1505/2366 symbols. NOC took 16.6s. Estimated remaining time: 2h 55m 45s [2025-10-26T00:05:00.535484] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:05:00.535736] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-26T00:05:00.535825] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-26T00:05:00.535965] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-26T00:05:00.536055] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-26T00:05:00.536168] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-26T00:05:00.536255] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-26T00:05:19.461017] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-26T00:05:19.846752] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-26T00:05:19.846867] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-26T00:05:19.847936] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-26T00:05:19.848050] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-26T00:05:19.849526] [DEBUG] [LOCAL ] NOG: Trimmed 74361 records to 52105 (keeping 200 days of data) [2025-10-26T00:05:20.157325] [DEBUG] [LOCAL ] NOG: Primary data saved (52105 records). [2025-10-26T00:05:20.157522] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-26T00:05:20.157775] [INFO ] [MAIN ] Update Progress: 1506/2366 symbols. NOG took 19.8s. Estimated remaining time: 2h 55m 37s [2025-10-26T00:05:20.324874] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:05:20.325077] [DEBUG] [LOCAL ] NOK: No existing data file found in primary storage. [2025-10-26T00:05:20.325183] [WARN ] [MAIN ] NOK: No existing data found, performing full refresh instead. [2025-10-26T00:05:20.325331] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-26T00:05:20.325420] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-26T00:05:20.325533] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-26T00:05:20.325605] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-26T00:05:41.844268] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-26T00:05:42.234625] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-26T00:05:42.234772] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-26T00:05:42.235857] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-26T00:05:42.235941] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-26T00:05:42.237413] [DEBUG] [LOCAL ] NOK: Trimmed 77774 records to 54402 (keeping 200 days of data) [2025-10-26T00:05:42.539164] [DEBUG] [LOCAL ] NOK: Primary data saved (54402 records). [2025-10-26T00:05:42.539345] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-26T00:05:42.539483] [INFO ] [MAIN ] Update Progress: 1507/2366 symbols. NOK took 22.4s. Estimated remaining time: 2h 55m 31s [2025-10-26T00:05:42.705765] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:05:42.705996] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-26T00:05:42.706070] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-26T00:05:42.706186] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-26T00:05:42.706264] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-26T00:05:42.706351] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-26T00:05:42.706422] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-26T00:05:47.007410] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-26T00:05:47.183970] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-26T00:05:47.184161] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:05:47.184231] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:05:47.184305] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-26T00:05:47.184398] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-26T00:05:47.184469] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-26T00:05:47.184548] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-26T00:05:47.184711] [INFO ] [MAIN ] Update Progress: 1508/2366 symbols. NOM took 4.6s. Estimated remaining time: 2h 55m 14s [2025-10-26T00:05:47.350948] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:05:47.351143] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-26T00:05:47.351218] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-26T00:05:47.351332] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-26T00:05:47.351404] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-26T00:05:47.351489] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-26T00:05:47.351560] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-26T00:06:03.686295] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-26T00:06:04.105407] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-26T00:06:04.105531] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-26T00:06:04.106788] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-26T00:06:04.106870] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-26T00:06:04.108137] [DEBUG] [LOCAL ] NOMD: Trimmed 61007 records to 43894 (keeping 200 days of data) [2025-10-26T00:06:04.363828] [DEBUG] [LOCAL ] NOMD: Primary data saved (43894 records). [2025-10-26T00:06:04.364433] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-26T00:06:04.364607] [INFO ] [MAIN ] Update Progress: 1509/2366 symbols. NOMD took 17.2s. Estimated remaining time: 2h 55m 4s [2025-10-26T00:06:04.533842] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:06:04.534115] [DEBUG] [LOCAL ] NOTE: No existing data file found in primary storage. [2025-10-26T00:06:04.534188] [WARN ] [MAIN ] NOTE: No existing data found, performing full refresh instead. [2025-10-26T00:06:04.534275] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-26T00:06:04.534344] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-26T00:06:04.534405] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-26T00:06:04.534468] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-26T00:06:21.848338] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-26T00:06:22.230889] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-26T00:06:22.231032] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-26T00:06:22.232115] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-26T00:06:22.232214] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-26T00:06:22.233542] [DEBUG] [LOCAL ] NOTE: Trimmed 60557 records to 39862 (keeping 200 days of data) [2025-10-26T00:06:22.456668] [DEBUG] [LOCAL ] NOTE: Primary data saved (39862 records). [2025-10-26T00:06:22.456878] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-26T00:06:22.457038] [INFO ] [MAIN ] Update Progress: 1510/2366 symbols. NOTE took 18.1s. Estimated remaining time: 2h 54m 56s [2025-10-26T00:06:22.628573] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:06:22.628800] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-26T00:06:22.628872] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-26T00:06:22.628988] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-26T00:06:22.629062] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-26T00:06:22.629143] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-26T00:06:22.629230] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-26T00:06:39.885006] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-26T00:06:40.279273] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-26T00:06:40.279423] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-26T00:06:40.280536] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-26T00:06:40.280621] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-26T00:06:40.282324] [DEBUG] [LOCAL ] NOV: Trimmed 77193 records to 53940 (keeping 200 days of data) [2025-10-26T00:06:40.601631] [DEBUG] [LOCAL ] NOV: Primary data saved (53940 records). [2025-10-26T00:06:40.601828] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-26T00:06:40.602004] [INFO ] [MAIN ] Update Progress: 1511/2366 symbols. NOV took 18.1s. Estimated remaining time: 2h 54m 47s [2025-10-26T00:06:40.768852] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:06:40.769037] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-26T00:06:40.769113] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-26T00:06:40.769203] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-26T00:06:40.769272] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-26T00:06:40.769355] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-26T00:06:40.769427] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-26T00:07:01.005889] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-26T00:07:01.403472] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-26T00:07:01.403590] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-26T00:07:01.404686] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-26T00:07:01.404765] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-26T00:07:01.406136] [DEBUG] [LOCAL ] NOW: Trimmed 70672 records to 48455 (keeping 200 days of data) [2025-10-26T00:07:01.701561] [DEBUG] [LOCAL ] NOW: Primary data saved (48455 records). [2025-10-26T00:07:01.701788] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-26T00:07:01.702088] [INFO ] [MAIN ] Update Progress: 1512/2366 symbols. NOW took 21.1s. Estimated remaining time: 2h 54m 39s [2025-10-26T00:07:01.889123] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:01.889371] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-26T00:07:01.889446] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-26T00:07:01.889569] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-26T00:07:01.889666] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-26T00:07:01.889750] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-26T00:07:01.889821] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-26T00:07:02.443450] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-26T00:07:02.443521] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:07:02.443596] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-26T00:07:02.443715] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-26T00:07:02.443786] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-26T00:07:02.443866] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-26T00:07:02.443999] [INFO ] [MAIN ] Update Progress: 1513/2366 symbols. NP took 0.7s. Estimated remaining time: 2h 54m 21s [2025-10-26T00:07:02.627276] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:02.627534] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-26T00:07:02.627606] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-26T00:07:02.627754] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-26T00:07:02.627826] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-26T00:07:02.627905] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-26T00:07:02.627988] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-26T00:07:03.191127] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-26T00:07:03.191200] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:07:03.191281] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-26T00:07:03.191355] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-26T00:07:03.191430] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-26T00:07:03.191496] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-26T00:07:03.191629] [INFO ] [MAIN ] Update Progress: 1514/2366 symbols. NPB took 0.7s. Estimated remaining time: 2h 54m 2s [2025-10-26T00:07:03.359487] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:03.359719] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-26T00:07:03.359807] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-26T00:07:03.359939] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-26T00:07:03.360032] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-26T00:07:03.360140] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-26T00:07:03.360280] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-26T00:07:13.699825] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-26T00:07:14.065543] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-26T00:07:14.065704] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-26T00:07:14.066257] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-26T00:07:14.066353] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-26T00:07:14.067093] [DEBUG] [LOCAL ] NPCT: Trimmed 24279 records to 16625 (keeping 200 days of data) [2025-10-26T00:07:14.163778] [DEBUG] [LOCAL ] NPCT: Primary data saved (16625 records). [2025-10-26T00:07:14.163958] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-26T00:07:14.164135] [INFO ] [MAIN ] Update Progress: 1515/2366 symbols. NPCT took 11.0s. Estimated remaining time: 2h 53m 49s [2025-10-26T00:07:14.332254] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:14.332455] [DEBUG] [LOCAL ] NPFD: No existing data file found in primary storage. [2025-10-26T00:07:14.332545] [WARN ] [MAIN ] NPFD: No existing data found, performing full refresh instead. [2025-10-26T00:07:14.332708] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-26T00:07:14.332801] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-26T00:07:14.332915] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-26T00:07:14.333003] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-26T00:07:22.624113] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-26T00:07:22.982179] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-26T00:07:22.982299] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-26T00:07:22.982692] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-26T00:07:22.982770] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-26T00:07:22.983319] [DEBUG] [LOCAL ] NPFD: Trimmed 14701 records to 10191 (keeping 200 days of data) [2025-10-26T00:07:23.043201] [DEBUG] [LOCAL ] NPFD: Primary data saved (10191 records). [2025-10-26T00:07:23.043359] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-26T00:07:23.043517] [INFO ] [MAIN ] Update Progress: 1516/2366 symbols. NPFD took 8.9s. Estimated remaining time: 2h 53m 35s [2025-10-26T00:07:23.210833] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:23.211040] [DEBUG] [LOCAL ] NPK: No existing data file found in primary storage. [2025-10-26T00:07:23.211114] [WARN ] [MAIN ] NPK: No existing data found, performing full refresh instead. [2025-10-26T00:07:23.211231] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-26T00:07:23.211304] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-26T00:07:23.211388] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-26T00:07:23.211460] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-26T00:07:30.477796] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-26T00:07:30.959176] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-26T00:07:30.959340] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-26T00:07:30.960010] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-26T00:07:30.960116] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-26T00:07:30.961075] [DEBUG] [LOCAL ] NPK: Trimmed 11098 records to 8472 (keeping 200 days of data) [2025-10-26T00:07:31.041616] [DEBUG] [LOCAL ] NPK: Primary data saved (8472 records). [2025-10-26T00:07:31.041874] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-26T00:07:31.042110] [INFO ] [MAIN ] Update Progress: 1517/2366 symbols. NPK took 8.0s. Estimated remaining time: 2h 53m 20s [2025-10-26T00:07:31.316258] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:31.316588] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-26T00:07:31.316699] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-26T00:07:31.316844] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-26T00:07:31.316933] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-26T00:07:31.317038] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-26T00:07:31.317124] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-26T00:07:46.190381] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-26T00:07:46.582935] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-26T00:07:46.583048] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-26T00:07:46.583969] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-26T00:07:46.584048] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-26T00:07:46.585225] [DEBUG] [LOCAL ] NPKI: Trimmed 56346 records to 40975 (keeping 200 days of data) [2025-10-26T00:07:46.812805] [DEBUG] [LOCAL ] NPKI: Primary data saved (40975 records). [2025-10-26T00:07:46.812978] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-26T00:07:46.813125] [INFO ] [MAIN ] Update Progress: 1518/2366 symbols. NPKI took 15.8s. Estimated remaining time: 2h 53m 10s [2025-10-26T00:07:46.984758] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:46.984945] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-26T00:07:46.985017] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-26T00:07:46.985131] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-26T00:07:46.985202] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-26T00:07:46.985284] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-26T00:07:46.985355] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-26T00:07:56.179273] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-26T00:07:56.539469] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-26T00:07:56.539610] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-26T00:07:56.540156] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-26T00:07:56.540254] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-26T00:07:56.540901] [DEBUG] [LOCAL ] NPO: Trimmed 18953 records to 13671 (keeping 200 days of data) [2025-10-26T00:07:56.622365] [DEBUG] [LOCAL ] NPO: Primary data saved (13671 records). [2025-10-26T00:07:56.622540] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-26T00:07:56.622762] [INFO ] [MAIN ] Update Progress: 1519/2366 symbols. NPO took 9.8s. Estimated remaining time: 2h 52m 56s [2025-10-26T00:07:56.791238] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:07:56.791432] [DEBUG] [LOCAL ] NPV: No existing data file found in primary storage. [2025-10-26T00:07:56.791508] [WARN ] [MAIN ] NPV: No existing data found, performing full refresh instead. [2025-10-26T00:07:56.791624] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-26T00:07:56.791720] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-26T00:07:56.791806] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-10-26T00:07:56.791877] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-26T00:08:03.587836] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-26T00:08:03.983096] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-26T00:08:03.983216] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-26T00:08:03.983482] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-26T00:08:03.983625] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-26T00:08:03.984123] [DEBUG] [LOCAL ] NPV: Trimmed 7163 records to 5424 (keeping 200 days of data) [2025-10-26T00:08:04.017526] [DEBUG] [LOCAL ] NPV: Primary data saved (5424 records). [2025-10-26T00:08:04.017723] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-26T00:08:04.017958] [INFO ] [MAIN ] Update Progress: 1520/2366 symbols. NPV took 7.4s. Estimated remaining time: 2h 52m 41s [2025-10-26T00:08:04.185319] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:08:04.185535] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-26T00:08:04.185606] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-26T00:08:04.185742] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-26T00:08:04.185811] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-26T00:08:04.185891] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-26T00:08:04.185963] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-26T00:08:20.465596] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-26T00:08:20.846113] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-26T00:08:20.846272] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-26T00:08:20.847268] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-26T00:08:20.847369] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-26T00:08:20.848813] [DEBUG] [LOCAL ] NPWR: Trimmed 60907 records to 44194 (keeping 200 days of data) [2025-10-26T00:08:21.092915] [DEBUG] [LOCAL ] NPWR: Primary data saved (44194 records). [2025-10-26T00:08:21.093120] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-26T00:08:21.093300] [INFO ] [MAIN ] Update Progress: 1521/2366 symbols. NPWR took 17.1s. Estimated remaining time: 2h 52m 32s [2025-10-26T00:08:21.261419] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:08:21.261614] [DEBUG] [LOCAL ] NQP: No existing data file found in primary storage. [2025-10-26T00:08:21.261722] [WARN ] [MAIN ] NQP: No existing data found, performing full refresh instead. [2025-10-26T00:08:21.261866] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-26T00:08:21.261956] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-26T00:08:21.262063] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-26T00:08:21.262151] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-26T00:08:28.988613] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-26T00:08:29.382877] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-26T00:08:29.382993] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-26T00:08:29.383329] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-26T00:08:29.383429] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-26T00:08:29.383963] [DEBUG] [LOCAL ] NQP: Trimmed 12658 records to 9155 (keeping 200 days of data) [2025-10-26T00:08:29.445165] [DEBUG] [LOCAL ] NQP: Primary data saved (9155 records). [2025-10-26T00:08:29.445456] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-26T00:08:29.445615] [INFO ] [MAIN ] Update Progress: 1522/2366 symbols. NQP took 8.4s. Estimated remaining time: 2h 52m 17s [2025-10-26T00:08:29.628473] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:08:29.628682] [DEBUG] [LOCAL ] NRDY: No existing data file found in primary storage. [2025-10-26T00:08:29.628756] [WARN ] [MAIN ] NRDY: No existing data found, performing full refresh instead. [2025-10-26T00:08:29.628875] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-26T00:08:29.628981] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-26T00:08:29.629088] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-26T00:08:29.629157] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-26T00:08:44.118061] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-26T00:08:44.499231] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-26T00:08:44.499586] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-26T00:08:44.500512] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-26T00:08:44.500598] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-26T00:08:44.501681] [DEBUG] [LOCAL ] NRDY: Trimmed 49681 records to 32551 (keeping 200 days of data) [2025-10-26T00:08:44.673250] [DEBUG] [LOCAL ] NRDY: Primary data saved (32551 records). [2025-10-26T00:08:44.673414] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-26T00:08:44.673570] [INFO ] [MAIN ] Update Progress: 1523/2366 symbols. NRDY took 15.2s. Estimated remaining time: 2h 52m 7s [2025-10-26T00:08:44.840209] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:08:44.840385] [DEBUG] [LOCAL ] NREF: No existing data file found in primary storage. [2025-10-26T00:08:44.840455] [WARN ] [MAIN ] NREF: No existing data found, performing full refresh instead. [2025-10-26T00:08:44.840565] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-26T00:08:44.840635] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-26T00:08:44.840743] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-26T00:08:44.840813] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-26T00:08:52.188503] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-26T00:08:52.562124] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-26T00:08:52.562239] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-26T00:08:52.562545] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-26T00:08:52.562622] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-26T00:08:52.563134] [DEBUG] [LOCAL ] NREF: Trimmed 10873 records to 7897 (keeping 200 days of data) [2025-10-26T00:08:52.610146] [DEBUG] [LOCAL ] NREF: Primary data saved (7897 records). [2025-10-26T00:08:52.610300] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-26T00:08:52.610466] [INFO ] [MAIN ] Update Progress: 1524/2366 symbols. NREF took 7.9s. Estimated remaining time: 2h 51m 52s [2025-10-26T00:08:52.784034] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:08:52.784223] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-26T00:08:52.784295] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-26T00:08:52.784409] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-26T00:08:52.784481] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-26T00:08:52.784544] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-26T00:08:52.784593] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-26T00:09:11.914462] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-26T00:09:12.318857] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-10-26T00:09:12.318989] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-10-26T00:09:12.320066] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-10-26T00:09:12.320148] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-10-26T00:09:12.321719] [DEBUG] [LOCAL ] NRG: Trimmed 76788 records to 53559 (keeping 200 days of data) [2025-10-26T00:09:12.640791] [DEBUG] [LOCAL ] NRG: Primary data saved (53559 records). [2025-10-26T00:09:12.640949] [INFO ] [MAIN ] NRG: Full history saved. [2025-10-26T00:09:12.641125] [INFO ] [MAIN ] Update Progress: 1525/2366 symbols. NRG took 20.0s. Estimated remaining time: 2h 51m 44s [2025-10-26T00:09:12.812751] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:09:12.812943] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-26T00:09:12.813022] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-26T00:09:12.813152] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-26T00:09:12.813239] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-26T00:09:12.813339] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-26T00:09:12.813413] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-26T00:09:29.301997] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-26T00:09:29.683056] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-26T00:09:29.683161] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-26T00:09:29.684168] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-26T00:09:29.684251] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-26T00:09:29.685526] [DEBUG] [LOCAL ] NRGV: Trimmed 62589 records to 44662 (keeping 200 days of data) [2025-10-26T00:09:29.928263] [DEBUG] [LOCAL ] NRGV: Primary data saved (44662 records). [2025-10-26T00:09:29.928421] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-26T00:09:29.928577] [INFO ] [MAIN ] Update Progress: 1526/2366 symbols. NRGV took 17.3s. Estimated remaining time: 2h 51m 35s [2025-10-26T00:09:30.093438] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:09:30.093631] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-26T00:09:30.093724] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-26T00:09:30.093803] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-26T00:09:30.093878] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-26T00:09:30.093935] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-26T00:09:30.093995] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-26T00:09:40.331846] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-26T00:09:40.706531] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-26T00:09:40.706639] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-26T00:09:40.707205] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-26T00:09:40.707275] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-26T00:09:40.708070] [DEBUG] [LOCAL ] NRK: Trimmed 27695 records to 20728 (keeping 200 days of data) [2025-10-26T00:09:40.826465] [DEBUG] [LOCAL ] NRK: Primary data saved (20728 records). [2025-10-26T00:09:40.826620] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-26T00:09:40.826799] [INFO ] [MAIN ] Update Progress: 1527/2366 symbols. NRK took 10.9s. Estimated remaining time: 2h 51m 22s [2025-10-26T00:09:41.003012] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:09:41.003221] [DEBUG] [LOCAL ] NRP: No existing data file found in primary storage. [2025-10-26T00:09:41.003292] [WARN ] [MAIN ] NRP: No existing data found, performing full refresh instead. [2025-10-26T00:09:41.003403] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-26T00:09:41.003473] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-26T00:09:41.003551] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-26T00:09:41.003619] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-26T00:09:47.083300] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-26T00:09:47.442607] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-26T00:09:47.442769] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-26T00:09:47.442996] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-26T00:09:47.443077] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-26T00:09:47.443491] [DEBUG] [LOCAL ] NRP: Trimmed 6327 records to 4222 (keeping 200 days of data) [2025-10-26T00:09:47.469061] [DEBUG] [LOCAL ] NRP: Primary data saved (4222 records). [2025-10-26T00:09:47.469238] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-26T00:09:47.469417] [INFO ] [MAIN ] Update Progress: 1528/2366 symbols. NRP took 6.6s. Estimated remaining time: 2h 51m 6s [2025-10-26T00:09:47.641323] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:09:47.641544] [DEBUG] [LOCAL ] NRT: No existing data file found in primary storage. [2025-10-26T00:09:47.641629] [WARN ] [MAIN ] NRT: No existing data found, performing full refresh instead. [2025-10-26T00:09:47.641789] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-26T00:09:47.641872] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-26T00:09:47.641969] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-26T00:09:47.642048] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-26T00:09:54.477525] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-26T00:09:54.845382] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-26T00:09:54.845513] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-26T00:09:54.845787] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-26T00:09:54.845887] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-26T00:09:54.846417] [DEBUG] [LOCAL ] NRT: Trimmed 7640 records to 4973 (keeping 200 days of data) [2025-10-26T00:09:54.874921] [DEBUG] [LOCAL ] NRT: Primary data saved (4973 records). [2025-10-26T00:09:54.875116] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-26T00:09:54.875328] [INFO ] [MAIN ] Update Progress: 1529/2366 symbols. NRT took 7.4s. Estimated remaining time: 2h 50m 51s [2025-10-26T00:09:55.041454] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:09:55.041689] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-26T00:09:55.041780] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-26T00:09:55.041915] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-26T00:09:55.042002] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-26T00:09:55.042109] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-26T00:09:55.042197] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-26T00:10:00.644580] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-26T00:10:01.024519] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-26T00:10:01.024695] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-26T00:10:01.024893] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-26T00:10:01.024964] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-26T00:10:01.025374] [DEBUG] [LOCAL ] NRUC: Trimmed 4931 records to 3135 (keeping 200 days of data) [2025-10-26T00:10:01.043919] [DEBUG] [LOCAL ] NRUC: Primary data saved (3135 records). [2025-10-26T00:10:01.044014] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-26T00:10:01.044177] [INFO ] [MAIN ] Update Progress: 1530/2366 symbols. NRUC took 6.2s. Estimated remaining time: 2h 50m 36s [2025-10-26T00:10:01.234436] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:10:01.234687] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-26T00:10:01.234761] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-26T00:10:01.234944] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-26T00:10:01.235016] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-26T00:10:01.235098] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-26T00:10:01.235169] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-26T00:10:16.872867] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-26T00:10:17.281827] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-26T00:10:17.281990] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-26T00:10:17.283317] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-26T00:10:17.283405] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-26T00:10:17.285190] [DEBUG] [LOCAL ] NSA: Trimmed 62885 records to 45778 (keeping 200 days of data) [2025-10-26T00:10:17.576416] [DEBUG] [LOCAL ] NSA: Primary data saved (45778 records). [2025-10-26T00:10:17.576621] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-26T00:10:17.576816] [INFO ] [MAIN ] Update Progress: 1531/2366 symbols. NSA took 16.5s. Estimated remaining time: 2h 50m 26s [2025-10-26T00:10:17.759113] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:10:17.759337] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-26T00:10:17.759414] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-26T00:10:17.759533] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-26T00:10:17.759607] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-26T00:10:17.759716] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-26T00:10:17.759789] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-26T00:10:34.640879] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-26T00:10:35.082786] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-10-26T00:10:35.082948] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-10-26T00:10:35.084089] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-10-26T00:10:35.084175] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-10-26T00:10:35.085693] [DEBUG] [LOCAL ] NSC: Trimmed 70964 records to 49373 (keeping 200 days of data) [2025-10-26T00:10:35.397082] [DEBUG] [LOCAL ] NSC: Primary data saved (49373 records). [2025-10-26T00:10:35.397252] [INFO ] [MAIN ] NSC: Full history saved. [2025-10-26T00:10:35.397414] [INFO ] [MAIN ] Update Progress: 1532/2366 symbols. NSC took 17.8s. Estimated remaining time: 2h 50m 17s [2025-10-26T00:10:35.568973] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:10:35.569195] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-26T00:10:35.569270] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-26T00:10:35.569396] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-26T00:10:35.569469] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-26T00:10:35.569552] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-26T00:10:35.569633] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-26T00:10:49.044271] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-26T00:10:49.426087] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-26T00:10:49.426201] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-26T00:10:49.427186] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-26T00:10:49.427271] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-26T00:10:49.428385] [DEBUG] [LOCAL ] NSP: Trimmed 50395 records to 36269 (keeping 200 days of data) [2025-10-26T00:10:49.637511] [DEBUG] [LOCAL ] NSP: Primary data saved (36269 records). [2025-10-26T00:10:49.637717] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-26T00:10:49.637895] [INFO ] [MAIN ] Update Progress: 1533/2366 symbols. NSP took 14.2s. Estimated remaining time: 2h 50m 5s [2025-10-26T00:10:49.822861] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:10:49.823059] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-26T00:10:49.823128] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-26T00:10:49.823242] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-26T00:10:49.823312] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-26T00:10:49.823392] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-26T00:10:49.823461] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-26T00:11:00.553014] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-26T00:11:00.928909] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-26T00:11:00.929094] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-26T00:11:00.929763] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-26T00:11:00.929841] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-26T00:11:00.930787] [DEBUG] [LOCAL ] NTB: Trimmed 30777 records to 20483 (keeping 200 days of data) [2025-10-26T00:11:01.048954] [DEBUG] [LOCAL ] NTB: Primary data saved (20483 records). [2025-10-26T00:11:01.049107] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-26T00:11:01.049264] [INFO ] [MAIN ] Update Progress: 1534/2366 symbols. NTB took 11.4s. Estimated remaining time: 2h 49m 53s [2025-10-26T00:11:01.214841] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:11:01.215044] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-26T00:11:01.215114] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-26T00:11:01.215226] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-26T00:11:01.215292] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-26T00:11:01.215377] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-26T00:11:01.215443] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-26T00:11:07.426279] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-26T00:11:07.648960] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-26T00:11:07.649189] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:11:07.649263] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:11:07.649340] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-26T00:11:07.649436] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-26T00:11:07.649509] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-26T00:11:07.649566] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-26T00:11:07.649734] [INFO ] [MAIN ] Update Progress: 1535/2366 symbols. NTEST took 6.6s. Estimated remaining time: 2h 49m 37s [2025-10-26T00:11:07.852514] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:11:07.852805] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-26T00:11:07.852893] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-26T00:11:07.853046] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-26T00:11:07.853139] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-26T00:11:07.853256] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-26T00:11:07.853387] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-26T00:11:26.054674] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-26T00:11:26.465579] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-26T00:11:26.465709] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-26T00:11:26.466831] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-26T00:11:26.466910] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-26T00:11:26.468422] [DEBUG] [LOCAL ] NTR: Trimmed 76468 records to 53361 (keeping 200 days of data) [2025-10-26T00:11:26.785667] [DEBUG] [LOCAL ] NTR: Primary data saved (53361 records). [2025-10-26T00:11:26.785823] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-26T00:11:26.785979] [INFO ] [MAIN ] Update Progress: 1536/2366 symbols. NTR took 19.1s. Estimated remaining time: 2h 49m 29s [2025-10-26T00:11:26.961235] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:11:26.961404] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-26T00:11:26.961476] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-26T00:11:26.961585] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-26T00:11:26.961683] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-26T00:11:26.961770] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-26T00:11:26.961840] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-26T00:11:42.323971] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-26T00:11:42.736874] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-26T00:11:42.737011] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-26T00:11:42.738128] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-26T00:11:42.738214] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-26T00:11:42.739618] [DEBUG] [LOCAL ] NTST: Trimmed 61912 records to 44699 (keeping 200 days of data) [2025-10-26T00:11:43.004745] [DEBUG] [LOCAL ] NTST: Primary data saved (44699 records). [2025-10-26T00:11:43.004930] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-26T00:11:43.005097] [INFO ] [MAIN ] Update Progress: 1537/2366 symbols. NTST took 16.2s. Estimated remaining time: 2h 49m 19s [2025-10-26T00:11:43.183434] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:11:43.183663] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-26T00:11:43.183738] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-26T00:11:43.183850] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-26T00:11:43.183921] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-26T00:11:43.183979] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-26T00:11:43.184052] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-26T00:12:06.293449] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-26T00:12:06.682516] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-26T00:12:06.682636] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-26T00:12:06.683761] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-26T00:12:06.683843] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-26T00:12:06.685295] [DEBUG] [LOCAL ] NU: Trimmed 77925 records to 54526 (keeping 200 days of data) [2025-10-26T00:12:07.006032] [DEBUG] [LOCAL ] NU: Primary data saved (54526 records). [2025-10-26T00:12:07.006250] [INFO ] [MAIN ] NU: Full history saved. [2025-10-26T00:12:07.006424] [INFO ] [MAIN ] Update Progress: 1538/2366 symbols. NU took 24.0s. Estimated remaining time: 2h 49m 13s [2025-10-26T00:12:07.179692] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:12:07.179892] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-26T00:12:07.179967] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-26T00:12:07.180086] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-26T00:12:07.180160] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-26T00:12:07.180250] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-26T00:12:07.180326] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-26T00:12:25.747604] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-26T00:12:25.942364] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:12:25.943221] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:12:25.943317] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:12:25.943424] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-26T00:12:25.943559] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-26T00:12:25.943672] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-26T00:12:25.943783] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-26T00:12:25.943927] [INFO ] [MAIN ] Update Progress: 1539/2366 symbols. NUE took 18.9s. Estimated remaining time: 2h 49m 4s [2025-10-26T00:12:26.112522] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:12:26.112742] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-26T00:12:26.112838] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-26T00:12:26.112970] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-26T00:12:26.113052] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-26T00:12:26.113156] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-26T00:12:26.113239] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-26T00:12:39.995406] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-26T00:12:40.381159] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-26T00:12:40.381280] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-26T00:12:40.382221] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-26T00:12:40.382315] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-26T00:12:40.383401] [DEBUG] [LOCAL ] NUS: Trimmed 53026 records to 36495 (keeping 200 days of data) [2025-10-26T00:12:40.593523] [DEBUG] [LOCAL ] NUS: Primary data saved (36495 records). [2025-10-26T00:12:40.593798] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-26T00:12:40.593981] [INFO ] [MAIN ] Update Progress: 1540/2366 symbols. NUS took 14.6s. Estimated remaining time: 2h 48m 53s [2025-10-26T00:12:40.765190] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:12:40.765598] [DEBUG] [LOCAL ] NUV: No existing data file found in primary storage. [2025-10-26T00:12:40.765688] [WARN ] [MAIN ] NUV: No existing data found, performing full refresh instead. [2025-10-26T00:12:40.765802] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-26T00:12:40.765871] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-26T00:12:40.765932] [DEBUG] [LOCAL ] NUV: No primary data file found to delete. [2025-10-26T00:12:40.765996] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-26T00:12:52.405183] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-26T00:12:52.796147] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-26T00:12:52.796297] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-26T00:12:52.797132] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-26T00:12:52.797213] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-26T00:12:52.798236] [DEBUG] [LOCAL ] NUV: Trimmed 33807 records to 23524 (keeping 200 days of data) [2025-10-26T00:12:52.934049] [DEBUG] [LOCAL ] NUV: Primary data saved (23524 records). [2025-10-26T00:12:52.934201] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-26T00:12:52.934375] [INFO ] [MAIN ] Update Progress: 1541/2366 symbols. NUV took 12.3s. Estimated remaining time: 2h 48m 41s [2025-10-26T00:12:53.107051] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:12:53.107254] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-26T00:12:53.107324] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-26T00:12:53.107434] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-26T00:12:53.107509] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-26T00:12:53.107587] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-26T00:12:53.107677] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-26T00:13:12.296332] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-26T00:13:12.692299] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-26T00:13:12.692417] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-26T00:13:12.693454] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-26T00:13:12.693535] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-26T00:13:12.694928] [DEBUG] [LOCAL ] NUVB: Trimmed 73532 records to 52488 (keeping 200 days of data) [2025-10-26T00:13:12.983085] [DEBUG] [LOCAL ] NUVB: Primary data saved (52488 records). [2025-10-26T00:13:12.983247] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-26T00:13:12.983407] [INFO ] [MAIN ] Update Progress: 1542/2366 symbols. NUVB took 20.0s. Estimated remaining time: 2h 48m 33s [2025-10-26T00:13:13.149333] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:13:13.149522] [DEBUG] [LOCAL ] NUW: No existing data file found in primary storage. [2025-10-26T00:13:13.149597] [WARN ] [MAIN ] NUW: No existing data found, performing full refresh instead. [2025-10-26T00:13:13.149746] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-26T00:13:13.149819] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-26T00:13:13.149906] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-26T00:13:13.149979] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-26T00:13:20.389312] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-26T00:13:20.740405] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-26T00:13:20.740519] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-26T00:13:20.740791] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-26T00:13:20.740871] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-26T00:13:20.741324] [DEBUG] [LOCAL ] NUW: Trimmed 10658 records to 6686 (keeping 200 days of data) [2025-10-26T00:13:20.779942] [DEBUG] [LOCAL ] NUW: Primary data saved (6686 records). [2025-10-26T00:13:20.780053] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-26T00:13:20.780185] [INFO ] [MAIN ] Update Progress: 1543/2366 symbols. NUW took 7.8s. Estimated remaining time: 2h 48m 18s [2025-10-26T00:13:20.946821] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:13:20.947010] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-26T00:13:20.947086] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-26T00:13:20.947219] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-26T00:13:20.947289] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-26T00:13:20.947367] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-26T00:13:20.947435] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-26T00:13:33.475925] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-26T00:13:33.844864] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-26T00:13:33.844977] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-26T00:13:33.845748] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-26T00:13:33.845825] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-26T00:13:33.846688] [DEBUG] [LOCAL ] NVG: Trimmed 39309 records to 27703 (keeping 200 days of data) [2025-10-26T00:13:34.006629] [DEBUG] [LOCAL ] NVG: Primary data saved (27703 records). [2025-10-26T00:13:34.006805] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-26T00:13:34.006962] [INFO ] [MAIN ] Update Progress: 1544/2366 symbols. NVG took 13.2s. Estimated remaining time: 2h 48m 6s [2025-10-26T00:13:34.177273] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:13:34.177456] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-26T00:13:34.177526] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-26T00:13:34.177636] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-26T00:13:34.177727] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-26T00:13:34.177806] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-26T00:13:34.177874] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-26T00:13:46.768238] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-26T00:13:47.158554] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-26T00:13:47.158753] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-26T00:13:47.160126] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-26T00:13:47.160231] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-26T00:13:47.161796] [DEBUG] [LOCAL ] NVGS: Trimmed 41890 records to 30234 (keeping 200 days of data) [2025-10-26T00:13:47.352617] [DEBUG] [LOCAL ] NVGS: Primary data saved (30234 records). [2025-10-26T00:13:47.352904] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-26T00:13:47.353156] [INFO ] [MAIN ] Update Progress: 1545/2366 symbols. NVGS took 13.3s. Estimated remaining time: 2h 47m 55s [2025-10-26T00:13:47.532635] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:13:47.532937] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-26T00:13:47.533018] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-26T00:13:47.533161] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-26T00:13:47.533235] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-26T00:13:47.533317] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-26T00:13:47.533391] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-26T00:14:14.858252] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-26T00:14:15.278476] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-26T00:14:15.278604] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-26T00:14:15.279972] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-26T00:14:15.280084] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-26T00:14:15.281631] [DEBUG] [LOCAL ] NVO: Trimmed 77964 records to 54564 (keeping 200 days of data) [2025-10-26T00:14:15.624625] [DEBUG] [LOCAL ] NVO: Primary data saved (54564 records). [2025-10-26T00:14:15.624842] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-26T00:14:15.625019] [INFO ] [MAIN ] Update Progress: 1546/2366 symbols. NVO took 28.3s. Estimated remaining time: 2h 47m 51s [2025-10-26T00:14:15.795574] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:14:15.795817] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-26T00:14:15.795902] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-26T00:14:15.796019] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-26T00:14:15.796088] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-26T00:14:15.796175] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-26T00:14:15.796247] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-26T00:14:26.789030] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-26T00:14:27.154328] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-26T00:14:27.154450] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-26T00:14:27.155077] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-26T00:14:27.155158] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-26T00:14:27.155912] [DEBUG] [LOCAL ] NVR: Trimmed 29060 records to 18660 (keeping 200 days of data) [2025-10-26T00:14:27.264396] [DEBUG] [LOCAL ] NVR: Primary data saved (18660 records). [2025-10-26T00:14:27.264560] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-26T00:14:27.264742] [INFO ] [MAIN ] Update Progress: 1547/2366 symbols. NVR took 11.6s. Estimated remaining time: 2h 47m 38s [2025-10-26T00:14:27.434125] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:14:27.434330] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-26T00:14:27.434400] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-26T00:14:27.434528] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-26T00:14:27.434600] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-26T00:14:27.434716] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-26T00:14:27.434786] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-26T00:14:41.925022] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-26T00:14:42.329830] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-26T00:14:42.329993] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-26T00:14:42.331670] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-26T00:14:42.331762] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-26T00:14:42.333513] [DEBUG] [LOCAL ] NVRI: Trimmed 55957 records to 39500 (keeping 200 days of data) [2025-10-26T00:14:42.566183] [DEBUG] [LOCAL ] NVRI: Primary data saved (39500 records). [2025-10-26T00:14:42.566444] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-26T00:14:42.566683] [INFO ] [MAIN ] Update Progress: 1548/2366 symbols. NVRI took 15.3s. Estimated remaining time: 2h 47m 28s [2025-10-26T00:14:42.744707] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:14:42.745018] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-26T00:14:42.745122] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-26T00:14:42.745256] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-26T00:14:42.745332] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-26T00:14:42.745417] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-26T00:14:42.745492] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-26T00:15:02.188142] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-26T00:15:02.573733] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-26T00:15:02.573849] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-26T00:15:02.574917] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-26T00:15:02.574999] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-26T00:15:02.576520] [DEBUG] [LOCAL ] NVS: Trimmed 74959 records to 52038 (keeping 200 days of data) [2025-10-26T00:15:02.901339] [DEBUG] [LOCAL ] NVS: Primary data saved (52038 records). [2025-10-26T00:15:02.901550] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-26T00:15:02.901752] [INFO ] [MAIN ] Update Progress: 1549/2366 symbols. NVS took 20.3s. Estimated remaining time: 2h 47m 20s [2025-10-26T00:15:03.085627] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:15:03.085885] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-26T00:15:03.085973] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-26T00:15:03.086113] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-26T00:15:03.086206] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-26T00:15:03.086320] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-26T00:15:03.086408] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-26T00:15:19.783339] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-26T00:15:20.173195] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-26T00:15:20.173338] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-26T00:15:20.174466] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-26T00:15:20.174547] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-26T00:15:20.176187] [DEBUG] [LOCAL ] NVST: Trimmed 74437 records to 52176 (keeping 200 days of data) [2025-10-26T00:15:20.461947] [DEBUG] [LOCAL ] NVST: Primary data saved (52176 records). [2025-10-26T00:15:20.462104] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-26T00:15:20.462263] [INFO ] [MAIN ] Update Progress: 1550/2366 symbols. NVST took 17.6s. Estimated remaining time: 2h 47m 10s [2025-10-26T00:15:20.627692] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:15:20.627873] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-26T00:15:20.627956] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-26T00:15:20.628092] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-26T00:15:20.628163] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-26T00:15:20.628231] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-26T00:15:20.628273] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-26T00:15:37.959688] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-26T00:15:38.349717] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-26T00:15:38.349850] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-26T00:15:38.350984] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-26T00:15:38.351065] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-26T00:15:38.352474] [DEBUG] [LOCAL ] NVT: Trimmed 74899 records to 52162 (keeping 200 days of data) [2025-10-26T00:15:38.665567] [DEBUG] [LOCAL ] NVT: Primary data saved (52162 records). [2025-10-26T00:15:38.665746] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-26T00:15:38.665906] [INFO ] [MAIN ] Update Progress: 1551/2366 symbols. NVT took 18.2s. Estimated remaining time: 2h 47m 1s [2025-10-26T00:15:38.834931] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:15:38.835158] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-26T00:15:38.835227] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-26T00:15:38.835337] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-26T00:15:38.835408] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-26T00:15:38.835487] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-26T00:15:38.835556] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-26T00:15:56.828836] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-26T00:15:57.263251] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-26T00:15:57.263400] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-26T00:15:57.264698] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-26T00:15:57.264787] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-26T00:15:57.266489] [DEBUG] [LOCAL ] NWG: Trimmed 74096 records to 52154 (keeping 200 days of data) [2025-10-26T00:15:57.585386] [DEBUG] [LOCAL ] NWG: Primary data saved (52154 records). [2025-10-26T00:15:57.585577] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-26T00:15:57.585770] [INFO ] [MAIN ] Update Progress: 1552/2366 symbols. NWG took 18.9s. Estimated remaining time: 2h 46m 52s [2025-10-26T00:15:57.767203] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:15:57.767390] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-26T00:15:57.767464] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-26T00:15:57.767575] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-26T00:15:57.767666] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-26T00:15:57.767767] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-26T00:15:57.767832] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-26T00:16:10.071133] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-26T00:16:10.464264] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-26T00:16:10.464420] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-26T00:16:10.465318] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-26T00:16:10.465420] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-26T00:16:10.466506] [DEBUG] [LOCAL ] NWN: Trimmed 37301 records to 26689 (keeping 200 days of data) [2025-10-26T00:16:10.626012] [DEBUG] [LOCAL ] NWN: Primary data saved (26689 records). [2025-10-26T00:16:10.626234] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-26T00:16:10.626420] [INFO ] [MAIN ] Update Progress: 1553/2366 symbols. NWN took 13.0s. Estimated remaining time: 2h 46m 40s [2025-10-26T00:16:10.801163] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:16:10.801399] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-26T00:16:10.801493] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-26T00:16:10.801668] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-26T00:16:10.801758] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-26T00:16:10.801865] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-26T00:16:10.801951] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-26T00:16:24.062791] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-26T00:16:24.483521] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-26T00:16:24.483682] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-26T00:16:24.484509] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-26T00:16:24.484581] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-26T00:16:24.485724] [DEBUG] [LOCAL ] NX: Trimmed 48364 records to 33740 (keeping 200 days of data) [2025-10-26T00:16:24.680503] [DEBUG] [LOCAL ] NX: Primary data saved (33740 records). [2025-10-26T00:16:24.680818] [INFO ] [MAIN ] NX: Full history saved. [2025-10-26T00:16:24.680977] [INFO ] [MAIN ] Update Progress: 1554/2366 symbols. NX took 14.1s. Estimated remaining time: 2h 46m 29s [2025-10-26T00:16:24.847236] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:16:24.847446] [DEBUG] [LOCAL ] NXC: No existing data file found in primary storage. [2025-10-26T00:16:24.847517] [WARN ] [MAIN ] NXC: No existing data found, performing full refresh instead. [2025-10-26T00:16:24.847629] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-26T00:16:24.847722] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-26T00:16:24.847803] [DEBUG] [LOCAL ] NXC: No primary data file found to delete. [2025-10-26T00:16:24.847872] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-26T00:16:30.931028] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-26T00:16:31.303936] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-26T00:16:31.304056] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-26T00:16:31.304265] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-26T00:16:31.304345] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-26T00:16:31.304834] [DEBUG] [LOCAL ] NXC: Trimmed 5660 records to 4121 (keeping 200 days of data) [2025-10-26T00:16:31.329478] [DEBUG] [LOCAL ] NXC: Primary data saved (4121 records). [2025-10-26T00:16:31.329588] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-26T00:16:31.329766] [INFO ] [MAIN ] Update Progress: 1555/2366 symbols. NXC took 6.6s. Estimated remaining time: 2h 46m 14s [2025-10-26T00:16:31.505059] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:16:31.505265] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-26T00:16:31.505335] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-26T00:16:31.505452] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-26T00:16:31.505524] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-26T00:16:31.505608] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-26T00:16:31.505698] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-26T00:16:32.091723] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-26T00:16:32.091791] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:16:32.091863] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-26T00:16:32.091956] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-26T00:16:32.092027] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-26T00:16:32.092107] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-26T00:16:32.092258] [INFO ] [MAIN ] Update Progress: 1556/2366 symbols. NXDR took 0.8s. Estimated remaining time: 2h 45m 55s [2025-10-26T00:16:32.261927] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:16:32.262123] [DEBUG] [LOCAL ] NXDT: No existing data file found in primary storage. [2025-10-26T00:16:32.262195] [WARN ] [MAIN ] NXDT: No existing data found, performing full refresh instead. [2025-10-26T00:16:32.262308] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-26T00:16:32.262375] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-26T00:16:32.262454] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-26T00:16:32.262521] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-26T00:16:42.294545] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-26T00:16:42.655727] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-26T00:16:42.655844] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-26T00:16:42.656287] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-26T00:16:42.656362] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-26T00:16:42.657000] [DEBUG] [LOCAL ] NXDT: Trimmed 23764 records to 14938 (keeping 200 days of data) [2025-10-26T00:16:42.737993] [DEBUG] [LOCAL ] NXDT: Primary data saved (14938 records). [2025-10-26T00:16:42.738164] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-26T00:16:42.738325] [INFO ] [MAIN ] Update Progress: 1557/2366 symbols. NXDT took 10.6s. Estimated remaining time: 2h 45m 42s [2025-10-26T00:16:42.905023] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:16:42.905174] [DEBUG] [LOCAL ] NXE: No existing data file found in primary storage. [2025-10-26T00:16:42.905244] [WARN ] [MAIN ] NXE: No existing data found, performing full refresh instead. [2025-10-26T00:16:42.905355] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-26T00:16:42.905431] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-26T00:16:42.905512] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-26T00:16:42.905582] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-26T00:17:01.917370] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-26T00:17:02.318110] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-26T00:17:02.318240] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-26T00:17:02.319368] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-26T00:17:02.319452] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-26T00:17:02.320989] [DEBUG] [LOCAL ] NXE: Trimmed 76959 records to 53842 (keeping 200 days of data) [2025-10-26T00:17:02.618721] [DEBUG] [LOCAL ] NXE: Primary data saved (53842 records). [2025-10-26T00:17:02.618933] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-26T00:17:02.619124] [INFO ] [MAIN ] Update Progress: 1558/2366 symbols. NXE took 19.9s. Estimated remaining time: 2h 45m 34s [2025-10-26T00:17:02.787307] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:02.787506] [DEBUG] [LOCAL ] NXG: No existing data file found in primary storage. [2025-10-26T00:17:02.787578] [WARN ] [MAIN ] NXG: No existing data found, performing full refresh instead. [2025-10-26T00:17:02.787715] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-26T00:17:02.787787] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-26T00:17:02.787869] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-26T00:17:02.787938] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-26T00:17:11.116142] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-26T00:17:11.482932] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-26T00:17:11.483052] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-26T00:17:11.483437] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-26T00:17:11.483514] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-26T00:17:11.484136] [DEBUG] [LOCAL ] NXG: Trimmed 14771 records to 10624 (keeping 200 days of data) [2025-10-26T00:17:11.549349] [DEBUG] [LOCAL ] NXG: Primary data saved (10624 records). [2025-10-26T00:17:11.549533] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-26T00:17:11.549730] [INFO ] [MAIN ] Update Progress: 1559/2366 symbols. NXG took 8.9s. Estimated remaining time: 2h 45m 20s [2025-10-26T00:17:11.721639] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:11.721925] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-26T00:17:11.721998] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-26T00:17:11.722120] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-26T00:17:11.722192] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-26T00:17:11.722287] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-26T00:17:11.722358] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-26T00:17:21.553306] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-26T00:17:21.954106] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-26T00:17:21.954223] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-26T00:17:21.954738] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-26T00:17:21.954823] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-26T00:17:21.955447] [DEBUG] [LOCAL ] NXJ: Trimmed 19934 records to 14894 (keeping 200 days of data) [2025-10-26T00:17:22.044098] [DEBUG] [LOCAL ] NXJ: Primary data saved (14894 records). [2025-10-26T00:17:22.044265] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-26T00:17:22.044427] [INFO ] [MAIN ] Update Progress: 1560/2366 symbols. NXJ took 10.5s. Estimated remaining time: 2h 45m 7s [2025-10-26T00:17:22.218732] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:22.218957] [DEBUG] [LOCAL ] NXN: No existing data file found in primary storage. [2025-10-26T00:17:22.219033] [WARN ] [MAIN ] NXN: No existing data found, performing full refresh instead. [2025-10-26T00:17:22.219146] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-26T00:17:22.219218] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-26T00:17:22.219304] [DEBUG] [LOCAL ] NXN: No primary data file found to delete. [2025-10-26T00:17:22.219375] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-26T00:17:27.611248] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-26T00:17:27.972639] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-26T00:17:27.972809] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-26T00:17:27.973015] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-26T00:17:27.973096] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-26T00:17:27.973608] [DEBUG] [LOCAL ] NXN: Trimmed 3446 records to 2332 (keeping 200 days of data) [2025-10-26T00:17:27.988543] [DEBUG] [LOCAL ] NXN: Primary data saved (2332 records). [2025-10-26T00:17:27.988672] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-26T00:17:27.988862] [INFO ] [MAIN ] Update Progress: 1561/2366 symbols. NXN took 5.9s. Estimated remaining time: 2h 44m 51s [2025-10-26T00:17:28.205923] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:28.206203] [DEBUG] [LOCAL ] NXP: No existing data file found in primary storage. [2025-10-26T00:17:28.206283] [WARN ] [MAIN ] NXP: No existing data found, performing full refresh instead. [2025-10-26T00:17:28.206381] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-26T00:17:28.206456] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-26T00:17:28.206522] [DEBUG] [LOCAL ] NXP: No primary data file found to delete. [2025-10-26T00:17:28.206603] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-26T00:17:37.022138] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-26T00:17:37.385948] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-26T00:17:37.386081] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-26T00:17:37.386460] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-26T00:17:37.386534] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-26T00:17:37.387197] [DEBUG] [LOCAL ] NXP: Trimmed 17014 records to 12360 (keeping 200 days of data) [2025-10-26T00:17:37.459834] [DEBUG] [LOCAL ] NXP: Primary data saved (12360 records). [2025-10-26T00:17:37.459993] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-26T00:17:37.460282] [INFO ] [MAIN ] Update Progress: 1562/2366 symbols. NXP took 9.5s. Estimated remaining time: 2h 44m 37s [2025-10-26T00:17:37.628094] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:37.628294] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-26T00:17:37.628380] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-26T00:17:37.628491] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-26T00:17:37.628560] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-26T00:17:37.628638] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-26T00:17:37.628723] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-26T00:17:47.720684] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-26T00:17:48.141219] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-26T00:17:48.141352] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-26T00:17:48.142050] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-26T00:17:48.142134] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-26T00:17:48.143048] [DEBUG] [LOCAL ] NXRT: Trimmed 26104 records to 19105 (keeping 200 days of data) [2025-10-26T00:17:48.253190] [DEBUG] [LOCAL ] NXRT: Primary data saved (19105 records). [2025-10-26T00:17:48.253350] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-26T00:17:48.253509] [INFO ] [MAIN ] Update Progress: 1563/2366 symbols. NXRT took 10.8s. Estimated remaining time: 2h 44m 24s [2025-10-26T00:17:48.419210] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:48.419409] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-26T00:17:48.419483] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-26T00:17:48.419597] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-26T00:17:48.419693] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-26T00:17:48.419775] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-26T00:17:48.419846] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-26T00:17:52.934136] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-26T00:17:53.127967] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-26T00:17:53.128259] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:17:53.128351] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:17:53.128461] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-26T00:17:53.128585] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-26T00:17:53.128707] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-26T00:17:53.128812] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-26T00:17:53.128990] [INFO ] [MAIN ] Update Progress: 1564/2366 symbols. NYC took 4.9s. Estimated remaining time: 2h 44m 8s [2025-10-26T00:17:53.322095] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:17:53.322304] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-26T00:17:53.322377] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-26T00:17:53.322496] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-26T00:17:53.322590] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-26T00:17:53.322701] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-26T00:17:53.322770] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-26T00:18:09.862883] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-26T00:18:10.307716] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-26T00:18:10.307898] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-26T00:18:10.310083] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-26T00:18:10.310179] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-26T00:18:10.312292] [DEBUG] [LOCAL ] NYT: Trimmed 72183 records to 50104 (keeping 200 days of data) [2025-10-26T00:18:10.637109] [DEBUG] [LOCAL ] NYT: Primary data saved (50104 records). [2025-10-26T00:18:10.637392] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-26T00:18:10.637663] [INFO ] [MAIN ] Update Progress: 1565/2366 symbols. NYT took 17.5s. Estimated remaining time: 2h 43m 58s [2025-10-26T00:18:10.821635] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:18:10.821948] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-26T00:18:10.822026] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-26T00:18:10.822152] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-26T00:18:10.822227] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-26T00:18:10.822316] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-26T00:18:10.822391] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-26T00:18:24.016204] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-26T00:18:24.390007] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-26T00:18:24.390132] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-26T00:18:24.390969] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-26T00:18:24.391049] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-26T00:18:24.392219] [DEBUG] [LOCAL ] NZF: Trimmed 42137 records to 29098 (keeping 200 days of data) [2025-10-26T00:18:24.562071] [DEBUG] [LOCAL ] NZF: Primary data saved (29098 records). [2025-10-26T00:18:24.562229] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-26T00:18:24.562386] [INFO ] [MAIN ] Update Progress: 1566/2366 symbols. NZF took 13.9s. Estimated remaining time: 2h 43m 47s [2025-10-26T00:18:24.730953] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:18:24.731166] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-26T00:18:24.731253] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-26T00:18:24.731392] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-26T00:18:24.731483] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-26T00:18:24.731596] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-26T00:18:24.731705] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-26T00:18:48.094104] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-26T00:18:48.306719] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:18:48.307672] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:18:48.307753] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:18:48.307835] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-26T00:18:48.307969] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-26T00:18:48.308067] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-26T00:18:48.308174] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-26T00:18:48.308296] [INFO ] [MAIN ] Update Progress: 1567/2366 symbols. O took 23.7s. Estimated remaining time: 2h 43m 41s [2025-10-26T00:18:48.480393] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:18:48.480602] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-26T00:18:48.480695] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-26T00:18:48.480806] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-26T00:18:48.480878] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-26T00:18:48.480958] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-26T00:18:48.481026] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-26T00:19:07.265943] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-26T00:19:07.657686] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-26T00:19:07.657808] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-26T00:19:07.658907] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-26T00:19:07.658989] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-26T00:19:07.660449] [DEBUG] [LOCAL ] OBDC: Trimmed 75414 records to 52497 (keeping 200 days of data) [2025-10-26T00:19:07.967566] [DEBUG] [LOCAL ] OBDC: Primary data saved (52497 records). [2025-10-26T00:19:07.967811] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-26T00:19:07.967978] [INFO ] [MAIN ] Update Progress: 1568/2366 symbols. OBDC took 19.7s. Estimated remaining time: 2h 43m 32s [2025-10-26T00:19:08.133548] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:19:08.133745] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-26T00:19:08.133817] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-26T00:19:08.133927] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-26T00:19:08.133999] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-26T00:19:08.134055] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-26T00:19:08.134123] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-26T00:19:18.685890] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-26T00:19:19.043691] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-26T00:19:19.043803] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-26T00:19:19.044327] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-26T00:19:19.044406] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-26T00:19:19.045054] [DEBUG] [LOCAL ] OBK: Trimmed 23935 records to 16594 (keeping 200 days of data) [2025-10-26T00:19:19.139071] [DEBUG] [LOCAL ] OBK: Primary data saved (16594 records). [2025-10-26T00:19:19.139233] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-26T00:19:19.139390] [INFO ] [MAIN ] Update Progress: 1569/2366 symbols. OBK took 11.2s. Estimated remaining time: 2h 43m 19s [2025-10-26T00:19:19.305707] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:19:19.305900] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-26T00:19:19.305981] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-26T00:19:19.306122] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-26T00:19:19.306204] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-26T00:19:19.306284] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-26T00:19:19.306351] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-26T00:19:35.231749] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-26T00:19:35.631817] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-26T00:19:35.631926] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-26T00:19:35.632905] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-26T00:19:35.632986] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-26T00:19:35.634299] [DEBUG] [LOCAL ] OC: Trimmed 64987 records to 45496 (keeping 200 days of data) [2025-10-26T00:19:35.911577] [DEBUG] [LOCAL ] OC: Primary data saved (45496 records). [2025-10-26T00:19:35.911756] [INFO ] [MAIN ] OC: Full history saved. [2025-10-26T00:19:35.912001] [INFO ] [MAIN ] Update Progress: 1570/2366 symbols. OC took 16.8s. Estimated remaining time: 2h 43m 9s [2025-10-26T00:19:36.081242] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:19:36.081433] [DEBUG] [LOCAL ] OCFT: No existing data file found in primary storage. [2025-10-26T00:19:36.081482] [WARN ] [MAIN ] OCFT: No existing data found, performing full refresh instead. [2025-10-26T00:19:36.081557] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-26T00:19:36.081599] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-26T00:19:36.081667] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-26T00:19:36.081738] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-26T00:19:43.544900] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-26T00:19:43.906084] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-26T00:19:43.906194] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-26T00:19:43.906498] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-26T00:19:43.906573] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-26T00:19:43.907054] [DEBUG] [LOCAL ] OCFT: Trimmed 11694 records to 7151 (keeping 200 days of data) [2025-10-26T00:19:43.944605] [DEBUG] [LOCAL ] OCFT: Primary data saved (7151 records). [2025-10-26T00:19:43.944881] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-26T00:19:43.945049] [INFO ] [MAIN ] Update Progress: 1571/2366 symbols. OCFT took 8.0s. Estimated remaining time: 2h 42m 55s [2025-10-26T00:19:44.112270] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:19:44.112486] [DEBUG] [LOCAL ] ODC: No existing data file found in primary storage. [2025-10-26T00:19:44.112559] [WARN ] [MAIN ] ODC: No existing data found, performing full refresh instead. [2025-10-26T00:19:44.112733] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-26T00:19:44.112807] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-26T00:19:44.112888] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-26T00:19:44.112956] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-26T00:19:52.073252] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-26T00:19:52.428576] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-26T00:19:52.428711] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-26T00:19:52.429009] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-26T00:19:52.429084] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-26T00:19:52.429573] [DEBUG] [LOCAL ] ODC: Trimmed 11477 records to 8784 (keeping 200 days of data) [2025-10-26T00:19:52.480361] [DEBUG] [LOCAL ] ODC: Primary data saved (8784 records). [2025-10-26T00:19:52.480512] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-26T00:19:52.480669] [INFO ] [MAIN ] Update Progress: 1572/2366 symbols. ODC took 8.5s. Estimated remaining time: 2h 42m 41s [2025-10-26T00:19:52.645618] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:19:52.645840] [DEBUG] [LOCAL ] ODV: No existing data file found in primary storage. [2025-10-26T00:19:52.645931] [WARN ] [MAIN ] ODV: No existing data found, performing full refresh instead. [2025-10-26T00:19:52.646042] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-26T00:19:52.646111] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-26T00:19:52.646190] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-26T00:19:52.646259] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-26T00:20:04.899329] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-26T00:20:05.308482] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-26T00:20:05.308695] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-26T00:20:05.309721] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-26T00:20:05.309815] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-26T00:20:05.311338] [DEBUG] [LOCAL ] ODV: Trimmed 36564 records to 30608 (keeping 200 days of data) [2025-10-26T00:20:05.485506] [DEBUG] [LOCAL ] ODV: Primary data saved (30608 records). [2025-10-26T00:20:05.485692] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-26T00:20:05.485930] [INFO ] [MAIN ] Update Progress: 1573/2366 symbols. ODV took 13.0s. Estimated remaining time: 2h 42m 29s [2025-10-26T00:20:05.655784] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:20:05.655991] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-26T00:20:05.656087] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-26T00:20:05.656204] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-26T00:20:05.656275] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-26T00:20:05.656357] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-26T00:20:05.656428] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-26T00:20:20.448295] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-26T00:20:20.827697] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-26T00:20:20.827932] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-26T00:20:20.829101] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-26T00:20:20.829187] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-26T00:20:20.830554] [DEBUG] [LOCAL ] OEC: Trimmed 53631 records to 37696 (keeping 200 days of data) [2025-10-26T00:20:21.068209] [DEBUG] [LOCAL ] OEC: Primary data saved (37696 records). [2025-10-26T00:20:21.068408] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-26T00:20:21.068637] [INFO ] [MAIN ] Update Progress: 1574/2366 symbols. OEC took 15.6s. Estimated remaining time: 2h 42m 18s [2025-10-26T00:20:21.277216] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:20:21.277468] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-26T00:20:21.277553] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-26T00:20:21.277717] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-26T00:20:21.277808] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-26T00:20:21.277920] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-26T00:20:21.278006] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-26T00:20:32.852786] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-26T00:20:33.231164] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-26T00:20:33.231280] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-26T00:20:33.232075] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-26T00:20:33.232156] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-26T00:20:33.233172] [DEBUG] [LOCAL ] OFG: Trimmed 33560 records to 20846 (keeping 200 days of data) [2025-10-26T00:20:33.356128] [DEBUG] [LOCAL ] OFG: Primary data saved (20846 records). [2025-10-26T00:20:33.356278] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-26T00:20:33.356435] [INFO ] [MAIN ] Update Progress: 1575/2366 symbols. OFG took 12.3s. Estimated remaining time: 2h 42m 6s [2025-10-26T00:20:33.530860] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:20:33.531101] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-26T00:20:33.531176] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-26T00:20:33.531269] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-26T00:20:33.531324] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-26T00:20:33.531371] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-26T00:20:33.531459] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-26T00:20:48.673118] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-26T00:20:49.104082] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-26T00:20:49.104212] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-26T00:20:49.105313] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-26T00:20:49.105401] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-26T00:20:49.106736] [DEBUG] [LOCAL ] OGE: Trimmed 66827 records to 46459 (keeping 200 days of data) [2025-10-26T00:20:49.392340] [DEBUG] [LOCAL ] OGE: Primary data saved (46459 records). [2025-10-26T00:20:49.392537] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-26T00:20:49.392723] [INFO ] [MAIN ] Update Progress: 1576/2366 symbols. OGE took 16.0s. Estimated remaining time: 2h 41m 55s [2025-10-26T00:20:49.557101] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:20:49.557289] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-26T00:20:49.557359] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-26T00:20:49.557496] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-26T00:20:49.557569] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-26T00:20:49.557682] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-26T00:20:49.557777] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-26T00:21:07.300363] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-26T00:21:07.715538] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-26T00:21:07.715725] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-26T00:21:07.717373] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-26T00:21:07.717492] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-26T00:21:07.719555] [DEBUG] [LOCAL ] OGN: Trimmed 76936 records to 53884 (keeping 200 days of data) [2025-10-26T00:21:08.042222] [DEBUG] [LOCAL ] OGN: Primary data saved (53884 records). [2025-10-26T00:21:08.042406] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-26T00:21:08.042614] [INFO ] [MAIN ] Update Progress: 1577/2366 symbols. OGN took 18.6s. Estimated remaining time: 2h 41m 46s [2025-10-26T00:21:08.217504] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:21:08.217712] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-26T00:21:08.217787] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-26T00:21:08.217965] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-26T00:21:08.218058] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-26T00:21:08.218148] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-26T00:21:08.218255] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-26T00:21:21.478449] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-26T00:21:21.875310] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-26T00:21:21.875419] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-26T00:21:21.876373] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-26T00:21:21.876454] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-26T00:21:21.877598] [DEBUG] [LOCAL ] OGS: Trimmed 47818 records to 34304 (keeping 200 days of data) [2025-10-26T00:21:22.084020] [DEBUG] [LOCAL ] OGS: Primary data saved (34304 records). [2025-10-26T00:21:22.084207] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-26T00:21:22.084470] [INFO ] [MAIN ] Update Progress: 1578/2366 symbols. OGS took 14.0s. Estimated remaining time: 2h 41m 35s [2025-10-26T00:21:22.251870] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:21:22.252058] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-26T00:21:22.252130] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-26T00:21:22.252257] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-26T00:21:22.252330] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-26T00:21:22.252412] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-26T00:21:22.252481] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-26T00:21:39.433881] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-26T00:21:39.819389] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-26T00:21:39.819509] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-26T00:21:39.820460] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-26T00:21:39.820544] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-26T00:21:39.822080] [DEBUG] [LOCAL ] OHI: Trimmed 75254 records to 52548 (keeping 200 days of data) [2025-10-26T00:21:40.143515] [DEBUG] [LOCAL ] OHI: Primary data saved (52548 records). [2025-10-26T00:21:40.143745] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-26T00:21:40.143980] [INFO ] [MAIN ] Update Progress: 1579/2366 symbols. OHI took 18.1s. Estimated remaining time: 2h 41m 25s [2025-10-26T00:21:40.311608] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:21:40.311866] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-26T00:21:40.311938] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-26T00:21:40.312113] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-26T00:21:40.312185] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-26T00:21:40.312267] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-26T00:21:40.312337] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-26T00:21:55.931349] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-26T00:21:56.357340] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-26T00:21:56.357481] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-26T00:21:56.358594] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-26T00:21:56.358705] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-26T00:21:56.360165] [DEBUG] [LOCAL ] OI: Trimmed 68224 records to 47691 (keeping 200 days of data) [2025-10-26T00:21:56.639005] [DEBUG] [LOCAL ] OI: Primary data saved (47691 records). [2025-10-26T00:21:56.639165] [INFO ] [MAIN ] OI: Full history saved. [2025-10-26T00:21:56.639325] [INFO ] [MAIN ] Update Progress: 1580/2366 symbols. OI took 16.5s. Estimated remaining time: 2h 41m 15s [2025-10-26T00:21:56.807334] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:21:56.807600] [DEBUG] [LOCAL ] OIA: No existing data file found in primary storage. [2025-10-26T00:21:56.807695] [WARN ] [MAIN ] OIA: No existing data found, performing full refresh instead. [2025-10-26T00:21:56.807807] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-26T00:21:56.807877] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-26T00:21:56.807934] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-26T00:21:56.808002] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-26T00:22:06.406865] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-26T00:22:06.777104] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-26T00:22:06.777224] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-26T00:22:06.777672] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-26T00:22:06.777754] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-26T00:22:06.778403] [DEBUG] [LOCAL ] OIA: Trimmed 20052 records to 13200 (keeping 200 days of data) [2025-10-26T00:22:06.851838] [DEBUG] [LOCAL ] OIA: Primary data saved (13200 records). [2025-10-26T00:22:06.851998] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-26T00:22:06.852163] [INFO ] [MAIN ] Update Progress: 1581/2366 symbols. OIA took 10.2s. Estimated remaining time: 2h 41m 2s [2025-10-26T00:22:07.022613] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:22:07.022846] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-26T00:22:07.022920] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-26T00:22:07.023034] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-26T00:22:07.023104] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-26T00:22:07.023186] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-26T00:22:07.023257] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-26T00:22:22.079433] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-26T00:22:22.479118] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-26T00:22:22.479280] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-26T00:22:22.480274] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-26T00:22:22.480358] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-26T00:22:22.481746] [DEBUG] [LOCAL ] OII: Trimmed 61776 records to 42488 (keeping 200 days of data) [2025-10-26T00:22:22.714111] [DEBUG] [LOCAL ] OII: Primary data saved (42488 records). [2025-10-26T00:22:22.714270] [INFO ] [MAIN ] OII: Full history saved. [2025-10-26T00:22:22.714427] [INFO ] [MAIN ] Update Progress: 1582/2366 symbols. OII took 15.9s. Estimated remaining time: 2h 40m 51s [2025-10-26T00:22:22.885663] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:22:22.885868] [DEBUG] [LOCAL ] OIS: No existing data file found in primary storage. [2025-10-26T00:22:22.885922] [WARN ] [MAIN ] OIS: No existing data found, performing full refresh instead. [2025-10-26T00:22:22.886033] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-26T00:22:22.886107] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-26T00:22:22.886168] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-26T00:22:22.886234] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-26T00:22:38.031803] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-26T00:22:38.413511] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-26T00:22:38.414105] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-26T00:22:38.415210] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-26T00:22:38.415441] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-26T00:22:38.416762] [DEBUG] [LOCAL ] OIS: Trimmed 57399 records to 40385 (keeping 200 days of data) [2025-10-26T00:22:38.631739] [DEBUG] [LOCAL ] OIS: Primary data saved (40385 records). [2025-10-26T00:22:38.631888] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-26T00:22:38.632043] [INFO ] [MAIN ] Update Progress: 1583/2366 symbols. OIS took 15.9s. Estimated remaining time: 2h 40m 41s [2025-10-26T00:22:38.800365] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:22:38.800635] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-26T00:22:38.800739] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-26T00:22:38.800897] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-26T00:22:38.800974] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-26T00:22:38.801055] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-26T00:22:38.801126] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-26T00:22:57.236428] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-26T00:22:57.637988] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-26T00:22:57.638131] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-26T00:22:57.639339] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-26T00:22:57.639424] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-26T00:22:57.641002] [DEBUG] [LOCAL ] OKE: Trimmed 77685 records to 54356 (keeping 200 days of data) [2025-10-26T00:22:57.989115] [DEBUG] [LOCAL ] OKE: Primary data saved (54356 records). [2025-10-26T00:22:57.989308] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-26T00:22:57.989496] [INFO ] [MAIN ] Update Progress: 1584/2366 symbols. OKE took 19.4s. Estimated remaining time: 2h 40m 32s [2025-10-26T00:22:58.166484] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:22:58.166725] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-26T00:22:58.166800] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-26T00:22:58.166914] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-26T00:22:58.166986] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-26T00:22:58.167069] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-26T00:22:58.167139] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-26T00:23:29.379306] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-26T00:23:29.782754] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-10-26T00:23:29.782867] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-10-26T00:23:29.784064] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-10-26T00:23:29.784150] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-10-26T00:23:29.785670] [DEBUG] [LOCAL ] OKLO: Trimmed 77999 records to 54599 (keeping 200 days of data) [2025-10-26T00:23:30.111948] [DEBUG] [LOCAL ] OKLO: Primary data saved (54599 records). [2025-10-26T00:23:30.112120] [INFO ] [MAIN ] OKLO: Full history saved. [2025-10-26T00:23:30.112311] [INFO ] [MAIN ] Update Progress: 1585/2366 symbols. OKLO took 32.1s. Estimated remaining time: 2h 40m 29s [2025-10-26T00:23:30.293386] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:23:30.293569] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-26T00:23:30.293664] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-26T00:23:30.293771] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-26T00:23:30.293843] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-26T00:23:30.293972] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-26T00:23:30.294044] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-26T00:23:46.839313] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-26T00:23:47.246922] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-26T00:23:47.247058] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-26T00:23:47.248454] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-26T00:23:47.248556] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-26T00:23:47.250416] [DEBUG] [LOCAL ] OLN: Trimmed 74777 records to 52761 (keeping 200 days of data) [2025-10-26T00:23:47.563374] [DEBUG] [LOCAL ] OLN: Primary data saved (52761 records). [2025-10-26T00:23:47.563571] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-26T00:23:47.563777] [INFO ] [MAIN ] Update Progress: 1586/2366 symbols. OLN took 17.5s. Estimated remaining time: 2h 40m 19s [2025-10-26T00:23:47.737120] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:23:47.737323] [DEBUG] [LOCAL ] OLP: No existing data file found in primary storage. [2025-10-26T00:23:47.737412] [WARN ] [MAIN ] OLP: No existing data found, performing full refresh instead. [2025-10-26T00:23:47.737550] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-26T00:23:47.737638] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-26T00:23:47.737781] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-26T00:23:47.737867] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-26T00:23:56.134728] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-26T00:23:56.544748] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-26T00:23:56.544904] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-26T00:23:56.545513] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-26T00:23:56.545591] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-26T00:23:56.546524] [DEBUG] [LOCAL ] OLP: Trimmed 14285 records to 10216 (keeping 200 days of data) [2025-10-26T00:23:56.611434] [DEBUG] [LOCAL ] OLP: Primary data saved (10216 records). [2025-10-26T00:23:56.611693] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-26T00:23:56.612136] [INFO ] [MAIN ] Update Progress: 1587/2366 symbols. OLP took 9.0s. Estimated remaining time: 2h 40m 5s [2025-10-26T00:23:56.794860] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:23:56.795129] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-26T00:23:56.795206] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-26T00:23:56.795337] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-26T00:23:56.795412] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-26T00:23:56.795498] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-26T00:23:56.795572] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-26T00:24:13.933188] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-26T00:24:14.321242] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-26T00:24:14.321367] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-26T00:24:14.322487] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-26T00:24:14.322572] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-26T00:24:14.324078] [DEBUG] [LOCAL ] OMC: Trimmed 77291 records to 54071 (keeping 200 days of data) [2025-10-26T00:24:14.643879] [DEBUG] [LOCAL ] OMC: Primary data saved (54071 records). [2025-10-26T00:24:14.644047] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-26T00:24:14.644208] [INFO ] [MAIN ] Update Progress: 1588/2366 symbols. OMC took 18.0s. Estimated remaining time: 2h 39m 56s [2025-10-26T00:24:14.808406] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:24:14.808595] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-26T00:24:14.808685] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-26T00:24:14.808797] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-26T00:24:14.808867] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-26T00:24:14.808945] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-26T00:24:14.809014] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-26T00:24:31.033731] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-26T00:24:31.413555] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-26T00:24:31.413715] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-26T00:24:31.414836] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-26T00:24:31.414918] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-26T00:24:31.416324] [DEBUG] [LOCAL ] OMF: Trimmed 67844 records to 47154 (keeping 200 days of data) [2025-10-26T00:24:31.686065] [DEBUG] [LOCAL ] OMF: Primary data saved (47154 records). [2025-10-26T00:24:31.686211] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-26T00:24:31.686385] [INFO ] [MAIN ] Update Progress: 1589/2366 symbols. OMF took 17.0s. Estimated remaining time: 2h 39m 46s [2025-10-26T00:24:31.853798] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:24:31.853995] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-26T00:24:31.854075] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-26T00:24:31.854245] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-26T00:24:31.854323] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-26T00:24:31.854412] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-26T00:24:31.854488] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-26T00:24:46.799942] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-26T00:24:47.211558] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-26T00:24:47.211696] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-26T00:24:47.212717] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-26T00:24:47.212798] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-26T00:24:47.214146] [DEBUG] [LOCAL ] OMI: Trimmed 65864 records to 46882 (keeping 200 days of data) [2025-10-26T00:24:47.461762] [DEBUG] [LOCAL ] OMI: Primary data saved (46882 records). [2025-10-26T00:24:47.461937] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-26T00:24:47.462102] [INFO ] [MAIN ] Update Progress: 1590/2366 symbols. OMI took 15.8s. Estimated remaining time: 2h 39m 35s [2025-10-26T00:24:47.638738] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:24:47.638965] [DEBUG] [LOCAL ] ONIT: No existing data file found in primary storage. [2025-10-26T00:24:47.639040] [WARN ] [MAIN ] ONIT: No existing data found, performing full refresh instead. [2025-10-26T00:24:47.639214] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-26T00:24:47.639286] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-26T00:24:47.639367] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-26T00:24:47.639436] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-26T00:24:55.465742] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-26T00:24:55.841739] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-26T00:24:55.841902] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-26T00:24:55.842309] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-26T00:24:55.842391] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-26T00:24:55.842925] [DEBUG] [LOCAL ] ONIT: Trimmed 10952 records to 7577 (keeping 200 days of data) [2025-10-26T00:24:55.885285] [DEBUG] [LOCAL ] ONIT: Primary data saved (7577 records). [2025-10-26T00:24:55.885437] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-26T00:24:55.885620] [INFO ] [MAIN ] Update Progress: 1591/2366 symbols. ONIT took 8.4s. Estimated remaining time: 2h 39m 21s [2025-10-26T00:24:56.053539] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:24:56.053794] [DEBUG] [LOCAL ] ONL: No existing data file found in primary storage. [2025-10-26T00:24:56.053869] [WARN ] [MAIN ] ONL: No existing data found, performing full refresh instead. [2025-10-26T00:24:56.053985] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-26T00:24:56.054090] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-26T00:24:56.054171] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-26T00:24:56.054242] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-26T00:25:09.989709] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-26T00:25:10.374628] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-26T00:25:10.374802] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-26T00:25:10.376159] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-26T00:25:10.376248] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-26T00:25:10.377854] [DEBUG] [LOCAL ] ONL: Trimmed 42346 records to 29141 (keeping 200 days of data) [2025-10-26T00:25:10.556987] [DEBUG] [LOCAL ] ONL: Primary data saved (29141 records). [2025-10-26T00:25:10.557236] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-26T00:25:10.557696] [INFO ] [MAIN ] Update Progress: 1592/2366 symbols. ONL took 14.7s. Estimated remaining time: 2h 39m 10s [2025-10-26T00:25:10.779293] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:25:10.779589] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-26T00:25:10.779716] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-26T00:25:10.779858] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-26T00:25:10.779934] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-26T00:25:10.780022] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-26T00:25:10.780135] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-26T00:25:31.612189] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-26T00:25:31.998052] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-26T00:25:31.998169] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-26T00:25:31.999256] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-26T00:25:31.999336] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-26T00:25:32.000804] [DEBUG] [LOCAL ] ONON: Trimmed 77770 records to 54393 (keeping 200 days of data) [2025-10-26T00:25:32.306413] [DEBUG] [LOCAL ] ONON: Primary data saved (54393 records). [2025-10-26T00:25:32.306598] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-26T00:25:32.306786] [INFO ] [MAIN ] Update Progress: 1593/2366 symbols. ONON took 21.7s. Estimated remaining time: 2h 39m 2s [2025-10-26T00:25:32.473630] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:25:32.473845] [DEBUG] [LOCAL ] ONTF: No existing data file found in primary storage. [2025-10-26T00:25:32.473918] [WARN ] [MAIN ] ONTF: No existing data found, performing full refresh instead. [2025-10-26T00:25:32.474085] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-26T00:25:32.474158] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-26T00:25:32.474241] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-26T00:25:32.474313] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-26T00:25:43.098798] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-26T00:25:43.471497] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-26T00:25:43.471608] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-26T00:25:43.472279] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-26T00:25:43.472353] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-26T00:25:43.473268] [DEBUG] [LOCAL ] ONTF: Trimmed 31506 records to 22818 (keeping 200 days of data) [2025-10-26T00:25:43.590576] [DEBUG] [LOCAL ] ONTF: Primary data saved (22818 records). [2025-10-26T00:25:43.590745] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-26T00:25:43.590912] [INFO ] [MAIN ] Update Progress: 1594/2366 symbols. ONTF took 11.3s. Estimated remaining time: 2h 38m 49s [2025-10-26T00:25:43.756929] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:25:43.757081] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-26T00:25:43.757151] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-26T00:25:43.757261] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-26T00:25:43.757330] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-26T00:25:43.757409] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-26T00:25:43.757482] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-26T00:26:00.042113] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-26T00:26:00.478063] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-26T00:26:00.478194] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-26T00:26:00.479456] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-26T00:26:00.479546] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-26T00:26:00.481186] [DEBUG] [LOCAL ] ONTO: Trimmed 67292 records to 47765 (keeping 200 days of data) [2025-10-26T00:26:00.777467] [DEBUG] [LOCAL ] ONTO: Primary data saved (47765 records). [2025-10-26T00:26:00.777728] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-26T00:26:00.777990] [INFO ] [MAIN ] Update Progress: 1595/2366 symbols. ONTO took 17.2s. Estimated remaining time: 2h 38m 39s [2025-10-26T00:26:00.971418] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:26:00.971606] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-26T00:26:00.971710] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-26T00:26:00.971893] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-26T00:26:00.971966] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-26T00:26:00.972049] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-26T00:26:00.972121] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-26T00:26:11.609685] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-26T00:26:11.993994] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-26T00:26:11.994145] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-26T00:26:11.994804] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-26T00:26:11.994906] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-26T00:26:11.995731] [DEBUG] [LOCAL ] OOMA: Trimmed 25870 records to 18453 (keeping 200 days of data) [2025-10-26T00:26:12.101757] [DEBUG] [LOCAL ] OOMA: Primary data saved (18453 records). [2025-10-26T00:26:12.101984] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-26T00:26:12.102187] [INFO ] [MAIN ] Update Progress: 1596/2366 symbols. OOMA took 11.3s. Estimated remaining time: 2h 38m 26s [2025-10-26T00:26:12.277330] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:26:12.277555] [DEBUG] [LOCAL ] OPAD: No existing data file found in primary storage. [2025-10-26T00:26:12.277661] [WARN ] [MAIN ] OPAD: No existing data found, performing full refresh instead. [2025-10-26T00:26:12.277797] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-26T00:26:12.277885] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-26T00:26:12.277991] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-26T00:26:12.278095] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-26T00:26:23.612181] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-26T00:26:23.973230] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-26T00:26:23.973341] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-26T00:26:23.973956] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-26T00:26:23.974036] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-26T00:26:23.974797] [DEBUG] [LOCAL ] OPAD: Trimmed 29496 records to 27038 (keeping 200 days of data) [2025-10-26T00:26:24.122837] [DEBUG] [LOCAL ] OPAD: Primary data saved (27038 records). [2025-10-26T00:26:24.123044] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-26T00:26:24.123289] [INFO ] [MAIN ] Update Progress: 1597/2366 symbols. OPAD took 12.0s. Estimated remaining time: 2h 38m 14s [2025-10-26T00:26:24.296031] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:26:24.296263] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-26T00:26:24.296349] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-26T00:26:24.296541] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-26T00:26:24.296617] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-26T00:26:24.296745] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-26T00:26:24.296826] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-26T00:26:42.021405] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-26T00:26:42.402677] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-26T00:26:42.402830] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-26T00:26:42.403982] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-26T00:26:42.404062] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-26T00:26:42.405738] [DEBUG] [LOCAL ] OPFI: Trimmed 68507 records to 46562 (keeping 200 days of data) [2025-10-26T00:26:42.662042] [DEBUG] [LOCAL ] OPFI: Primary data saved (46562 records). [2025-10-26T00:26:42.662193] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-26T00:26:42.662350] [INFO ] [MAIN ] Update Progress: 1598/2366 symbols. OPFI took 18.5s. Estimated remaining time: 2h 38m 4s [2025-10-26T00:26:42.828074] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:26:42.828274] [DEBUG] [LOCAL ] OPP: No existing data file found in primary storage. [2025-10-26T00:26:42.828345] [WARN ] [MAIN ] OPP: No existing data found, performing full refresh instead. [2025-10-26T00:26:42.828473] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-26T00:26:42.828544] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-26T00:26:42.828624] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-10-26T00:26:42.828711] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-26T00:26:51.483341] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-26T00:26:51.853503] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-26T00:26:51.853616] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-26T00:26:51.854054] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-26T00:26:51.854134] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-26T00:26:51.854767] [DEBUG] [LOCAL ] OPP: Trimmed 17494 records to 12586 (keeping 200 days of data) [2025-10-26T00:26:51.924957] [DEBUG] [LOCAL ] OPP: Primary data saved (12586 records). [2025-10-26T00:26:51.925116] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-26T00:26:51.925275] [INFO ] [MAIN ] Update Progress: 1599/2366 symbols. OPP took 9.3s. Estimated remaining time: 2h 37m 51s [2025-10-26T00:26:52.089365] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:26:52.089535] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-26T00:26:52.089614] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-26T00:26:52.089747] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-26T00:26:52.089828] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-26T00:26:52.089888] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-26T00:26:52.089951] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-26T00:26:59.631912] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-26T00:26:59.810794] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:26:59.811084] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:26:59.811161] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:26:59.811213] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-26T00:26:59.811301] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-26T00:26:59.811374] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-26T00:26:59.811434] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-26T00:26:59.811549] [INFO ] [MAIN ] Update Progress: 1600/2366 symbols. OPY took 7.9s. Estimated remaining time: 2h 37m 36s [2025-10-26T00:26:59.980189] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:26:59.980391] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-26T00:26:59.980464] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-26T00:26:59.980577] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-26T00:26:59.980671] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-26T00:26:59.980757] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-26T00:26:59.980826] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-26T00:27:16.193198] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-26T00:27:16.581027] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-26T00:27:16.581144] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-26T00:27:16.582195] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-26T00:27:16.582293] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-26T00:27:16.583629] [DEBUG] [LOCAL ] OR: Trimmed 67073 records to 47581 (keeping 200 days of data) [2025-10-26T00:27:16.864361] [DEBUG] [LOCAL ] OR: Primary data saved (47581 records). [2025-10-26T00:27:16.864566] [INFO ] [MAIN ] OR: Full history saved. [2025-10-26T00:27:16.864893] [INFO ] [MAIN ] Update Progress: 1601/2366 symbols. OR took 17.1s. Estimated remaining time: 2h 37m 26s [2025-10-26T00:27:17.034587] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:27:17.034836] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-26T00:27:17.034926] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-26T00:27:17.035077] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-26T00:27:17.035159] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-26T00:27:17.035265] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-26T00:27:17.035340] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-26T00:27:31.338933] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-26T00:27:31.726671] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-26T00:27:31.726790] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-26T00:27:31.727692] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-26T00:27:31.727771] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-26T00:27:31.728952] [DEBUG] [LOCAL ] ORA: Trimmed 48894 records to 33555 (keeping 200 days of data) [2025-10-26T00:27:31.940024] [DEBUG] [LOCAL ] ORA: Primary data saved (33555 records). [2025-10-26T00:27:31.940221] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-26T00:27:31.940412] [INFO ] [MAIN ] Update Progress: 1602/2366 symbols. ORA took 15.1s. Estimated remaining time: 2h 37m 15s [2025-10-26T00:27:32.121592] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:27:32.121835] [DEBUG] [LOCAL ] ORC: No existing data file found in primary storage. [2025-10-26T00:27:32.121984] [WARN ] [MAIN ] ORC: No existing data found, performing full refresh instead. [2025-10-26T00:27:32.122121] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-26T00:27:32.122199] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-26T00:27:32.122283] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-26T00:27:32.122354] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-26T00:27:52.856423] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-26T00:27:53.273806] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-26T00:27:53.273978] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-26T00:27:53.275617] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-26T00:27:53.275732] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-26T00:27:53.277910] [DEBUG] [LOCAL ] ORC: Trimmed 75634 records to 53251 (keeping 200 days of data) [2025-10-26T00:27:53.603766] [DEBUG] [LOCAL ] ORC: Primary data saved (53251 records). [2025-10-26T00:27:53.604028] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-26T00:27:53.604270] [INFO ] [MAIN ] Update Progress: 1603/2366 symbols. ORC took 21.7s. Estimated remaining time: 2h 37m 7s [2025-10-26T00:27:53.790933] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:27:53.791242] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-26T00:27:53.791337] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-26T00:27:53.791499] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-26T00:27:53.791581] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-26T00:27:53.791734] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-26T00:27:53.791810] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-26T00:28:17.265856] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-26T00:28:17.458786] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:28:17.459503] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:28:17.459596] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:28:17.459693] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-26T00:28:17.459786] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-26T00:28:17.459858] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-26T00:28:17.459938] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-26T00:28:17.460043] [INFO ] [MAIN ] Update Progress: 1604/2366 symbols. ORCL took 23.9s. Estimated remaining time: 2h 37m 0s [2025-10-26T00:28:17.622528] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:28:17.622697] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-26T00:28:17.622767] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-26T00:28:17.622876] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-26T00:28:17.622945] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-26T00:28:17.623029] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-26T00:28:17.623094] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-26T00:28:33.445559] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-26T00:28:33.638937] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:28:33.639662] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:28:33.639737] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:28:33.639810] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-26T00:28:33.639902] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-26T00:28:33.639991] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-26T00:28:33.640071] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-26T00:28:33.640177] [INFO ] [MAIN ] Update Progress: 1605/2366 symbols. ORI took 16.2s. Estimated remaining time: 2h 36m 50s [2025-10-26T00:28:33.810473] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:28:33.810703] [DEBUG] [LOCAL ] ORN: No existing data file found in primary storage. [2025-10-26T00:28:33.810775] [WARN ] [MAIN ] ORN: No existing data found, performing full refresh instead. [2025-10-26T00:28:33.810894] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-26T00:28:33.810966] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-26T00:28:33.811048] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-26T00:28:33.811117] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-26T00:28:46.687421] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-26T00:28:47.073459] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-26T00:28:47.073578] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-26T00:28:47.074500] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-26T00:28:47.074583] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-26T00:28:47.075732] [DEBUG] [LOCAL ] ORN: Trimmed 45585 records to 31185 (keeping 200 days of data) [2025-10-26T00:28:47.245475] [DEBUG] [LOCAL ] ORN: Primary data saved (31185 records). [2025-10-26T00:28:47.245679] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-26T00:28:47.245834] [INFO ] [MAIN ] Update Progress: 1606/2366 symbols. ORN took 13.6s. Estimated remaining time: 2h 36m 38s [2025-10-26T00:28:47.418130] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:28:47.418358] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-26T00:28:47.418478] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-26T00:28:47.418725] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-26T00:28:47.418817] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-26T00:28:47.418907] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-26T00:28:47.418978] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-26T00:29:10.307471] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-26T00:29:10.711994] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-26T00:29:10.712155] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-26T00:29:10.713813] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-26T00:29:10.713971] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-26T00:29:10.716098] [DEBUG] [LOCAL ] OSCR: Trimmed 77765 records to 54549 (keeping 200 days of data) [2025-10-26T00:29:11.057752] [DEBUG] [LOCAL ] OSCR: Primary data saved (54549 records). [2025-10-26T00:29:11.058002] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-26T00:29:11.058274] [INFO ] [MAIN ] Update Progress: 1607/2366 symbols. OSCR took 23.8s. Estimated remaining time: 2h 36m 31s [2025-10-26T00:29:11.234406] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:29:11.234755] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-26T00:29:11.234835] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-26T00:29:11.234967] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-26T00:29:11.235045] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-26T00:29:11.235133] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-26T00:29:11.235211] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-26T00:29:25.773292] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-26T00:29:25.963973] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:29:25.964607] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:29:25.964719] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:29:25.964805] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-26T00:29:25.964902] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-26T00:29:25.964978] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-26T00:29:25.965063] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-26T00:29:25.965173] [INFO ] [MAIN ] Update Progress: 1608/2366 symbols. OSK took 14.9s. Estimated remaining time: 2h 36m 20s [2025-10-26T00:29:26.142442] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:29:26.142667] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-26T00:29:26.142741] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-26T00:29:26.142857] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-26T00:29:26.142930] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-26T00:29:26.143012] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-26T00:29:26.143083] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-26T00:29:26.693715] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-26T00:29:26.693786] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:29:26.693861] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-26T00:29:26.693973] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-26T00:29:26.694045] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-26T00:29:26.694126] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-26T00:29:26.694266] [INFO ] [MAIN ] Update Progress: 1609/2366 symbols. OTF took 0.7s. Estimated remaining time: 2h 36m 2s [2025-10-26T00:29:26.863318] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:29:26.863509] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-26T00:29:26.863582] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-26T00:29:26.863725] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-26T00:29:26.863796] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-26T00:29:26.863879] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-26T00:29:26.863948] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-26T00:29:44.152110] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-26T00:29:44.552091] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-26T00:29:44.552211] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-26T00:29:44.553337] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-26T00:29:44.553418] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-26T00:29:44.554905] [DEBUG] [LOCAL ] OTIS: Trimmed 76386 records to 53455 (keeping 200 days of data) [2025-10-26T00:29:44.876054] [DEBUG] [LOCAL ] OTIS: Primary data saved (53455 records). [2025-10-26T00:29:44.876288] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-26T00:29:44.876463] [INFO ] [MAIN ] Update Progress: 1610/2366 symbols. OTIS took 18.2s. Estimated remaining time: 2h 35m 52s [2025-10-26T00:29:45.046031] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:29:45.046240] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-26T00:29:45.046315] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-26T00:29:45.046430] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-26T00:29:45.046506] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-26T00:29:45.046588] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-26T00:29:45.046682] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-26T00:30:01.606960] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-26T00:30:02.010853] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-26T00:30:02.011008] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-26T00:30:02.012059] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-26T00:30:02.012145] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-26T00:30:02.013680] [DEBUG] [LOCAL ] OUT: Trimmed 69185 records to 48397 (keeping 200 days of data) [2025-10-26T00:30:02.307269] [DEBUG] [LOCAL ] OUT: Primary data saved (48397 records). [2025-10-26T00:30:02.307463] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-26T00:30:02.307674] [INFO ] [MAIN ] Update Progress: 1611/2366 symbols. OUT took 17.4s. Estimated remaining time: 2h 35m 42s [2025-10-26T00:30:02.501613] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:30:02.501842] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-26T00:30:02.501913] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-26T00:30:02.502027] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-26T00:30:02.502098] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-26T00:30:02.502203] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-26T00:30:02.502273] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-26T00:30:18.965485] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-26T00:30:19.377866] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-26T00:30:19.378003] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-26T00:30:19.379278] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-26T00:30:19.379368] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-26T00:30:19.381029] [DEBUG] [LOCAL ] OVV: Trimmed 77519 records to 54274 (keeping 200 days of data) [2025-10-26T00:30:19.702250] [DEBUG] [LOCAL ] OVV: Primary data saved (54274 records). [2025-10-26T00:30:19.702427] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-26T00:30:19.702608] [INFO ] [MAIN ] Update Progress: 1612/2366 symbols. OVV took 17.4s. Estimated remaining time: 2h 35m 32s [2025-10-26T00:30:19.870949] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:30:19.871148] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-26T00:30:19.871221] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-26T00:30:19.871334] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-26T00:30:19.871404] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-26T00:30:19.871485] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-26T00:30:19.871556] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-26T00:30:38.164802] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-26T00:30:38.559266] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-26T00:30:38.559423] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-26T00:30:38.560549] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-26T00:30:38.560672] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-26T00:30:38.562226] [DEBUG] [LOCAL ] OWL: Trimmed 77712 records to 54340 (keeping 200 days of data) [2025-10-26T00:30:38.887603] [DEBUG] [LOCAL ] OWL: Primary data saved (54340 records). [2025-10-26T00:30:38.887850] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-26T00:30:38.888092] [INFO ] [MAIN ] Update Progress: 1613/2366 symbols. OWL took 19.2s. Estimated remaining time: 2h 35m 23s [2025-10-26T00:30:39.061352] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:30:39.061604] [DEBUG] [LOCAL ] OWLT: No existing data file found in primary storage. [2025-10-26T00:30:39.061708] [WARN ] [MAIN ] OWLT: No existing data found, performing full refresh instead. [2025-10-26T00:30:39.061823] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-26T00:30:39.061894] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-26T00:30:39.061975] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-26T00:30:39.062046] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-26T00:30:46.975178] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-26T00:30:47.333288] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-26T00:30:47.333396] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-26T00:30:47.333805] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-26T00:30:47.333892] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-26T00:30:47.334461] [DEBUG] [LOCAL ] OWLT: Trimmed 12754 records to 10173 (keeping 200 days of data) [2025-10-26T00:30:47.391868] [DEBUG] [LOCAL ] OWLT: Primary data saved (10173 records). [2025-10-26T00:30:47.392038] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-26T00:30:47.392259] [INFO ] [MAIN ] Update Progress: 1614/2366 symbols. OWLT took 8.5s. Estimated remaining time: 2h 35m 9s [2025-10-26T00:30:47.561938] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:30:47.562201] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-26T00:30:47.562296] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-26T00:30:47.562455] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-26T00:30:47.562540] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-26T00:30:47.562673] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-26T00:30:47.562750] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-26T00:31:01.159572] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-26T00:31:01.540269] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-26T00:31:01.540401] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-26T00:31:01.541563] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-26T00:31:01.541669] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-26T00:31:01.543096] [DEBUG] [LOCAL ] OXM: Trimmed 46543 records to 33567 (keeping 200 days of data) [2025-10-26T00:31:01.759313] [DEBUG] [LOCAL ] OXM: Primary data saved (33567 records). [2025-10-26T00:31:01.759534] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-26T00:31:01.759807] [INFO ] [MAIN ] Update Progress: 1615/2366 symbols. OXM took 14.4s. Estimated remaining time: 2h 34m 57s [2025-10-26T00:31:01.943574] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:31:01.943854] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-26T00:31:01.943933] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-26T00:31:01.944064] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-26T00:31:01.944139] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-26T00:31:01.944221] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-26T00:31:01.944294] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-26T00:31:25.840935] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-26T00:31:26.040952] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T00:31:26.041846] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:31:26.041920] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:31:26.041997] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-26T00:31:26.042095] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-26T00:31:26.042193] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-26T00:31:26.042277] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-26T00:31:26.042389] [INFO ] [MAIN ] Update Progress: 1616/2366 symbols. OXY took 24.3s. Estimated remaining time: 2h 34m 50s [2025-10-26T00:31:26.212874] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:31:26.213059] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-26T00:31:26.213131] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-26T00:31:26.213269] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-26T00:31:26.213358] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-26T00:31:26.213435] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-26T00:31:26.213503] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-26T00:31:46.075160] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-26T00:31:46.474674] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-26T00:31:46.474840] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-26T00:31:46.476000] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-26T00:31:46.476082] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-26T00:31:46.477562] [DEBUG] [LOCAL ] PAAS: Trimmed 77661 records to 54405 (keeping 200 days of data) [2025-10-26T00:31:46.794464] [DEBUG] [LOCAL ] PAAS: Primary data saved (54405 records). [2025-10-26T00:31:46.794673] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-26T00:31:46.794841] [INFO ] [MAIN ] Update Progress: 1617/2366 symbols. PAAS took 20.8s. Estimated remaining time: 2h 34m 42s [2025-10-26T00:31:46.972594] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:31:46.972812] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-26T00:31:46.972885] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-26T00:31:46.973000] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-26T00:31:46.973074] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-26T00:31:46.973158] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-26T00:31:46.973232] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-26T00:31:56.031905] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-26T00:31:56.426747] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-26T00:31:56.426914] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-26T00:31:56.427695] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-26T00:31:56.427783] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-26T00:31:56.428719] [DEBUG] [LOCAL ] PAC: Trimmed 16813 records to 11672 (keeping 200 days of data) [2025-10-26T00:31:56.500289] [DEBUG] [LOCAL ] PAC: Primary data saved (11672 records). [2025-10-26T00:31:56.500459] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-26T00:31:56.500675] [INFO ] [MAIN ] Update Progress: 1618/2366 symbols. PAC took 9.7s. Estimated remaining time: 2h 34m 28s [2025-10-26T00:31:56.664860] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:31:56.665040] [DEBUG] [LOCAL ] PACK: No existing data file found in primary storage. [2025-10-26T00:31:56.665110] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-10-26T00:31:56.665217] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-26T00:31:56.665286] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-26T00:31:56.665347] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-26T00:31:56.665408] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-26T00:32:10.146896] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-26T00:32:10.543381] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-26T00:32:10.543567] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-26T00:32:10.544434] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-26T00:32:10.544517] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-26T00:32:10.545589] [DEBUG] [LOCAL ] PACK: Trimmed 45562 records to 32387 (keeping 200 days of data) [2025-10-26T00:32:10.717356] [DEBUG] [LOCAL ] PACK: Primary data saved (32387 records). [2025-10-26T00:32:10.717517] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-26T00:32:10.717704] [INFO ] [MAIN ] Update Progress: 1619/2366 symbols. PACK took 14.2s. Estimated remaining time: 2h 34m 17s [2025-10-26T00:32:10.884917] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:32:10.885112] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-26T00:32:10.885182] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-26T00:32:10.885335] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-26T00:32:10.885405] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-26T00:32:10.885491] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-26T00:32:10.885539] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-26T00:32:25.298673] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-26T00:32:25.723832] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-26T00:32:25.723951] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-26T00:32:25.724907] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-26T00:32:25.724990] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-26T00:32:25.726155] [DEBUG] [LOCAL ] PACS: Trimmed 50278 records to 35157 (keeping 200 days of data) [2025-10-26T00:32:25.930577] [DEBUG] [LOCAL ] PACS: Primary data saved (35157 records). [2025-10-26T00:32:25.930760] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-26T00:32:25.930925] [INFO ] [MAIN ] Update Progress: 1620/2366 symbols. PACS took 15.2s. Estimated remaining time: 2h 34m 6s [2025-10-26T00:32:26.117782] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:32:26.117993] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-26T00:32:26.118083] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-26T00:32:26.118204] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-26T00:32:26.118277] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-26T00:32:26.118359] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-26T00:32:26.118429] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-26T00:32:36.815476] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-26T00:32:37.177403] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-26T00:32:37.177522] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-26T00:32:37.178217] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-26T00:32:37.178298] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-26T00:32:37.179219] [DEBUG] [LOCAL ] PAG: Trimmed 30941 records to 21581 (keeping 200 days of data) [2025-10-26T00:32:37.306455] [DEBUG] [LOCAL ] PAG: Primary data saved (21581 records). [2025-10-26T00:32:37.306608] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-26T00:32:37.306781] [INFO ] [MAIN ] Update Progress: 1621/2366 symbols. PAG took 11.4s. Estimated remaining time: 2h 33m 53s [2025-10-26T00:32:37.476366] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:32:37.476521] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-26T00:32:37.476591] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-26T00:32:37.476731] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-26T00:32:37.476810] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-26T00:32:37.476871] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-26T00:32:37.476936] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-26T00:32:55.069139] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-26T00:32:55.672158] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-26T00:32:55.672312] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-26T00:32:55.673428] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-26T00:32:55.673531] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-26T00:32:55.675233] [DEBUG] [LOCAL ] PAGS: Trimmed 76498 records to 53570 (keeping 200 days of data) [2025-10-26T00:32:55.985628] [DEBUG] [LOCAL ] PAGS: Primary data saved (53570 records). [2025-10-26T00:32:55.985805] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-26T00:32:55.985970] [INFO ] [MAIN ] Update Progress: 1622/2366 symbols. PAGS took 18.7s. Estimated remaining time: 2h 33m 43s [2025-10-26T00:32:56.150952] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:32:56.151131] [DEBUG] [LOCAL ] PAI: No existing data file found in primary storage. [2025-10-26T00:32:56.151200] [WARN ] [MAIN ] PAI: No existing data found, performing full refresh instead. [2025-10-26T00:32:56.151321] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-26T00:32:56.151387] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-26T00:32:56.151466] [DEBUG] [LOCAL ] PAI: No primary data file found to delete. [2025-10-26T00:32:56.151533] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-26T00:33:02.090284] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-26T00:33:02.447005] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-26T00:33:02.447114] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-26T00:33:02.447279] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-26T00:33:02.447362] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-26T00:33:02.447790] [DEBUG] [LOCAL ] PAI: Trimmed 4245 records to 2990 (keeping 200 days of data) [2025-10-26T00:33:02.465797] [DEBUG] [LOCAL ] PAI: Primary data saved (2990 records). [2025-10-26T00:33:02.465886] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-26T00:33:02.466042] [INFO ] [MAIN ] Update Progress: 1623/2366 symbols. PAI took 6.5s. Estimated remaining time: 2h 33m 28s [2025-10-26T00:33:02.638515] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:33:02.638773] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-26T00:33:02.638855] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-26T00:33:02.638983] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-26T00:33:02.639057] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-26T00:33:02.639137] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-26T00:33:02.639208] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-26T00:33:03.214335] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-26T00:33:03.214426] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:33:03.214526] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-26T00:33:03.214671] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-26T00:33:03.214768] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-26T00:33:03.214877] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-26T00:33:03.215084] [INFO ] [MAIN ] Update Progress: 1624/2366 symbols. PAII took 0.7s. Estimated remaining time: 2h 33m 10s [2025-10-26T00:33:03.387892] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:33:03.388127] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-26T00:33:03.388215] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-26T00:33:03.388356] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-26T00:33:03.388452] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-26T00:33:03.388567] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-26T00:33:03.388691] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-26T00:33:16.614105] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-26T00:33:17.028558] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-26T00:33:17.028697] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-26T00:33:17.029522] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-26T00:33:17.029598] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-26T00:33:17.030571] [DEBUG] [LOCAL ] PAM: Trimmed 42442 records to 29588 (keeping 200 days of data) [2025-10-26T00:33:17.194310] [DEBUG] [LOCAL ] PAM: Primary data saved (29588 records). [2025-10-26T00:33:17.194470] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-26T00:33:17.194631] [INFO ] [MAIN ] Update Progress: 1625/2366 symbols. PAM took 14.0s. Estimated remaining time: 2h 32m 59s [2025-10-26T00:33:17.361440] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:33:17.361666] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-26T00:33:17.361756] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-26T00:33:17.361896] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-26T00:33:17.362002] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-26T00:33:17.362140] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-26T00:33:17.362232] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-26T00:33:30.760821] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-26T00:33:31.152468] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-26T00:33:31.152580] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-26T00:33:31.153507] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-26T00:33:31.153591] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-26T00:33:31.154639] [DEBUG] [LOCAL ] PAR: Trimmed 49379 records to 34854 (keeping 200 days of data) [2025-10-26T00:33:31.347636] [DEBUG] [LOCAL ] PAR: Primary data saved (34854 records). [2025-10-26T00:33:31.347813] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-26T00:33:31.347973] [INFO ] [MAIN ] Update Progress: 1626/2366 symbols. PAR took 14.2s. Estimated remaining time: 2h 32m 47s [2025-10-26T00:33:31.513303] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:33:31.513487] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-26T00:33:31.513565] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-26T00:33:31.513705] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-26T00:33:31.513773] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-26T00:33:31.513857] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-26T00:33:31.513938] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-26T00:33:46.946810] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-26T00:33:47.343317] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-26T00:33:47.343455] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-26T00:33:47.344670] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-26T00:33:47.344783] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-26T00:33:47.346326] [DEBUG] [LOCAL ] PARR: Trimmed 69132 records to 48648 (keeping 200 days of data) [2025-10-26T00:33:47.621690] [DEBUG] [LOCAL ] PARR: Primary data saved (48648 records). [2025-10-26T00:33:47.621860] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-26T00:33:47.622023] [INFO ] [MAIN ] Update Progress: 1627/2366 symbols. PARR took 16.3s. Estimated remaining time: 2h 32m 37s [2025-10-26T00:33:47.796112] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:33:47.796340] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-26T00:33:47.796448] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-26T00:33:47.796561] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-26T00:33:47.796633] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-26T00:33:47.796761] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-26T00:33:47.796829] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-26T00:34:11.439480] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-26T00:34:11.836772] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-26T00:34:11.836900] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-26T00:34:11.838129] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-26T00:34:11.838220] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-26T00:34:11.839816] [DEBUG] [LOCAL ] PATH: Trimmed 77852 records to 54460 (keeping 200 days of data) [2025-10-26T00:34:12.152870] [DEBUG] [LOCAL ] PATH: Primary data saved (54460 records). [2025-10-26T00:34:12.153059] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-26T00:34:12.153282] [INFO ] [MAIN ] Update Progress: 1628/2366 symbols. PATH took 24.5s. Estimated remaining time: 2h 32m 30s [2025-10-26T00:34:12.326138] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:34:12.326364] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-26T00:34:12.326450] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-26T00:34:12.326536] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-26T00:34:12.326603] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-26T00:34:12.326689] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-26T00:34:12.326745] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-26T00:34:23.589700] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-26T00:34:23.983138] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-26T00:34:23.983275] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-26T00:34:23.983951] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-26T00:34:23.984044] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-26T00:34:23.985018] [DEBUG] [LOCAL ] PAXS: Trimmed 29354 records to 21115 (keeping 200 days of data) [2025-10-26T00:34:24.110110] [DEBUG] [LOCAL ] PAXS: Primary data saved (21115 records). [2025-10-26T00:34:24.110286] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-26T00:34:24.110525] [INFO ] [MAIN ] Update Progress: 1629/2366 symbols. PAXS took 12.0s. Estimated remaining time: 2h 32m 17s [2025-10-26T00:34:24.294632] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:34:24.294890] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-26T00:34:24.294962] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-26T00:34:24.295077] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-26T00:34:24.295149] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-26T00:34:24.295231] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-26T00:34:24.295305] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-26T00:34:38.826817] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-26T00:34:39.218222] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-26T00:34:39.218358] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-26T00:34:39.219319] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-26T00:34:39.219401] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-26T00:34:39.220732] [DEBUG] [LOCAL ] PAY: Trimmed 53978 records to 39036 (keeping 200 days of data) [2025-10-26T00:34:39.447352] [DEBUG] [LOCAL ] PAY: Primary data saved (39036 records). [2025-10-26T00:34:39.447526] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-26T00:34:39.447710] [INFO ] [MAIN ] Update Progress: 1630/2366 symbols. PAY took 15.3s. Estimated remaining time: 2h 32m 6s [2025-10-26T00:34:39.633627] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:34:39.633855] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-26T00:34:39.633928] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-26T00:34:39.634043] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-26T00:34:39.634119] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-26T00:34:39.634202] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-26T00:34:39.634272] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-26T00:34:54.021894] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-26T00:34:54.420428] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-26T00:34:54.420539] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-26T00:34:54.421266] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-26T00:34:54.421349] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-26T00:34:54.422372] [DEBUG] [LOCAL ] PAYC: Trimmed 53102 records to 36478 (keeping 200 days of data) [2025-10-26T00:34:54.635676] [DEBUG] [LOCAL ] PAYC: Primary data saved (36478 records). [2025-10-26T00:34:54.635834] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-26T00:34:54.635992] [INFO ] [MAIN ] Update Progress: 1631/2366 symbols. PAYC took 15.2s. Estimated remaining time: 2h 31m 55s [2025-10-26T00:34:54.804689] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:34:54.804864] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-26T00:34:54.804937] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-26T00:34:54.805024] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-26T00:34:54.805090] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-26T00:34:54.805183] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-26T00:34:54.805253] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-26T00:35:10.254277] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-26T00:35:10.662823] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-26T00:35:10.662996] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-26T00:35:10.664562] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-26T00:35:10.664699] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-26T00:35:10.666595] [DEBUG] [LOCAL ] PB: Trimmed 59915 records to 42965 (keeping 200 days of data) [2025-10-26T00:35:10.920343] [DEBUG] [LOCAL ] PB: Primary data saved (42965 records). [2025-10-26T00:35:10.920505] [INFO ] [MAIN ] PB: Full history saved. [2025-10-26T00:35:10.920690] [INFO ] [MAIN ] Update Progress: 1632/2366 symbols. PB took 16.3s. Estimated remaining time: 2h 31m 44s [2025-10-26T00:35:11.092262] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:35:11.092474] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-26T00:35:11.092546] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-26T00:35:11.092637] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-26T00:35:11.092725] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-26T00:35:11.092806] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-26T00:35:11.092924] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-26T00:35:28.229015] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-26T00:35:28.626816] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-26T00:35:28.626938] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-26T00:35:28.628138] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-26T00:35:28.628223] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-26T00:35:28.629605] [DEBUG] [LOCAL ] PBA: Trimmed 71657 records to 49882 (keeping 200 days of data) [2025-10-26T00:35:28.920125] [DEBUG] [LOCAL ] PBA: Primary data saved (49882 records). [2025-10-26T00:35:28.920289] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-26T00:35:28.920450] [INFO ] [MAIN ] Update Progress: 1633/2366 symbols. PBA took 18.0s. Estimated remaining time: 2h 31m 34s [2025-10-26T00:35:29.086841] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:35:29.087059] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-26T00:35:29.087129] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-26T00:35:29.087237] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-26T00:35:29.087307] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-26T00:35:29.087367] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-26T00:35:29.087427] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-26T00:35:46.097567] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-26T00:35:46.489416] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-26T00:35:46.489533] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-26T00:35:46.490605] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-26T00:35:46.490713] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-26T00:35:46.492147] [DEBUG] [LOCAL ] PBF: Trimmed 76756 records to 53883 (keeping 200 days of data) [2025-10-26T00:35:46.807535] [DEBUG] [LOCAL ] PBF: Primary data saved (53883 records). [2025-10-26T00:35:46.807736] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-26T00:35:46.807904] [INFO ] [MAIN ] Update Progress: 1634/2366 symbols. PBF took 17.9s. Estimated remaining time: 2h 31m 24s [2025-10-26T00:35:46.982950] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:35:46.983170] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-26T00:35:46.983245] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-26T00:35:46.983357] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-26T00:35:46.983437] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-26T00:35:46.983498] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-26T00:35:46.983565] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-26T00:35:59.451894] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-26T00:35:59.829875] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-26T00:35:59.829985] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-26T00:35:59.830838] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-26T00:35:59.830918] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-26T00:35:59.831939] [DEBUG] [LOCAL ] PBH: Trimmed 44830 records to 32839 (keeping 200 days of data) [2025-10-26T00:36:00.012990] [DEBUG] [LOCAL ] PBH: Primary data saved (32839 records). [2025-10-26T00:36:00.013147] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-26T00:36:00.013306] [INFO ] [MAIN ] Update Progress: 1635/2366 symbols. PBH took 13.2s. Estimated remaining time: 2h 31m 12s [2025-10-26T00:36:00.178963] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:36:00.179169] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-26T00:36:00.179240] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-26T00:36:00.179346] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-26T00:36:00.179419] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-26T00:36:00.179485] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-26T00:36:00.179547] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-26T00:36:16.733382] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-26T00:36:17.134661] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-26T00:36:17.134806] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-26T00:36:17.135924] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-26T00:36:17.136007] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-26T00:36:17.137595] [DEBUG] [LOCAL ] PBI: Trimmed 72427 records to 50666 (keeping 200 days of data) [2025-10-26T00:36:17.431591] [DEBUG] [LOCAL ] PBI: Primary data saved (50666 records). [2025-10-26T00:36:17.431775] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-26T00:36:17.431938] [INFO ] [MAIN ] Update Progress: 1636/2366 symbols. PBI took 17.4s. Estimated remaining time: 2h 31m 2s [2025-10-26T00:36:17.611004] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:36:17.611199] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-26T00:36:17.611270] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-26T00:36:17.611394] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-26T00:36:17.611466] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-26T00:36:17.611544] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-26T00:36:17.611612] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-26T00:36:39.126507] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-26T00:36:39.508222] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-26T00:36:39.508348] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-26T00:36:39.509466] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-26T00:36:39.509554] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-26T00:36:39.511060] [DEBUG] [LOCAL ] PBR: Trimmed 77882 records to 54493 (keeping 200 days of data) [2025-10-26T00:36:39.832093] [DEBUG] [LOCAL ] PBR: Primary data saved (54493 records). [2025-10-26T00:36:39.832268] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-26T00:36:39.832451] [INFO ] [MAIN ] Update Progress: 1637/2366 symbols. PBR took 22.4s. Estimated remaining time: 2h 30m 54s [2025-10-26T00:36:39.997461] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:36:39.997689] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-26T00:36:39.997764] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-26T00:36:39.997879] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-26T00:36:39.997951] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-26T00:36:39.998054] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-26T00:36:39.998129] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-26T00:36:50.474183] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-26T00:36:50.837894] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-26T00:36:50.838009] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-26T00:36:50.838623] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-26T00:36:50.838746] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-26T00:36:50.839418] [DEBUG] [LOCAL ] PBT: Trimmed 24503 records to 17508 (keeping 200 days of data) [2025-10-26T00:36:50.943904] [DEBUG] [LOCAL ] PBT: Primary data saved (17508 records). [2025-10-26T00:36:50.944100] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-26T00:36:50.944242] [INFO ] [MAIN ] Update Progress: 1638/2366 symbols. PBT took 11.1s. Estimated remaining time: 2h 30m 41s [2025-10-26T00:36:51.110931] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:36:51.111110] [DEBUG] [LOCAL ] PCF: No existing data file found in primary storage. [2025-10-26T00:36:51.111180] [WARN ] [MAIN ] PCF: No existing data found, performing full refresh instead. [2025-10-26T00:36:51.111288] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-26T00:36:51.111366] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-26T00:36:51.111426] [DEBUG] [LOCAL ] PCF: No primary data file found to delete. [2025-10-26T00:36:51.111494] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-26T00:36:58.909369] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-26T00:36:59.266269] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-26T00:36:59.266393] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-26T00:36:59.266730] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-26T00:36:59.266807] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-26T00:36:59.267297] [DEBUG] [LOCAL ] PCF: Trimmed 13392 records to 9194 (keeping 200 days of data) [2025-10-26T00:36:59.318155] [DEBUG] [LOCAL ] PCF: Primary data saved (9194 records). [2025-10-26T00:36:59.318289] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-26T00:36:59.318461] [INFO ] [MAIN ] Update Progress: 1639/2366 symbols. PCF took 8.4s. Estimated remaining time: 2h 30m 27s [2025-10-26T00:36:59.484625] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:36:59.484805] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-26T00:36:59.484877] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-26T00:36:59.484987] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-26T00:36:59.485064] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-26T00:36:59.485124] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-26T00:36:59.485186] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-26T00:37:17.139322] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-26T00:37:17.526173] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-10-26T00:37:17.526290] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-10-26T00:37:17.527380] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-10-26T00:37:17.527460] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-10-26T00:37:17.529044] [DEBUG] [LOCAL ] PCG: Trimmed 77898 records to 54499 (keeping 200 days of data) [2025-10-26T00:37:17.848217] [DEBUG] [LOCAL ] PCG: Primary data saved (54499 records). [2025-10-26T00:37:17.848395] [INFO ] [MAIN ] PCG: Full history saved. [2025-10-26T00:37:17.848571] [INFO ] [MAIN ] Update Progress: 1640/2366 symbols. PCG took 18.5s. Estimated remaining time: 2h 30m 17s [2025-10-26T00:37:18.017835] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:37:18.018125] [DEBUG] [LOCAL ] PCM: No existing data file found in primary storage. [2025-10-26T00:37:18.018201] [WARN ] [MAIN ] PCM: No existing data found, performing full refresh instead. [2025-10-26T00:37:18.018313] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-26T00:37:18.018384] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-26T00:37:18.018468] [DEBUG] [LOCAL ] PCM: No primary data file found to delete. [2025-10-26T00:37:18.018534] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-26T00:37:25.593113] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-26T00:37:25.979428] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-26T00:37:25.979551] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-26T00:37:25.979888] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-26T00:37:25.979994] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-26T00:37:25.980457] [DEBUG] [LOCAL ] PCM: Trimmed 10205 records to 6992 (keeping 200 days of data) [2025-10-26T00:37:26.023593] [DEBUG] [LOCAL ] PCM: Primary data saved (6992 records). [2025-10-26T00:37:26.023777] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-26T00:37:26.023922] [INFO ] [MAIN ] Update Progress: 1641/2366 symbols. PCM took 8.2s. Estimated remaining time: 2h 30m 3s [2025-10-26T00:37:26.191171] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:37:26.191364] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-26T00:37:26.191440] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-26T00:37:26.191557] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-26T00:37:26.191627] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-26T00:37:26.191725] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-26T00:37:26.191774] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-26T00:37:37.761130] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-26T00:37:38.138186] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-26T00:37:38.138298] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-26T00:37:38.139117] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-26T00:37:38.139216] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-26T00:37:38.140133] [DEBUG] [LOCAL ] PCN: Trimmed 34918 records to 25709 (keeping 200 days of data) [2025-10-26T00:37:38.291987] [DEBUG] [LOCAL ] PCN: Primary data saved (25709 records). [2025-10-26T00:37:38.292138] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-26T00:37:38.292298] [INFO ] [MAIN ] Update Progress: 1642/2366 symbols. PCN took 12.3s. Estimated remaining time: 2h 29m 51s [2025-10-26T00:37:38.458754] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:37:38.458946] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-26T00:37:38.459016] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-26T00:37:38.459106] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-26T00:37:38.459187] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-26T00:37:38.459259] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-26T00:37:38.459327] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-26T00:37:54.303025] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-26T00:37:54.694661] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-26T00:37:54.694804] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-26T00:37:54.695862] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-26T00:37:54.695944] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-26T00:37:54.697421] [DEBUG] [LOCAL ] PCOR: Trimmed 69127 records to 47981 (keeping 200 days of data) [2025-10-26T00:37:54.966669] [DEBUG] [LOCAL ] PCOR: Primary data saved (47981 records). [2025-10-26T00:37:54.966828] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-26T00:37:54.966989] [INFO ] [MAIN ] Update Progress: 1643/2366 symbols. PCOR took 16.7s. Estimated remaining time: 2h 29m 40s [2025-10-26T00:37:55.131793] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:37:55.131987] [DEBUG] [LOCAL ] PCQ: No existing data file found in primary storage. [2025-10-26T00:37:55.132059] [WARN ] [MAIN ] PCQ: No existing data found, performing full refresh instead. [2025-10-26T00:37:55.132172] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-26T00:37:55.132242] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-26T00:37:55.132322] [DEBUG] [LOCAL ] PCQ: No primary data file found to delete. [2025-10-26T00:37:55.132391] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-26T00:38:04.109672] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-26T00:38:04.467001] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-26T00:38:04.467114] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-26T00:38:04.467539] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-26T00:38:04.467613] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-26T00:38:04.468201] [DEBUG] [LOCAL ] PCQ: Trimmed 17065 records to 12380 (keeping 200 days of data) [2025-10-26T00:38:04.538988] [DEBUG] [LOCAL ] PCQ: Primary data saved (12380 records). [2025-10-26T00:38:04.539154] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-26T00:38:04.539317] [INFO ] [MAIN ] Update Progress: 1644/2366 symbols. PCQ took 9.6s. Estimated remaining time: 2h 29m 26s [2025-10-26T00:38:04.706558] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:38:04.706774] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-26T00:38:04.706846] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-26T00:38:04.706956] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-26T00:38:04.707025] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-26T00:38:04.707087] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-26T00:38:04.707149] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-26T00:38:21.000061] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-26T00:38:21.379665] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-26T00:38:21.379783] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-26T00:38:21.380854] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-26T00:38:21.380937] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-26T00:38:21.382314] [DEBUG] [LOCAL ] PD: Trimmed 68322 records to 49011 (keeping 200 days of data) [2025-10-26T00:38:21.654332] [DEBUG] [LOCAL ] PD: Primary data saved (49011 records). [2025-10-26T00:38:21.654513] [INFO ] [MAIN ] PD: Full history saved. [2025-10-26T00:38:21.654699] [INFO ] [MAIN ] Update Progress: 1645/2366 symbols. PD took 17.1s. Estimated remaining time: 2h 29m 16s [2025-10-26T00:38:21.823151] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:38:21.823367] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-26T00:38:21.823439] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-26T00:38:21.823558] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-26T00:38:21.823626] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-26T00:38:21.823752] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-26T00:38:21.823819] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-26T00:38:25.797315] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-26T00:38:25.978377] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-26T00:38:25.978603] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:38:25.978696] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:38:25.978772] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-26T00:38:25.978864] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-26T00:38:25.978935] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-26T00:38:25.979016] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-26T00:38:25.979163] [INFO ] [MAIN ] Update Progress: 1646/2366 symbols. PDCC took 4.3s. Estimated remaining time: 2h 28m 60s [2025-10-26T00:38:26.143069] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:38:26.143270] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-26T00:38:26.143342] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-26T00:38:26.143458] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-26T00:38:26.143530] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-26T00:38:26.143612] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-26T00:38:26.143711] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-26T00:38:44.251709] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-26T00:38:44.732780] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-26T00:38:44.732976] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-26T00:38:44.734806] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-26T00:38:44.734902] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-26T00:38:44.737383] [DEBUG] [LOCAL ] PDI: Trimmed 73147 records to 50949 (keeping 200 days of data) [2025-10-26T00:38:45.071403] [DEBUG] [LOCAL ] PDI: Primary data saved (50949 records). [2025-10-26T00:38:45.071587] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-26T00:38:45.071780] [INFO ] [MAIN ] Update Progress: 1647/2366 symbols. PDI took 19.1s. Estimated remaining time: 2h 28m 50s [2025-10-26T00:38:45.267344] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:38:45.267579] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-26T00:38:45.267686] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-26T00:38:45.267814] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-26T00:38:45.267891] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-26T00:38:45.267977] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-26T00:38:45.268075] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-26T00:38:59.624090] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-26T00:39:00.003417] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-26T00:39:00.003522] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-26T00:39:00.004484] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-26T00:39:00.004566] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-26T00:39:00.005755] [DEBUG] [LOCAL ] PDM: Trimmed 57357 records to 40283 (keeping 200 days of data) [2025-10-26T00:39:00.220891] [DEBUG] [LOCAL ] PDM: Primary data saved (40283 records). [2025-10-26T00:39:00.221041] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-26T00:39:00.221388] [INFO ] [MAIN ] Update Progress: 1648/2366 symbols. PDM took 15.1s. Estimated remaining time: 2h 28m 39s [2025-10-26T00:39:00.386956] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:39:00.387142] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-26T00:39:00.387261] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-26T00:39:00.387372] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-26T00:39:00.387459] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-26T00:39:00.387539] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-26T00:39:00.387605] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-26T00:39:14.315322] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-26T00:39:14.733807] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-26T00:39:14.733945] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-26T00:39:14.735165] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-26T00:39:14.735252] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-26T00:39:14.736492] [DEBUG] [LOCAL ] PDO: Trimmed 46676 records to 31795 (keeping 200 days of data) [2025-10-26T00:39:14.967317] [DEBUG] [LOCAL ] PDO: Primary data saved (31795 records). [2025-10-26T00:39:14.967510] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-26T00:39:14.967709] [INFO ] [MAIN ] Update Progress: 1649/2366 symbols. PDO took 14.7s. Estimated remaining time: 2h 28m 28s [2025-10-26T00:39:15.182529] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:39:15.182832] [DEBUG] [LOCAL ] PDS: No existing data file found in primary storage. [2025-10-26T00:39:15.182907] [WARN ] [MAIN ] PDS: No existing data found, performing full refresh instead. [2025-10-26T00:39:15.183024] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-26T00:39:15.183095] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-26T00:39:15.183177] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-26T00:39:15.183246] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-26T00:39:25.352729] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-26T00:39:25.711486] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-26T00:39:25.711596] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-26T00:39:25.712179] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-26T00:39:25.712254] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-26T00:39:25.712923] [DEBUG] [LOCAL ] PDS: Trimmed 25694 records to 16903 (keeping 200 days of data) [2025-10-26T00:39:25.803909] [DEBUG] [LOCAL ] PDS: Primary data saved (16903 records). [2025-10-26T00:39:25.804066] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-26T00:39:25.804223] [INFO ] [MAIN ] Update Progress: 1650/2366 symbols. PDS took 10.8s. Estimated remaining time: 2h 28m 15s [2025-10-26T00:39:25.972559] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:39:25.972795] [DEBUG] [LOCAL ] PDT: No existing data file found in primary storage. [2025-10-26T00:39:25.972867] [WARN ] [MAIN ] PDT: No existing data found, performing full refresh instead. [2025-10-26T00:39:25.972982] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-26T00:39:25.973053] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-26T00:39:25.973112] [DEBUG] [LOCAL ] PDT: No primary data file found to delete. [2025-10-26T00:39:25.973178] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-26T00:39:36.380001] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-26T00:39:36.754551] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-26T00:39:36.754701] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-26T00:39:36.755259] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-26T00:39:36.755336] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-26T00:39:36.756192] [DEBUG] [LOCAL ] PDT: Trimmed 25106 records to 17663 (keeping 200 days of data) [2025-10-26T00:39:36.867883] [DEBUG] [LOCAL ] PDT: Primary data saved (17663 records). [2025-10-26T00:39:36.868086] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-26T00:39:36.868261] [INFO ] [MAIN ] Update Progress: 1651/2366 symbols. PDT took 11.1s. Estimated remaining time: 2h 28m 2s [2025-10-26T00:39:37.049237] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:39:37.049433] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-26T00:39:37.049510] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-26T00:39:37.049628] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-26T00:39:37.049724] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-26T00:39:37.049808] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-26T00:39:37.049882] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-26T00:39:46.834188] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-26T00:39:47.204371] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-26T00:39:47.204481] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-26T00:39:47.204995] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-26T00:39:47.205073] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-26T00:39:47.205702] [DEBUG] [LOCAL ] PDX: Trimmed 23676 records to 14318 (keeping 200 days of data) [2025-10-26T00:39:47.288479] [DEBUG] [LOCAL ] PDX: Primary data saved (14318 records). [2025-10-26T00:39:47.288635] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-26T00:39:47.288819] [INFO ] [MAIN ] Update Progress: 1652/2366 symbols. PDX took 10.4s. Estimated remaining time: 2h 27m 48s [2025-10-26T00:39:47.453376] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:39:47.453570] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-26T00:39:47.453660] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-26T00:39:47.453779] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-26T00:39:47.453852] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-26T00:39:47.453934] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-26T00:39:47.454005] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-26T00:40:04.145932] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-26T00:40:04.542531] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-26T00:40:04.542675] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-26T00:40:04.543869] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-26T00:40:04.543952] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-26T00:40:04.545474] [DEBUG] [LOCAL ] PEB: Trimmed 73260 records to 51456 (keeping 200 days of data) [2025-10-26T00:40:04.842803] [DEBUG] [LOCAL ] PEB: Primary data saved (51456 records). [2025-10-26T00:40:04.842960] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-26T00:40:04.843123] [INFO ] [MAIN ] Update Progress: 1653/2366 symbols. PEB took 17.6s. Estimated remaining time: 2h 27m 38s [2025-10-26T00:40:05.015752] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:40:05.015964] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-26T00:40:05.016040] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-26T00:40:05.016176] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-26T00:40:05.016253] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-26T00:40:05.016337] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-26T00:40:05.016405] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-26T00:40:22.071318] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-26T00:40:22.461594] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-10-26T00:40:22.461741] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-10-26T00:40:22.462921] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-10-26T00:40:22.463004] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-10-26T00:40:22.464559] [DEBUG] [LOCAL ] PEG: Trimmed 76996 records to 53894 (keeping 200 days of data) [2025-10-26T00:40:22.779293] [DEBUG] [LOCAL ] PEG: Primary data saved (53894 records). [2025-10-26T00:40:22.779447] [INFO ] [MAIN ] PEG: Full history saved. [2025-10-26T00:40:22.779703] [INFO ] [MAIN ] Update Progress: 1654/2366 symbols. PEG took 17.9s. Estimated remaining time: 2h 27m 28s [2025-10-26T00:40:22.951560] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:40:22.951809] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-26T00:40:22.951911] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-26T00:40:22.952059] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-26T00:40:22.952136] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-26T00:40:22.952241] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-26T00:40:22.952319] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-26T00:40:35.749883] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-26T00:40:36.127026] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-26T00:40:36.127142] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-26T00:40:36.127985] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-26T00:40:36.128100] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-26T00:40:36.128990] [DEBUG] [LOCAL ] PEN: Trimmed 43993 records to 29866 (keeping 200 days of data) [2025-10-26T00:40:36.298411] [DEBUG] [LOCAL ] PEN: Primary data saved (29866 records). [2025-10-26T00:40:36.298567] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-26T00:40:36.298749] [INFO ] [MAIN ] Update Progress: 1655/2366 symbols. PEN took 13.5s. Estimated remaining time: 2h 27m 16s [2025-10-26T00:40:36.482189] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:40:36.482436] [DEBUG] [LOCAL ] PEO: No existing data file found in primary storage. [2025-10-26T00:40:36.482511] [WARN ] [MAIN ] PEO: No existing data found, performing full refresh instead. [2025-10-26T00:40:36.482610] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-26T00:40:36.482704] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-26T00:40:36.482788] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-26T00:40:36.482860] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-26T00:40:45.177056] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-26T00:40:45.545926] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-26T00:40:45.546047] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-26T00:40:45.546533] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-26T00:40:45.546612] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-26T00:40:45.547187] [DEBUG] [LOCAL ] PEO: Trimmed 16323 records to 11239 (keeping 200 days of data) [2025-10-26T00:40:45.612227] [DEBUG] [LOCAL ] PEO: Primary data saved (11239 records). [2025-10-26T00:40:45.612413] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-26T00:40:45.612563] [INFO ] [MAIN ] Update Progress: 1656/2366 symbols. PEO took 9.3s. Estimated remaining time: 2h 27m 2s [2025-10-26T00:40:45.783029] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:40:45.783274] [DEBUG] [LOCAL ] PERF: No existing data file found in primary storage. [2025-10-26T00:40:45.783357] [WARN ] [MAIN ] PERF: No existing data found, performing full refresh instead. [2025-10-26T00:40:45.783475] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-26T00:40:45.783531] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-26T00:40:45.783609] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-26T00:40:45.783701] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-26T00:40:55.932767] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-26T00:40:56.346173] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-26T00:40:56.346318] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-26T00:40:56.346860] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-26T00:40:56.346941] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-26T00:40:56.347552] [DEBUG] [LOCAL ] PERF: Trimmed 21277 records to 14654 (keeping 200 days of data) [2025-10-26T00:40:56.427472] [DEBUG] [LOCAL ] PERF: Primary data saved (14654 records). [2025-10-26T00:40:56.427677] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-26T00:40:56.427846] [INFO ] [MAIN ] Update Progress: 1657/2366 symbols. PERF took 10.8s. Estimated remaining time: 2h 26m 49s [2025-10-26T00:40:56.615874] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:40:56.616101] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-26T00:40:56.616193] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-26T00:40:56.616329] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-26T00:40:56.616418] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-26T00:40:56.616495] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-26T00:40:56.616579] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-26T00:40:57.206307] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-26T00:40:57.206375] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:40:57.206448] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-26T00:40:57.206542] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-26T00:40:57.206613] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-26T00:40:57.206727] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-26T00:40:57.206871] [INFO ] [MAIN ] Update Progress: 1658/2366 symbols. PEW took 0.8s. Estimated remaining time: 2h 26m 32s [2025-10-26T00:40:57.372775] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:40:57.372971] [DEBUG] [LOCAL ] PFD: No existing data file found in primary storage. [2025-10-26T00:40:57.373043] [WARN ] [MAIN ] PFD: No existing data found, performing full refresh instead. [2025-10-26T00:40:57.373156] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-26T00:40:57.373227] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-26T00:40:57.373310] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-26T00:40:57.373380] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-26T00:41:04.322129] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-26T00:41:04.696698] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-26T00:41:04.696828] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-26T00:41:04.697049] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-26T00:41:04.697129] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-26T00:41:04.697563] [DEBUG] [LOCAL ] PFD: Trimmed 7484 records to 5405 (keeping 200 days of data) [2025-10-26T00:41:04.730562] [DEBUG] [LOCAL ] PFD: Primary data saved (5405 records). [2025-10-26T00:41:04.730740] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-26T00:41:04.730905] [INFO ] [MAIN ] Update Progress: 1659/2366 symbols. PFD took 7.5s. Estimated remaining time: 2h 26m 17s [2025-10-26T00:41:04.905243] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:41:04.905484] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-26T00:41:04.905569] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-26T00:41:04.905711] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-26T00:41:04.905785] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-26T00:41:04.905865] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-26T00:41:04.905936] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-26T00:41:28.851502] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-26T00:41:29.247049] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-10-26T00:41:29.247178] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-10-26T00:41:29.248383] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-10-26T00:41:29.248466] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-10-26T00:41:29.250016] [DEBUG] [LOCAL ] PFE: Trimmed 77993 records to 54593 (keeping 200 days of data) [2025-10-26T00:41:29.582665] [DEBUG] [LOCAL ] PFE: Primary data saved (54593 records). [2025-10-26T00:41:29.582837] [INFO ] [MAIN ] PFE: Full history saved. [2025-10-26T00:41:29.583003] [INFO ] [MAIN ] Update Progress: 1660/2366 symbols. PFE took 24.9s. Estimated remaining time: 2h 26m 10s [2025-10-26T00:41:29.749248] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:41:29.749453] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-26T00:41:29.749524] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-26T00:41:29.749635] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-26T00:41:29.749727] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-26T00:41:29.749808] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-26T00:41:29.749877] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-26T00:41:44.624847] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-26T00:41:45.027852] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-26T00:41:45.027976] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-26T00:41:45.029072] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-26T00:41:45.029160] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-26T00:41:45.030529] [DEBUG] [LOCAL ] PFGC: Trimmed 67599 records to 47284 (keeping 200 days of data) [2025-10-26T00:41:45.300863] [DEBUG] [LOCAL ] PFGC: Primary data saved (47284 records). [2025-10-26T00:41:45.301015] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-26T00:41:45.301179] [INFO ] [MAIN ] Update Progress: 1661/2366 symbols. PFGC took 15.7s. Estimated remaining time: 2h 25m 59s [2025-10-26T00:41:45.466004] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:41:45.466184] [DEBUG] [LOCAL ] PFH: No existing data file found in primary storage. [2025-10-26T00:41:45.466256] [WARN ] [MAIN ] PFH: No existing data found, performing full refresh instead. [2025-10-26T00:41:45.466366] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-26T00:41:45.466437] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-26T00:41:45.466499] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-26T00:41:45.466601] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-26T00:41:52.862319] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-26T00:41:53.218507] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-26T00:41:53.218623] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-26T00:41:53.218967] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-26T00:41:53.219047] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-26T00:41:53.219599] [DEBUG] [LOCAL ] PFH: Trimmed 9587 records to 6474 (keeping 200 days of data) [2025-10-26T00:41:53.257310] [DEBUG] [LOCAL ] PFH: Primary data saved (6474 records). [2025-10-26T00:41:53.257456] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-26T00:41:53.257670] [INFO ] [MAIN ] Update Progress: 1662/2366 symbols. PFH took 8.0s. Estimated remaining time: 2h 25m 45s [2025-10-26T00:41:53.425516] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:41:53.425742] [DEBUG] [LOCAL ] PFL: No existing data file found in primary storage. [2025-10-26T00:41:53.425827] [WARN ] [MAIN ] PFL: No existing data found, performing full refresh instead. [2025-10-26T00:41:53.425992] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-26T00:41:53.426080] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-26T00:41:53.426189] [DEBUG] [LOCAL ] PFL: No primary data file found to delete. [2025-10-26T00:41:53.426279] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-26T00:42:02.818733] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-26T00:42:03.181576] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-26T00:42:03.181715] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-26T00:42:03.182171] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-26T00:42:03.182249] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-26T00:42:03.182877] [DEBUG] [LOCAL ] PFL: Trimmed 20762 records to 14680 (keeping 200 days of data) [2025-10-26T00:42:03.268405] [DEBUG] [LOCAL ] PFL: Primary data saved (14680 records). [2025-10-26T00:42:03.268626] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-26T00:42:03.268891] [INFO ] [MAIN ] Update Progress: 1663/2366 symbols. PFL took 10.0s. Estimated remaining time: 2h 25m 32s [2025-10-26T00:42:03.442483] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:42:03.442716] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-26T00:42:03.442791] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-26T00:42:03.442905] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-26T00:42:03.442978] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-26T00:42:03.443062] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-26T00:42:03.443131] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-26T00:42:20.500094] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-26T00:42:20.881028] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-26T00:42:20.881146] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-26T00:42:20.882139] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-26T00:42:20.882222] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-26T00:42:20.883662] [DEBUG] [LOCAL ] PFLT: Trimmed 64372 records to 44870 (keeping 200 days of data) [2025-10-26T00:42:21.136980] [DEBUG] [LOCAL ] PFLT: Primary data saved (44870 records). [2025-10-26T00:42:21.137130] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-26T00:42:21.137314] [INFO ] [MAIN ] Update Progress: 1664/2366 symbols. PFLT took 17.9s. Estimated remaining time: 2h 25m 21s [2025-10-26T00:42:21.303585] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:42:21.303815] [DEBUG] [LOCAL ] PFN: No existing data file found in primary storage. [2025-10-26T00:42:21.303884] [WARN ] [MAIN ] PFN: No existing data found, performing full refresh instead. [2025-10-26T00:42:21.304027] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-26T00:42:21.304098] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-26T00:42:21.304176] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-10-26T00:42:21.304245] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-26T00:42:32.786613] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-26T00:42:33.195370] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-26T00:42:33.195491] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-26T00:42:33.196228] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-26T00:42:33.196308] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-26T00:42:33.197368] [DEBUG] [LOCAL ] PFN: Trimmed 31419 records to 22498 (keeping 200 days of data) [2025-10-26T00:42:33.321477] [DEBUG] [LOCAL ] PFN: Primary data saved (22498 records). [2025-10-26T00:42:33.321633] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-26T00:42:33.321883] [INFO ] [MAIN ] Update Progress: 1665/2366 symbols. PFN took 12.2s. Estimated remaining time: 2h 25m 9s [2025-10-26T00:42:33.487626] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:42:33.487830] [DEBUG] [LOCAL ] PFO: No existing data file found in primary storage. [2025-10-26T00:42:33.487900] [WARN ] [MAIN ] PFO: No existing data found, performing full refresh instead. [2025-10-26T00:42:33.488010] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-26T00:42:33.488098] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-26T00:42:33.488181] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-10-26T00:42:33.488276] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-26T00:42:40.304131] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-26T00:42:40.674899] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-26T00:42:40.675007] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-26T00:42:40.675238] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-26T00:42:40.675347] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-26T00:42:40.675846] [DEBUG] [LOCAL ] PFO: Trimmed 7921 records to 6154 (keeping 200 days of data) [2025-10-26T00:42:40.711538] [DEBUG] [LOCAL ] PFO: Primary data saved (6154 records). [2025-10-26T00:42:40.711689] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-26T00:42:40.711895] [INFO ] [MAIN ] Update Progress: 1666/2366 symbols. PFO took 7.4s. Estimated remaining time: 2h 24m 54s [2025-10-26T00:42:40.880616] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:42:40.880841] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-26T00:42:40.880913] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-26T00:42:40.881064] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-26T00:42:40.881136] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-26T00:42:40.881218] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-26T00:42:40.881291] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-26T00:42:54.043036] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-26T00:42:54.428378] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-26T00:42:54.428518] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-26T00:42:54.429617] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-26T00:42:54.429749] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-26T00:42:54.431166] [DEBUG] [LOCAL ] PFS: Trimmed 52270 records to 36164 (keeping 200 days of data) [2025-10-26T00:42:54.636026] [DEBUG] [LOCAL ] PFS: Primary data saved (36164 records). [2025-10-26T00:42:54.636190] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-26T00:42:54.636351] [INFO ] [MAIN ] Update Progress: 1667/2366 symbols. PFS took 13.9s. Estimated remaining time: 2h 24m 43s [2025-10-26T00:42:54.800227] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:42:54.800400] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-26T00:42:54.800469] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-26T00:42:54.800580] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-26T00:42:54.800676] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-26T00:42:54.800761] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-26T00:42:54.800830] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-26T00:43:08.031935] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-26T00:43:08.411311] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-26T00:43:08.411425] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-26T00:43:08.412246] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-26T00:43:08.412326] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-26T00:43:08.413270] [DEBUG] [LOCAL ] PFSI: Trimmed 41941 records to 29674 (keeping 200 days of data) [2025-10-26T00:43:08.585077] [DEBUG] [LOCAL ] PFSI: Primary data saved (29674 records). [2025-10-26T00:43:08.585230] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-26T00:43:08.585390] [INFO ] [MAIN ] Update Progress: 1668/2366 symbols. PFSI took 13.9s. Estimated remaining time: 2h 24m 31s [2025-10-26T00:43:08.750659] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:43:08.750838] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-26T00:43:08.750917] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-26T00:43:08.751026] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-26T00:43:08.751096] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-26T00:43:08.751177] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-26T00:43:08.751245] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-26T00:43:28.922141] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-26T00:43:28.923025] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-24). Symbol may be delisted or halted. [2025-10-26T00:43:28.923120] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:43:28.923216] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:43:28.923310] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-26T00:43:28.923427] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-26T00:43:28.923524] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-26T00:43:28.923687] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-26T00:43:28.923906] [INFO ] [MAIN ] Update Progress: 1669/2366 symbols. PG took 20.3s. Estimated remaining time: 2h 24m 22s [2025-10-26T00:43:29.095986] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:43:29.096214] [DEBUG] [LOCAL ] PGP: No existing data file found in primary storage. [2025-10-26T00:43:29.096287] [WARN ] [MAIN ] PGP: No existing data found, performing full refresh instead. [2025-10-26T00:43:29.096497] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-26T00:43:29.096573] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-26T00:43:29.096692] [DEBUG] [LOCAL ] PGP: No primary data file found to delete. [2025-10-26T00:43:29.096760] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-26T00:43:36.041900] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-26T00:43:36.401595] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-26T00:43:36.401750] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-26T00:43:36.402044] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-26T00:43:36.402138] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-26T00:43:36.402611] [DEBUG] [LOCAL ] PGP: Trimmed 7975 records to 5784 (keeping 200 days of data) [2025-10-26T00:43:36.436448] [DEBUG] [LOCAL ] PGP: Primary data saved (5784 records). [2025-10-26T00:43:36.436613] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-26T00:43:36.436813] [INFO ] [MAIN ] Update Progress: 1670/2366 symbols. PGP took 7.5s. Estimated remaining time: 2h 24m 7s [2025-10-26T00:43:36.605427] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:43:36.605623] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-26T00:43:36.605718] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-26T00:43:36.605906] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-26T00:43:36.605976] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-26T00:43:36.606058] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-26T00:43:36.606126] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-26T00:43:55.432558] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-26T00:43:55.840294] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-26T00:43:55.840413] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-26T00:43:55.841679] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-26T00:43:55.841762] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-26T00:43:55.843237] [DEBUG] [LOCAL ] PGR: Trimmed 76795 records to 53642 (keeping 200 days of data) [2025-10-26T00:43:56.173326] [DEBUG] [LOCAL ] PGR: Primary data saved (53642 records). [2025-10-26T00:43:56.173485] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-26T00:43:56.173667] [INFO ] [MAIN ] Update Progress: 1671/2366 symbols. PGR took 19.7s. Estimated remaining time: 2h 23m 58s [2025-10-26T00:43:56.343535] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:43:56.343751] [DEBUG] [LOCAL ] PGRE: No existing data file found in primary storage. [2025-10-26T00:43:56.343822] [WARN ] [MAIN ] PGRE: No existing data found, performing full refresh instead. [2025-10-26T00:43:56.343908] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-26T00:43:56.343974] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-26T00:43:56.344033] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-26T00:43:56.344099] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-26T00:44:12.357487] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-26T00:44:12.745368] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-26T00:44:12.745476] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-26T00:44:12.746480] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-26T00:44:12.746561] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-26T00:44:12.747934] [DEBUG] [LOCAL ] PGRE: Trimmed 64671 records to 47652 (keeping 200 days of data) [2025-10-26T00:44:12.998250] [DEBUG] [LOCAL ] PGRE: Primary data saved (47652 records). [2025-10-26T00:44:12.998420] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-26T00:44:12.998580] [INFO ] [MAIN ] Update Progress: 1672/2366 symbols. PGRE took 16.8s. Estimated remaining time: 2h 23m 47s [2025-10-26T00:44:13.169372] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:44:13.169566] [DEBUG] [LOCAL ] PGZ: No existing data file found in primary storage. [2025-10-26T00:44:13.169638] [WARN ] [MAIN ] PGZ: No existing data found, performing full refresh instead. [2025-10-26T00:44:13.169777] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-26T00:44:13.169846] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-26T00:44:13.169929] [DEBUG] [LOCAL ] PGZ: No primary data file found to delete. [2025-10-26T00:44:13.169996] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-26T00:44:19.820888] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-26T00:44:20.174020] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-26T00:44:20.174152] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-26T00:44:20.174387] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-26T00:44:20.174462] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-26T00:44:20.175013] [DEBUG] [LOCAL ] PGZ: Trimmed 8160 records to 5556 (keeping 200 days of data) [2025-10-26T00:44:20.208566] [DEBUG] [LOCAL ] PGZ: Primary data saved (5556 records). [2025-10-26T00:44:20.208760] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-26T00:44:20.208935] [INFO ] [MAIN ] Update Progress: 1673/2366 symbols. PGZ took 7.2s. Estimated remaining time: 2h 23m 33s [2025-10-26T00:44:20.374484] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:44:20.374691] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-26T00:44:20.374763] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-26T00:44:20.374874] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-26T00:44:20.374963] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-26T00:44:20.375046] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-26T00:44:20.375118] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-26T00:44:35.945384] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-26T00:44:36.326579] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-26T00:44:36.326714] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-26T00:44:36.327767] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-26T00:44:36.327853] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-26T00:44:36.329125] [DEBUG] [LOCAL ] PH: Trimmed 55623 records to 36966 (keeping 200 days of data) [2025-10-26T00:44:36.555791] [DEBUG] [LOCAL ] PH: Primary data saved (36966 records). [2025-10-26T00:44:36.555967] [INFO ] [MAIN ] PH: Full history saved. [2025-10-26T00:44:36.556214] [INFO ] [MAIN ] Update Progress: 1674/2366 symbols. PH took 16.3s. Estimated remaining time: 2h 23m 22s [2025-10-26T00:44:36.724442] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:44:36.724633] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-26T00:44:36.724748] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-26T00:44:36.724901] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-26T00:44:36.725010] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-26T00:44:36.725115] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-26T00:44:36.725195] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-26T00:44:52.937203] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-26T00:44:53.326145] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-26T00:44:53.326263] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-26T00:44:53.327321] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-26T00:44:53.327401] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-26T00:44:53.328797] [DEBUG] [LOCAL ] PHG: Trimmed 65771 records to 46074 (keeping 200 days of data) [2025-10-26T00:44:53.593045] [DEBUG] [LOCAL ] PHG: Primary data saved (46074 records). [2025-10-26T00:44:53.593217] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-26T00:44:53.593430] [INFO ] [MAIN ] Update Progress: 1675/2366 symbols. PHG took 17.0s. Estimated remaining time: 2h 23m 11s [2025-10-26T00:44:53.769317] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:44:53.769516] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-10-26T00:44:53.769615] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-10-26T00:44:53.769767] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-26T00:44:53.769857] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-26T00:44:53.769966] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-26T00:44:53.770054] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-26T00:45:03.593232] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-26T00:45:03.987672] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-26T00:45:03.987834] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-26T00:45:03.988755] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-26T00:45:03.988881] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-26T00:45:03.989928] [DEBUG] [LOCAL ] PHI: Trimmed 21389 records to 15370 (keeping 200 days of data) [2025-10-26T00:45:04.084170] [DEBUG] [LOCAL ] PHI: Primary data saved (15370 records). [2025-10-26T00:45:04.084420] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-26T00:45:04.084671] [INFO ] [MAIN ] Update Progress: 1676/2366 symbols. PHI took 10.5s. Estimated remaining time: 2h 22m 58s [2025-10-26T00:45:04.274598] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:45:04.274903] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-26T00:45:04.274981] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-26T00:45:04.275127] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-26T00:45:04.275209] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-26T00:45:04.275295] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-26T00:45:04.275367] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-26T00:45:17.513094] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-26T00:45:17.952297] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-26T00:45:17.952464] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-26T00:45:17.954498] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-26T00:45:17.954601] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-26T00:45:17.956361] [DEBUG] [LOCAL ] PHIN: Trimmed 47363 records to 31835 (keeping 200 days of data) [2025-10-26T00:45:18.168227] [DEBUG] [LOCAL ] PHIN: Primary data saved (31835 records). [2025-10-26T00:45:18.168471] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-26T00:45:18.168819] [INFO ] [MAIN ] Update Progress: 1677/2366 symbols. PHIN took 14.1s. Estimated remaining time: 2h 22m 46s [2025-10-26T00:45:18.353560] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:45:18.353870] [DEBUG] [LOCAL ] PHK: No existing data file found in primary storage. [2025-10-26T00:45:18.354086] [WARN ] [MAIN ] PHK: No existing data found, performing full refresh instead. [2025-10-26T00:45:18.354215] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-26T00:45:18.354287] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-26T00:45:18.354372] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-26T00:45:18.354444] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-26T00:45:31.035682] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-26T00:45:31.456779] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-26T00:45:31.456973] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-26T00:45:31.457818] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-26T00:45:31.457899] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-26T00:45:31.459044] [DEBUG] [LOCAL ] PHK: Trimmed 39361 records to 27092 (keeping 200 days of data) [2025-10-26T00:45:31.608258] [DEBUG] [LOCAL ] PHK: Primary data saved (27092 records). [2025-10-26T00:45:31.608418] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-26T00:45:31.608581] [INFO ] [MAIN ] Update Progress: 1678/2366 symbols. PHK took 13.4s. Estimated remaining time: 2h 22m 34s [2025-10-26T00:45:31.772746] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:45:31.772963] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-26T00:45:31.773038] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-26T00:45:31.773154] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-26T00:45:31.773229] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-26T00:45:31.773313] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-26T00:45:31.773384] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-26T00:45:49.439405] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-26T00:45:49.822395] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-10-26T00:45:49.822532] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-10-26T00:45:49.823718] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-10-26T00:45:49.823810] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-10-26T00:45:49.825426] [DEBUG] [LOCAL ] PHM: Trimmed 75250 records to 52443 (keeping 200 days of data) [2025-10-26T00:45:50.141408] [DEBUG] [LOCAL ] PHM: Primary data saved (52443 records). [2025-10-26T00:45:50.141570] [INFO ] [MAIN ] PHM: Full history saved. [2025-10-26T00:45:50.141755] [INFO ] [MAIN ] Update Progress: 1679/2366 symbols. PHM took 18.5s. Estimated remaining time: 2h 22m 24s [2025-10-26T00:45:50.306432] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:45:50.306672] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-26T00:45:50.306747] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-26T00:45:50.306935] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-26T00:45:50.307009] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-26T00:45:50.307089] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-26T00:45:50.307159] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-26T00:46:05.166213] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-26T00:46:05.549870] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-26T00:46:05.550420] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-26T00:46:05.551665] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-26T00:46:05.551763] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-26T00:46:05.553357] [DEBUG] [LOCAL ] PHR: Trimmed 53477 records to 38423 (keeping 200 days of data) [2025-10-26T00:46:05.767699] [DEBUG] [LOCAL ] PHR: Primary data saved (38423 records). [2025-10-26T00:46:05.767861] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-26T00:46:05.768024] [INFO ] [MAIN ] Update Progress: 1680/2366 symbols. PHR took 15.6s. Estimated remaining time: 2h 22m 13s [2025-10-26T00:46:05.936325] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:46:05.936525] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-26T00:46:05.936597] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-26T00:46:05.936709] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-26T00:46:05.936805] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-26T00:46:05.936890] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-26T00:46:05.936959] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-26T00:46:22.493635] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-26T00:46:22.944569] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-26T00:46:22.944719] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-26T00:46:22.945977] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-26T00:46:22.946068] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-26T00:46:22.947791] [DEBUG] [LOCAL ] PII: Trimmed 71270 records to 49333 (keeping 200 days of data) [2025-10-26T00:46:23.261861] [DEBUG] [LOCAL ] PII: Primary data saved (49333 records). [2025-10-26T00:46:23.262031] [INFO ] [MAIN ] PII: Full history saved. [2025-10-26T00:46:23.262196] [INFO ] [MAIN ] Update Progress: 1681/2366 symbols. PII took 17.5s. Estimated remaining time: 2h 22m 3s [2025-10-26T00:46:23.427890] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:46:23.428106] [DEBUG] [LOCAL ] PIM: No existing data file found in primary storage. [2025-10-26T00:46:23.428178] [WARN ] [MAIN ] PIM: No existing data found, performing full refresh instead. [2025-10-26T00:46:23.428290] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-26T00:46:23.428361] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-26T00:46:23.428442] [DEBUG] [LOCAL ] PIM: No primary data file found to delete. [2025-10-26T00:46:23.428512] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-26T00:46:29.738353] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-26T00:46:30.085834] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-26T00:46:30.085948] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-26T00:46:30.086150] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-26T00:46:30.086224] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-26T00:46:30.086680] [DEBUG] [LOCAL ] PIM: Trimmed 6493 records to 4927 (keeping 200 days of data) [2025-10-26T00:46:30.123530] [DEBUG] [LOCAL ] PIM: Primary data saved (4927 records). [2025-10-26T00:46:30.123785] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-26T00:46:30.124048] [INFO ] [MAIN ] Update Progress: 1682/2366 symbols. PIM took 6.9s. Estimated remaining time: 2h 21m 48s [2025-10-26T00:46:30.306726] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:46:30.307063] [DEBUG] [LOCAL ] PINE: No existing data file found in primary storage. [2025-10-26T00:46:30.307142] [WARN ] [MAIN ] PINE: No existing data found, performing full refresh instead. [2025-10-26T00:46:30.307319] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-26T00:46:30.307396] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-26T00:46:30.307482] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-26T00:46:30.307586] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-26T00:46:40.319888] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-26T00:46:40.688875] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-26T00:46:40.689007] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-26T00:46:40.689469] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-26T00:46:40.689546] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-26T00:46:40.690334] [DEBUG] [LOCAL ] PINE: Trimmed 21080 records to 14657 (keeping 200 days of data) [2025-10-26T00:46:40.775467] [DEBUG] [LOCAL ] PINE: Primary data saved (14657 records). [2025-10-26T00:46:40.775625] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-26T00:46:40.775801] [INFO ] [MAIN ] Update Progress: 1683/2366 symbols. PINE took 10.7s. Estimated remaining time: 2h 21m 35s [2025-10-26T00:46:40.942199] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:46:40.942361] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-26T00:46:40.942432] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-26T00:46:40.942525] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-26T00:46:40.942591] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-26T00:46:40.942699] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-26T00:46:40.942754] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-26T00:47:01.275679] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-26T00:47:01.666965] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-26T00:47:01.667101] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-26T00:47:01.668280] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-26T00:47:01.668362] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-26T00:47:01.669910] [DEBUG] [LOCAL ] PINS: Trimmed 77871 records to 54473 (keeping 200 days of data) [2025-10-26T00:47:01.978303] [DEBUG] [LOCAL ] PINS: Primary data saved (54473 records). [2025-10-26T00:47:01.978465] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-26T00:47:01.978635] [INFO ] [MAIN ] Update Progress: 1684/2366 symbols. PINS took 21.2s. Estimated remaining time: 2h 21m 26s [2025-10-26T00:47:02.143617] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:47:02.143839] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-26T00:47:02.143910] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-26T00:47:02.144022] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-26T00:47:02.144093] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-26T00:47:02.144175] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-26T00:47:02.144244] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-26T00:47:11.955458] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-26T00:47:12.313238] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-26T00:47:12.313354] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-26T00:47:12.313846] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-26T00:47:12.313928] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-26T00:47:12.314510] [DEBUG] [LOCAL ] PIPR: Trimmed 20959 records to 15121 (keeping 200 days of data) [2025-10-26T00:47:12.409827] [DEBUG] [LOCAL ] PIPR: Primary data saved (15121 records). [2025-10-26T00:47:12.410060] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-26T00:47:12.410288] [INFO ] [MAIN ] Update Progress: 1685/2366 symbols. PIPR took 10.4s. Estimated remaining time: 2h 21m 13s [2025-10-26T00:47:12.604160] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:47:12.604378] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-26T00:47:12.604448] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-26T00:47:12.604560] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-26T00:47:12.604630] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-26T00:47:12.604730] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-26T00:47:12.604798] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-26T00:47:23.231384] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-26T00:47:23.604741] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-26T00:47:23.604851] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-26T00:47:23.605514] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-26T00:47:23.605589] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-26T00:47:23.606347] [DEBUG] [LOCAL ] PJT: Trimmed 32043 records to 21384 (keeping 200 days of data) [2025-10-26T00:47:23.735947] [DEBUG] [LOCAL ] PJT: Primary data saved (21384 records). [2025-10-26T00:47:23.736097] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-26T00:47:23.736268] [INFO ] [MAIN ] Update Progress: 1686/2366 symbols. PJT took 11.3s. Estimated remaining time: 2h 20m 60s [2025-10-26T00:47:23.907375] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:47:23.907602] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-26T00:47:23.907693] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-26T00:47:23.907809] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-26T00:47:23.907884] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-26T00:47:23.907964] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-26T00:47:23.908051] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-26T00:47:40.896224] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-26T00:47:41.275841] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-26T00:47:41.275962] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-26T00:47:41.277137] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-26T00:47:41.277226] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-26T00:47:41.278822] [DEBUG] [LOCAL ] PK: Trimmed 76531 records to 53520 (keeping 200 days of data) [2025-10-26T00:47:41.592153] [DEBUG] [LOCAL ] PK: Primary data saved (53520 records). [2025-10-26T00:47:41.592335] [INFO ] [MAIN ] PK: Full history saved. [2025-10-26T00:47:41.592602] [INFO ] [MAIN ] Update Progress: 1687/2366 symbols. PK took 17.9s. Estimated remaining time: 2h 20m 50s [2025-10-26T00:47:41.759511] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:47:41.759762] [DEBUG] [LOCAL ] PKE: No existing data file found in primary storage. [2025-10-26T00:47:41.759862] [WARN ] [MAIN ] PKE: No existing data found, performing full refresh instead. [2025-10-26T00:47:41.760011] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-26T00:47:41.760090] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-26T00:47:41.760194] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-26T00:47:41.760283] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-26T00:47:51.047355] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-26T00:47:51.404881] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-26T00:47:51.404989] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-26T00:47:51.405444] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-26T00:47:51.405522] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-26T00:47:51.406192] [DEBUG] [LOCAL ] PKE: Trimmed 18484 records to 14464 (keeping 200 days of data) [2025-10-26T00:47:51.489474] [DEBUG] [LOCAL ] PKE: Primary data saved (14464 records). [2025-10-26T00:47:51.489625] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-26T00:47:51.489811] [INFO ] [MAIN ] Update Progress: 1688/2366 symbols. PKE took 9.9s. Estimated remaining time: 2h 20m 36s [2025-10-26T00:47:51.654553] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:47:51.654768] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-26T00:47:51.654838] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-26T00:47:51.654957] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-26T00:47:51.655042] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-26T00:47:51.655127] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-26T00:47:51.655193] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-26T00:48:05.743265] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-26T00:48:06.122196] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-26T00:48:06.122309] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-26T00:48:06.123268] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-26T00:48:06.123349] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-26T00:48:06.124597] [DEBUG] [LOCAL ] PKG: Trimmed 57786 records to 39291 (keeping 200 days of data) [2025-10-26T00:48:06.362963] [DEBUG] [LOCAL ] PKG: Primary data saved (39291 records). [2025-10-26T00:48:06.363142] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-26T00:48:06.363289] [INFO ] [MAIN ] Update Progress: 1689/2366 symbols. PKG took 14.9s. Estimated remaining time: 2h 20m 25s [2025-10-26T00:48:06.532297] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:48:06.532514] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-26T00:48:06.532587] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-26T00:48:06.532700] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-26T00:48:06.532782] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-26T00:48:06.532867] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-26T00:48:06.532966] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-26T00:48:17.547869] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-26T00:48:17.921099] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-26T00:48:17.921216] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-26T00:48:17.921856] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-26T00:48:17.921943] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-26T00:48:17.922696] [DEBUG] [LOCAL ] PKST: Trimmed 28899 records to 18434 (keeping 200 days of data) [2025-10-26T00:48:18.029670] [DEBUG] [LOCAL ] PKST: Primary data saved (18434 records). [2025-10-26T00:48:18.029861] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-26T00:48:18.030035] [INFO ] [MAIN ] Update Progress: 1690/2366 symbols. PKST took 11.7s. Estimated remaining time: 2h 20m 12s [2025-10-26T00:48:18.200547] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:48:18.200759] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-26T00:48:18.200833] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-26T00:48:18.200947] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-26T00:48:18.201057] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-26T00:48:18.201142] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-26T00:48:18.201210] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-26T00:48:30.623931] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-26T00:48:31.001060] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-26T00:48:31.001189] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-26T00:48:31.002270] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-26T00:48:31.002356] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-26T00:48:31.003311] [DEBUG] [LOCAL ] PKX: Trimmed 35844 records to 22906 (keeping 200 days of data) [2025-10-26T00:48:31.136225] [DEBUG] [LOCAL ] PKX: Primary data saved (22906 records). [2025-10-26T00:48:31.136376] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-26T00:48:31.136567] [INFO ] [MAIN ] Update Progress: 1691/2366 symbols. PKX took 13.1s. Estimated remaining time: 2h 19m 60s [2025-10-26T00:48:31.306230] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:48:31.306415] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-26T00:48:31.306488] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-26T00:48:31.306625] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-26T00:48:31.306722] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-26T00:48:31.306803] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-26T00:48:31.306874] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-26T00:48:52.899390] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-26T00:48:53.290994] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-26T00:48:53.291120] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-26T00:48:53.292341] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-26T00:48:53.292427] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-26T00:48:53.293977] [DEBUG] [LOCAL ] PL: Trimmed 77131 records to 53992 (keeping 200 days of data) [2025-10-26T00:48:53.619500] [DEBUG] [LOCAL ] PL: Primary data saved (53992 records). [2025-10-26T00:48:53.619764] [INFO ] [MAIN ] PL: Full history saved. [2025-10-26T00:48:53.619986] [INFO ] [MAIN ] Update Progress: 1692/2366 symbols. PL took 22.5s. Estimated remaining time: 2h 19m 51s [2025-10-26T00:48:53.791112] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:48:53.791396] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-26T00:48:53.791473] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-26T00:48:53.791599] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-26T00:48:53.791697] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-26T00:48:53.791765] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-26T00:48:53.791833] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-26T00:49:11.331514] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-26T00:49:11.725321] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-26T00:49:11.725451] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-26T00:49:11.726921] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-26T00:49:11.727005] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-26T00:49:11.728765] [DEBUG] [LOCAL ] PLD: Trimmed 77504 records to 54188 (keeping 200 days of data) [2025-10-26T00:49:12.060942] [DEBUG] [LOCAL ] PLD: Primary data saved (54188 records). [2025-10-26T00:49:12.061099] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-26T00:49:12.061277] [INFO ] [MAIN ] Update Progress: 1693/2366 symbols. PLD took 18.4s. Estimated remaining time: 2h 19m 41s [2025-10-26T00:49:12.237233] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:49:12.237738] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-26T00:49:12.237813] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-26T00:49:12.237903] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-26T00:49:12.237970] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-26T00:49:12.238069] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-26T00:49:12.238140] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-26T00:49:28.220782] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-26T00:49:28.614143] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-26T00:49:28.614272] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-26T00:49:28.615438] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-26T00:49:28.615534] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-26T00:49:28.617137] [DEBUG] [LOCAL ] PLNT: Trimmed 70594 records to 48705 (keeping 200 days of data) [2025-10-26T00:49:28.891860] [DEBUG] [LOCAL ] PLNT: Primary data saved (48705 records). [2025-10-26T00:49:28.892027] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-26T00:49:28.892259] [INFO ] [MAIN ] Update Progress: 1694/2366 symbols. PLNT took 16.8s. Estimated remaining time: 2h 19m 31s [2025-10-26T00:49:29.070114] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:49:29.071539] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-26T00:49:29.071625] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-26T00:49:29.071852] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-26T00:49:29.071936] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-26T00:49:29.072050] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-26T00:49:29.072135] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-26T00:49:39.554367] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-26T00:49:39.949142] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-26T00:49:39.949259] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-26T00:49:39.949878] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-26T00:49:39.949957] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-26T00:49:39.950772] [DEBUG] [LOCAL ] PLOW: Trimmed 28100 records to 19817 (keeping 200 days of data) [2025-10-26T00:49:40.064935] [DEBUG] [LOCAL ] PLOW: Primary data saved (19817 records). [2025-10-26T00:49:40.065102] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-26T00:49:40.065335] [INFO ] [MAIN ] Update Progress: 1695/2366 symbols. PLOW took 11.2s. Estimated remaining time: 2h 19m 18s [2025-10-26T00:49:40.232131] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:49:40.232346] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-26T00:49:40.232422] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-26T00:49:40.232570] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-26T00:49:40.232805] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-26T00:49:40.232895] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-26T00:49:40.232971] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-26T00:49:53.738667] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-26T00:49:54.117276] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-26T00:49:54.117440] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-26T00:49:54.118390] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-26T00:49:54.118471] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-26T00:49:54.119691] [DEBUG] [LOCAL ] PLYM: Trimmed 48052 records to 34879 (keeping 200 days of data) [2025-10-26T00:49:54.320590] [DEBUG] [LOCAL ] PLYM: Primary data saved (34879 records). [2025-10-26T00:49:54.320763] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-26T00:49:54.320943] [INFO ] [MAIN ] Update Progress: 1696/2366 symbols. PLYM took 14.3s. Estimated remaining time: 2h 19m 6s [2025-10-26T00:49:54.491227] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:49:54.491421] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-26T00:49:54.491491] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-26T00:49:54.491582] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-26T00:49:54.491668] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-26T00:49:54.491762] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-26T00:49:54.491836] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-26T00:50:13.664833] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-26T00:50:14.056545] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-26T00:50:14.056691] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-26T00:50:14.057866] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-26T00:50:14.057947] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-26T00:50:14.059551] [DEBUG] [LOCAL ] PM: Trimmed 77834 records to 54454 (keeping 200 days of data) [2025-10-26T00:50:14.400620] [DEBUG] [LOCAL ] PM: Primary data saved (54454 records). [2025-10-26T00:50:14.400864] [INFO ] [MAIN ] PM: Full history saved. [2025-10-26T00:50:14.401053] [INFO ] [MAIN ] Update Progress: 1697/2366 symbols. PM took 20.1s. Estimated remaining time: 2h 18m 56s [2025-10-26T00:50:14.568228] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:50:14.568418] [DEBUG] [LOCAL ] PML: No existing data file found in primary storage. [2025-10-26T00:50:14.568489] [WARN ] [MAIN ] PML: No existing data found, performing full refresh instead. [2025-10-26T00:50:14.568603] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-26T00:50:14.568695] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-26T00:50:14.568791] [DEBUG] [LOCAL ] PML: No primary data file found to delete. [2025-10-26T00:50:14.568876] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-26T00:50:25.909623] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-26T00:50:26.277316] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-26T00:50:26.277449] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-26T00:50:26.278172] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-26T00:50:26.278251] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-26T00:50:26.279031] [DEBUG] [LOCAL ] PML: Trimmed 29791 records to 22205 (keeping 200 days of data) [2025-10-26T00:50:26.403539] [DEBUG] [LOCAL ] PML: Primary data saved (22205 records). [2025-10-26T00:50:26.403711] [INFO ] [MAIN ] PML: Full history saved. [2025-10-26T00:50:26.403877] [INFO ] [MAIN ] Update Progress: 1698/2366 symbols. PML took 12.0s. Estimated remaining time: 2h 18m 44s [2025-10-26T00:50:26.568152] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:50:26.568362] [DEBUG] [LOCAL ] PMM: No existing data file found in primary storage. [2025-10-26T00:50:26.568434] [WARN ] [MAIN ] PMM: No existing data found, performing full refresh instead. [2025-10-26T00:50:26.568566] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-26T00:50:26.568635] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-26T00:50:26.568739] [DEBUG] [LOCAL ] PMM: No primary data file found to delete. [2025-10-26T00:50:26.568805] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-26T00:50:35.419909] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-26T00:50:35.779380] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-26T00:50:35.779499] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-26T00:50:35.779902] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-26T00:50:35.779979] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-26T00:50:35.780518] [DEBUG] [LOCAL ] PMM: Trimmed 17395 records to 10173 (keeping 200 days of data) [2025-10-26T00:50:35.840128] [DEBUG] [LOCAL ] PMM: Primary data saved (10173 records). [2025-10-26T00:50:35.840305] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-26T00:50:35.840500] [INFO ] [MAIN ] Update Progress: 1699/2366 symbols. PMM took 9.4s. Estimated remaining time: 2h 18m 30s [2025-10-26T00:50:36.011302] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:50:36.011489] [DEBUG] [LOCAL ] PMO: No existing data file found in primary storage. [2025-10-26T00:50:36.011560] [WARN ] [MAIN ] PMO: No existing data found, performing full refresh instead. [2025-10-26T00:50:36.011701] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-26T00:50:36.011772] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-26T00:50:36.011859] [DEBUG] [LOCAL ] PMO: No primary data file found to delete. [2025-10-26T00:50:36.011926] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-26T00:50:44.814853] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-26T00:50:45.253515] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-26T00:50:45.253694] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-26T00:50:45.254180] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-26T00:50:45.254297] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-26T00:50:45.255100] [DEBUG] [LOCAL ] PMO: Trimmed 15822 records to 9502 (keeping 200 days of data) [2025-10-26T00:50:45.320538] [DEBUG] [LOCAL ] PMO: Primary data saved (9502 records). [2025-10-26T00:50:45.320718] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-26T00:50:45.320886] [INFO ] [MAIN ] Update Progress: 1700/2366 symbols. PMO took 9.5s. Estimated remaining time: 2h 18m 16s [2025-10-26T00:50:45.496569] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:50:45.496854] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-26T00:50:45.496930] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-26T00:50:45.497074] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-26T00:50:45.497148] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-26T00:50:45.497211] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-26T00:50:45.497276] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-26T00:51:00.042789] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-26T00:51:00.434758] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-26T00:51:00.434879] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-26T00:51:00.435948] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-26T00:51:00.436044] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-26T00:51:00.437302] [DEBUG] [LOCAL ] PMT: Trimmed 58819 records to 41398 (keeping 200 days of data) [2025-10-26T00:51:00.686390] [DEBUG] [LOCAL ] PMT: Primary data saved (41398 records). [2025-10-26T00:51:00.686584] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-26T00:51:00.686792] [INFO ] [MAIN ] Update Progress: 1701/2366 symbols. PMT took 15.4s. Estimated remaining time: 2h 18m 5s [2025-10-26T00:51:00.856454] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:00.856639] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-26T00:51:00.856743] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-26T00:51:00.856865] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-26T00:51:00.856937] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-26T00:51:00.857023] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-26T00:51:00.857097] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-26T00:51:04.997687] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-26T00:51:05.177868] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-26T00:51:05.178092] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:51:05.178168] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:51:05.178246] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-26T00:51:05.178339] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-26T00:51:05.178416] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-26T00:51:05.178496] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-26T00:51:05.178689] [INFO ] [MAIN ] Update Progress: 1702/2366 symbols. PMTU took 4.5s. Estimated remaining time: 2h 17m 50s [2025-10-26T00:51:05.347785] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:05.347970] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-26T00:51:05.348080] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-26T00:51:05.348201] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-26T00:51:05.348271] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-26T00:51:05.348329] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-26T00:51:05.348404] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-26T00:51:05.923266] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-26T00:51:05.923331] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:51:05.923402] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-26T00:51:05.923491] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-26T00:51:05.923558] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-26T00:51:05.923637] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-26T00:51:05.923805] [INFO ] [MAIN ] Update Progress: 1703/2366 symbols. PMTV took 0.7s. Estimated remaining time: 2h 17m 33s [2025-10-26T00:51:06.111486] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:06.111734] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-26T00:51:06.111805] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-26T00:51:06.111916] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-26T00:51:06.111983] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-26T00:51:06.112064] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-26T00:51:06.112130] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-26T00:51:06.696178] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-26T00:51:06.696243] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T00:51:06.696313] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-26T00:51:06.696404] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-26T00:51:06.696471] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-26T00:51:06.696550] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-26T00:51:06.696714] [INFO ] [MAIN ] Update Progress: 1704/2366 symbols. PMTW took 0.8s. Estimated remaining time: 2h 17m 16s [2025-10-26T00:51:06.869681] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:06.869947] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-26T00:51:06.870035] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-26T00:51:06.870170] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-26T00:51:06.870244] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-26T00:51:06.870325] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-26T00:51:06.870411] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-26T00:51:24.180783] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-26T00:51:24.579520] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-10-26T00:51:24.579678] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-10-26T00:51:24.580801] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-10-26T00:51:24.580888] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-10-26T00:51:24.582371] [DEBUG] [LOCAL ] PNC: Trimmed 75775 records to 52824 (keeping 200 days of data) [2025-10-26T00:51:24.903694] [DEBUG] [LOCAL ] PNC: Primary data saved (52824 records). [2025-10-26T00:51:24.903857] [INFO ] [MAIN ] PNC: Full history saved. [2025-10-26T00:51:24.903994] [INFO ] [MAIN ] Update Progress: 1705/2366 symbols. PNC took 18.2s. Estimated remaining time: 2h 17m 5s [2025-10-26T00:51:25.074053] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:25.074244] [DEBUG] [LOCAL ] PNI: No existing data file found in primary storage. [2025-10-26T00:51:25.074295] [WARN ] [MAIN ] PNI: No existing data found, performing full refresh instead. [2025-10-26T00:51:25.074376] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-26T00:51:25.074443] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-26T00:51:25.074525] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-26T00:51:25.074594] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-26T00:51:32.280981] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-26T00:51:32.636806] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-26T00:51:32.636917] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-26T00:51:32.637181] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-26T00:51:32.637254] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-26T00:51:32.637747] [DEBUG] [LOCAL ] PNI: Trimmed 9619 records to 6937 (keeping 200 days of data) [2025-10-26T00:51:32.676818] [DEBUG] [LOCAL ] PNI: Primary data saved (6937 records). [2025-10-26T00:51:32.676994] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-26T00:51:32.677161] [INFO ] [MAIN ] Update Progress: 1706/2366 symbols. PNI took 7.8s. Estimated remaining time: 2h 16m 51s [2025-10-26T00:51:32.849767] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:32.850109] [DEBUG] [LOCAL ] PNNT: No existing data file found in primary storage. [2025-10-26T00:51:32.850217] [WARN ] [MAIN ] PNNT: No existing data found, performing full refresh instead. [2025-10-26T00:51:32.850343] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-26T00:51:32.850422] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-26T00:51:32.850481] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-26T00:51:32.850549] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-26T00:51:47.128633] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-26T00:51:47.515378] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-26T00:51:47.515502] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-26T00:51:47.516481] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-26T00:51:47.516564] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-26T00:51:47.517758] [DEBUG] [LOCAL ] PNNT: Trimmed 47821 records to 33779 (keeping 200 days of data) [2025-10-26T00:51:47.715881] [DEBUG] [LOCAL ] PNNT: Primary data saved (33779 records). [2025-10-26T00:51:47.716060] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-26T00:51:47.716229] [INFO ] [MAIN ] Update Progress: 1707/2366 symbols. PNNT took 15.0s. Estimated remaining time: 2h 16m 40s [2025-10-26T00:51:47.894576] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:51:47.894834] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-26T00:51:47.894911] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-26T00:51:47.895028] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-26T00:51:47.895102] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-26T00:51:47.895166] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-26T00:51:47.895234] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-26T00:52:04.040501] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-26T00:52:04.448442] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-10-26T00:52:04.448592] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-10-26T00:52:04.449678] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-10-26T00:52:04.449763] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-10-26T00:52:04.451316] [DEBUG] [LOCAL ] PNR: Trimmed 69772 records to 48198 (keeping 200 days of data) [2025-10-26T00:52:04.745510] [DEBUG] [LOCAL ] PNR: Primary data saved (48198 records). [2025-10-26T00:52:04.745719] [INFO ] [MAIN ] PNR: Full history saved. [2025-10-26T00:52:04.745891] [INFO ] [MAIN ] Update Progress: 1708/2366 symbols. PNR took 17.0s. Estimated remaining time: 2h 16m 29s [2025-10-26T00:52:04.918054] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:52:04.918309] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-26T00:52:04.918382] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-26T00:52:04.918497] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-26T00:52:04.918567] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-26T00:52:04.918678] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-26T00:52:04.918752] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-26T00:52:19.663777] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-26T00:52:20.061314] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-26T00:52:20.061446] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-26T00:52:20.062490] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-26T00:52:20.062572] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-26T00:52:20.063995] [DEBUG] [LOCAL ] PNW: Trimmed 65986 records to 46156 (keeping 200 days of data) [2025-10-26T00:52:20.338663] [DEBUG] [LOCAL ] PNW: Primary data saved (46156 records). [2025-10-26T00:52:20.338829] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-26T00:52:20.339002] [INFO ] [MAIN ] Update Progress: 1709/2366 symbols. PNW took 15.6s. Estimated remaining time: 2h 16m 18s [2025-10-26T00:52:20.506693] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:52:20.506879] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-26T00:52:20.506949] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-26T00:52:20.507060] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-26T00:52:20.507162] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-26T00:52:20.507244] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-26T00:52:20.507311] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-26T00:52:36.653982] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-26T00:52:37.038448] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-26T00:52:37.038579] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-26T00:52:37.039698] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-26T00:52:37.039792] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-26T00:52:37.041245] [DEBUG] [LOCAL ] POR: Trimmed 68291 records to 47442 (keeping 200 days of data) [2025-10-26T00:52:37.324032] [DEBUG] [LOCAL ] POR: Primary data saved (47442 records). [2025-10-26T00:52:37.324217] [INFO ] [MAIN ] POR: Full history saved. [2025-10-26T00:52:37.324423] [INFO ] [MAIN ] Update Progress: 1710/2366 symbols. POR took 17.0s. Estimated remaining time: 2h 16m 7s [2025-10-26T00:52:37.493626] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:52:37.493851] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-26T00:52:37.493926] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-26T00:52:37.494038] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-26T00:52:37.494116] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-26T00:52:37.494229] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-26T00:52:37.494309] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-26T00:52:51.598692] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-26T00:52:51.985965] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-26T00:52:51.986088] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-26T00:52:51.987242] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-26T00:52:51.987330] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-26T00:52:51.988725] [DEBUG] [LOCAL ] POST: Trimmed 55481 records to 38919 (keeping 200 days of data) [2025-10-26T00:52:52.213727] [DEBUG] [LOCAL ] POST: Primary data saved (38919 records). [2025-10-26T00:52:52.213891] [INFO ] [MAIN ] POST: Full history saved. [2025-10-26T00:52:52.214056] [INFO ] [MAIN ] Update Progress: 1711/2366 symbols. POST took 14.9s. Estimated remaining time: 2h 15m 56s [2025-10-26T00:52:52.386867] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:52:52.387076] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-26T00:52:52.387152] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-26T00:52:52.387255] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-26T00:52:52.387331] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-26T00:52:52.387397] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-26T00:52:52.387498] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-26T00:53:09.385900] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-26T00:53:09.783838] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-26T00:53:09.784005] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-26T00:53:09.785907] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-26T00:53:09.785998] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-26T00:53:09.788052] [DEBUG] [LOCAL ] PPG: Trimmed 73878 records to 51199 (keeping 200 days of data) [2025-10-26T00:53:10.129774] [DEBUG] [LOCAL ] PPG: Primary data saved (51199 records). [2025-10-26T00:53:10.130011] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-26T00:53:10.130211] [INFO ] [MAIN ] Update Progress: 1712/2366 symbols. PPG took 17.9s. Estimated remaining time: 2h 15m 45s [2025-10-26T00:53:10.307801] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:53:10.308117] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-26T00:53:10.308192] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-26T00:53:10.308315] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-26T00:53:10.308391] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-26T00:53:10.308476] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-26T00:53:10.308549] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-26T00:53:27.742165] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-26T00:53:28.160740] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-10-26T00:53:28.160912] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-10-26T00:53:28.162841] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-10-26T00:53:28.162938] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-10-26T00:53:28.165185] [DEBUG] [LOCAL ] PPL: Trimmed 77630 records to 54284 (keeping 200 days of data) [2025-10-26T00:53:28.504807] [DEBUG] [LOCAL ] PPL: Primary data saved (54284 records). [2025-10-26T00:53:28.505037] [INFO ] [MAIN ] PPL: Full history saved. [2025-10-26T00:53:28.505294] [INFO ] [MAIN ] Update Progress: 1713/2366 symbols. PPL took 18.4s. Estimated remaining time: 2h 15m 35s [2025-10-26T00:53:28.682810] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:53:28.683126] [DEBUG] [LOCAL ] PPT: No existing data file found in primary storage. [2025-10-26T00:53:28.683207] [WARN ] [MAIN ] PPT: No existing data found, performing full refresh instead. [2025-10-26T00:53:28.683341] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-26T00:53:28.683418] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-26T00:53:28.683483] [DEBUG] [LOCAL ] PPT: No primary data file found to delete. [2025-10-26T00:53:28.683551] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-26T00:53:38.896739] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-26T00:53:39.329669] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-26T00:53:39.329790] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-26T00:53:39.330422] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-26T00:53:39.330504] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-26T00:53:39.331268] [DEBUG] [LOCAL ] PPT: Trimmed 28306 records to 19827 (keeping 200 days of data) [2025-10-26T00:53:39.439416] [DEBUG] [LOCAL ] PPT: Primary data saved (19827 records). [2025-10-26T00:53:39.439592] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-26T00:53:39.439821] [INFO ] [MAIN ] Update Progress: 1714/2366 symbols. PPT took 10.9s. Estimated remaining time: 2h 15m 22s [2025-10-26T00:53:39.610921] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:53:39.611140] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-26T00:53:39.611228] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-26T00:53:39.611364] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-26T00:53:39.611444] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-26T00:53:39.611553] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-26T00:53:39.611667] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-26T00:53:56.693241] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-26T00:53:57.102803] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-26T00:53:57.102955] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-26T00:53:57.104238] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-26T00:53:57.104323] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-26T00:53:57.105849] [DEBUG] [LOCAL ] PR: Trimmed 77762 records to 54390 (keeping 200 days of data) [2025-10-26T00:53:57.425127] [DEBUG] [LOCAL ] PR: Primary data saved (54390 records). [2025-10-26T00:53:57.425289] [INFO ] [MAIN ] PR: Full history saved. [2025-10-26T00:53:57.425454] [INFO ] [MAIN ] Update Progress: 1715/2366 symbols. PR took 18.0s. Estimated remaining time: 2h 15m 12s [2025-10-26T00:53:57.591213] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:53:57.591397] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-26T00:53:57.591467] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-26T00:53:57.591578] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-26T00:53:57.591670] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-26T00:53:57.591754] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-26T00:53:57.591823] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-26T00:54:10.871198] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-26T00:54:11.243069] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-26T00:54:11.243187] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-26T00:54:11.244085] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-26T00:54:11.244167] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-26T00:54:11.245172] [DEBUG] [LOCAL ] PRA: Trimmed 45333 records to 34809 (keeping 200 days of data) [2025-10-26T00:54:11.438214] [DEBUG] [LOCAL ] PRA: Primary data saved (34809 records). [2025-10-26T00:54:11.438382] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-26T00:54:11.438546] [INFO ] [MAIN ] Update Progress: 1716/2366 symbols. PRA took 14.0s. Estimated remaining time: 2h 14m 60s [2025-10-26T00:54:11.603174] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:54:11.603392] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-10-26T00:54:11.603465] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-10-26T00:54:11.603582] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-26T00:54:11.603675] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-26T00:54:11.603760] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-10-26T00:54:11.603830] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-26T00:54:16.802124] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-26T00:54:17.179620] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-26T00:54:17.179750] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-26T00:54:17.179914] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-26T00:54:17.180010] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-26T00:54:17.180456] [DEBUG] [LOCAL ] PRCS: Trimmed 3884 records to 2818 (keeping 200 days of data) [2025-10-26T00:54:17.196202] [DEBUG] [LOCAL ] PRCS: Primary data saved (2818 records). [2025-10-26T00:54:17.196286] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-26T00:54:17.196483] [INFO ] [MAIN ] Update Progress: 1717/2366 symbols. PRCS took 5.8s. Estimated remaining time: 2h 14m 45s [2025-10-26T00:54:17.361346] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:54:17.361520] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-26T00:54:17.361597] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-26T00:54:17.361733] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-26T00:54:17.361809] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-26T00:54:17.361958] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-26T00:54:17.362027] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-26T00:54:30.277598] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-26T00:54:30.653243] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-26T00:54:30.653355] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-26T00:54:30.654220] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-26T00:54:30.654301] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-26T00:54:30.655342] [DEBUG] [LOCAL ] PRG: Trimmed 44607 records to 30188 (keeping 200 days of data) [2025-10-26T00:54:30.830920] [DEBUG] [LOCAL ] PRG: Primary data saved (30188 records). [2025-10-26T00:54:30.831103] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-26T00:54:30.831274] [INFO ] [MAIN ] Update Progress: 1718/2366 symbols. PRG took 13.6s. Estimated remaining time: 2h 14m 33s [2025-10-26T00:54:30.999218] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:54:30.999438] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-26T00:54:30.999512] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-26T00:54:30.999684] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-26T00:54:30.999759] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-26T00:54:30.999843] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-26T00:54:30.999913] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-26T00:54:45.958106] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-26T00:54:46.335210] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-26T00:54:46.335348] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-26T00:54:46.336460] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-26T00:54:46.336544] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-26T00:54:46.337984] [DEBUG] [LOCAL ] PRGO: Trimmed 68855 records to 47793 (keeping 200 days of data) [2025-10-26T00:54:46.622759] [DEBUG] [LOCAL ] PRGO: Primary data saved (47793 records). [2025-10-26T00:54:46.623069] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-26T00:54:46.623244] [INFO ] [MAIN ] Update Progress: 1719/2366 symbols. PRGO took 15.8s. Estimated remaining time: 2h 14m 22s [2025-10-26T00:54:46.792499] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:54:46.792740] [DEBUG] [LOCAL ] PRH: No existing data file found in primary storage. [2025-10-26T00:54:46.792815] [WARN ] [MAIN ] PRH: No existing data found, performing full refresh instead. [2025-10-26T00:54:46.792951] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-26T00:54:46.793040] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-26T00:54:46.793168] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-26T00:54:46.793238] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-26T00:54:53.423205] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-26T00:54:53.811472] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-26T00:54:53.811680] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-26T00:54:53.812053] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-26T00:54:53.812145] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-26T00:54:53.813166] [DEBUG] [LOCAL ] PRH: Trimmed 7418 records to 4728 (keeping 200 days of data) [2025-10-26T00:54:53.846693] [DEBUG] [LOCAL ] PRH: Primary data saved (4728 records). [2025-10-26T00:54:53.846954] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-26T00:54:53.847188] [INFO ] [MAIN ] Update Progress: 1720/2366 symbols. PRH took 7.2s. Estimated remaining time: 2h 14m 7s [2025-10-26T00:54:54.028079] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:54:54.028394] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-26T00:54:54.028493] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-26T00:54:54.028635] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-26T00:54:54.028725] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-26T00:54:54.028792] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-26T00:54:54.028860] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-26T00:55:04.514146] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-26T00:55:04.939556] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-26T00:55:04.939857] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-26T00:55:04.940483] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-26T00:55:04.940564] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-26T00:55:04.941268] [DEBUG] [LOCAL ] PRI: Trimmed 25573 records to 17931 (keeping 200 days of data) [2025-10-26T00:55:05.049931] [DEBUG] [LOCAL ] PRI: Primary data saved (17931 records). [2025-10-26T00:55:05.050106] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-26T00:55:05.050274] [INFO ] [MAIN ] Update Progress: 1721/2366 symbols. PRI took 11.2s. Estimated remaining time: 2h 13m 54s [2025-10-26T00:55:05.220404] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:55:05.220713] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-26T00:55:05.220793] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-26T00:55:05.220907] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-26T00:55:05.220981] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-26T00:55:05.221064] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-26T00:55:05.221137] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-26T00:55:22.112064] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-26T00:55:22.673985] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-26T00:55:22.674145] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-26T00:55:22.675391] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-26T00:55:22.675502] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-26T00:55:22.676992] [DEBUG] [LOCAL ] PRIM: Trimmed 63882 records to 44712 (keeping 200 days of data) [2025-10-26T00:55:22.951353] [DEBUG] [LOCAL ] PRIM: Primary data saved (44712 records). [2025-10-26T00:55:22.951525] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-26T00:55:22.951719] [INFO ] [MAIN ] Update Progress: 1722/2366 symbols. PRIM took 17.9s. Estimated remaining time: 2h 13m 44s [2025-10-26T00:55:23.119185] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:55:23.119389] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-26T00:55:23.119461] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-26T00:55:23.119574] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-26T00:55:23.119664] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-26T00:55:23.119755] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-26T00:55:23.119821] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-26T00:55:38.016955] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-26T00:55:38.393460] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-26T00:55:38.393578] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-26T00:55:38.394571] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-26T00:55:38.394675] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-26T00:55:38.396002] [DEBUG] [LOCAL ] PRKS: Trimmed 61523 records to 42803 (keeping 200 days of data) [2025-10-26T00:55:38.629292] [DEBUG] [LOCAL ] PRKS: Primary data saved (42803 records). [2025-10-26T00:55:38.629442] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-26T00:55:38.629584] [INFO ] [MAIN ] Update Progress: 1723/2366 symbols. PRKS took 15.7s. Estimated remaining time: 2h 13m 32s [2025-10-26T00:55:38.793564] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:55:38.793765] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-26T00:55:38.793837] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-26T00:55:38.793947] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-26T00:55:38.794018] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-26T00:55:38.794103] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-26T00:55:38.794193] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-26T00:55:49.434427] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-26T00:55:49.804513] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-26T00:55:49.804633] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-26T00:55:49.805307] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-26T00:55:49.805385] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-26T00:55:49.806141] [DEBUG] [LOCAL ] PRLB: Trimmed 30473 records to 20576 (keeping 200 days of data) [2025-10-26T00:55:49.919365] [DEBUG] [LOCAL ] PRLB: Primary data saved (20576 records). [2025-10-26T00:55:49.919524] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-26T00:55:49.919708] [INFO ] [MAIN ] Update Progress: 1724/2366 symbols. PRLB took 11.3s. Estimated remaining time: 2h 13m 20s [2025-10-26T00:55:50.084954] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:55:50.085112] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-26T00:55:50.085185] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-26T00:55:50.085297] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-26T00:55:50.085370] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-26T00:55:50.085453] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-26T00:55:50.085526] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-26T00:56:05.655485] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-26T00:56:06.078246] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-26T00:56:06.078506] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-26T00:56:06.081021] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-26T00:56:06.081129] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-26T00:56:06.083457] [DEBUG] [LOCAL ] PRM: Trimmed 64861 records to 44919 (keeping 200 days of data) [2025-10-26T00:56:06.358160] [DEBUG] [LOCAL ] PRM: Primary data saved (44919 records). [2025-10-26T00:56:06.358405] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-26T00:56:06.358690] [INFO ] [MAIN ] Update Progress: 1725/2366 symbols. PRM took 16.4s. Estimated remaining time: 2h 13m 9s [2025-10-26T00:56:06.532085] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:56:06.532297] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-26T00:56:06.532371] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-26T00:56:06.532489] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-26T00:56:06.532565] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-26T00:56:06.532672] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-26T00:56:06.532745] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-26T00:56:24.179197] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-26T00:56:24.563941] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-26T00:56:24.564052] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-26T00:56:24.565157] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-26T00:56:24.565237] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-26T00:56:24.566603] [DEBUG] [LOCAL ] PRMB: Trimmed 76301 records to 53853 (keeping 200 days of data) [2025-10-26T00:56:24.879153] [DEBUG] [LOCAL ] PRMB: Primary data saved (53853 records). [2025-10-26T00:56:24.879392] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-26T00:56:24.879600] [INFO ] [MAIN ] Update Progress: 1726/2366 symbols. PRMB took 18.5s. Estimated remaining time: 2h 12m 58s [2025-10-26T00:56:25.045589] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:56:25.045794] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-26T00:56:25.045865] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-26T00:56:25.045954] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-26T00:56:25.046020] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-26T00:56:25.046080] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-26T00:56:25.046143] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-26T00:56:39.642621] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-26T00:56:40.016088] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-26T00:56:40.016198] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-26T00:56:40.017125] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-26T00:56:40.017204] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-26T00:56:40.018365] [DEBUG] [LOCAL ] PRO: Trimmed 54064 records to 40709 (keeping 200 days of data) [2025-10-26T00:56:40.245981] [DEBUG] [LOCAL ] PRO: Primary data saved (40709 records). [2025-10-26T00:56:40.246165] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-26T00:56:40.246356] [INFO ] [MAIN ] Update Progress: 1727/2366 symbols. PRO took 15.4s. Estimated remaining time: 2h 12m 47s [2025-10-26T00:56:40.411512] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:56:40.411674] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-26T00:56:40.411747] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-26T00:56:40.411874] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-26T00:56:40.411950] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-26T00:56:40.412030] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-26T00:56:40.412098] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-26T00:56:51.696320] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-10-26T00:56:52.078528] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-10-26T00:56:52.078666] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-10-26T00:56:52.079367] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-10-26T00:56:52.079437] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-10-26T00:56:52.080257] [DEBUG] [LOCAL ] PRSU: Trimmed 34158 records to 23312 (keeping 200 days of data) [2025-10-26T00:56:52.212363] [DEBUG] [LOCAL ] PRSU: Primary data saved (23312 records). [2025-10-26T00:56:52.212548] [INFO ] [MAIN ] PRSU: Full history saved. [2025-10-26T00:56:52.212721] [INFO ] [MAIN ] Update Progress: 1728/2366 symbols. PRSU took 12.0s. Estimated remaining time: 2h 12m 34s [2025-10-26T00:56:52.387016] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:56:52.387264] [DEBUG] [LOCAL ] PRT: No existing data file found in primary storage. [2025-10-26T00:56:52.387337] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-10-26T00:56:52.387427] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-26T00:56:52.387495] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-26T00:56:52.387555] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-26T00:56:52.387619] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-26T00:56:59.263531] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-26T00:56:59.621515] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-26T00:56:59.621622] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-26T00:56:59.621881] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-26T00:56:59.621963] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-26T00:56:59.622393] [DEBUG] [LOCAL ] PRT: Trimmed 8434 records to 5120 (keeping 200 days of data) [2025-10-26T00:56:59.650741] [DEBUG] [LOCAL ] PRT: Primary data saved (5120 records). [2025-10-26T00:56:59.650858] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-26T00:56:59.650999] [INFO ] [MAIN ] Update Progress: 1729/2366 symbols. PRT took 7.4s. Estimated remaining time: 2h 12m 20s [2025-10-26T00:56:59.820888] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:56:59.821098] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-26T00:56:59.821172] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-26T00:56:59.821292] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-26T00:56:59.821364] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-26T00:56:59.821453] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-26T00:56:59.821520] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-26T00:57:17.162231] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-26T00:57:17.548886] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-26T00:57:17.549006] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-26T00:57:17.550116] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-26T00:57:17.550199] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-26T00:57:17.551582] [DEBUG] [LOCAL ] PRU: Trimmed 74558 records to 51847 (keeping 200 days of data) [2025-10-26T00:57:17.862575] [DEBUG] [LOCAL ] PRU: Primary data saved (51847 records). [2025-10-26T00:57:17.862763] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-26T00:57:17.862927] [INFO ] [MAIN ] Update Progress: 1730/2366 symbols. PRU took 18.2s. Estimated remaining time: 2h 12m 10s [2025-10-26T00:57:18.035212] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:57:18.035389] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-26T00:57:18.035460] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-26T00:57:18.035572] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-26T00:57:18.035662] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-26T00:57:18.035743] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-26T00:57:18.035812] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-26T00:57:21.949028] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-26T00:57:22.129858] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-26T00:57:22.130084] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-26T00:57:22.130157] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-26T00:57:22.130211] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-26T00:57:22.130296] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-26T00:57:22.130369] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-26T00:57:22.130449] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-26T00:57:22.130583] [INFO ] [MAIN ] Update Progress: 1731/2366 symbols. PRVS took 4.3s. Estimated remaining time: 2h 11m 54s [2025-10-26T00:57:22.314822] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:57:22.315049] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-26T00:57:22.315121] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-26T00:57:22.315239] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-26T00:57:22.315316] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-26T00:57:22.315408] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-26T00:57:22.315479] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-26T00:57:38.217793] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-26T00:57:38.598346] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-26T00:57:38.598487] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-26T00:57:38.599571] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-26T00:57:38.599694] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-26T00:57:38.600921] [DEBUG] [LOCAL ] PSA: Trimmed 59675 records to 42639 (keeping 200 days of data) [2025-10-26T00:57:38.853743] [DEBUG] [LOCAL ] PSA: Primary data saved (42639 records). [2025-10-26T00:57:38.853906] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-26T00:57:38.854087] [INFO ] [MAIN ] Update Progress: 1732/2366 symbols. PSA took 16.7s. Estimated remaining time: 2h 11m 43s [2025-10-26T00:57:39.024338] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:57:39.024596] [DEBUG] [LOCAL ] PSBD: No existing data file found in primary storage. [2025-10-26T00:57:39.024725] [WARN ] [MAIN ] PSBD: No existing data found, performing full refresh instead. [2025-10-26T00:57:39.024865] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-26T00:57:39.024957] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-26T00:57:39.025066] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-26T00:57:39.025179] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-26T00:57:46.706808] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-26T00:57:47.073351] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-26T00:57:47.073462] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-26T00:57:47.073781] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-26T00:57:47.073858] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-26T00:57:47.074341] [DEBUG] [LOCAL ] PSBD: Trimmed 11004 records to 8353 (keeping 200 days of data) [2025-10-26T00:57:47.122862] [DEBUG] [LOCAL ] PSBD: Primary data saved (8353 records). [2025-10-26T00:57:47.122999] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-26T00:57:47.123164] [INFO ] [MAIN ] Update Progress: 1733/2366 symbols. PSBD took 8.3s. Estimated remaining time: 2h 11m 29s [2025-10-26T00:57:47.297579] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:57:47.297998] [DEBUG] [LOCAL ] PSF: No existing data file found in primary storage. [2025-10-26T00:57:47.298096] [WARN ] [MAIN ] PSF: No existing data found, performing full refresh instead. [2025-10-26T00:57:47.298209] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-26T00:57:47.298284] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-26T00:57:47.298375] [DEBUG] [LOCAL ] PSF: No primary data file found to delete. [2025-10-26T00:57:47.298460] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-26T00:57:54.796349] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-26T00:57:55.151231] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-26T00:57:55.151345] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-26T00:57:55.151602] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-26T00:57:55.151703] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-26T00:57:55.152164] [DEBUG] [LOCAL ] PSF: Trimmed 9639 records to 6996 (keeping 200 days of data) [2025-10-26T00:57:55.192882] [DEBUG] [LOCAL ] PSF: Primary data saved (6996 records). [2025-10-26T00:57:55.193014] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-26T00:57:55.193177] [INFO ] [MAIN ] Update Progress: 1734/2366 symbols. PSF took 8.1s. Estimated remaining time: 2h 11m 15s [2025-10-26T00:57:55.368400] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:57:55.368566] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-26T00:57:55.368677] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-26T00:57:55.368820] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-26T00:57:55.368918] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-26T00:57:55.369028] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-26T00:57:55.369113] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-26T00:58:08.795892] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-26T00:58:09.238366] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-26T00:58:09.238542] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-26T00:58:09.239957] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-26T00:58:09.240046] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-26T00:58:09.241593] [DEBUG] [LOCAL ] PSFE: Trimmed 43061 records to 29936 (keeping 200 days of data) [2025-10-26T00:58:09.418978] [DEBUG] [LOCAL ] PSFE: Primary data saved (29936 records). [2025-10-26T00:58:09.419213] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-26T00:58:09.419475] [INFO ] [MAIN ] Update Progress: 1735/2366 symbols. PSFE took 14.2s. Estimated remaining time: 2h 11m 3s [2025-10-26T00:58:09.593568] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:58:09.593858] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-26T00:58:09.593934] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-26T00:58:09.594063] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-26T00:58:09.594136] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-26T00:58:09.594221] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-26T00:58:09.594295] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-26T00:58:25.916115] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-26T00:58:26.315773] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-26T00:58:26.315890] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-26T00:58:26.316916] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-26T00:58:26.316996] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-26T00:58:26.318317] [DEBUG] [LOCAL ] PSN: Trimmed 66722 records to 45674 (keeping 200 days of data) [2025-10-26T00:58:26.582822] [DEBUG] [LOCAL ] PSN: Primary data saved (45674 records). [2025-10-26T00:58:26.583001] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-26T00:58:26.583172] [INFO ] [MAIN ] Update Progress: 1736/2366 symbols. PSN took 17.2s. Estimated remaining time: 2h 10m 53s [2025-10-26T00:58:26.764525] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:58:26.764799] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-26T00:58:26.764874] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-26T00:58:26.764990] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-26T00:58:26.765062] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-26T00:58:26.765146] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-26T00:58:26.765220] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-26T00:58:43.104571] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-26T00:58:43.479992] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-26T00:58:43.480115] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-26T00:58:43.481142] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-26T00:58:43.481227] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-26T00:58:43.482376] [DEBUG] [LOCAL ] PSO: Trimmed 52825 records to 37103 (keeping 200 days of data) [2025-10-26T00:58:43.698048] [DEBUG] [LOCAL ] PSO: Primary data saved (37103 records). [2025-10-26T00:58:43.698221] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-26T00:58:43.698511] [INFO ] [MAIN ] Update Progress: 1737/2366 symbols. PSO took 17.1s. Estimated remaining time: 2h 10m 42s [2025-10-26T00:58:43.875592] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:58:43.875857] [DEBUG] [LOCAL ] PSQH: No existing data file found in primary storage. [2025-10-26T00:58:43.875930] [WARN ] [MAIN ] PSQH: No existing data found, performing full refresh instead. [2025-10-26T00:58:43.876044] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-26T00:58:43.876115] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-26T00:58:43.876195] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-26T00:58:43.876280] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-26T00:58:59.785426] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-26T00:59:00.193882] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-26T00:59:00.193994] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-26T00:59:00.194969] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-26T00:59:00.195049] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-26T00:59:00.196077] [DEBUG] [LOCAL ] PSQH: Trimmed 53240 records to 35963 (keeping 200 days of data) [2025-10-26T00:59:00.385915] [DEBUG] [LOCAL ] PSQH: Primary data saved (35963 records). [2025-10-26T00:59:00.386072] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-26T00:59:00.386234] [INFO ] [MAIN ] Update Progress: 1738/2366 symbols. PSQH took 16.7s. Estimated remaining time: 2h 10m 31s [2025-10-26T00:59:00.557285] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:59:00.557479] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-26T00:59:00.557550] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-26T00:59:00.557637] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-26T00:59:00.557737] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-26T00:59:00.557818] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-26T00:59:00.557887] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-26T00:59:19.750402] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-26T00:59:20.142300] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-26T00:59:20.142420] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-26T00:59:20.143531] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-26T00:59:20.143613] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-26T00:59:20.145049] [DEBUG] [LOCAL ] PSTG: Trimmed 76684 records to 53584 (keeping 200 days of data) [2025-10-26T00:59:20.451733] [DEBUG] [LOCAL ] PSTG: Primary data saved (53584 records). [2025-10-26T00:59:20.451908] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-26T00:59:20.452081] [INFO ] [MAIN ] Update Progress: 1739/2366 symbols. PSTG took 20.1s. Estimated remaining time: 2h 10m 21s [2025-10-26T00:59:20.620554] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:59:20.620788] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-26T00:59:20.620861] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-26T00:59:20.620975] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-26T00:59:20.621047] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-26T00:59:20.621128] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-26T00:59:20.621199] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-26T00:59:31.378749] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-26T00:59:31.765253] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-26T00:59:31.765380] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-26T00:59:31.766122] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-26T00:59:31.766208] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-26T00:59:31.767046] [DEBUG] [LOCAL ] PSTL: Trimmed 29312 records to 20106 (keeping 200 days of data) [2025-10-26T00:59:31.895985] [DEBUG] [LOCAL ] PSTL: Primary data saved (20106 records). [2025-10-26T00:59:31.896147] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-26T00:59:31.896320] [INFO ] [MAIN ] Update Progress: 1740/2366 symbols. PSTL took 11.4s. Estimated remaining time: 2h 10m 8s [2025-10-26T00:59:32.070693] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:59:32.070892] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-26T00:59:32.070967] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-26T00:59:32.071083] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-26T00:59:32.071176] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-26T00:59:32.071261] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-26T00:59:32.071333] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-26T00:59:49.602803] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-26T00:59:49.998842] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-26T00:59:49.998956] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-26T00:59:50.000058] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-26T00:59:50.000139] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-26T00:59:50.001558] [DEBUG] [LOCAL ] PSX: Trimmed 77127 records to 53890 (keeping 200 days of data) [2025-10-26T00:59:50.325274] [DEBUG] [LOCAL ] PSX: Primary data saved (53890 records). [2025-10-26T00:59:50.325434] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-26T00:59:50.325595] [INFO ] [MAIN ] Update Progress: 1741/2366 symbols. PSX took 18.4s. Estimated remaining time: 2h 9m 58s [2025-10-26T00:59:50.493966] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T00:59:50.494184] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-26T00:59:50.494257] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-26T00:59:50.494375] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-26T00:59:50.494447] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-26T00:59:50.494529] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-26T00:59:50.494598] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-26T01:00:00.461620] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-26T01:00:00.819771] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-26T01:00:00.819892] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-26T01:00:00.820431] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-26T01:00:00.820515] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-26T01:00:00.821174] [DEBUG] [LOCAL ] PTA: Trimmed 22741 records to 15775 (keeping 200 days of data) [2025-10-26T01:00:00.912199] [DEBUG] [LOCAL ] PTA: Primary data saved (15775 records). [2025-10-26T01:00:00.912357] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-26T01:00:00.912528] [INFO ] [MAIN ] Update Progress: 1742/2366 symbols. PTA took 10.6s. Estimated remaining time: 2h 9m 45s [2025-10-26T01:00:01.082616] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:00:01.082799] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-26T01:00:01.082870] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-26T01:00:01.082981] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-26T01:00:01.083051] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-26T01:00:01.083131] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-26T01:00:01.083201] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-26T01:00:17.463707] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-26T01:00:17.881627] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-26T01:00:17.881766] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-26T01:00:17.882869] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-26T01:00:17.882953] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-26T01:00:17.884146] [DEBUG] [LOCAL ] PTY: Trimmed 54593 records to 38464 (keeping 200 days of data) [2025-10-26T01:00:18.125568] [DEBUG] [LOCAL ] PTY: Primary data saved (38464 records). [2025-10-26T01:00:18.125822] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-26T01:00:18.126023] [INFO ] [MAIN ] Update Progress: 1743/2366 symbols. PTY took 17.2s. Estimated remaining time: 2h 9m 34s [2025-10-26T01:00:18.312565] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:00:18.312817] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-26T01:00:18.312892] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-26T01:00:18.313006] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-26T01:00:18.313079] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-26T01:00:18.313162] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-26T01:00:18.313233] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-26T01:00:36.125342] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-26T01:00:36.509118] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-26T01:00:36.509263] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-26T01:00:36.510286] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-26T01:00:36.510368] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-26T01:00:36.511705] [DEBUG] [LOCAL ] PUK: Trimmed 65297 records to 44998 (keeping 200 days of data) [2025-10-26T01:00:36.772259] [DEBUG] [LOCAL ] PUK: Primary data saved (44998 records). [2025-10-26T01:00:36.772412] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-26T01:00:36.772582] [INFO ] [MAIN ] Update Progress: 1744/2366 symbols. PUK took 18.6s. Estimated remaining time: 2h 9m 24s [2025-10-26T01:00:36.942985] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:00:36.943184] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-26T01:00:36.943263] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-26T01:00:36.943382] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-26T01:00:36.943456] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-26T01:00:36.943539] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-26T01:00:36.943610] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-26T01:00:53.283152] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-26T01:00:53.696535] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-26T01:00:53.696718] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-26T01:00:53.697888] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-26T01:00:53.697973] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-26T01:00:53.699444] [DEBUG] [LOCAL ] PUMP: Trimmed 71794 records to 50189 (keeping 200 days of data) [2025-10-26T01:00:53.970061] [DEBUG] [LOCAL ] PUMP: Primary data saved (50189 records). [2025-10-26T01:00:53.970233] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-26T01:00:53.970403] [INFO ] [MAIN ] Update Progress: 1745/2366 symbols. PUMP took 17.2s. Estimated remaining time: 2h 9m 13s [2025-10-26T01:00:54.137083] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:00:54.137321] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-26T01:00:54.137396] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-26T01:00:54.137517] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-26T01:00:54.137589] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-26T01:00:54.137704] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-26T01:00:54.137776] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-26T01:01:11.056845] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-26T01:01:11.455070] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-26T01:01:11.455195] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-26T01:01:11.456224] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-26T01:01:11.456303] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-26T01:01:11.457671] [DEBUG] [LOCAL ] PVH: Trimmed 70777 records to 50019 (keeping 200 days of data) [2025-10-26T01:01:11.748977] [DEBUG] [LOCAL ] PVH: Primary data saved (50019 records). [2025-10-26T01:01:11.749149] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-26T01:01:11.749294] [INFO ] [MAIN ] Update Progress: 1746/2366 symbols. PVH took 17.8s. Estimated remaining time: 2h 9m 2s [2025-10-26T01:01:11.914741] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:01:11.914935] [DEBUG] [LOCAL ] PVL: No existing data file found in primary storage. [2025-10-26T01:01:11.915005] [WARN ] [MAIN ] PVL: No existing data found, performing full refresh instead. [2025-10-26T01:01:11.915118] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-26T01:01:11.915189] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-26T01:01:11.915269] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-26T01:01:11.915338] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-26T01:01:18.416816] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-26T01:01:18.799300] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-26T01:01:18.799454] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-26T01:01:18.799798] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-26T01:01:18.799879] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-26T01:01:18.800393] [DEBUG] [LOCAL ] PVL: Trimmed 7059 records to 4793 (keeping 200 days of data) [2025-10-26T01:01:18.829113] [DEBUG] [LOCAL ] PVL: Primary data saved (4793 records). [2025-10-26T01:01:18.829302] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-26T01:01:18.829514] [INFO ] [MAIN ] Update Progress: 1747/2366 symbols. PVL took 7.1s. Estimated remaining time: 2h 8m 48s [2025-10-26T01:01:19.019236] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:01:19.019520] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-26T01:01:19.019594] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-26T01:01:19.019742] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-26T01:01:19.019816] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-26T01:01:19.019898] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-26T01:01:19.019970] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-26T01:01:35.849342] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-26T01:01:36.238235] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-26T01:01:36.238454] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-26T01:01:36.239579] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-26T01:01:36.239697] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-26T01:01:36.241089] [DEBUG] [LOCAL ] PWR: Trimmed 69117 records to 47102 (keeping 200 days of data) [2025-10-26T01:01:36.531447] [DEBUG] [LOCAL ] PWR: Primary data saved (47102 records). [2025-10-26T01:01:36.531608] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-26T01:01:36.531790] [INFO ] [MAIN ] Update Progress: 1748/2366 symbols. PWR took 17.7s. Estimated remaining time: 2h 8m 37s [2025-10-26T01:01:36.697217] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:01:36.697426] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-26T01:01:36.697497] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-26T01:01:36.697663] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-26T01:01:36.697737] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-26T01:01:36.697816] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-26T01:01:36.697885] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-26T01:01:51.269462] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-26T01:01:51.648519] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-26T01:01:51.648662] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-26T01:01:51.649535] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-26T01:01:51.649606] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-26T01:01:51.650727] [DEBUG] [LOCAL ] PX: Trimmed 49576 records to 34249 (keeping 200 days of data) [2025-10-26T01:01:51.850052] [DEBUG] [LOCAL ] PX: Primary data saved (34249 records). [2025-10-26T01:01:51.850217] [INFO ] [MAIN ] PX: Full history saved. [2025-10-26T01:01:51.850384] [INFO ] [MAIN ] Update Progress: 1749/2366 symbols. PX took 15.3s. Estimated remaining time: 2h 8m 26s [2025-10-26T01:01:52.020913] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:01:52.021109] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-26T01:01:52.021180] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-26T01:01:52.021295] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-26T01:01:52.021369] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-26T01:01:52.021451] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-26T01:01:52.021521] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-26T01:01:52.617214] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-26T01:01:52.617306] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:01:52.617383] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-26T01:01:52.617486] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-26T01:01:52.617560] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-26T01:01:52.617665] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-26T01:01:52.617825] [INFO ] [MAIN ] Update Progress: 1750/2366 symbols. PXED took 0.8s. Estimated remaining time: 2h 8m 9s [2025-10-26T01:01:52.790506] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:01:52.790735] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-26T01:01:52.790810] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-26T01:01:52.790925] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-26T01:01:52.790997] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-26T01:01:52.791090] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-26T01:01:52.791178] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-26T01:02:19.022215] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-26T01:02:19.405205] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-10-26T01:02:19.405325] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-10-26T01:02:19.406461] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-10-26T01:02:19.406544] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-10-26T01:02:19.408036] [DEBUG] [LOCAL ] QBTS: Trimmed 77923 records to 54600 (keeping 200 days of data) [2025-10-26T01:02:19.723949] [DEBUG] [LOCAL ] QBTS: Primary data saved (54600 records). [2025-10-26T01:02:19.724142] [INFO ] [MAIN ] QBTS: Full history saved. [2025-10-26T01:02:19.724321] [INFO ] [MAIN ] Update Progress: 1751/2366 symbols. QBTS took 27.1s. Estimated remaining time: 2h 8m 2s [2025-10-26T01:02:19.891426] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:02:19.891622] [DEBUG] [LOCAL ] QD: No existing data file found in primary storage. [2025-10-26T01:02:19.891717] [WARN ] [MAIN ] QD: No existing data found, performing full refresh instead. [2025-10-26T01:02:19.891828] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-26T01:02:19.891901] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-26T01:02:19.891987] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-26T01:02:19.892057] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-26T01:02:32.305001] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-26T01:02:32.685774] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-26T01:02:32.685919] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-26T01:02:32.686882] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-26T01:02:32.686964] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-26T01:02:32.687994] [DEBUG] [LOCAL ] QD: Trimmed 39796 records to 27746 (keeping 200 days of data) [2025-10-26T01:02:32.836240] [DEBUG] [LOCAL ] QD: Primary data saved (27746 records). [2025-10-26T01:02:32.836399] [INFO ] [MAIN ] QD: Full history saved. [2025-10-26T01:02:32.836599] [INFO ] [MAIN ] Update Progress: 1752/2366 symbols. QD took 13.1s. Estimated remaining time: 2h 7m 50s [2025-10-26T01:02:33.004337] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:02:33.004540] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-26T01:02:33.004612] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-26T01:02:33.004754] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-26T01:02:33.004835] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-26T01:02:33.004918] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-26T01:02:33.004997] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-26T01:02:50.564047] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-26T01:02:50.947718] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-26T01:02:50.947843] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-26T01:02:50.948971] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-26T01:02:50.949052] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-26T01:02:50.950415] [DEBUG] [LOCAL ] QGEN: Trimmed 70702 records to 49728 (keeping 200 days of data) [2025-10-26T01:02:51.236882] [DEBUG] [LOCAL ] QGEN: Primary data saved (49728 records). [2025-10-26T01:02:51.237038] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-26T01:02:51.237208] [INFO ] [MAIN ] Update Progress: 1753/2366 symbols. QGEN took 18.4s. Estimated remaining time: 2h 7m 39s [2025-10-26T01:02:51.403670] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:02:51.403875] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-26T01:02:51.403946] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-26T01:02:51.404054] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-26T01:02:51.404125] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-26T01:02:51.404185] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-26T01:02:51.404253] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-26T01:03:14.397527] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-26T01:03:14.800172] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-26T01:03:14.800318] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-26T01:03:14.801617] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-26T01:03:14.801732] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-26T01:03:14.803364] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 54540 (keeping 200 days of data) [2025-10-26T01:03:15.112360] [DEBUG] [LOCAL ] QS: Primary data saved (54540 records). [2025-10-26T01:03:15.112550] [INFO ] [MAIN ] QS: Full history saved. [2025-10-26T01:03:15.112758] [INFO ] [MAIN ] Update Progress: 1754/2366 symbols. QS took 23.9s. Estimated remaining time: 2h 7m 31s [2025-10-26T01:03:15.281783] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:03:15.282002] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-26T01:03:15.282081] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-26T01:03:15.282195] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-26T01:03:15.282267] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-26T01:03:15.282355] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-26T01:03:15.282434] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-26T01:03:33.773800] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-26T01:03:34.162307] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-26T01:03:34.162432] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-26T01:03:34.163553] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-26T01:03:34.163680] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-26T01:03:34.165160] [DEBUG] [LOCAL ] QSR: Trimmed 76031 records to 53166 (keeping 200 days of data) [2025-10-26T01:03:34.476016] [DEBUG] [LOCAL ] QSR: Primary data saved (53166 records). [2025-10-26T01:03:34.476174] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-26T01:03:34.476340] [INFO ] [MAIN ] Update Progress: 1755/2366 symbols. QSR took 19.4s. Estimated remaining time: 2h 7m 21s [2025-10-26T01:03:34.645574] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:03:34.645777] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-26T01:03:34.645855] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-26T01:03:34.645975] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-26T01:03:34.646046] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-26T01:03:34.646105] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-26T01:03:34.646167] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-26T01:03:50.212807] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-26T01:03:50.593314] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-26T01:03:50.593430] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-26T01:03:50.594400] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-26T01:03:50.594480] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-26T01:03:50.595702] [DEBUG] [LOCAL ] QTWO: Trimmed 58160 records to 39985 (keeping 200 days of data) [2025-10-26T01:03:50.823333] [DEBUG] [LOCAL ] QTWO: Primary data saved (39985 records). [2025-10-26T01:03:50.823507] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-26T01:03:50.823699] [INFO ] [MAIN ] Update Progress: 1756/2366 symbols. QTWO took 16.3s. Estimated remaining time: 2h 7m 9s [2025-10-26T01:03:50.999635] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:03:50.999841] [DEBUG] [LOCAL ] QUAD: No existing data file found in primary storage. [2025-10-26T01:03:50.999932] [WARN ] [MAIN ] QUAD: No existing data found, performing full refresh instead. [2025-10-26T01:03:51.000045] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-26T01:03:51.000116] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-26T01:03:51.000198] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-26T01:03:51.000272] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-26T01:04:03.012148] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-26T01:04:03.377842] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-26T01:04:03.377979] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-26T01:04:03.378688] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-26T01:04:03.378783] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-26T01:04:03.379560] [DEBUG] [LOCAL ] QUAD: Trimmed 33870 records to 23268 (keeping 200 days of data) [2025-10-26T01:04:03.506595] [DEBUG] [LOCAL ] QUAD: Primary data saved (23268 records). [2025-10-26T01:04:03.506816] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-26T01:04:03.507011] [INFO ] [MAIN ] Update Progress: 1757/2366 symbols. QUAD took 12.7s. Estimated remaining time: 2h 6m 57s [2025-10-26T01:04:03.671398] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:04:03.671589] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-26T01:04:03.671699] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-26T01:04:03.671834] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-26T01:04:03.671923] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-26T01:04:03.672037] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-26T01:04:03.672123] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-26T01:04:11.318883] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-26T01:04:11.675216] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-26T01:04:11.675361] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-26T01:04:11.675759] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-26T01:04:11.675853] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-26T01:04:11.676401] [DEBUG] [LOCAL ] QVCC: Trimmed 11865 records to 8787 (keeping 200 days of data) [2025-10-26T01:04:11.727682] [DEBUG] [LOCAL ] QVCC: Primary data saved (8787 records). [2025-10-26T01:04:11.727861] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-26T01:04:11.728077] [INFO ] [MAIN ] Update Progress: 1758/2366 symbols. QVCC took 8.2s. Estimated remaining time: 2h 6m 43s [2025-10-26T01:04:11.896858] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:04:11.897111] [DEBUG] [LOCAL ] QVCD: No existing data file found in primary storage. [2025-10-26T01:04:11.897197] [WARN ] [MAIN ] QVCD: No existing data found, performing full refresh instead. [2025-10-26T01:04:11.897338] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-26T01:04:11.897429] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-26T01:04:11.897534] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-26T01:04:11.897622] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-26T01:04:18.265105] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-26T01:04:18.627018] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-26T01:04:18.627146] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-26T01:04:18.627372] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-26T01:04:18.627459] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-26T01:04:18.627977] [DEBUG] [LOCAL ] QVCD: Trimmed 6174 records to 4594 (keeping 200 days of data) [2025-10-26T01:04:18.654905] [DEBUG] [LOCAL ] QVCD: Primary data saved (4594 records). [2025-10-26T01:04:18.655073] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-26T01:04:18.655241] [INFO ] [MAIN ] Update Progress: 1759/2366 symbols. QVCD took 6.9s. Estimated remaining time: 2h 6m 29s [2025-10-26T01:04:18.822891] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:04:18.823121] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-26T01:04:18.823194] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-26T01:04:18.823312] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-26T01:04:18.823383] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-26T01:04:18.823467] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-26T01:04:18.823540] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-26T01:04:38.490388] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-26T01:04:38.869730] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-26T01:04:38.869854] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-26T01:04:38.871072] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-26T01:04:38.871159] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-26T01:04:38.872802] [DEBUG] [LOCAL ] QXO: Trimmed 76354 records to 54255 (keeping 200 days of data) [2025-10-26T01:04:39.199017] [DEBUG] [LOCAL ] QXO: Primary data saved (54255 records). [2025-10-26T01:04:39.199180] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-26T01:04:39.199352] [INFO ] [MAIN ] Update Progress: 1760/2366 symbols. QXO took 20.5s. Estimated remaining time: 2h 6m 19s [2025-10-26T01:04:39.386705] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:04:39.386977] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-26T01:04:39.387083] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-26T01:04:39.387210] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-26T01:04:39.387283] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-26T01:04:39.387364] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-26T01:04:39.387436] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-26T01:04:52.211119] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-26T01:04:52.574271] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-26T01:04:52.574392] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-26T01:04:52.575239] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-26T01:04:52.575318] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-26T01:04:52.576256] [DEBUG] [LOCAL ] R: Trimmed 42633 records to 28502 (keeping 200 days of data) [2025-10-26T01:04:52.748139] [DEBUG] [LOCAL ] R: Primary data saved (28502 records). [2025-10-26T01:04:52.748297] [INFO ] [MAIN ] R: Full history saved. [2025-10-26T01:04:52.748465] [INFO ] [MAIN ] Update Progress: 1761/2366 symbols. R took 13.5s. Estimated remaining time: 2h 6m 7s [2025-10-26T01:04:52.912478] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:04:52.912738] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-26T01:04:52.912821] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-26T01:04:52.912937] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-26T01:04:52.913008] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-26T01:04:52.913090] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-26T01:04:52.913161] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-26T01:05:04.981849] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-26T01:05:05.364339] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-26T01:05:05.364451] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-26T01:05:05.365127] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-26T01:05:05.365213] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-26T01:05:05.365996] [DEBUG] [LOCAL ] RA: Trimmed 31946 records to 22239 (keeping 200 days of data) [2025-10-26T01:05:05.493534] [DEBUG] [LOCAL ] RA: Primary data saved (22239 records). [2025-10-26T01:05:05.493709] [INFO ] [MAIN ] RA: Full history saved. [2025-10-26T01:05:05.493874] [INFO ] [MAIN ] Update Progress: 1762/2366 symbols. RA took 12.7s. Estimated remaining time: 2h 5m 54s [2025-10-26T01:05:05.668459] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:05:05.668713] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-26T01:05:05.668791] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-26T01:05:05.668903] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-26T01:05:05.668976] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-26T01:05:05.669059] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-26T01:05:05.669126] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-26T01:05:22.231867] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-26T01:05:22.609968] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-26T01:05:22.610157] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-26T01:05:22.611201] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-26T01:05:22.611288] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-26T01:05:22.612507] [DEBUG] [LOCAL ] RACE: Trimmed 49717 records to 33563 (keeping 200 days of data) [2025-10-26T01:05:22.807816] [DEBUG] [LOCAL ] RACE: Primary data saved (33563 records). [2025-10-26T01:05:22.808028] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-26T01:05:22.808203] [INFO ] [MAIN ] Update Progress: 1763/2366 symbols. RACE took 17.3s. Estimated remaining time: 2h 5m 43s [2025-10-26T01:05:22.974329] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:05:22.974547] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-26T01:05:22.974619] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-26T01:05:22.974753] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-26T01:05:22.974825] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-26T01:05:22.974907] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-26T01:05:22.974977] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-26T01:05:37.283045] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-26T01:05:37.677494] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-26T01:05:37.677612] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-26T01:05:37.678583] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-26T01:05:37.678688] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-26T01:05:37.679922] [DEBUG] [LOCAL ] RAMP: Trimmed 54856 records to 38175 (keeping 200 days of data) [2025-10-26T01:05:37.889994] [DEBUG] [LOCAL ] RAMP: Primary data saved (38175 records). [2025-10-26T01:05:37.890173] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-26T01:05:37.890344] [INFO ] [MAIN ] Update Progress: 1764/2366 symbols. RAMP took 15.1s. Estimated remaining time: 2h 5m 32s [2025-10-26T01:05:38.060456] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:05:38.060725] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-26T01:05:38.060798] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-26T01:05:38.060888] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-26T01:05:38.060951] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-26T01:05:38.061030] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-26T01:05:38.061095] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-26T01:05:54.342434] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-26T01:05:54.731693] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-26T01:05:54.731862] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-26T01:05:54.733021] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-26T01:05:54.733116] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-26T01:05:54.734619] [DEBUG] [LOCAL ] RBA: Trimmed 66645 records to 46713 (keeping 200 days of data) [2025-10-26T01:05:55.017226] [DEBUG] [LOCAL ] RBA: Primary data saved (46713 records). [2025-10-26T01:05:55.017384] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-26T01:05:55.017585] [INFO ] [MAIN ] Update Progress: 1765/2366 symbols. RBA took 17.1s. Estimated remaining time: 2h 5m 21s [2025-10-26T01:05:55.194734] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:05:55.194959] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-26T01:05:55.195049] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-26T01:05:55.195209] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-26T01:05:55.195293] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-26T01:05:55.195376] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-26T01:05:55.195445] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-26T01:06:05.510982] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-26T01:06:05.898368] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-26T01:06:05.898487] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-26T01:06:05.899008] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-26T01:06:05.899088] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-26T01:06:05.899718] [DEBUG] [LOCAL ] RBC: Trimmed 21935 records to 15509 (keeping 200 days of data) [2025-10-26T01:06:05.991281] [DEBUG] [LOCAL ] RBC: Primary data saved (15509 records). [2025-10-26T01:06:05.991476] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-26T01:06:05.991685] [INFO ] [MAIN ] Update Progress: 1766/2366 symbols. RBC took 11.0s. Estimated remaining time: 2h 5m 8s [2025-10-26T01:06:06.158780] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:06:06.158969] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-26T01:06:06.159039] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-26T01:06:06.159157] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-26T01:06:06.159228] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-26T01:06:06.159307] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-26T01:06:06.159374] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-26T01:06:30.254220] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-26T01:06:30.645965] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-26T01:06:30.646082] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-26T01:06:30.647186] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-26T01:06:30.647266] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-26T01:06:30.648820] [DEBUG] [LOCAL ] RBLX: Trimmed 77886 records to 54497 (keeping 200 days of data) [2025-10-26T01:06:30.968625] [DEBUG] [LOCAL ] RBLX: Primary data saved (54497 records). [2025-10-26T01:06:30.968855] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-26T01:06:30.969069] [INFO ] [MAIN ] Update Progress: 1767/2366 symbols. RBLX took 25.0s. Estimated remaining time: 2h 4m 59s [2025-10-26T01:06:31.139842] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:06:31.140029] [DEBUG] [LOCAL ] RBOT: No existing data file found in primary storage. [2025-10-26T01:06:31.140100] [WARN ] [MAIN ] RBOT: No existing data found, performing full refresh instead. [2025-10-26T01:06:31.140220] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-26T01:06:31.140292] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-26T01:06:31.140374] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-26T01:06:31.140449] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-26T01:06:38.481785] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-26T01:06:38.849067] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-26T01:06:38.849209] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-26T01:06:38.849484] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-26T01:06:38.849573] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-26T01:06:38.850077] [DEBUG] [LOCAL ] RBOT: Trimmed 9140 records to 6349 (keeping 200 days of data) [2025-10-26T01:06:38.884760] [DEBUG] [LOCAL ] RBOT: Primary data saved (6349 records). [2025-10-26T01:06:38.884881] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-26T01:06:38.885078] [INFO ] [MAIN ] Update Progress: 1768/2366 symbols. RBOT took 7.9s. Estimated remaining time: 2h 4m 45s [2025-10-26T01:06:39.053958] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:06:39.054139] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-26T01:06:39.054206] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-26T01:06:39.054311] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-26T01:06:39.054389] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-26T01:06:39.054455] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-26T01:06:39.054492] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-26T01:06:59.470318] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-26T01:06:59.857860] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-26T01:06:59.857979] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-26T01:06:59.859200] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-26T01:06:59.859295] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-26T01:06:59.860757] [DEBUG] [LOCAL ] RBRK: Trimmed 76710 records to 53941 (keeping 200 days of data) [2025-10-26T01:07:00.166930] [DEBUG] [LOCAL ] RBRK: Primary data saved (53941 records). [2025-10-26T01:07:00.167094] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-26T01:07:00.167265] [INFO ] [MAIN ] Update Progress: 1769/2366 symbols. RBRK took 21.3s. Estimated remaining time: 2h 4m 36s [2025-10-26T01:07:00.344666] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:07:00.344890] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-26T01:07:00.344962] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-26T01:07:00.345047] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-26T01:07:00.345114] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-26T01:07:00.345215] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-26T01:07:00.345285] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-26T01:07:17.162487] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-26T01:07:17.565848] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-26T01:07:17.565980] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-26T01:07:17.567040] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-26T01:07:17.567138] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-26T01:07:17.568557] [DEBUG] [LOCAL ] RC: Trimmed 71086 records to 49562 (keeping 200 days of data) [2025-10-26T01:07:17.845739] [DEBUG] [LOCAL ] RC: Primary data saved (49562 records). [2025-10-26T01:07:17.845912] [INFO ] [MAIN ] RC: Full history saved. [2025-10-26T01:07:17.846121] [INFO ] [MAIN ] Update Progress: 1770/2366 symbols. RC took 17.7s. Estimated remaining time: 2h 4m 25s [2025-10-26T01:07:18.013581] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:07:18.013765] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-26T01:07:18.013853] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-26T01:07:18.013985] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-26T01:07:18.014075] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-26T01:07:18.014187] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-26T01:07:18.014275] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-26T01:07:23.439578] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-26T01:07:23.675706] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-26T01:07:23.675931] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:07:23.676021] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:07:23.676124] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-26T01:07:23.676227] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-26T01:07:23.676304] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-26T01:07:23.676396] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-26T01:07:23.676661] [INFO ] [MAIN ] Update Progress: 1771/2366 symbols. RCB took 5.8s. Estimated remaining time: 2h 4m 10s [2025-10-26T01:07:23.859982] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:07:23.860200] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-26T01:07:23.860276] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-26T01:07:23.860397] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-26T01:07:23.860472] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-26T01:07:23.860558] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-26T01:07:23.860630] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-26T01:07:29.796506] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-26T01:07:30.179026] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-26T01:07:30.179148] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-26T01:07:30.179372] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-26T01:07:30.179452] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-26T01:07:30.179942] [DEBUG] [LOCAL ] RCD: Trimmed 5780 records to 3401 (keeping 200 days of data) [2025-10-26T01:07:30.200748] [DEBUG] [LOCAL ] RCD: Primary data saved (3401 records). [2025-10-26T01:07:30.200884] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-26T01:07:30.201063] [INFO ] [MAIN ] Update Progress: 1772/2366 symbols. RCD took 6.5s. Estimated remaining time: 2h 3m 56s [2025-10-26T01:07:30.388493] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:07:30.388731] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-26T01:07:30.388805] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-26T01:07:30.388920] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-26T01:07:30.388991] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-26T01:07:30.389072] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-26T01:07:30.389141] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-26T01:07:47.550536] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-26T01:07:47.942671] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-26T01:07:47.942824] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-26T01:07:47.944256] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-26T01:07:47.944340] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-26T01:07:47.946288] [DEBUG] [LOCAL ] RCI: Trimmed 70729 records to 49335 (keeping 200 days of data) [2025-10-26T01:07:48.248792] [DEBUG] [LOCAL ] RCI: Primary data saved (49335 records). [2025-10-26T01:07:48.249069] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-26T01:07:48.249323] [INFO ] [MAIN ] Update Progress: 1773/2366 symbols. RCI took 18.0s. Estimated remaining time: 2h 3m 45s [2025-10-26T01:07:48.429477] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:07:48.429866] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-26T01:07:48.429947] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-26T01:07:48.430087] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-26T01:07:48.430161] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-26T01:07:48.430248] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-26T01:07:48.430323] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-26T01:08:07.902102] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-26T01:08:08.320203] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-10-26T01:08:08.320322] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-10-26T01:08:08.321437] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-10-26T01:08:08.321520] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-10-26T01:08:08.322948] [DEBUG] [LOCAL ] RCL: Trimmed 75361 records to 52384 (keeping 200 days of data) [2025-10-26T01:08:08.642016] [DEBUG] [LOCAL ] RCL: Primary data saved (52384 records). [2025-10-26T01:08:08.642176] [INFO ] [MAIN ] RCL: Full history saved. [2025-10-26T01:08:08.642347] [INFO ] [MAIN ] Update Progress: 1774/2366 symbols. RCL took 20.4s. Estimated remaining time: 2h 3m 35s [2025-10-26T01:08:08.810139] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:08:08.810351] [DEBUG] [LOCAL ] RCS: No existing data file found in primary storage. [2025-10-26T01:08:08.810424] [WARN ] [MAIN ] RCS: No existing data found, performing full refresh instead. [2025-10-26T01:08:08.810537] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-26T01:08:08.810611] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-26T01:08:08.810716] [DEBUG] [LOCAL ] RCS: No primary data file found to delete. [2025-10-26T01:08:08.810790] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-26T01:08:18.018698] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-26T01:08:18.388519] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-26T01:08:18.388670] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-26T01:08:18.389132] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-26T01:08:18.389219] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-26T01:08:18.389846] [DEBUG] [LOCAL ] RCS: Trimmed 18722 records to 12587 (keeping 200 days of data) [2025-10-26T01:08:18.458788] [DEBUG] [LOCAL ] RCS: Primary data saved (12587 records). [2025-10-26T01:08:18.458941] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-26T01:08:18.459107] [INFO ] [MAIN ] Update Progress: 1775/2366 symbols. RCS took 9.8s. Estimated remaining time: 2h 3m 22s [2025-10-26T01:08:18.624125] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:08:18.624313] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-26T01:08:18.624384] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-26T01:08:18.624493] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-26T01:08:18.624563] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-26T01:08:18.624688] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-26T01:08:18.624793] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-26T01:08:33.461095] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-26T01:08:33.875700] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-26T01:08:33.875833] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-26T01:08:33.876841] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-26T01:08:33.876930] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-26T01:08:33.878303] [DEBUG] [LOCAL ] RCUS: Trimmed 61272 records to 43513 (keeping 200 days of data) [2025-10-26T01:08:34.113179] [DEBUG] [LOCAL ] RCUS: Primary data saved (43513 records). [2025-10-26T01:08:34.113366] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-26T01:08:34.113557] [INFO ] [MAIN ] Update Progress: 1776/2366 symbols. RCUS took 15.7s. Estimated remaining time: 2h 3m 10s [2025-10-26T01:08:34.278495] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:08:34.278727] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-26T01:08:34.278814] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-26T01:08:34.278953] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-26T01:08:34.279042] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-26T01:08:34.279153] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-26T01:08:34.279239] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-26T01:08:58.915743] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-26T01:08:59.298115] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-26T01:08:59.298237] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-26T01:08:59.299509] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-26T01:08:59.299609] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-26T01:08:59.301201] [DEBUG] [LOCAL ] RDDT: Trimmed 77926 records to 54549 (keeping 200 days of data) [2025-10-26T01:08:59.616325] [DEBUG] [LOCAL ] RDDT: Primary data saved (54549 records). [2025-10-26T01:08:59.616494] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-26T01:08:59.616711] [INFO ] [MAIN ] Update Progress: 1777/2366 symbols. RDDT took 25.5s. Estimated remaining time: 2h 3m 2s [2025-10-26T01:08:59.784099] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:08:59.784315] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-26T01:08:59.784425] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-26T01:08:59.784559] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-26T01:08:59.784669] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-26T01:08:59.784781] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-26T01:08:59.784871] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-26T01:09:16.049434] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-26T01:09:16.439392] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-26T01:09:16.439527] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-26T01:09:16.440610] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-26T01:09:16.440723] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-26T01:09:16.442485] [DEBUG] [LOCAL ] RDN: Trimmed 65640 records to 44595 (keeping 200 days of data) [2025-10-26T01:09:16.702730] [DEBUG] [LOCAL ] RDN: Primary data saved (44595 records). [2025-10-26T01:09:16.702887] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-26T01:09:16.703058] [INFO ] [MAIN ] Update Progress: 1778/2366 symbols. RDN took 17.1s. Estimated remaining time: 2h 2m 51s [2025-10-26T01:09:16.869774] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:09:16.869976] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-26T01:09:16.870052] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-26T01:09:16.870171] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-26T01:09:16.870242] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-26T01:09:16.870320] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-26T01:09:16.870389] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-26T01:09:37.670834] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-26T01:09:38.064957] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-26T01:09:38.065077] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-26T01:09:38.066218] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-26T01:09:38.066301] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-26T01:09:38.067781] [DEBUG] [LOCAL ] RDW: Trimmed 75590 records to 53064 (keeping 200 days of data) [2025-10-26T01:09:38.364323] [DEBUG] [LOCAL ] RDW: Primary data saved (53064 records). [2025-10-26T01:09:38.364489] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-26T01:09:38.364685] [INFO ] [MAIN ] Update Progress: 1779/2366 symbols. RDW took 21.7s. Estimated remaining time: 2h 2m 41s [2025-10-26T01:09:38.538780] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:09:38.539007] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-26T01:09:38.539106] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-26T01:09:38.539225] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-26T01:09:38.539298] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-26T01:09:38.539383] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-26T01:09:38.539455] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-26T01:09:54.682373] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-26T01:09:55.060752] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-26T01:09:55.060866] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-26T01:09:55.061902] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-26T01:09:55.061981] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-26T01:09:55.063260] [DEBUG] [LOCAL ] RDY: Trimmed 68388 records to 46820 (keeping 200 days of data) [2025-10-26T01:09:55.337439] [DEBUG] [LOCAL ] RDY: Primary data saved (46820 records). [2025-10-26T01:09:55.337621] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-26T01:09:55.337816] [INFO ] [MAIN ] Update Progress: 1780/2366 symbols. RDY took 17.0s. Estimated remaining time: 2h 2m 30s [2025-10-26T01:09:55.506384] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:09:55.506599] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-26T01:09:55.506694] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-26T01:09:55.506808] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-26T01:09:55.506880] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-26T01:09:55.506961] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-26T01:09:55.507012] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-26T01:10:12.488234] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-26T01:10:12.908251] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-26T01:10:12.908392] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-26T01:10:12.909474] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-26T01:10:12.909559] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-26T01:10:12.910969] [DEBUG] [LOCAL ] RELX: Trimmed 68544 records to 49251 (keeping 200 days of data) [2025-10-26T01:10:13.192668] [DEBUG] [LOCAL ] RELX: Primary data saved (49251 records). [2025-10-26T01:10:13.192838] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-26T01:10:13.193006] [INFO ] [MAIN ] Update Progress: 1781/2366 symbols. RELX took 17.9s. Estimated remaining time: 2h 2m 20s [2025-10-26T01:10:13.360374] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:10:13.360625] [DEBUG] [LOCAL ] RERE: No existing data file found in primary storage. [2025-10-26T01:10:13.360721] [WARN ] [MAIN ] RERE: No existing data found, performing full refresh instead. [2025-10-26T01:10:13.360848] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-26T01:10:13.360922] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-26T01:10:13.361010] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-26T01:10:13.361077] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-26T01:10:27.390930] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-26T01:10:27.797855] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-26T01:10:27.797974] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-26T01:10:27.799165] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-26T01:10:27.799249] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-26T01:10:27.800577] [DEBUG] [LOCAL ] RERE: Trimmed 58207 records to 42354 (keeping 200 days of data) [2025-10-26T01:10:28.035203] [DEBUG] [LOCAL ] RERE: Primary data saved (42354 records). [2025-10-26T01:10:28.035396] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-26T01:10:28.035611] [INFO ] [MAIN ] Update Progress: 1782/2366 symbols. RERE took 14.8s. Estimated remaining time: 2h 2m 8s [2025-10-26T01:10:28.213502] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:10:28.213728] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-26T01:10:28.213807] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-26T01:10:28.213929] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-26T01:10:28.214016] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-26T01:10:28.214104] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-26T01:10:28.214194] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-26T01:10:43.461200] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-26T01:10:43.842069] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-26T01:10:43.842183] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-26T01:10:43.843268] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-26T01:10:43.843348] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-26T01:10:43.844726] [DEBUG] [LOCAL ] RES: Trimmed 68722 records to 47576 (keeping 200 days of data) [2025-10-26T01:10:44.104701] [DEBUG] [LOCAL ] RES: Primary data saved (47576 records). [2025-10-26T01:10:44.104857] [INFO ] [MAIN ] RES: Full history saved. [2025-10-26T01:10:44.105052] [INFO ] [MAIN ] Update Progress: 1783/2366 symbols. RES took 16.1s. Estimated remaining time: 2h 1m 56s [2025-10-26T01:10:44.273429] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:10:44.273676] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-26T01:10:44.273748] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-26T01:10:44.273863] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-26T01:10:44.273939] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-26T01:10:44.274018] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-26T01:10:44.274087] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-26T01:10:58.984453] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-26T01:10:59.457944] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-26T01:10:59.458106] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-26T01:10:59.459273] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-26T01:10:59.459369] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-26T01:10:59.460720] [DEBUG] [LOCAL ] REVG: Trimmed 57834 records to 40708 (keeping 200 days of data) [2025-10-26T01:10:59.702368] [DEBUG] [LOCAL ] REVG: Primary data saved (40708 records). [2025-10-26T01:10:59.702534] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-26T01:10:59.702781] [INFO ] [MAIN ] Update Progress: 1784/2366 symbols. REVG took 15.6s. Estimated remaining time: 2h 1m 45s [2025-10-26T01:10:59.871759] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:10:59.871938] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-26T01:10:59.872029] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-26T01:10:59.872176] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-26T01:10:59.872267] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-26T01:10:59.872376] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-26T01:10:59.872458] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-26T01:11:09.370801] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-26T01:11:09.745768] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-26T01:11:09.745886] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-26T01:11:09.746380] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-26T01:11:09.746461] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-26T01:11:09.747170] [DEBUG] [LOCAL ] REX: Trimmed 21139 records to 14552 (keeping 200 days of data) [2025-10-26T01:11:09.831072] [DEBUG] [LOCAL ] REX: Primary data saved (14552 records). [2025-10-26T01:11:09.831271] [INFO ] [MAIN ] REX: Full history saved. [2025-10-26T01:11:09.831559] [INFO ] [MAIN ] Update Progress: 1785/2366 symbols. REX took 10.1s. Estimated remaining time: 2h 1m 32s [2025-10-26T01:11:10.008839] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:11:10.009223] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-26T01:11:10.009302] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-26T01:11:10.009468] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-26T01:11:10.009540] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-26T01:11:10.009619] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-26T01:11:10.009720] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-26T01:11:26.139674] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-26T01:11:26.525234] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-26T01:11:26.525351] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-26T01:11:26.526472] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-26T01:11:26.526555] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-26T01:11:26.527969] [DEBUG] [LOCAL ] REXR: Trimmed 75358 records to 52951 (keeping 200 days of data) [2025-10-26T01:11:26.836342] [DEBUG] [LOCAL ] REXR: Primary data saved (52951 records). [2025-10-26T01:11:26.836504] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-26T01:11:26.836690] [INFO ] [MAIN ] Update Progress: 1786/2366 symbols. REXR took 17.0s. Estimated remaining time: 2h 1m 20s [2025-10-26T01:11:27.003405] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:11:27.003616] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-26T01:11:27.003711] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-26T01:11:27.003823] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-26T01:11:27.003895] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-26T01:11:27.003963] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-26T01:11:27.004026] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-26T01:11:41.808735] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-26T01:11:42.207127] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-26T01:11:42.207251] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-26T01:11:42.208345] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-26T01:11:42.208431] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-26T01:11:42.209805] [DEBUG] [LOCAL ] REZI: Trimmed 66291 records to 47796 (keeping 200 days of data) [2025-10-26T01:11:42.485391] [DEBUG] [LOCAL ] REZI: Primary data saved (47796 records). [2025-10-26T01:11:42.485605] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-26T01:11:42.485809] [INFO ] [MAIN ] Update Progress: 1787/2366 symbols. REZI took 15.6s. Estimated remaining time: 2h 1m 9s [2025-10-26T01:11:42.678021] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:11:42.678252] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-26T01:11:42.678323] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-26T01:11:42.678434] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-26T01:11:42.678506] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-26T01:11:42.678591] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-26T01:11:42.678661] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-26T01:11:59.301481] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-26T01:11:59.693987] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-26T01:11:59.694100] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-26T01:11:59.695238] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-26T01:11:59.695359] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-26T01:11:59.696820] [DEBUG] [LOCAL ] RF: Trimmed 77798 records to 54413 (keeping 200 days of data) [2025-10-26T01:12:00.017038] [DEBUG] [LOCAL ] RF: Primary data saved (54413 records). [2025-10-26T01:12:00.017200] [INFO ] [MAIN ] RF: Full history saved. [2025-10-26T01:12:00.017362] [INFO ] [MAIN ] Update Progress: 1788/2366 symbols. RF took 17.5s. Estimated remaining time: 2h 0m 58s [2025-10-26T01:12:00.186614] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:00.186815] [DEBUG] [LOCAL ] RFI: No existing data file found in primary storage. [2025-10-26T01:12:00.186882] [WARN ] [MAIN ] RFI: No existing data found, performing full refresh instead. [2025-10-26T01:12:00.186989] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-26T01:12:00.187068] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-26T01:12:00.187127] [DEBUG] [LOCAL ] RFI: No primary data file found to delete. [2025-10-26T01:12:00.187172] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-26T01:12:08.664153] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-26T01:12:09.031904] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-26T01:12:09.032017] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-26T01:12:09.032441] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-26T01:12:09.032525] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-26T01:12:09.033146] [DEBUG] [LOCAL ] RFI: Trimmed 14983 records to 10368 (keeping 200 days of data) [2025-10-26T01:12:09.094874] [DEBUG] [LOCAL ] RFI: Primary data saved (10368 records). [2025-10-26T01:12:09.095049] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-26T01:12:09.095281] [INFO ] [MAIN ] Update Progress: 1789/2366 symbols. RFI took 9.1s. Estimated remaining time: 2h 0m 44s [2025-10-26T01:12:09.268667] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:09.268916] [DEBUG] [LOCAL ] RFL: No existing data file found in primary storage. [2025-10-26T01:12:09.269011] [WARN ] [MAIN ] RFL: No existing data found, performing full refresh instead. [2025-10-26T01:12:09.269155] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-26T01:12:09.269250] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-26T01:12:09.269358] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-26T01:12:09.269444] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-26T01:12:17.280911] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-26T01:12:17.639921] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-26T01:12:17.640033] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-26T01:12:17.640360] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-26T01:12:17.640437] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-26T01:12:17.641112] [DEBUG] [LOCAL ] RFL: Trimmed 13252 records to 11473 (keeping 200 days of data) [2025-10-26T01:12:17.702329] [DEBUG] [LOCAL ] RFL: Primary data saved (11473 records). [2025-10-26T01:12:17.702485] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-26T01:12:17.702669] [INFO ] [MAIN ] Update Progress: 1790/2366 symbols. RFL took 8.6s. Estimated remaining time: 2h 0m 30s [2025-10-26T01:12:17.867975] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:17.868188] [DEBUG] [LOCAL ] RFM: No existing data file found in primary storage. [2025-10-26T01:12:17.868261] [WARN ] [MAIN ] RFM: No existing data found, performing full refresh instead. [2025-10-26T01:12:17.868374] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-26T01:12:17.868446] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-26T01:12:17.868574] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-26T01:12:17.868667] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-26T01:12:24.068381] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-26T01:12:24.456745] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-26T01:12:24.456865] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-26T01:12:24.457076] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-26T01:12:24.457153] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-26T01:12:24.457594] [DEBUG] [LOCAL ] RFM: Trimmed 5609 records to 4249 (keeping 200 days of data) [2025-10-26T01:12:24.484030] [DEBUG] [LOCAL ] RFM: Primary data saved (4249 records). [2025-10-26T01:12:24.484152] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-26T01:12:24.484324] [INFO ] [MAIN ] Update Progress: 1791/2366 symbols. RFM took 6.8s. Estimated remaining time: 2h 0m 16s [2025-10-26T01:12:24.673078] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:24.673322] [DEBUG] [LOCAL ] RFMZ: No existing data file found in primary storage. [2025-10-26T01:12:24.673402] [WARN ] [MAIN ] RFMZ: No existing data found, performing full refresh instead. [2025-10-26T01:12:24.673554] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-26T01:12:24.673634] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-26T01:12:24.673751] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-26T01:12:24.673828] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-26T01:12:32.456165] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-26T01:12:32.812210] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-26T01:12:32.812340] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-26T01:12:32.812750] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-26T01:12:32.812846] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-26T01:12:32.813421] [DEBUG] [LOCAL ] RFMZ: Trimmed 12453 records to 9232 (keeping 200 days of data) [2025-10-26T01:12:32.869740] [DEBUG] [LOCAL ] RFMZ: Primary data saved (9232 records). [2025-10-26T01:12:32.869883] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-26T01:12:32.870118] [INFO ] [MAIN ] Update Progress: 1792/2366 symbols. RFMZ took 8.4s. Estimated remaining time: 2h 0m 2s [2025-10-26T01:12:33.061412] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:33.061619] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-26T01:12:33.061712] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-26T01:12:33.061831] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-26T01:12:33.061902] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-26T01:12:33.061981] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-26T01:12:33.062077] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-26T01:12:45.672423] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-26T01:12:46.048573] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-26T01:12:46.048721] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-26T01:12:46.049587] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-26T01:12:46.049685] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-26T01:12:46.050709] [DEBUG] [LOCAL ] RGA: Trimmed 44837 records to 29613 (keeping 200 days of data) [2025-10-26T01:12:46.230184] [DEBUG] [LOCAL ] RGA: Primary data saved (29613 records). [2025-10-26T01:12:46.230361] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-26T01:12:46.230571] [INFO ] [MAIN ] Update Progress: 1793/2366 symbols. RGA took 13.4s. Estimated remaining time: 1h 59m 50s [2025-10-26T01:12:46.401052] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:46.401245] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-26T01:12:46.401323] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-26T01:12:46.401434] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-26T01:12:46.401504] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-26T01:12:46.401586] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-26T01:12:46.401683] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-26T01:12:56.915990] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-26T01:12:57.301309] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-26T01:12:57.301410] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-26T01:12:57.302053] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-26T01:12:57.302133] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-26T01:12:57.302928] [DEBUG] [LOCAL ] RGR: Trimmed 28776 records to 21185 (keeping 200 days of data) [2025-10-26T01:12:57.422639] [DEBUG] [LOCAL ] RGR: Primary data saved (21185 records). [2025-10-26T01:12:57.422817] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-26T01:12:57.422979] [INFO ] [MAIN ] Update Progress: 1794/2366 symbols. RGR took 11.2s. Estimated remaining time: 1h 59m 37s [2025-10-26T01:12:57.617665] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:12:57.617853] [DEBUG] [LOCAL ] RGT: No existing data file found in primary storage. [2025-10-26T01:12:57.617924] [WARN ] [MAIN ] RGT: No existing data found, performing full refresh instead. [2025-10-26T01:12:57.618059] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-26T01:12:57.618133] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-26T01:12:57.618215] [DEBUG] [LOCAL ] RGT: No primary data file found to delete. [2025-10-26T01:12:57.618285] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-26T01:13:03.134401] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-26T01:13:03.491727] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-26T01:13:03.491842] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-26T01:13:03.492048] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-26T01:13:03.492152] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-26T01:13:03.492675] [DEBUG] [LOCAL ] RGT: Trimmed 3934 records to 2730 (keeping 200 days of data) [2025-10-26T01:13:03.511597] [DEBUG] [LOCAL ] RGT: Primary data saved (2730 records). [2025-10-26T01:13:03.511737] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-26T01:13:03.511979] [INFO ] [MAIN ] Update Progress: 1795/2366 symbols. RGT took 6.1s. Estimated remaining time: 1h 59m 22s [2025-10-26T01:13:03.681551] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:13:03.681793] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-26T01:13:03.681891] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-26T01:13:03.682050] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-26T01:13:03.682132] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-26T01:13:03.682237] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-26T01:13:03.682319] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-26T01:13:20.712414] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-26T01:13:21.099218] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-26T01:13:21.099353] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-26T01:13:21.100542] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-26T01:13:21.100638] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-26T01:13:21.101981] [DEBUG] [LOCAL ] RH: Trimmed 66376 records to 47727 (keeping 200 days of data) [2025-10-26T01:13:21.376705] [DEBUG] [LOCAL ] RH: Primary data saved (47727 records). [2025-10-26T01:13:21.376903] [INFO ] [MAIN ] RH: Full history saved. [2025-10-26T01:13:21.377094] [INFO ] [MAIN ] Update Progress: 1796/2366 symbols. RH took 17.9s. Estimated remaining time: 1h 59m 11s [2025-10-26T01:13:21.544714] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:13:21.544890] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-26T01:13:21.544964] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-26T01:13:21.545080] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-26T01:13:21.545150] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-26T01:13:21.545234] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-26T01:13:21.545302] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-26T01:13:37.566275] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-26T01:13:37.993956] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-26T01:13:37.994148] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-26T01:13:37.996188] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-26T01:13:37.996297] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-26T01:13:37.998537] [DEBUG] [LOCAL ] RHI: Trimmed 71040 records to 50463 (keeping 200 days of data) [2025-10-26T01:13:38.315813] [DEBUG] [LOCAL ] RHI: Primary data saved (50463 records). [2025-10-26T01:13:38.316062] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-26T01:13:38.316312] [INFO ] [MAIN ] Update Progress: 1797/2366 symbols. RHI took 16.9s. Estimated remaining time: 1h 59m 0s [2025-10-26T01:13:38.498909] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:13:38.499208] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-26T01:13:38.499284] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-26T01:13:38.499414] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-26T01:13:38.499489] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-26T01:13:38.499573] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-26T01:13:38.499673] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-26T01:13:39.090459] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-26T01:13:39.090537] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:13:39.090621] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-26T01:13:39.090761] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-26T01:13:39.090839] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-26T01:13:39.090925] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-26T01:13:39.091183] [INFO ] [MAIN ] Update Progress: 1798/2366 symbols. RHLD took 0.8s. Estimated remaining time: 1h 58m 44s [2025-10-26T01:13:39.277050] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:13:39.277354] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-26T01:13:39.277437] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-26T01:13:39.277568] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-26T01:13:39.277670] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-26T01:13:39.277789] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-26T01:13:39.277865] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-26T01:13:53.886022] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-26T01:13:54.290621] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-26T01:13:54.290806] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-26T01:13:54.292569] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-26T01:13:54.292686] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-26T01:13:54.294614] [DEBUG] [LOCAL ] RHP: Trimmed 58183 records to 40779 (keeping 200 days of data) [2025-10-26T01:13:54.553150] [DEBUG] [LOCAL ] RHP: Primary data saved (40779 records). [2025-10-26T01:13:54.553358] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-26T01:13:54.553578] [INFO ] [MAIN ] Update Progress: 1799/2366 symbols. RHP took 15.5s. Estimated remaining time: 1h 58m 32s [2025-10-26T01:13:54.724488] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:13:54.724773] [DEBUG] [LOCAL ] RIG: No existing data file found in primary storage. [2025-10-26T01:13:54.724850] [WARN ] [MAIN ] RIG: No existing data found, performing full refresh instead. [2025-10-26T01:13:54.724978] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-26T01:13:54.725051] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-26T01:13:54.725138] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-26T01:13:54.725210] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-26T01:14:15.085127] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-26T01:14:15.515661] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-26T01:14:15.515789] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-26T01:14:15.517046] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-26T01:14:15.517132] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-26T01:14:15.518773] [DEBUG] [LOCAL ] RIG: Trimmed 77845 records to 54455 (keeping 200 days of data) [2025-10-26T01:14:15.834188] [DEBUG] [LOCAL ] RIG: Primary data saved (54455 records). [2025-10-26T01:14:15.834353] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-26T01:14:15.834527] [INFO ] [MAIN ] Update Progress: 1800/2366 symbols. RIG took 21.3s. Estimated remaining time: 1h 58m 23s [2025-10-26T01:14:16.027058] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:14:16.027284] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-26T01:14:16.027359] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-26T01:14:16.027451] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-26T01:14:16.027520] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-26T01:14:16.027580] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-26T01:14:16.027661] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-26T01:14:39.230774] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-26T01:14:39.646933] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-26T01:14:39.647052] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-26T01:14:39.648182] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-26T01:14:39.648266] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-26T01:14:39.649754] [DEBUG] [LOCAL ] RIO: Trimmed 77513 records to 54181 (keeping 200 days of data) [2025-10-26T01:14:39.961919] [DEBUG] [LOCAL ] RIO: Primary data saved (54181 records). [2025-10-26T01:14:39.962084] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-26T01:14:39.962237] [INFO ] [MAIN ] Update Progress: 1801/2366 symbols. RIO took 24.1s. Estimated remaining time: 1h 58m 14s [2025-10-26T01:14:40.132973] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:14:40.133322] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-26T01:14:40.133393] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-26T01:14:40.133482] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-26T01:14:40.133549] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-26T01:14:40.133629] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-26T01:14:40.133721] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-26T01:14:59.511492] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-26T01:14:59.898008] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-26T01:14:59.898132] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-26T01:14:59.899271] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-26T01:14:59.899353] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-26T01:14:59.900810] [DEBUG] [LOCAL ] RITM: Trimmed 76738 records to 53714 (keeping 200 days of data) [2025-10-26T01:15:00.214119] [DEBUG] [LOCAL ] RITM: Primary data saved (53714 records). [2025-10-26T01:15:00.214287] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-26T01:15:00.214454] [INFO ] [MAIN ] Update Progress: 1802/2366 symbols. RITM took 20.3s. Estimated remaining time: 1h 58m 3s [2025-10-26T01:15:00.383091] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:15:00.383325] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-26T01:15:00.383397] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-26T01:15:00.383485] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-26T01:15:00.383552] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-26T01:15:00.383611] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-26T01:15:00.383694] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-26T01:15:10.114844] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-26T01:15:10.489284] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-26T01:15:10.489407] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-26T01:15:10.489840] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-26T01:15:10.489919] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-26T01:15:10.490574] [DEBUG] [LOCAL ] RIV: Trimmed 17564 records to 12782 (keeping 200 days of data) [2025-10-26T01:15:10.570379] [DEBUG] [LOCAL ] RIV: Primary data saved (12782 records). [2025-10-26T01:15:10.570553] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-26T01:15:10.570753] [INFO ] [MAIN ] Update Progress: 1803/2366 symbols. RIV took 10.4s. Estimated remaining time: 1h 57m 50s [2025-10-26T01:15:10.746675] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:15:10.746887] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-26T01:15:10.746959] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-26T01:15:10.747077] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-26T01:15:10.747130] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-26T01:15:10.747206] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-26T01:15:10.747278] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-26T01:15:26.917556] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-26T01:15:27.317291] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-26T01:15:27.317438] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-26T01:15:27.318525] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-26T01:15:27.318606] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-26T01:15:27.319981] [DEBUG] [LOCAL ] RJF: Trimmed 68917 records to 47314 (keeping 200 days of data) [2025-10-26T01:15:27.608127] [DEBUG] [LOCAL ] RJF: Primary data saved (47314 records). [2025-10-26T01:15:27.608292] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-26T01:15:27.608462] [INFO ] [MAIN ] Update Progress: 1804/2366 symbols. RJF took 17.0s. Estimated remaining time: 1h 57m 39s [2025-10-26T01:15:27.776336] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:15:27.776552] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-26T01:15:27.776627] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-26T01:15:27.776763] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-26T01:15:27.776836] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-26T01:15:27.776922] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-26T01:15:27.777000] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-26T01:15:48.457553] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-26T01:15:48.840521] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-26T01:15:48.840637] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-26T01:15:48.841803] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-26T01:15:48.841885] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-26T01:15:48.843305] [DEBUG] [LOCAL ] RKT: Trimmed 77610 records to 54509 (keeping 200 days of data) [2025-10-26T01:15:49.156689] [DEBUG] [LOCAL ] RKT: Primary data saved (54509 records). [2025-10-26T01:15:49.156872] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-26T01:15:49.157041] [INFO ] [MAIN ] Update Progress: 1805/2366 symbols. RKT took 21.5s. Estimated remaining time: 1h 57m 29s [2025-10-26T01:15:49.320474] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:15:49.320700] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-26T01:15:49.320790] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-26T01:15:49.320913] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-26T01:15:49.320980] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-26T01:15:49.321065] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-26T01:15:49.321133] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-26T01:16:05.465910] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-26T01:16:05.887403] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-26T01:16:05.887915] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-26T01:16:05.889557] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-26T01:16:05.889684] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-26T01:16:05.891000] [DEBUG] [LOCAL ] RL: Trimmed 59003 records to 39763 (keeping 200 days of data) [2025-10-26T01:16:06.132978] [DEBUG] [LOCAL ] RL: Primary data saved (39763 records). [2025-10-26T01:16:06.133166] [INFO ] [MAIN ] RL: Full history saved. [2025-10-26T01:16:06.133338] [INFO ] [MAIN ] Update Progress: 1806/2366 symbols. RL took 17.0s. Estimated remaining time: 1h 57m 18s [2025-10-26T01:16:06.302121] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:16:06.302307] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-26T01:16:06.302378] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-26T01:16:06.302466] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-26T01:16:06.302553] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-26T01:16:06.302682] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-26T01:16:06.302751] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-26T01:16:19.911346] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-26T01:16:20.301494] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-26T01:16:20.301624] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-26T01:16:20.302638] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-26T01:16:20.302748] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-26T01:16:20.303908] [DEBUG] [LOCAL ] RLI: Trimmed 49621 records to 35269 (keeping 200 days of data) [2025-10-26T01:16:20.527752] [DEBUG] [LOCAL ] RLI: Primary data saved (35269 records). [2025-10-26T01:16:20.527930] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-26T01:16:20.528437] [INFO ] [MAIN ] Update Progress: 1807/2366 symbols. RLI took 14.4s. Estimated remaining time: 1h 57m 6s [2025-10-26T01:16:20.703621] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:16:20.703880] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-26T01:16:20.703954] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-26T01:16:20.704067] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-26T01:16:20.704139] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-26T01:16:20.704220] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-26T01:16:20.704291] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-26T01:16:37.101193] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-26T01:16:37.481399] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-26T01:16:37.481510] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-26T01:16:37.482487] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-26T01:16:37.482568] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-26T01:16:37.483897] [DEBUG] [LOCAL ] RLJ: Trimmed 69378 records to 48616 (keeping 200 days of data) [2025-10-26T01:16:37.756043] [DEBUG] [LOCAL ] RLJ: Primary data saved (48616 records). [2025-10-26T01:16:37.756215] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-26T01:16:37.756394] [INFO ] [MAIN ] Update Progress: 1808/2366 symbols. RLJ took 17.2s. Estimated remaining time: 1h 56m 55s [2025-10-26T01:16:37.924386] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:16:37.924545] [DEBUG] [LOCAL ] RLTY: No existing data file found in primary storage. [2025-10-26T01:16:37.924616] [WARN ] [MAIN ] RLTY: No existing data found, performing full refresh instead. [2025-10-26T01:16:37.924744] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-26T01:16:37.924820] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-26T01:16:37.924902] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-26T01:16:37.924972] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-26T01:16:46.777511] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-26T01:16:47.159273] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-26T01:16:47.159390] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-26T01:16:47.159836] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-26T01:16:47.159914] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-26T01:16:47.160617] [DEBUG] [LOCAL ] RLTY: Trimmed 17196 records to 11106 (keeping 200 days of data) [2025-10-26T01:16:47.228289] [DEBUG] [LOCAL ] RLTY: Primary data saved (11106 records). [2025-10-26T01:16:47.228486] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-26T01:16:47.228747] [INFO ] [MAIN ] Update Progress: 1809/2366 symbols. RLTY took 9.5s. Estimated remaining time: 1h 56m 41s [2025-10-26T01:16:47.400907] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:16:47.401118] [DEBUG] [LOCAL ] RLX: No existing data file found in primary storage. [2025-10-26T01:16:47.401188] [WARN ] [MAIN ] RLX: No existing data found, performing full refresh instead. [2025-10-26T01:16:47.401303] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-26T01:16:47.401398] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-26T01:16:47.401480] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-26T01:16:47.401550] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-26T01:17:03.826888] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-26T01:17:04.302370] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-26T01:17:04.302541] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-26T01:17:04.304449] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-26T01:17:04.304576] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-26T01:17:04.306622] [DEBUG] [LOCAL ] RLX: Trimmed 70031 records to 48812 (keeping 200 days of data) [2025-10-26T01:17:04.743542] [DEBUG] [LOCAL ] RLX: Primary data saved (48812 records). [2025-10-26T01:17:04.743830] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-26T01:17:04.744215] [INFO ] [MAIN ] Update Progress: 1810/2366 symbols. RLX took 17.5s. Estimated remaining time: 1h 56m 30s [2025-10-26T01:17:05.006559] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:17:05.006860] [DEBUG] [LOCAL ] RM: No existing data file found in primary storage. [2025-10-26T01:17:05.006951] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-10-26T01:17:05.007124] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-26T01:17:05.007218] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-26T01:17:05.007322] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-26T01:17:05.007413] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-26T01:17:12.662377] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-26T01:17:13.053571] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-26T01:17:13.053743] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-26T01:17:13.054083] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-26T01:17:13.054163] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-26T01:17:13.054798] [DEBUG] [LOCAL ] RM: Trimmed 11425 records to 7553 (keeping 200 days of data) [2025-10-26T01:17:13.103357] [DEBUG] [LOCAL ] RM: Primary data saved (7553 records). [2025-10-26T01:17:13.103525] [INFO ] [MAIN ] RM: Full history saved. [2025-10-26T01:17:13.103738] [INFO ] [MAIN ] Update Progress: 1811/2366 symbols. RM took 8.4s. Estimated remaining time: 1h 56m 17s [2025-10-26T01:17:13.296073] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:17:13.296300] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-26T01:17:13.296375] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-26T01:17:13.296468] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-26T01:17:13.296537] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-26T01:17:13.296628] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-26T01:17:13.296723] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-26T01:17:24.304354] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-26T01:17:24.691470] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-26T01:17:24.691583] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-26T01:17:24.692267] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-26T01:17:24.692358] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-26T01:17:24.693142] [DEBUG] [LOCAL ] RMAX: Trimmed 29891 records to 21863 (keeping 200 days of data) [2025-10-26T01:17:24.813623] [DEBUG] [LOCAL ] RMAX: Primary data saved (21863 records). [2025-10-26T01:17:24.813807] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-26T01:17:24.814001] [INFO ] [MAIN ] Update Progress: 1812/2366 symbols. RMAX took 11.7s. Estimated remaining time: 1h 56m 4s [2025-10-26T01:17:24.983940] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:17:24.984170] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-26T01:17:24.984242] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-26T01:17:24.984356] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-26T01:17:24.984427] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-26T01:17:24.984507] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-26T01:17:24.984602] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-26T01:17:40.607954] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-26T01:17:40.990178] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-26T01:17:40.990309] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-26T01:17:40.991450] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-26T01:17:40.991536] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-26T01:17:40.992907] [DEBUG] [LOCAL ] RMD: Trimmed 61709 records to 42502 (keeping 200 days of data) [2025-10-26T01:17:41.249967] [DEBUG] [LOCAL ] RMD: Primary data saved (42502 records). [2025-10-26T01:17:41.250153] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-26T01:17:41.250342] [INFO ] [MAIN ] Update Progress: 1813/2366 symbols. RMD took 16.4s. Estimated remaining time: 1h 55m 52s [2025-10-26T01:17:41.416767] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:17:41.416985] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-26T01:17:41.417058] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-26T01:17:41.417170] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-26T01:17:41.417242] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-26T01:17:41.417326] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-26T01:17:41.417398] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-26T01:17:47.646125] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-26T01:17:48.030189] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-26T01:17:48.030301] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-26T01:17:48.030555] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-26T01:17:48.030663] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-26T01:17:48.031070] [DEBUG] [LOCAL ] RMI: Trimmed 6154 records to 4883 (keeping 200 days of data) [2025-10-26T01:17:48.060250] [DEBUG] [LOCAL ] RMI: Primary data saved (4883 records). [2025-10-26T01:17:48.060433] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-26T01:17:48.060606] [INFO ] [MAIN ] Update Progress: 1814/2366 symbols. RMI took 6.8s. Estimated remaining time: 1h 55m 38s [2025-10-26T01:17:48.234441] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:17:48.234723] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-26T01:17:48.234821] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-26T01:17:48.234952] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-26T01:17:48.235028] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-26T01:17:48.235113] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-26T01:17:48.235192] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-26T01:17:56.689566] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-26T01:17:57.053870] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-26T01:17:57.054007] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-26T01:17:57.054408] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-26T01:17:57.054485] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-26T01:17:57.055015] [DEBUG] [LOCAL ] RMM: Trimmed 14955 records to 11153 (keeping 200 days of data) [2025-10-26T01:17:57.122433] [DEBUG] [LOCAL ] RMM: Primary data saved (11153 records). [2025-10-26T01:17:57.122597] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-26T01:17:57.122812] [INFO ] [MAIN ] Update Progress: 1815/2366 symbols. RMM took 9.1s. Estimated remaining time: 1h 55m 24s [2025-10-26T01:17:57.294191] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:17:57.294434] [DEBUG] [LOCAL ] RMMZ: No existing data file found in primary storage. [2025-10-26T01:17:57.294507] [WARN ] [MAIN ] RMMZ: No existing data found, performing full refresh instead. [2025-10-26T01:17:57.294663] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-26T01:17:57.294740] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-26T01:17:57.294808] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-26T01:17:57.294871] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-26T01:18:03.706471] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-26T01:18:04.076027] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-26T01:18:04.076156] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-26T01:18:04.076366] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-26T01:18:04.076442] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-26T01:18:04.076920] [DEBUG] [LOCAL ] RMMZ: Trimmed 6584 records to 4852 (keeping 200 days of data) [2025-10-26T01:18:04.106047] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4852 records). [2025-10-26T01:18:04.106192] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-26T01:18:04.106363] [INFO ] [MAIN ] Update Progress: 1816/2366 symbols. RMMZ took 7.0s. Estimated remaining time: 1h 55m 10s [2025-10-26T01:18:04.271826] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:18:04.272083] [DEBUG] [LOCAL ] RMT: No existing data file found in primary storage. [2025-10-26T01:18:04.272155] [WARN ] [MAIN ] RMT: No existing data found, performing full refresh instead. [2025-10-26T01:18:04.272244] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-26T01:18:04.272338] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-26T01:18:04.272420] [DEBUG] [LOCAL ] RMT: No primary data file found to delete. [2025-10-26T01:18:04.272491] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-26T01:18:14.544057] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-26T01:18:14.925708] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-26T01:18:14.925822] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-26T01:18:14.926379] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-26T01:18:14.926459] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-26T01:18:14.927190] [DEBUG] [LOCAL ] RMT: Trimmed 25418 records to 17331 (keeping 200 days of data) [2025-10-26T01:18:15.024907] [DEBUG] [LOCAL ] RMT: Primary data saved (17331 records). [2025-10-26T01:18:15.025085] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-26T01:18:15.025265] [INFO ] [MAIN ] Update Progress: 1817/2366 symbols. RMT took 10.9s. Estimated remaining time: 1h 54m 57s [2025-10-26T01:18:15.192128] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:18:15.192340] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-26T01:18:15.192411] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-26T01:18:15.192582] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-26T01:18:15.192808] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-26T01:18:15.192894] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-26T01:18:15.193021] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-26T01:18:32.229071] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-26T01:18:32.608761] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-26T01:18:32.608889] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-26T01:18:32.610061] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-26T01:18:32.610147] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-26T01:18:32.611532] [DEBUG] [LOCAL ] RNG: Trimmed 69930 records to 48663 (keeping 200 days of data) [2025-10-26T01:18:32.885271] [DEBUG] [LOCAL ] RNG: Primary data saved (48663 records). [2025-10-26T01:18:32.885432] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-26T01:18:32.885605] [INFO ] [MAIN ] Update Progress: 1818/2366 symbols. RNG took 17.9s. Estimated remaining time: 1h 54m 46s [2025-10-26T01:18:33.051762] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:18:33.051940] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-26T01:18:33.052010] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-26T01:18:33.052119] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-26T01:18:33.052188] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-26T01:18:33.052290] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-26T01:18:33.052386] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-26T01:18:44.137036] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-26T01:18:44.512140] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-26T01:18:44.512270] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-26T01:18:44.513008] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-26T01:18:44.513105] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-26T01:18:44.513877] [DEBUG] [LOCAL ] RNGR: Trimmed 28392 records to 20973 (keeping 200 days of data) [2025-10-26T01:18:44.633316] [DEBUG] [LOCAL ] RNGR: Primary data saved (20973 records). [2025-10-26T01:18:44.633482] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-26T01:18:44.633694] [INFO ] [MAIN ] Update Progress: 1819/2366 symbols. RNGR took 11.7s. Estimated remaining time: 1h 54m 33s [2025-10-26T01:18:44.804184] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:18:44.804370] [DEBUG] [LOCAL ] RNP: No existing data file found in primary storage. [2025-10-26T01:18:44.804449] [WARN ] [MAIN ] RNP: No existing data found, performing full refresh instead. [2025-10-26T01:18:44.804571] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-26T01:18:44.804623] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-26T01:18:44.804722] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-10-26T01:18:44.804812] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-26T01:18:55.031547] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-26T01:18:55.396610] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-26T01:18:55.396745] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-26T01:18:55.397240] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-26T01:18:55.397314] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-26T01:18:55.398002] [DEBUG] [LOCAL ] RNP: Trimmed 23267 records to 16090 (keeping 200 days of data) [2025-10-26T01:18:55.490976] [DEBUG] [LOCAL ] RNP: Primary data saved (16090 records). [2025-10-26T01:18:55.491149] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-26T01:18:55.491321] [INFO ] [MAIN ] Update Progress: 1820/2366 symbols. RNP took 10.9s. Estimated remaining time: 1h 54m 20s [2025-10-26T01:18:55.658317] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:18:55.658549] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-26T01:18:55.658624] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-26T01:18:55.658764] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-26T01:18:55.658840] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-26T01:18:55.658923] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-26T01:18:55.658996] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-26T01:19:10.284470] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-26T01:19:10.670139] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-26T01:19:10.670262] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-26T01:19:10.671350] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-26T01:19:10.671437] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-26T01:19:10.672509] [DEBUG] [LOCAL ] RNR: Trimmed 50902 records to 33952 (keeping 200 days of data) [2025-10-26T01:19:10.876772] [DEBUG] [LOCAL ] RNR: Primary data saved (33952 records). [2025-10-26T01:19:10.876943] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-26T01:19:10.877088] [INFO ] [MAIN ] Update Progress: 1821/2366 symbols. RNR took 15.4s. Estimated remaining time: 1h 54m 8s [2025-10-26T01:19:11.049766] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:19:11.049975] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-26T01:19:11.050051] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-26T01:19:11.050166] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-26T01:19:11.050239] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-26T01:19:11.050341] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-26T01:19:11.050429] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-26T01:19:25.136459] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-26T01:19:25.523781] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-26T01:19:25.523914] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-26T01:19:25.524867] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-26T01:19:25.524948] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-26T01:19:25.526228] [DEBUG] [LOCAL ] RNST: Trimmed 52756 records to 36378 (keeping 200 days of data) [2025-10-26T01:19:25.736888] [DEBUG] [LOCAL ] RNST: Primary data saved (36378 records). [2025-10-26T01:19:25.737063] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-26T01:19:25.737232] [INFO ] [MAIN ] Update Progress: 1822/2366 symbols. RNST took 14.9s. Estimated remaining time: 1h 53m 57s [2025-10-26T01:19:25.906798] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:19:25.907034] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-26T01:19:25.907107] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-26T01:19:25.907223] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-26T01:19:25.907294] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-26T01:19:25.907376] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-26T01:19:25.907448] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-26T01:19:37.496272] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-26T01:19:37.871058] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-26T01:19:37.871169] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-26T01:19:37.871901] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-26T01:19:37.871986] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-26T01:19:37.872790] [DEBUG] [LOCAL ] ROG: Trimmed 30690 records to 21760 (keeping 200 days of data) [2025-10-26T01:19:38.011205] [DEBUG] [LOCAL ] ROG: Primary data saved (21760 records). [2025-10-26T01:19:38.011379] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-26T01:19:38.011541] [INFO ] [MAIN ] Update Progress: 1823/2366 symbols. ROG took 12.3s. Estimated remaining time: 1h 53m 44s [2025-10-26T01:19:38.194516] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:19:38.194736] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-26T01:19:38.194810] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-26T01:19:38.194926] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-26T01:19:38.195004] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-26T01:19:38.195091] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-26T01:19:38.195162] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-26T01:19:54.049134] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-26T01:19:54.440427] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-26T01:19:54.440541] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-26T01:19:54.441730] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-26T01:19:54.441824] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-26T01:19:54.443111] [DEBUG] [LOCAL ] ROK: Trimmed 62514 records to 43229 (keeping 200 days of data) [2025-10-26T01:19:54.702983] [DEBUG] [LOCAL ] ROK: Primary data saved (43229 records). [2025-10-26T01:19:54.703175] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-26T01:19:54.703393] [INFO ] [MAIN ] Update Progress: 1824/2366 symbols. ROK took 16.7s. Estimated remaining time: 1h 53m 33s [2025-10-26T01:19:54.876156] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:19:54.876348] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-26T01:19:54.876421] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-26T01:19:54.876534] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-26T01:19:54.876605] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-26T01:19:54.876709] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-26T01:19:54.876783] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-26T01:20:12.169026] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-26T01:20:12.556563] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-26T01:20:12.556714] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-26T01:20:12.557928] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-26T01:20:12.558061] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-26T01:20:12.559622] [DEBUG] [LOCAL ] ROL: Trimmed 73204 records to 50981 (keeping 200 days of data) [2025-10-26T01:20:12.856917] [DEBUG] [LOCAL ] ROL: Primary data saved (50981 records). [2025-10-26T01:20:12.857111] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-26T01:20:12.857306] [INFO ] [MAIN ] Update Progress: 1825/2366 symbols. ROL took 18.2s. Estimated remaining time: 1h 53m 22s [2025-10-26T01:20:13.028209] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:20:13.028425] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-26T01:20:13.028498] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-26T01:20:13.028613] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-26T01:20:13.028727] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-26T01:20:13.028812] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-26T01:20:13.028886] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-26T01:20:28.601556] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-26T01:20:29.003171] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-26T01:20:29.003285] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-26T01:20:29.004277] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-26T01:20:29.004355] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-26T01:20:29.005564] [DEBUG] [LOCAL ] RPM: Trimmed 59755 records to 42639 (keeping 200 days of data) [2025-10-26T01:20:29.267475] [DEBUG] [LOCAL ] RPM: Primary data saved (42639 records). [2025-10-26T01:20:29.267687] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-26T01:20:29.267863] [INFO ] [MAIN ] Update Progress: 1826/2366 symbols. RPM took 16.4s. Estimated remaining time: 1h 53m 10s [2025-10-26T01:20:29.439008] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:20:29.439210] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-10-26T01:20:29.439292] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-10-26T01:20:29.439409] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-26T01:20:29.439479] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-26T01:20:29.439560] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-26T01:20:29.439629] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-26T01:20:40.252145] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-26T01:20:40.644418] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-26T01:20:40.644551] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-26T01:20:40.645262] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-26T01:20:40.645355] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-26T01:20:40.646300] [DEBUG] [LOCAL ] RPT: Trimmed 28188 records to 19162 (keeping 200 days of data) [2025-10-26T01:20:40.757530] [DEBUG] [LOCAL ] RPT: Primary data saved (19162 records). [2025-10-26T01:20:40.757760] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-26T01:20:40.758037] [INFO ] [MAIN ] Update Progress: 1827/2366 symbols. RPT took 11.5s. Estimated remaining time: 1h 52m 57s [2025-10-26T01:20:40.933176] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:20:40.933445] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-26T01:20:40.933528] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-26T01:20:40.933690] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-26T01:20:40.933780] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-26T01:20:40.933931] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-26T01:20:40.934010] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-26T01:20:54.468311] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-26T01:20:54.841381] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-26T01:20:54.841517] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-26T01:20:54.842472] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-26T01:20:54.842572] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-26T01:20:54.843521] [DEBUG] [LOCAL ] RQI: Trimmed 42575 records to 29097 (keeping 200 days of data) [2025-10-26T01:20:55.013336] [DEBUG] [LOCAL ] RQI: Primary data saved (29097 records). [2025-10-26T01:20:55.013545] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-26T01:20:55.013786] [INFO ] [MAIN ] Update Progress: 1828/2366 symbols. RQI took 14.3s. Estimated remaining time: 1h 52m 45s [2025-10-26T01:20:55.181494] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:20:55.181717] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-26T01:20:55.181806] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-26T01:20:55.181947] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-26T01:20:55.182037] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-26T01:20:55.182140] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-26T01:20:55.182227] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-26T01:21:12.979363] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-26T01:21:13.389999] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-26T01:21:13.390135] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-26T01:21:13.391313] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-26T01:21:13.391401] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-26T01:21:13.393054] [DEBUG] [LOCAL ] RRC: Trimmed 76755 records to 53691 (keeping 200 days of data) [2025-10-26T01:21:13.705037] [DEBUG] [LOCAL ] RRC: Primary data saved (53691 records). [2025-10-26T01:21:13.705200] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-26T01:21:13.705370] [INFO ] [MAIN ] Update Progress: 1829/2366 symbols. RRC took 18.7s. Estimated remaining time: 1h 52m 34s [2025-10-26T01:21:13.875426] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:21:13.875635] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-26T01:21:13.875721] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-26T01:21:13.875828] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-26T01:21:13.875898] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-26T01:21:13.876015] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-26T01:21:13.876083] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-26T01:21:30.533777] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-26T01:21:30.923115] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-26T01:21:30.923225] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-26T01:21:30.924250] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-26T01:21:30.924332] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-26T01:21:30.925522] [DEBUG] [LOCAL ] RRX: Trimmed 58712 records to 41304 (keeping 200 days of data) [2025-10-26T01:21:31.170742] [DEBUG] [LOCAL ] RRX: Primary data saved (41304 records). [2025-10-26T01:21:31.170895] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-26T01:21:31.171057] [INFO ] [MAIN ] Update Progress: 1830/2366 symbols. RRX took 17.5s. Estimated remaining time: 1h 52m 23s [2025-10-26T01:21:31.340876] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:21:31.341067] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-26T01:21:31.341139] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-26T01:21:31.341275] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-26T01:21:31.341372] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-26T01:21:31.341453] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-26T01:21:31.341519] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-26T01:21:43.439804] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-26T01:21:43.808288] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-26T01:21:43.808424] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-26T01:21:43.809358] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-26T01:21:43.809460] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-26T01:21:43.810394] [DEBUG] [LOCAL ] RS: Trimmed 38510 records to 24971 (keeping 200 days of data) [2025-10-26T01:21:43.957670] [DEBUG] [LOCAL ] RS: Primary data saved (24971 records). [2025-10-26T01:21:43.957830] [INFO ] [MAIN ] RS: Full history saved. [2025-10-26T01:21:43.958045] [INFO ] [MAIN ] Update Progress: 1831/2366 symbols. RS took 12.8s. Estimated remaining time: 1h 52m 11s [2025-10-26T01:21:44.125387] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:21:44.125637] [DEBUG] [LOCAL ] RSF: No existing data file found in primary storage. [2025-10-26T01:21:44.125721] [WARN ] [MAIN ] RSF: No existing data found, performing full refresh instead. [2025-10-26T01:21:44.125802] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-26T01:21:44.125868] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-26T01:21:44.125946] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-10-26T01:21:44.126022] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-26T01:21:50.096851] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-26T01:21:50.540943] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-26T01:21:50.541079] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-26T01:21:50.541324] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-26T01:21:50.541403] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-26T01:21:50.541954] [DEBUG] [LOCAL ] RSF: Trimmed 5566 records to 4285 (keeping 200 days of data) [2025-10-26T01:21:50.569794] [DEBUG] [LOCAL ] RSF: Primary data saved (4285 records). [2025-10-26T01:21:50.569966] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-26T01:21:50.570142] [INFO ] [MAIN ] Update Progress: 1832/2366 symbols. RSF took 6.6s. Estimated remaining time: 1h 51m 56s [2025-10-26T01:21:50.778344] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:21:50.778574] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-26T01:21:50.778680] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-26T01:21:50.778805] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-26T01:21:50.778878] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-26T01:21:50.778940] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-26T01:21:50.779003] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-26T01:22:08.221522] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-26T01:22:08.624987] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-26T01:22:08.625106] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-26T01:22:08.626174] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-26T01:22:08.626253] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-26T01:22:08.627511] [DEBUG] [LOCAL ] RSG: Trimmed 68430 records to 47994 (keeping 200 days of data) [2025-10-26T01:22:08.920528] [DEBUG] [LOCAL ] RSG: Primary data saved (47994 records). [2025-10-26T01:22:08.920737] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-26T01:22:08.921065] [INFO ] [MAIN ] Update Progress: 1833/2366 symbols. RSG took 18.4s. Estimated remaining time: 1h 51m 46s [2025-10-26T01:22:09.100524] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:22:09.100754] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-26T01:22:09.100827] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-26T01:22:09.100938] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-26T01:22:09.101009] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-26T01:22:09.101095] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-26T01:22:09.101166] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-26T01:22:25.984386] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-26T01:22:26.368957] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-26T01:22:26.369089] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-26T01:22:26.370307] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-26T01:22:26.370389] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-26T01:22:26.371825] [DEBUG] [LOCAL ] RSI: Trimmed 69727 records to 47711 (keeping 200 days of data) [2025-10-26T01:22:26.634069] [DEBUG] [LOCAL ] RSI: Primary data saved (47711 records). [2025-10-26T01:22:26.634222] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-26T01:22:26.634389] [INFO ] [MAIN ] Update Progress: 1834/2366 symbols. RSI took 17.7s. Estimated remaining time: 1h 51m 35s [2025-10-26T01:22:26.801426] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:22:26.801631] [DEBUG] [LOCAL ] RSKD: No existing data file found in primary storage. [2025-10-26T01:22:26.801726] [WARN ] [MAIN ] RSKD: No existing data found, performing full refresh instead. [2025-10-26T01:22:26.801833] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-26T01:22:26.801906] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-26T01:22:26.801983] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-26T01:22:26.802054] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-26T01:22:39.978833] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-26T01:22:40.360481] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-26T01:22:40.360616] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-26T01:22:40.361762] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-26T01:22:40.361845] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-26T01:22:40.362922] [DEBUG] [LOCAL ] RSKD: Trimmed 48437 records to 33786 (keeping 200 days of data) [2025-10-26T01:22:40.538057] [DEBUG] [LOCAL ] RSKD: Primary data saved (33786 records). [2025-10-26T01:22:40.538213] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-26T01:22:40.538383] [INFO ] [MAIN ] Update Progress: 1835/2366 symbols. RSKD took 13.9s. Estimated remaining time: 1h 51m 22s [2025-10-26T01:22:40.703601] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:22:40.703812] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-26T01:22:40.703885] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-26T01:22:40.703978] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-26T01:22:40.704079] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-26T01:22:40.704167] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-26T01:22:40.704239] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-26T01:22:55.900496] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-26T01:22:56.281207] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-26T01:22:56.281323] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-26T01:22:56.282303] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-26T01:22:56.282380] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-26T01:22:56.283686] [DEBUG] [LOCAL ] RTO: Trimmed 58982 records to 40455 (keeping 200 days of data) [2025-10-26T01:22:56.513882] [DEBUG] [LOCAL ] RTO: Primary data saved (40455 records). [2025-10-26T01:22:56.514026] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-26T01:22:56.514336] [INFO ] [MAIN ] Update Progress: 1836/2366 symbols. RTO took 16.0s. Estimated remaining time: 1h 51m 11s [2025-10-26T01:22:56.680976] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:22:56.681154] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-26T01:22:56.681232] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-26T01:22:56.681318] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-26T01:22:56.681383] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-26T01:22:56.681461] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-26T01:22:56.681529] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-26T01:23:22.318464] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-26T01:23:22.729051] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-26T01:23:22.729218] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-26T01:23:22.730768] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-26T01:23:22.730857] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-26T01:23:22.732918] [DEBUG] [LOCAL ] RTX: Trimmed 77877 records to 54485 (keeping 200 days of data) [2025-10-26T01:23:23.092361] [DEBUG] [LOCAL ] RTX: Primary data saved (54485 records). [2025-10-26T01:23:23.092562] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-26T01:23:23.092772] [INFO ] [MAIN ] Update Progress: 1837/2366 symbols. RTX took 26.6s. Estimated remaining time: 1h 51m 2s [2025-10-26T01:23:23.272678] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:23:23.272874] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-26T01:23:23.272948] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-26T01:23:23.273063] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-26T01:23:23.273138] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-26T01:23:23.273222] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-26T01:23:23.273293] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-26T01:23:40.465230] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-26T01:23:40.865027] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-26T01:23:40.865154] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-26T01:23:40.866320] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-26T01:23:40.866416] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-26T01:23:40.867947] [DEBUG] [LOCAL ] RVLV: Trimmed 68922 records to 47974 (keeping 200 days of data) [2025-10-26T01:23:41.133026] [DEBUG] [LOCAL ] RVLV: Primary data saved (47974 records). [2025-10-26T01:23:41.133195] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-26T01:23:41.133366] [INFO ] [MAIN ] Update Progress: 1838/2366 symbols. RVLV took 18.0s. Estimated remaining time: 1h 50m 51s [2025-10-26T01:23:41.305807] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:23:41.306024] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-26T01:23:41.306096] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-26T01:23:41.306227] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-26T01:23:41.306298] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-26T01:23:41.306360] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-26T01:23:41.306422] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-26T01:23:53.600176] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-26T01:23:53.996814] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-26T01:23:53.996927] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-26T01:23:53.997921] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-26T01:23:53.998261] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-26T01:23:53.999872] [DEBUG] [LOCAL ] RVT: Trimmed 39028 records to 26410 (keeping 200 days of data) [2025-10-26T01:23:54.153547] [DEBUG] [LOCAL ] RVT: Primary data saved (26410 records). [2025-10-26T01:23:54.153732] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-26T01:23:54.153928] [INFO ] [MAIN ] Update Progress: 1839/2366 symbols. RVT took 13.0s. Estimated remaining time: 1h 50m 39s [2025-10-26T01:23:54.323664] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:23:54.323903] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-26T01:23:54.323975] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-26T01:23:54.324097] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-26T01:23:54.324171] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-26T01:23:54.324251] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-26T01:23:54.324322] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-26T01:24:11.080691] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-26T01:24:11.462406] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-26T01:24:11.462569] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-26T01:24:11.463747] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-26T01:24:11.463826] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-26T01:24:11.465427] [DEBUG] [LOCAL ] RVTY: Trimmed 68231 records to 48517 (keeping 200 days of data) [2025-10-26T01:24:11.751994] [DEBUG] [LOCAL ] RVTY: Primary data saved (48517 records). [2025-10-26T01:24:11.752154] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-26T01:24:11.752321] [INFO ] [MAIN ] Update Progress: 1840/2366 symbols. RVTY took 17.6s. Estimated remaining time: 1h 50m 27s [2025-10-26T01:24:11.918317] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:24:11.918473] [DEBUG] [LOCAL ] RWT: No existing data file found in primary storage. [2025-10-26T01:24:11.918544] [WARN ] [MAIN ] RWT: No existing data found, performing full refresh instead. [2025-10-26T01:24:11.918675] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-26T01:24:11.918749] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-26T01:24:11.918818] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-26T01:24:11.918879] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-26T01:24:26.757181] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-26T01:24:27.144163] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-26T01:24:27.144280] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-26T01:24:27.145254] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-26T01:24:27.145333] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-26T01:24:27.146566] [DEBUG] [LOCAL ] RWT: Trimmed 58082 records to 40951 (keeping 200 days of data) [2025-10-26T01:24:27.370685] [DEBUG] [LOCAL ] RWT: Primary data saved (40951 records). [2025-10-26T01:24:27.370838] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-26T01:24:27.371002] [INFO ] [MAIN ] Update Progress: 1841/2366 symbols. RWT took 15.6s. Estimated remaining time: 1h 50m 16s [2025-10-26T01:24:27.536422] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:24:27.536596] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-26T01:24:27.536688] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-26T01:24:27.536820] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-26T01:24:27.536890] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-26T01:24:27.536995] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-26T01:24:27.537068] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-26T01:24:32.358258] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-26T01:24:32.535843] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-26T01:24:32.536042] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:24:32.536095] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:24:32.536169] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-26T01:24:32.536266] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-26T01:24:32.536342] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-26T01:24:32.536427] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-26T01:24:32.536606] [INFO ] [MAIN ] Update Progress: 1842/2366 symbols. RWTN took 5.2s. Estimated remaining time: 1h 50m 1s [2025-10-26T01:24:32.707276] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:24:32.707483] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-26T01:24:32.707556] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-26T01:24:32.707691] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-26T01:24:32.707765] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-26T01:24:32.707851] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-26T01:24:32.707921] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-26T01:24:37.959870] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-26T01:24:38.142127] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-26T01:24:38.142341] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:24:38.142416] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:24:38.142495] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-26T01:24:38.142569] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-26T01:24:38.142638] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-26T01:24:38.142746] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-26T01:24:38.142941] [INFO ] [MAIN ] Update Progress: 1843/2366 symbols. RWTO took 5.6s. Estimated remaining time: 1h 49m 46s [2025-10-26T01:24:38.318790] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:24:38.319067] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-26T01:24:38.319148] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-26T01:24:38.319269] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-26T01:24:38.319343] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-26T01:24:38.319430] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-26T01:24:38.319502] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-26T01:24:43.645940] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-10-26T01:24:43.826689] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-10-26T01:24:43.826920] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:24:43.826995] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:24:43.827137] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-26T01:24:43.827233] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-26T01:24:43.827305] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-26T01:24:43.827387] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-26T01:24:43.827543] [INFO ] [MAIN ] Update Progress: 1844/2366 symbols. RWTP took 5.7s. Estimated remaining time: 1h 49m 32s [2025-10-26T01:24:43.996448] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:24:43.996672] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-26T01:24:43.996746] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-26T01:24:43.996860] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-26T01:24:43.996933] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-26T01:24:43.997074] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-26T01:24:43.997152] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-26T01:25:02.601663] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-26T01:25:02.991835] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-26T01:25:02.991996] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-26T01:25:02.993211] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-26T01:25:02.993302] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-26T01:25:02.994874] [DEBUG] [LOCAL ] RXO: Trimmed 69050 records to 49160 (keeping 200 days of data) [2025-10-26T01:25:03.265609] [DEBUG] [LOCAL ] RXO: Primary data saved (49160 records). [2025-10-26T01:25:03.265801] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-26T01:25:03.266055] [INFO ] [MAIN ] Update Progress: 1845/2366 symbols. RXO took 19.4s. Estimated remaining time: 1h 49m 21s [2025-10-26T01:25:03.437360] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:25:03.437529] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-26T01:25:03.437589] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-26T01:25:03.437721] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-26T01:25:03.437807] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-26T01:25:03.437888] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-26T01:25:03.438006] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-26T01:25:22.157415] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-26T01:25:22.544058] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-26T01:25:22.544175] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-26T01:25:22.545218] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-26T01:25:22.545298] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-26T01:25:22.546620] [DEBUG] [LOCAL ] RY: Trimmed 69204 records to 48118 (keeping 200 days of data) [2025-10-26T01:25:22.838039] [DEBUG] [LOCAL ] RY: Primary data saved (48118 records). [2025-10-26T01:25:22.838211] [INFO ] [MAIN ] RY: Full history saved. [2025-10-26T01:25:22.838383] [INFO ] [MAIN ] Update Progress: 1846/2366 symbols. RY took 19.6s. Estimated remaining time: 1h 49m 11s [2025-10-26T01:25:23.011761] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:25:23.011974] [DEBUG] [LOCAL ] RYAM: No existing data file found in primary storage. [2025-10-26T01:25:23.012045] [WARN ] [MAIN ] RYAM: No existing data found, performing full refresh instead. [2025-10-26T01:25:23.012131] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-26T01:25:23.012199] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-26T01:25:23.012258] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-26T01:25:23.012320] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-26T01:25:38.669678] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-26T01:25:39.057117] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-26T01:25:39.057233] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-26T01:25:39.058200] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-26T01:25:39.058281] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-26T01:25:39.059405] [DEBUG] [LOCAL ] RYAM: Trimmed 49206 records to 35519 (keeping 200 days of data) [2025-10-26T01:25:39.246449] [DEBUG] [LOCAL ] RYAM: Primary data saved (35519 records). [2025-10-26T01:25:39.246633] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-26T01:25:39.246825] [INFO ] [MAIN ] Update Progress: 1847/2366 symbols. RYAM took 16.4s. Estimated remaining time: 1h 48m 59s [2025-10-26T01:25:39.423339] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:25:39.423568] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-26T01:25:39.423691] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-26T01:25:39.423807] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-26T01:25:39.423881] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-26T01:25:39.423963] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-26T01:25:39.424034] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-26T01:25:54.716234] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-26T01:25:55.144322] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-26T01:25:55.144435] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-26T01:25:55.145459] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-26T01:25:55.145541] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-26T01:25:55.146827] [DEBUG] [LOCAL ] RYAN: Trimmed 64936 records to 45649 (keeping 200 days of data) [2025-10-26T01:25:55.414946] [DEBUG] [LOCAL ] RYAN: Primary data saved (45649 records). [2025-10-26T01:25:55.415106] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-26T01:25:55.415274] [INFO ] [MAIN ] Update Progress: 1848/2366 symbols. RYAN took 16.2s. Estimated remaining time: 1h 48m 47s [2025-10-26T01:25:55.593435] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:25:55.593691] [DEBUG] [LOCAL ] RYI: No existing data file found in primary storage. [2025-10-26T01:25:55.593821] [WARN ] [MAIN ] RYI: No existing data found, performing full refresh instead. [2025-10-26T01:25:55.593939] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-26T01:25:55.594012] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-26T01:25:55.594075] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-26T01:25:55.594170] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-26T01:26:07.017913] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-26T01:26:07.392979] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-26T01:26:07.393167] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-26T01:26:07.394672] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-26T01:26:07.394759] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-26T01:26:07.395749] [DEBUG] [LOCAL ] RYI: Trimmed 31868 records to 22032 (keeping 200 days of data) [2025-10-26T01:26:07.522760] [DEBUG] [LOCAL ] RYI: Primary data saved (22032 records). [2025-10-26T01:26:07.522912] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-26T01:26:07.523080] [INFO ] [MAIN ] Update Progress: 1849/2366 symbols. RYI took 12.1s. Estimated remaining time: 1h 48m 35s [2025-10-26T01:26:07.690305] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:26:07.690534] [DEBUG] [LOCAL ] RYN: No existing data file found in primary storage. [2025-10-26T01:26:07.690606] [WARN ] [MAIN ] RYN: No existing data found, performing full refresh instead. [2025-10-26T01:26:07.690737] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-26T01:26:07.690808] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-26T01:26:07.690893] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-26T01:26:07.690942] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-26T01:26:23.251111] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-26T01:26:23.630769] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-26T01:26:23.630883] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-26T01:26:23.631956] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-26T01:26:23.632034] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-26T01:26:23.633336] [DEBUG] [LOCAL ] RYN: Trimmed 65869 records to 46443 (keeping 200 days of data) [2025-10-26T01:26:23.901252] [DEBUG] [LOCAL ] RYN: Primary data saved (46443 records). [2025-10-26T01:26:23.901408] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-26T01:26:23.901553] [INFO ] [MAIN ] Update Progress: 1850/2366 symbols. RYN took 16.4s. Estimated remaining time: 1h 48m 23s [2025-10-26T01:26:24.072507] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:26:24.073757] [DEBUG] [LOCAL ] RZB: No existing data file found in primary storage. [2025-10-26T01:26:24.073829] [WARN ] [MAIN ] RZB: No existing data found, performing full refresh instead. [2025-10-26T01:26:24.073987] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-26T01:26:24.074063] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-26T01:26:24.074142] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-26T01:26:24.074210] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-26T01:26:30.861845] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-26T01:26:31.217440] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-26T01:26:31.217573] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-26T01:26:31.217892] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-26T01:26:31.218010] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-26T01:26:31.218516] [DEBUG] [LOCAL ] RZB: Trimmed 8277 records to 5925 (keeping 200 days of data) [2025-10-26T01:26:31.253284] [DEBUG] [LOCAL ] RZB: Primary data saved (5925 records). [2025-10-26T01:26:31.253418] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-26T01:26:31.253677] [INFO ] [MAIN ] Update Progress: 1851/2366 symbols. RZB took 7.4s. Estimated remaining time: 1h 48m 9s [2025-10-26T01:26:31.423418] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:26:31.423607] [DEBUG] [LOCAL ] RZC: No existing data file found in primary storage. [2025-10-26T01:26:31.423711] [WARN ] [MAIN ] RZC: No existing data found, performing full refresh instead. [2025-10-26T01:26:31.423847] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-26T01:26:31.423963] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-26T01:26:31.424069] [DEBUG] [LOCAL ] RZC: No primary data file found to delete. [2025-10-26T01:26:31.424161] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-26T01:26:38.422906] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-26T01:26:38.782002] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-26T01:26:38.782118] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-26T01:26:38.782347] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-26T01:26:38.782421] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-26T01:26:38.782913] [DEBUG] [LOCAL ] RZC: Trimmed 9589 records to 6527 (keeping 200 days of data) [2025-10-26T01:26:38.820541] [DEBUG] [LOCAL ] RZC: Primary data saved (6527 records). [2025-10-26T01:26:38.820668] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-26T01:26:38.820819] [INFO ] [MAIN ] Update Progress: 1852/2366 symbols. RZC took 7.6s. Estimated remaining time: 1h 47m 55s [2025-10-26T01:26:38.987453] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:26:38.987618] [DEBUG] [LOCAL ] S: No existing data file found in primary storage. [2025-10-26T01:26:38.987708] [WARN ] [MAIN ] S: No existing data found, performing full refresh instead. [2025-10-26T01:26:38.987820] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-26T01:26:38.987890] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-26T01:26:38.987997] [DEBUG] [LOCAL ] S: No primary data file found to delete. [2025-10-26T01:26:38.988072] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-26T01:26:59.442835] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-26T01:26:59.849112] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-26T01:26:59.849219] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-26T01:26:59.850347] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-26T01:26:59.850424] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-26T01:26:59.851849] [DEBUG] [LOCAL ] S: Trimmed 77657 records to 54316 (keeping 200 days of data) [2025-10-26T01:27:00.158098] [DEBUG] [LOCAL ] S: Primary data saved (54316 records). [2025-10-26T01:27:00.158238] [INFO ] [MAIN ] S: Full history saved. [2025-10-26T01:27:00.158436] [INFO ] [MAIN ] Update Progress: 1853/2366 symbols. S took 21.3s. Estimated remaining time: 1h 47m 45s [2025-10-26T01:27:00.328722] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:27:00.328934] [DEBUG] [LOCAL ] SA: No existing data file found in primary storage. [2025-10-26T01:27:00.329005] [WARN ] [MAIN ] SA: No existing data found, performing full refresh instead. [2025-10-26T01:27:00.329123] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-26T01:27:00.329203] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-26T01:27:00.329286] [DEBUG] [LOCAL ] SA: No primary data file found to delete. [2025-10-26T01:27:00.329354] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-26T01:27:17.034639] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-26T01:27:17.435631] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-26T01:27:17.435783] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-26T01:27:17.436814] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-26T01:27:17.436899] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-26T01:27:17.438288] [DEBUG] [LOCAL ] SA: Trimmed 63628 records to 45282 (keeping 200 days of data) [2025-10-26T01:27:17.693846] [DEBUG] [LOCAL ] SA: Primary data saved (45282 records). [2025-10-26T01:27:17.694006] [INFO ] [MAIN ] SA: Full history saved. [2025-10-26T01:27:17.694175] [INFO ] [MAIN ] Update Progress: 1854/2366 symbols. SA took 17.5s. Estimated remaining time: 1h 47m 34s [2025-10-26T01:27:17.872233] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:27:17.872471] [DEBUG] [LOCAL ] SABA: No existing data file found in primary storage. [2025-10-26T01:27:17.872544] [WARN ] [MAIN ] SABA: No existing data found, performing full refresh instead. [2025-10-26T01:27:17.872688] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-26T01:27:17.872762] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-26T01:27:17.872844] [DEBUG] [LOCAL ] SABA: No primary data file found to delete. [2025-10-26T01:27:17.872916] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-26T01:27:25.808022] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-26T01:27:26.180379] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-26T01:27:26.180489] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-26T01:27:26.180895] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-26T01:27:26.180976] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-26T01:27:26.181490] [DEBUG] [LOCAL ] SABA: Trimmed 15008 records to 9294 (keeping 200 days of data) [2025-10-26T01:27:26.234470] [DEBUG] [LOCAL ] SABA: Primary data saved (9294 records). [2025-10-26T01:27:26.234614] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-26T01:27:26.234816] [INFO ] [MAIN ] Update Progress: 1855/2366 symbols. SABA took 8.5s. Estimated remaining time: 1h 47m 20s [2025-10-26T01:27:26.403589] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:27:26.403790] [DEBUG] [LOCAL ] SAFE: No existing data file found in primary storage. [2025-10-26T01:27:26.403864] [WARN ] [MAIN ] SAFE: No existing data found, performing full refresh instead. [2025-10-26T01:27:26.403978] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-26T01:27:26.404052] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-26T01:27:26.404133] [DEBUG] [LOCAL ] SAFE: No primary data file found to delete. [2025-10-26T01:27:26.404203] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-26T01:27:39.035232] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-26T01:27:39.417175] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-26T01:27:39.417292] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-26T01:27:39.418303] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-26T01:27:39.418387] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-26T01:27:39.419338] [DEBUG] [LOCAL ] SAFE: Trimmed 43744 records to 30182 (keeping 200 days of data) [2025-10-26T01:27:39.592292] [DEBUG] [LOCAL ] SAFE: Primary data saved (30182 records). [2025-10-26T01:27:39.592447] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-26T01:27:39.592616] [INFO ] [MAIN ] Update Progress: 1856/2366 symbols. SAFE took 13.4s. Estimated remaining time: 1h 47m 8s [2025-10-26T01:27:39.762309] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:27:39.762511] [DEBUG] [LOCAL ] SAH: No existing data file found in primary storage. [2025-10-26T01:27:39.762584] [WARN ] [MAIN ] SAH: No existing data found, performing full refresh instead. [2025-10-26T01:27:39.762723] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-26T01:27:39.762796] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-26T01:27:39.762886] [DEBUG] [LOCAL ] SAH: No primary data file found to delete. [2025-10-26T01:27:39.762958] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-26T01:27:50.553809] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-26T01:27:50.932284] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-26T01:27:50.932402] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-26T01:27:50.933085] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-26T01:27:50.933165] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-26T01:27:50.933978] [DEBUG] [LOCAL ] SAH: Trimmed 31066 records to 21167 (keeping 200 days of data) [2025-10-26T01:27:51.059845] [DEBUG] [LOCAL ] SAH: Primary data saved (21167 records). [2025-10-26T01:27:51.060005] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-26T01:27:51.060177] [INFO ] [MAIN ] Update Progress: 1857/2366 symbols. SAH took 11.5s. Estimated remaining time: 1h 46m 55s [2025-10-26T01:27:51.231216] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:27:51.231469] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-26T01:27:51.231547] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-26T01:27:51.231686] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-26T01:27:51.231757] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-26T01:27:51.231843] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-26T01:27:51.231910] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-26T01:27:54.912946] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-26T01:27:55.184326] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-26T01:27:55.184621] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:27:55.184731] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:27:55.184825] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-26T01:27:55.184947] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-26T01:27:55.185036] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-26T01:27:55.185144] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-26T01:27:55.185403] [INFO ] [MAIN ] Update Progress: 1858/2366 symbols. SAJ took 4.1s. Estimated remaining time: 1h 46m 40s [2025-10-26T01:27:55.408058] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:27:55.408279] [DEBUG] [LOCAL ] SAM: No existing data file found in primary storage. [2025-10-26T01:27:55.408355] [WARN ] [MAIN ] SAM: No existing data found, performing full refresh instead. [2025-10-26T01:27:55.408477] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-26T01:27:55.408552] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-26T01:27:55.408638] [DEBUG] [LOCAL ] SAM: No primary data file found to delete. [2025-10-26T01:27:55.408742] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-26T01:28:07.156069] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-26T01:28:07.532952] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-26T01:28:07.533072] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-26T01:28:07.533780] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-26T01:28:07.533857] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-26T01:28:07.534627] [DEBUG] [LOCAL ] SAM: Trimmed 31283 records to 21603 (keeping 200 days of data) [2025-10-26T01:28:07.658216] [DEBUG] [LOCAL ] SAM: Primary data saved (21603 records). [2025-10-26T01:28:07.658361] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-26T01:28:07.658526] [INFO ] [MAIN ] Update Progress: 1859/2366 symbols. SAM took 12.5s. Estimated remaining time: 1h 46m 27s [2025-10-26T01:28:07.826741] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:28:07.826929] [DEBUG] [LOCAL ] SAN: No existing data file found in primary storage. [2025-10-26T01:28:07.826998] [WARN ] [MAIN ] SAN: No existing data found, performing full refresh instead. [2025-10-26T01:28:07.827111] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-26T01:28:07.827181] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-26T01:28:07.827260] [DEBUG] [LOCAL ] SAN: No primary data file found to delete. [2025-10-26T01:28:07.827329] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-26T01:28:26.879140] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-26T01:28:27.267774] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-26T01:28:27.267902] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-26T01:28:27.269067] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-26T01:28:27.269151] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-26T01:28:27.270624] [DEBUG] [LOCAL ] SAN: Trimmed 76598 records to 53725 (keeping 200 days of data) [2025-10-26T01:28:27.565087] [DEBUG] [LOCAL ] SAN: Primary data saved (53725 records). [2025-10-26T01:28:27.565247] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-26T01:28:27.565548] [INFO ] [MAIN ] Update Progress: 1860/2366 symbols. SAN took 19.9s. Estimated remaining time: 1h 46m 17s [2025-10-26T01:28:27.738596] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:28:27.738840] [DEBUG] [LOCAL ] SAP: No existing data file found in primary storage. [2025-10-26T01:28:27.738914] [WARN ] [MAIN ] SAP: No existing data found, performing full refresh instead. [2025-10-26T01:28:27.739028] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-26T01:28:27.739101] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-26T01:28:27.739188] [DEBUG] [LOCAL ] SAP: No primary data file found to delete. [2025-10-26T01:28:27.739260] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-26T01:28:47.357314] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-26T01:28:47.753625] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-26T01:28:47.753757] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-26T01:28:47.754962] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-26T01:28:47.755052] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-26T01:28:47.756541] [DEBUG] [LOCAL ] SAP: Trimmed 72341 records to 50620 (keeping 200 days of data) [2025-10-26T01:28:48.053492] [DEBUG] [LOCAL ] SAP: Primary data saved (50620 records). [2025-10-26T01:28:48.053679] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-26T01:28:48.053854] [INFO ] [MAIN ] Update Progress: 1861/2366 symbols. SAP took 20.5s. Estimated remaining time: 1h 46m 6s [2025-10-26T01:28:48.219218] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:28:48.219398] [DEBUG] [LOCAL ] SAR: No existing data file found in primary storage. [2025-10-26T01:28:48.219470] [WARN ] [MAIN ] SAR: No existing data found, performing full refresh instead. [2025-10-26T01:28:48.219554] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-26T01:28:48.219638] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-26T01:28:48.219744] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-10-26T01:28:48.219818] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-26T01:28:58.644421] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-26T01:28:59.013620] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-26T01:28:59.013754] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-26T01:28:59.014281] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-26T01:28:59.014357] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-26T01:28:59.015021] [DEBUG] [LOCAL ] SAR: Trimmed 24139 records to 17321 (keeping 200 days of data) [2025-10-26T01:28:59.115868] [DEBUG] [LOCAL ] SAR: Primary data saved (17321 records). [2025-10-26T01:28:59.116060] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-26T01:28:59.116232] [INFO ] [MAIN ] Update Progress: 1862/2366 symbols. SAR took 11.1s. Estimated remaining time: 1h 45m 53s [2025-10-26T01:28:59.285965] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:28:59.286186] [DEBUG] [LOCAL ] SARO: No existing data file found in primary storage. [2025-10-26T01:28:59.286259] [WARN ] [MAIN ] SARO: No existing data found, performing full refresh instead. [2025-10-26T01:28:59.286374] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-26T01:28:59.286446] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-26T01:28:59.286527] [DEBUG] [LOCAL ] SARO: No primary data file found to delete. [2025-10-26T01:28:59.286599] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-26T01:29:16.331698] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-26T01:29:16.716042] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-26T01:29:16.716164] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-26T01:29:16.717223] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-26T01:29:16.717316] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-26T01:29:16.718790] [DEBUG] [LOCAL ] SARO: Trimmed 68989 records to 48929 (keeping 200 days of data) [2025-10-26T01:29:16.984738] [DEBUG] [LOCAL ] SARO: Primary data saved (48929 records). [2025-10-26T01:29:16.984897] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-26T01:29:16.985063] [INFO ] [MAIN ] Update Progress: 1863/2366 symbols. SARO took 17.9s. Estimated remaining time: 1h 45m 42s [2025-10-26T01:29:17.151146] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:29:17.151337] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-26T01:29:17.151410] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-26T01:29:17.151505] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-26T01:29:17.151575] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-26T01:29:17.151679] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-26T01:29:17.151747] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-26T01:29:21.096471] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-26T01:29:21.283993] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-26T01:29:21.284181] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:29:21.284253] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:29:21.284327] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-26T01:29:21.284421] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-26T01:29:21.284515] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-26T01:29:21.284603] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-26T01:29:21.284782] [INFO ] [MAIN ] Update Progress: 1864/2366 symbols. SAT took 4.3s. Estimated remaining time: 1h 45m 27s [2025-10-26T01:29:21.455225] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:29:21.456482] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-26T01:29:21.456556] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-26T01:29:21.456717] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-26T01:29:21.456792] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-26T01:29:21.456872] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-26T01:29:21.456941] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-26T01:29:25.582323] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-26T01:29:25.758836] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-26T01:29:25.759009] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:29:25.759078] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:29:25.759133] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-26T01:29:25.759203] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-26T01:29:25.759278] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-26T01:29:25.759372] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-26T01:29:25.759548] [INFO ] [MAIN ] Update Progress: 1865/2366 symbols. SAY took 4.5s. Estimated remaining time: 1h 45m 12s [2025-10-26T01:29:25.925269] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:29:25.925460] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-26T01:29:25.925530] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-26T01:29:25.925676] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-26T01:29:25.925764] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-26T01:29:25.925856] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-26T01:29:25.925922] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-26T01:29:30.164889] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-26T01:29:30.363614] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T01:29:30.363833] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:29:30.363922] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:29:30.364026] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-26T01:29:30.364148] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-26T01:29:30.364238] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-26T01:29:30.364342] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-26T01:29:30.364539] [INFO ] [MAIN ] Update Progress: 1866/2366 symbols. SAZ took 4.6s. Estimated remaining time: 1h 44m 57s [2025-10-26T01:29:30.530707] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:29:30.530911] [DEBUG] [LOCAL ] SB: No existing data file found in primary storage. [2025-10-26T01:29:30.530997] [WARN ] [MAIN ] SB: No existing data found, performing full refresh instead. [2025-10-26T01:29:30.531128] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-26T01:29:30.531236] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-26T01:29:30.531342] [DEBUG] [LOCAL ] SB: No primary data file found to delete. [2025-10-26T01:29:30.531430] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-26T01:29:44.930359] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-26T01:29:45.316164] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-26T01:29:45.316274] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-26T01:29:45.317171] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-26T01:29:45.317250] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-26T01:29:45.318386] [DEBUG] [LOCAL ] SB: Trimmed 49179 records to 32901 (keeping 200 days of data) [2025-10-26T01:29:45.498390] [DEBUG] [LOCAL ] SB: Primary data saved (32901 records). [2025-10-26T01:29:45.498544] [INFO ] [MAIN ] SB: Full history saved. [2025-10-26T01:29:45.498743] [INFO ] [MAIN ] Update Progress: 1867/2366 symbols. SB took 15.1s. Estimated remaining time: 1h 44m 46s [2025-10-26T01:29:45.668366] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:29:45.668535] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-26T01:29:45.668609] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-26T01:29:45.668764] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-26T01:29:45.668843] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-26T01:29:45.668924] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-26T01:29:45.668995] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-26T01:29:46.233962] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-26T01:29:46.234029] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:29:46.234102] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-26T01:29:46.234193] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-26T01:29:46.234266] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-26T01:29:46.234347] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-26T01:29:46.234499] [INFO ] [MAIN ] Update Progress: 1868/2366 symbols. SBDS took 0.7s. Estimated remaining time: 1h 44m 30s [2025-10-26T01:29:46.401729] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:29:46.401906] [DEBUG] [LOCAL ] SBH: No existing data file found in primary storage. [2025-10-26T01:29:46.401978] [WARN ] [MAIN ] SBH: No existing data found, performing full refresh instead. [2025-10-26T01:29:46.402091] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-26T01:29:46.402164] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-26T01:29:46.402246] [DEBUG] [LOCAL ] SBH: No primary data file found to delete. [2025-10-26T01:29:46.402316] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-26T01:30:02.656227] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-26T01:30:03.047619] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-26T01:30:03.047770] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-26T01:30:03.048904] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-26T01:30:03.048987] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-26T01:30:03.050427] [DEBUG] [LOCAL ] SBH: Trimmed 72999 records to 50564 (keeping 200 days of data) [2025-10-26T01:30:03.324925] [DEBUG] [LOCAL ] SBH: Primary data saved (50564 records). [2025-10-26T01:30:03.325079] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-26T01:30:03.325251] [INFO ] [MAIN ] Update Progress: 1869/2366 symbols. SBH took 17.1s. Estimated remaining time: 1h 44m 18s [2025-10-26T01:30:03.490573] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:30:03.490782] [DEBUG] [LOCAL ] SBI: No existing data file found in primary storage. [2025-10-26T01:30:03.490853] [WARN ] [MAIN ] SBI: No existing data found, performing full refresh instead. [2025-10-26T01:30:03.490967] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-26T01:30:03.491038] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-26T01:30:03.491119] [DEBUG] [LOCAL ] SBI: No primary data file found to delete. [2025-10-26T01:30:03.491187] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-26T01:30:10.551167] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-26T01:30:10.917554] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-26T01:30:10.917691] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-26T01:30:10.918007] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-26T01:30:10.918084] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-26T01:30:10.918543] [DEBUG] [LOCAL ] SBI: Trimmed 10613 records to 7835 (keeping 200 days of data) [2025-10-26T01:30:10.962797] [DEBUG] [LOCAL ] SBI: Primary data saved (7835 records). [2025-10-26T01:30:10.962954] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-26T01:30:10.963123] [INFO ] [MAIN ] Update Progress: 1870/2366 symbols. SBI took 7.6s. Estimated remaining time: 1h 44m 4s [2025-10-26T01:30:11.145288] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:30:11.145481] [DEBUG] [LOCAL ] SBR: No existing data file found in primary storage. [2025-10-26T01:30:11.145557] [WARN ] [MAIN ] SBR: No existing data found, performing full refresh instead. [2025-10-26T01:30:11.145706] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-26T01:30:11.145778] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-26T01:30:11.145863] [DEBUG] [LOCAL ] SBR: No primary data file found to delete. [2025-10-26T01:30:11.145933] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-26T01:30:18.936899] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-26T01:30:19.294252] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-26T01:30:19.294365] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-26T01:30:19.294706] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-26T01:30:19.294798] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-26T01:30:19.295312] [DEBUG] [LOCAL ] SBR: Trimmed 11410 records to 7939 (keeping 200 days of data) [2025-10-26T01:30:19.342161] [DEBUG] [LOCAL ] SBR: Primary data saved (7939 records). [2025-10-26T01:30:19.342362] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-26T01:30:19.342569] [INFO ] [MAIN ] Update Progress: 1871/2366 symbols. SBR took 8.4s. Estimated remaining time: 1h 43m 51s [2025-10-26T01:30:19.508709] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:30:19.508893] [DEBUG] [LOCAL ] SBS: No existing data file found in primary storage. [2025-10-26T01:30:19.508964] [WARN ] [MAIN ] SBS: No existing data found, performing full refresh instead. [2025-10-26T01:30:19.509075] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-26T01:30:19.509143] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-26T01:30:19.509222] [DEBUG] [LOCAL ] SBS: No primary data file found to delete. [2025-10-26T01:30:19.509293] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-26T01:30:36.128870] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-26T01:30:36.517809] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-26T01:30:36.517921] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-26T01:30:36.519013] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-26T01:30:36.519111] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-26T01:30:36.520431] [DEBUG] [LOCAL ] SBS: Trimmed 70697 records to 49990 (keeping 200 days of data) [2025-10-26T01:30:36.801688] [DEBUG] [LOCAL ] SBS: Primary data saved (49990 records). [2025-10-26T01:30:36.801863] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-26T01:30:36.802059] [INFO ] [MAIN ] Update Progress: 1872/2366 symbols. SBS took 17.5s. Estimated remaining time: 1h 43m 39s [2025-10-26T01:30:36.967120] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:30:36.967305] [DEBUG] [LOCAL ] SBSI: No existing data file found in primary storage. [2025-10-26T01:30:36.967374] [WARN ] [MAIN ] SBSI: No existing data found, performing full refresh instead. [2025-10-26T01:30:36.967484] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-26T01:30:36.967553] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-26T01:30:36.967632] [DEBUG] [LOCAL ] SBSI: No primary data file found to delete. [2025-10-26T01:30:36.967722] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-26T01:30:45.777251] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-26T01:30:46.141120] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-26T01:30:46.141244] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-26T01:30:46.141768] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-26T01:30:46.141858] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-26T01:30:46.142578] [DEBUG] [LOCAL ] SBSI: Trimmed 21372 records to 15036 (keeping 200 days of data) [2025-10-26T01:30:46.230254] [DEBUG] [LOCAL ] SBSI: Primary data saved (15036 records). [2025-10-26T01:30:46.230446] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-26T01:30:46.230696] [INFO ] [MAIN ] Update Progress: 1873/2366 symbols. SBSI took 9.4s. Estimated remaining time: 1h 43m 26s [2025-10-26T01:30:46.396367] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:30:46.396587] [DEBUG] [LOCAL ] SBSW: No existing data file found in primary storage. [2025-10-26T01:30:46.396680] [WARN ] [MAIN ] SBSW: No existing data found, performing full refresh instead. [2025-10-26T01:30:46.396792] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-26T01:30:46.396863] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-26T01:30:46.396942] [DEBUG] [LOCAL ] SBSW: No primary data file found to delete. [2025-10-26T01:30:46.397010] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-26T01:31:07.315909] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-26T01:31:07.699195] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-26T01:31:07.699307] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-26T01:31:07.700431] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-26T01:31:07.700524] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-26T01:31:07.702024] [DEBUG] [LOCAL ] SBSW: Trimmed 76768 records to 53964 (keeping 200 days of data) [2025-10-26T01:31:08.000862] [DEBUG] [LOCAL ] SBSW: Primary data saved (53964 records). [2025-10-26T01:31:08.001051] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-26T01:31:08.001234] [INFO ] [MAIN ] Update Progress: 1874/2366 symbols. SBSW took 21.8s. Estimated remaining time: 1h 43m 16s [2025-10-26T01:31:08.167313] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:31:08.167491] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-26T01:31:08.167568] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-26T01:31:08.167700] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-26T01:31:08.167806] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-26T01:31:08.167889] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-26T01:31:08.167955] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-26T01:31:12.629278] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-26T01:31:12.818236] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-26T01:31:12.818425] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:31:12.818499] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:31:12.818575] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-26T01:31:12.818701] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-26T01:31:12.818777] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-26T01:31:12.818858] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-26T01:31:12.819024] [INFO ] [MAIN ] Update Progress: 1875/2366 symbols. SBXD took 4.8s. Estimated remaining time: 1h 43m 1s [2025-10-26T01:31:12.993311] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:31:12.993508] [DEBUG] [LOCAL ] SCCO: No existing data file found in primary storage. [2025-10-26T01:31:12.993580] [WARN ] [MAIN ] SCCO: No existing data found, performing full refresh instead. [2025-10-26T01:31:12.993721] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-26T01:31:12.993793] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-26T01:31:12.993875] [DEBUG] [LOCAL ] SCCO: No primary data file found to delete. [2025-10-26T01:31:12.993947] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-26T01:31:30.619606] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-26T01:31:31.004236] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-26T01:31:31.004385] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-26T01:31:31.005511] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-26T01:31:31.005594] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-26T01:31:31.007060] [DEBUG] [LOCAL ] SCCO: Trimmed 71873 records to 50276 (keeping 200 days of data) [2025-10-26T01:31:31.315640] [DEBUG] [LOCAL ] SCCO: Primary data saved (50276 records). [2025-10-26T01:31:31.315842] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-26T01:31:31.316020] [INFO ] [MAIN ] Update Progress: 1876/2366 symbols. SCCO took 18.5s. Estimated remaining time: 1h 42m 50s [2025-10-26T01:31:31.506929] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:31:31.507176] [DEBUG] [LOCAL ] SCD: No existing data file found in primary storage. [2025-10-26T01:31:31.507249] [WARN ] [MAIN ] SCD: No existing data found, performing full refresh instead. [2025-10-26T01:31:31.507365] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-26T01:31:31.507437] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-26T01:31:31.507529] [DEBUG] [LOCAL ] SCD: No primary data file found to delete. [2025-10-26T01:31:31.507607] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-26T01:31:40.689060] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-26T01:31:41.100632] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-26T01:31:41.100801] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-26T01:31:41.101249] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-26T01:31:41.101332] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-26T01:31:41.101972] [DEBUG] [LOCAL ] SCD: Trimmed 17242 records to 13746 (keeping 200 days of data) [2025-10-26T01:31:41.186508] [DEBUG] [LOCAL ] SCD: Primary data saved (13746 records). [2025-10-26T01:31:41.186698] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-26T01:31:41.186900] [INFO ] [MAIN ] Update Progress: 1877/2366 symbols. SCD took 9.9s. Estimated remaining time: 1h 42m 37s [2025-10-26T01:31:41.375510] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:31:41.375735] [DEBUG] [LOCAL ] SCHW: No existing data file found in primary storage. [2025-10-26T01:31:41.375809] [WARN ] [MAIN ] SCHW: No existing data found, performing full refresh instead. [2025-10-26T01:31:41.375927] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-26T01:31:41.375998] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-26T01:31:41.376082] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-10-26T01:31:41.376154] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-26T01:32:00.069373] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-26T01:32:00.471027] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-26T01:32:00.471139] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-26T01:32:00.472278] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-26T01:32:00.472360] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-26T01:32:00.473903] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 54465 (keeping 200 days of data) [2025-10-26T01:32:00.790233] [DEBUG] [LOCAL ] SCHW: Primary data saved (54465 records). [2025-10-26T01:32:00.790397] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-26T01:32:00.790572] [INFO ] [MAIN ] Update Progress: 1878/2366 symbols. SCHW took 19.6s. Estimated remaining time: 1h 42m 26s [2025-10-26T01:32:00.964045] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:32:00.964227] [DEBUG] [LOCAL ] SCI: No existing data file found in primary storage. [2025-10-26T01:32:00.964297] [WARN ] [MAIN ] SCI: No existing data found, performing full refresh instead. [2025-10-26T01:32:00.964408] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-26T01:32:00.964531] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-26T01:32:00.964618] [DEBUG] [LOCAL ] SCI: No primary data file found to delete. [2025-10-26T01:32:00.964707] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-26T01:32:17.284201] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-26T01:32:17.734382] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-26T01:32:17.734538] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-26T01:32:17.736301] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-26T01:32:17.736387] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-26T01:32:17.738151] [DEBUG] [LOCAL ] SCI: Trimmed 67395 records to 46687 (keeping 200 days of data) [2025-10-26T01:32:18.036903] [DEBUG] [LOCAL ] SCI: Primary data saved (46687 records). [2025-10-26T01:32:18.037139] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-26T01:32:18.037326] [INFO ] [MAIN ] Update Progress: 1879/2366 symbols. SCI took 17.2s. Estimated remaining time: 1h 42m 15s [2025-10-26T01:32:18.209577] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:32:18.209837] [DEBUG] [LOCAL ] SCL: No existing data file found in primary storage. [2025-10-26T01:32:18.209913] [WARN ] [MAIN ] SCL: No existing data found, performing full refresh instead. [2025-10-26T01:32:18.210028] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-26T01:32:18.210102] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-26T01:32:18.210187] [DEBUG] [LOCAL ] SCL: No primary data file found to delete. [2025-10-26T01:32:18.210259] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-26T01:32:27.767245] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-26T01:32:28.161065] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-26T01:32:28.161178] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-26T01:32:28.161749] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-26T01:32:28.161830] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-26T01:32:28.162473] [DEBUG] [LOCAL ] SCL: Trimmed 21721 records to 15455 (keeping 200 days of data) [2025-10-26T01:32:28.251057] [DEBUG] [LOCAL ] SCL: Primary data saved (15455 records). [2025-10-26T01:32:28.251227] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-26T01:32:28.251396] [INFO ] [MAIN ] Update Progress: 1880/2366 symbols. SCL took 10.2s. Estimated remaining time: 1h 42m 2s [2025-10-26T01:32:28.423876] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:32:28.424135] [DEBUG] [LOCAL ] SCM: No existing data file found in primary storage. [2025-10-26T01:32:28.424206] [WARN ] [MAIN ] SCM: No existing data found, performing full refresh instead. [2025-10-26T01:32:28.424335] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-26T01:32:28.424409] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-26T01:32:28.424488] [DEBUG] [LOCAL ] SCM: No primary data file found to delete. [2025-10-26T01:32:28.424557] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-26T01:32:39.660790] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-26T01:32:40.037097] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-26T01:32:40.037209] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-26T01:32:40.037948] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-26T01:32:40.038049] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-26T01:32:40.039064] [DEBUG] [LOCAL ] SCM: Trimmed 29509 records to 20440 (keeping 200 days of data) [2025-10-26T01:32:40.158888] [DEBUG] [LOCAL ] SCM: Primary data saved (20440 records). [2025-10-26T01:32:40.159048] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-26T01:32:40.159226] [INFO ] [MAIN ] Update Progress: 1881/2366 symbols. SCM took 11.9s. Estimated remaining time: 1h 41m 49s [2025-10-26T01:32:40.333371] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:32:40.333623] [DEBUG] [LOCAL ] SCS: No existing data file found in primary storage. [2025-10-26T01:32:40.333741] [WARN ] [MAIN ] SCS: No existing data found, performing full refresh instead. [2025-10-26T01:32:40.333870] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-26T01:32:40.333941] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-26T01:32:40.334031] [DEBUG] [LOCAL ] SCS: No primary data file found to delete. [2025-10-26T01:32:40.334114] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-26T01:32:56.167793] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-26T01:32:56.561711] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-26T01:32:56.561833] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-26T01:32:56.563160] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-26T01:32:56.563244] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-26T01:32:56.564483] [DEBUG] [LOCAL ] SCS: Trimmed 61039 records to 43785 (keeping 200 days of data) [2025-10-26T01:32:56.822824] [DEBUG] [LOCAL ] SCS: Primary data saved (43785 records). [2025-10-26T01:32:56.822984] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-26T01:32:56.823150] [INFO ] [MAIN ] Update Progress: 1882/2366 symbols. SCS took 16.7s. Estimated remaining time: 1h 41m 37s [2025-10-26T01:32:56.996696] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:32:56.996927] [DEBUG] [LOCAL ] SD: No existing data file found in primary storage. [2025-10-26T01:32:56.996997] [WARN ] [MAIN ] SD: No existing data found, performing full refresh instead. [2025-10-26T01:32:56.997105] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-26T01:32:56.997172] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-26T01:32:56.997231] [DEBUG] [LOCAL ] SD: No primary data file found to delete. [2025-10-26T01:32:56.997295] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-26T01:33:10.081138] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-26T01:33:10.460703] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-26T01:33:10.460812] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-26T01:33:10.461685] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-26T01:33:10.461763] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-26T01:33:10.462663] [DEBUG] [LOCAL ] SD: Trimmed 40617 records to 28572 (keeping 200 days of data) [2025-10-26T01:33:10.629329] [DEBUG] [LOCAL ] SD: Primary data saved (28572 records). [2025-10-26T01:33:10.629481] [INFO ] [MAIN ] SD: Full history saved. [2025-10-26T01:33:10.629688] [INFO ] [MAIN ] Update Progress: 1883/2366 symbols. SD took 13.8s. Estimated remaining time: 1h 41m 25s [2025-10-26T01:33:10.799349] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:33:10.799559] [DEBUG] [LOCAL ] SDHC: No existing data file found in primary storage. [2025-10-26T01:33:10.799633] [WARN ] [MAIN ] SDHC: No existing data found, performing full refresh instead. [2025-10-26T01:33:10.799763] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-26T01:33:10.799833] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-26T01:33:10.799930] [DEBUG] [LOCAL ] SDHC: No primary data file found to delete. [2025-10-26T01:33:10.800015] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-26T01:33:19.182501] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-26T01:33:19.542674] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-26T01:33:19.542788] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-26T01:33:19.543265] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-26T01:33:19.543341] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-26T01:33:19.543906] [DEBUG] [LOCAL ] SDHC: Trimmed 16704 records to 10495 (keeping 200 days of data) [2025-10-26T01:33:19.601935] [DEBUG] [LOCAL ] SDHC: Primary data saved (10495 records). [2025-10-26T01:33:19.602093] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-26T01:33:19.602266] [INFO ] [MAIN ] Update Progress: 1884/2366 symbols. SDHC took 9.0s. Estimated remaining time: 1h 41m 11s [2025-10-26T01:33:19.767381] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:33:19.767587] [DEBUG] [LOCAL ] SDHY: No existing data file found in primary storage. [2025-10-26T01:33:19.767679] [WARN ] [MAIN ] SDHY: No existing data found, performing full refresh instead. [2025-10-26T01:33:19.767775] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-26T01:33:19.767843] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-26T01:33:19.767930] [DEBUG] [LOCAL ] SDHY: No primary data file found to delete. [2025-10-26T01:33:19.768016] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-26T01:33:28.310576] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-26T01:33:28.857605] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-26T01:33:28.857803] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-26T01:33:28.858617] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-26T01:33:28.858749] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-26T01:33:28.859956] [DEBUG] [LOCAL ] SDHY: Trimmed 15971 records to 11380 (keeping 200 days of data) [2025-10-26T01:33:28.963836] [DEBUG] [LOCAL ] SDHY: Primary data saved (11380 records). [2025-10-26T01:33:28.964019] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-26T01:33:28.964199] [INFO ] [MAIN ] Update Progress: 1885/2366 symbols. SDHY took 9.4s. Estimated remaining time: 1h 40m 58s [2025-10-26T01:33:29.149845] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:33:29.150074] [DEBUG] [LOCAL ] SDRL: No existing data file found in primary storage. [2025-10-26T01:33:29.150150] [WARN ] [MAIN ] SDRL: No existing data found, performing full refresh instead. [2025-10-26T01:33:29.150297] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-26T01:33:29.150374] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-26T01:33:29.150456] [DEBUG] [LOCAL ] SDRL: No primary data file found to delete. [2025-10-26T01:33:29.150538] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-26T01:33:44.781867] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-26T01:33:45.157625] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-26T01:33:45.157760] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-26T01:33:45.158815] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-26T01:33:45.158894] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-26T01:33:45.160122] [DEBUG] [LOCAL ] SDRL: Trimmed 61255 records to 41771 (keeping 200 days of data) [2025-10-26T01:33:45.388093] [DEBUG] [LOCAL ] SDRL: Primary data saved (41771 records). [2025-10-26T01:33:45.388241] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-26T01:33:45.388402] [INFO ] [MAIN ] Update Progress: 1886/2366 symbols. SDRL took 16.4s. Estimated remaining time: 1h 40m 46s [2025-10-26T01:33:45.558562] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:33:45.558779] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-10-26T01:33:45.558865] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-10-26T01:33:45.558983] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-26T01:33:45.559069] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-26T01:33:45.559157] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-26T01:33:45.559223] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-26T01:34:07.451982] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-26T01:34:07.855832] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-26T01:34:07.855948] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-26T01:34:07.857048] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-26T01:34:07.857131] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-26T01:34:07.858600] [DEBUG] [LOCAL ] SE: Trimmed 77297 records to 54079 (keeping 200 days of data) [2025-10-26T01:34:08.171814] [DEBUG] [LOCAL ] SE: Primary data saved (54079 records). [2025-10-26T01:34:08.172008] [INFO ] [MAIN ] SE: Full history saved. [2025-10-26T01:34:08.172222] [INFO ] [MAIN ] Update Progress: 1887/2366 symbols. SE took 22.8s. Estimated remaining time: 1h 40m 36s [2025-10-26T01:34:08.340163] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:34:08.340389] [DEBUG] [LOCAL ] SEE: No existing data file found in primary storage. [2025-10-26T01:34:08.340478] [WARN ] [MAIN ] SEE: No existing data found, performing full refresh instead. [2025-10-26T01:34:08.340601] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-26T01:34:08.340696] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-26T01:34:08.340796] [DEBUG] [LOCAL ] SEE: No primary data file found to delete. [2025-10-26T01:34:08.340865] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-26T01:34:24.102846] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-26T01:34:24.505448] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-26T01:34:24.505582] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-26T01:34:24.506729] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-26T01:34:24.506811] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-26T01:34:24.508312] [DEBUG] [LOCAL ] SEE: Trimmed 70058 records to 48764 (keeping 200 days of data) [2025-10-26T01:34:24.794482] [DEBUG] [LOCAL ] SEE: Primary data saved (48764 records). [2025-10-26T01:34:24.794673] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-26T01:34:24.794877] [INFO ] [MAIN ] Update Progress: 1888/2366 symbols. SEE took 16.6s. Estimated remaining time: 1h 40m 25s [2025-10-26T01:34:24.965738] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:34:24.965947] [DEBUG] [LOCAL ] SEG: No existing data file found in primary storage. [2025-10-26T01:34:24.966018] [WARN ] [MAIN ] SEG: No existing data found, performing full refresh instead. [2025-10-26T01:34:24.966132] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-26T01:34:24.966229] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-26T01:34:24.966319] [DEBUG] [LOCAL ] SEG: No primary data file found to delete. [2025-10-26T01:34:24.966390] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-26T01:34:34.229183] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-26T01:34:34.606402] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-26T01:34:34.606522] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-26T01:34:34.607031] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-26T01:34:34.607111] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-26T01:34:34.607879] [DEBUG] [LOCAL ] SEG: Trimmed 19780 records to 12604 (keeping 200 days of data) [2025-10-26T01:34:34.682398] [DEBUG] [LOCAL ] SEG: Primary data saved (12604 records). [2025-10-26T01:34:34.682581] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-26T01:34:34.682833] [INFO ] [MAIN ] Update Progress: 1889/2366 symbols. SEG took 9.9s. Estimated remaining time: 1h 40m 11s [2025-10-26T01:34:34.849722] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:34:34.849945] [DEBUG] [LOCAL ] SEI: No existing data file found in primary storage. [2025-10-26T01:34:34.850023] [WARN ] [MAIN ] SEI: No existing data found, performing full refresh instead. [2025-10-26T01:34:34.850136] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-26T01:34:34.850205] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-26T01:34:34.850285] [DEBUG] [LOCAL ] SEI: No primary data file found to delete. [2025-10-26T01:34:34.850354] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-26T01:34:51.805136] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-26T01:34:52.188977] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-26T01:34:52.189102] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-26T01:34:52.190179] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-26T01:34:52.190265] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-26T01:34:52.192257] [DEBUG] [LOCAL ] SEI: Trimmed 71358 records to 50795 (keeping 200 days of data) [2025-10-26T01:34:52.510556] [DEBUG] [LOCAL ] SEI: Primary data saved (50795 records). [2025-10-26T01:34:52.510856] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-26T01:34:52.511089] [INFO ] [MAIN ] Update Progress: 1890/2366 symbols. SEI took 17.8s. Estimated remaining time: 1h 40m 0s [2025-10-26T01:34:52.699116] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:34:52.699446] [DEBUG] [LOCAL ] SEM: No existing data file found in primary storage. [2025-10-26T01:34:52.699527] [WARN ] [MAIN ] SEM: No existing data found, performing full refresh instead. [2025-10-26T01:34:52.699688] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-26T01:34:52.699768] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-26T01:34:52.699856] [DEBUG] [LOCAL ] SEM: No primary data file found to delete. [2025-10-26T01:34:52.699947] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-26T01:35:07.749749] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-26T01:35:08.136357] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-26T01:35:08.136481] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-26T01:35:08.137567] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-26T01:35:08.137691] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-26T01:35:08.139019] [DEBUG] [LOCAL ] SEM: Trimmed 61467 records to 43751 (keeping 200 days of data) [2025-10-26T01:35:08.394238] [DEBUG] [LOCAL ] SEM: Primary data saved (43751 records). [2025-10-26T01:35:08.394390] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-26T01:35:08.394563] [INFO ] [MAIN ] Update Progress: 1891/2366 symbols. SEM took 15.9s. Estimated remaining time: 1h 39m 48s [2025-10-26T01:35:08.565674] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:35:08.565920] [DEBUG] [LOCAL ] SEMR: No existing data file found in primary storage. [2025-10-26T01:35:08.566007] [WARN ] [MAIN ] SEMR: No existing data found, performing full refresh instead. [2025-10-26T01:35:08.566163] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-26T01:35:08.566234] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-26T01:35:08.566314] [DEBUG] [LOCAL ] SEMR: No primary data file found to delete. [2025-10-26T01:35:08.566384] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-26T01:35:23.698483] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-26T01:35:24.077059] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-26T01:35:24.077174] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-26T01:35:24.078183] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-26T01:35:24.078262] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-26T01:35:24.079448] [DEBUG] [LOCAL ] SEMR: Trimmed 60709 records to 42648 (keeping 200 days of data) [2025-10-26T01:35:24.309754] [DEBUG] [LOCAL ] SEMR: Primary data saved (42648 records). [2025-10-26T01:35:24.309903] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-26T01:35:24.310070] [INFO ] [MAIN ] Update Progress: 1892/2366 symbols. SEMR took 15.9s. Estimated remaining time: 1h 39m 37s [2025-10-26T01:35:24.475183] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:35:24.475390] [DEBUG] [LOCAL ] SES: No existing data file found in primary storage. [2025-10-26T01:35:24.475460] [WARN ] [MAIN ] SES: No existing data found, performing full refresh instead. [2025-10-26T01:35:24.475570] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-26T01:35:24.475659] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-26T01:35:24.475745] [DEBUG] [LOCAL ] SES: No primary data file found to delete. [2025-10-26T01:35:24.475812] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-26T01:35:47.907330] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-26T01:35:48.306518] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-26T01:35:48.306632] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-26T01:35:48.307771] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-26T01:35:48.307850] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-26T01:35:48.309352] [DEBUG] [LOCAL ] SES: Trimmed 75646 records to 52393 (keeping 200 days of data) [2025-10-26T01:35:48.601814] [DEBUG] [LOCAL ] SES: Primary data saved (52393 records). [2025-10-26T01:35:48.601990] [INFO ] [MAIN ] SES: Full history saved. [2025-10-26T01:35:48.602162] [INFO ] [MAIN ] Update Progress: 1893/2366 symbols. SES took 24.3s. Estimated remaining time: 1h 39m 27s [2025-10-26T01:35:48.776096] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:35:48.776297] [DEBUG] [LOCAL ] SF: No existing data file found in primary storage. [2025-10-26T01:35:48.776370] [WARN ] [MAIN ] SF: No existing data found, performing full refresh instead. [2025-10-26T01:35:48.776484] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-26T01:35:48.776556] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-26T01:35:48.776615] [DEBUG] [LOCAL ] SF: No primary data file found to delete. [2025-10-26T01:35:48.776703] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-26T01:36:03.258031] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-26T01:36:03.668025] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-26T01:36:03.668151] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-26T01:36:03.669248] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-26T01:36:03.669328] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-26T01:36:03.670625] [DEBUG] [LOCAL ] SF: Trimmed 60434 records to 41965 (keeping 200 days of data) [2025-10-26T01:36:03.923106] [DEBUG] [LOCAL ] SF: Primary data saved (41965 records). [2025-10-26T01:36:03.923260] [INFO ] [MAIN ] SF: Full history saved. [2025-10-26T01:36:03.923452] [INFO ] [MAIN ] Update Progress: 1894/2366 symbols. SF took 15.3s. Estimated remaining time: 1h 39m 15s [2025-10-26T01:36:04.089699] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:36:04.089907] [DEBUG] [LOCAL ] SFB: No existing data file found in primary storage. [2025-10-26T01:36:04.089978] [WARN ] [MAIN ] SFB: No existing data found, performing full refresh instead. [2025-10-26T01:36:04.090098] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-26T01:36:04.090170] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-26T01:36:04.090252] [DEBUG] [LOCAL ] SFB: No primary data file found to delete. [2025-10-26T01:36:04.090321] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-26T01:36:10.205321] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-26T01:36:10.582477] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-26T01:36:10.582590] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-26T01:36:10.582893] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-26T01:36:10.582971] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-26T01:36:10.583429] [DEBUG] [LOCAL ] SFB: Trimmed 5735 records to 3715 (keeping 200 days of data) [2025-10-26T01:36:10.605389] [DEBUG] [LOCAL ] SFB: Primary data saved (3715 records). [2025-10-26T01:36:10.605478] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-26T01:36:10.605699] [INFO ] [MAIN ] Update Progress: 1895/2366 symbols. SFB took 6.7s. Estimated remaining time: 1h 39m 1s [2025-10-26T01:36:10.776224] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:36:10.777347] [DEBUG] [LOCAL ] SFBS: No existing data file found in primary storage. [2025-10-26T01:36:10.777429] [WARN ] [MAIN ] SFBS: No existing data found, performing full refresh instead. [2025-10-26T01:36:10.777581] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-26T01:36:10.777870] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-26T01:36:10.777955] [DEBUG] [LOCAL ] SFBS: No primary data file found to delete. [2025-10-26T01:36:10.778054] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-26T01:36:21.188752] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-26T01:36:21.553984] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-26T01:36:21.554109] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-26T01:36:21.554800] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-26T01:36:21.554881] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-26T01:36:21.555900] [DEBUG] [LOCAL ] SFBS: Trimmed 30570 records to 21716 (keeping 200 days of data) [2025-10-26T01:36:21.687986] [DEBUG] [LOCAL ] SFBS: Primary data saved (21716 records). [2025-10-26T01:36:21.688149] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-26T01:36:21.688321] [INFO ] [MAIN ] Update Progress: 1896/2366 symbols. SFBS took 11.1s. Estimated remaining time: 1h 38m 48s [2025-10-26T01:36:21.853325] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:36:21.853506] [DEBUG] [LOCAL ] SFL: No existing data file found in primary storage. [2025-10-26T01:36:21.853577] [WARN ] [MAIN ] SFL: No existing data found, performing full refresh instead. [2025-10-26T01:36:21.853691] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-26T01:36:21.853764] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-26T01:36:21.853867] [DEBUG] [LOCAL ] SFL: No primary data file found to delete. [2025-10-26T01:36:21.853933] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-26T01:36:38.354318] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-26T01:36:38.757632] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-26T01:36:38.757766] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-26T01:36:38.758867] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-26T01:36:38.758954] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-26T01:36:38.760355] [DEBUG] [LOCAL ] SFL: Trimmed 65892 records to 45839 (keeping 200 days of data) [2025-10-26T01:36:39.018420] [DEBUG] [LOCAL ] SFL: Primary data saved (45839 records). [2025-10-26T01:36:39.018587] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-26T01:36:39.018805] [INFO ] [MAIN ] Update Progress: 1897/2366 symbols. SFL took 17.3s. Estimated remaining time: 1h 38m 36s [2025-10-26T01:36:39.190514] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:36:39.190762] [DEBUG] [LOCAL ] SG: No existing data file found in primary storage. [2025-10-26T01:36:39.190836] [WARN ] [MAIN ] SG: No existing data found, performing full refresh instead. [2025-10-26T01:36:39.190982] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-26T01:36:39.191059] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-26T01:36:39.191142] [DEBUG] [LOCAL ] SG: No primary data file found to delete. [2025-10-26T01:36:39.191217] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-26T01:36:58.718433] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-26T01:36:59.116223] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-26T01:36:59.116346] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-26T01:36:59.117489] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-26T01:36:59.117573] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-26T01:36:59.119156] [DEBUG] [LOCAL ] SG: Trimmed 77483 records to 54281 (keeping 200 days of data) [2025-10-26T01:36:59.420002] [DEBUG] [LOCAL ] SG: Primary data saved (54281 records). [2025-10-26T01:36:59.420164] [INFO ] [MAIN ] SG: Full history saved. [2025-10-26T01:36:59.420360] [INFO ] [MAIN ] Update Progress: 1898/2366 symbols. SG took 20.4s. Estimated remaining time: 1h 38m 26s [2025-10-26T01:36:59.594002] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:36:59.594174] [DEBUG] [LOCAL ] SGHC: No existing data file found in primary storage. [2025-10-26T01:36:59.594257] [WARN ] [MAIN ] SGHC: No existing data found, performing full refresh instead. [2025-10-26T01:36:59.594382] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-26T01:36:59.594454] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-26T01:36:59.594533] [DEBUG] [LOCAL ] SGHC: No primary data file found to delete. [2025-10-26T01:36:59.594602] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-26T01:37:15.127352] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-26T01:37:15.521821] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-26T01:37:15.521939] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-26T01:37:15.522978] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-26T01:37:15.523060] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-26T01:37:15.524466] [DEBUG] [LOCAL ] SGHC: Trimmed 65891 records to 47979 (keeping 200 days of data) [2025-10-26T01:37:15.806147] [DEBUG] [LOCAL ] SGHC: Primary data saved (47979 records). [2025-10-26T01:37:15.806326] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-26T01:37:15.806560] [INFO ] [MAIN ] Update Progress: 1899/2366 symbols. SGHC took 16.4s. Estimated remaining time: 1h 38m 14s [2025-10-26T01:37:15.974924] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:37:15.975101] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-26T01:37:15.975161] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-26T01:37:15.975266] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-26T01:37:15.975339] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-26T01:37:15.975444] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-26T01:37:15.975513] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-26T01:37:16.530263] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-26T01:37:16.530336] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:37:16.530417] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-26T01:37:16.530505] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-26T01:37:16.530575] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-26T01:37:16.530697] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-26T01:37:16.530862] [INFO ] [MAIN ] Update Progress: 1900/2366 symbols. SGI took 0.7s. Estimated remaining time: 1h 37m 59s [2025-10-26T01:37:16.696365] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:37:16.696574] [DEBUG] [LOCAL ] SGU: No existing data file found in primary storage. [2025-10-26T01:37:16.696668] [WARN ] [MAIN ] SGU: No existing data found, performing full refresh instead. [2025-10-26T01:37:16.696783] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-26T01:37:16.696854] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-26T01:37:16.696935] [DEBUG] [LOCAL ] SGU: No primary data file found to delete. [2025-10-26T01:37:16.697005] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-26T01:37:23.851165] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-26T01:37:24.211457] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-26T01:37:24.211592] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-26T01:37:24.211983] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-26T01:37:24.212080] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-26T01:37:24.212623] [DEBUG] [LOCAL ] SGU: Trimmed 8887 records to 6548 (keeping 200 days of data) [2025-10-26T01:37:24.250493] [DEBUG] [LOCAL ] SGU: Primary data saved (6548 records). [2025-10-26T01:37:24.250673] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-26T01:37:24.250876] [INFO ] [MAIN ] Update Progress: 1901/2366 symbols. SGU took 7.7s. Estimated remaining time: 1h 37m 45s [2025-10-26T01:37:24.431825] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:37:24.432009] [DEBUG] [LOCAL ] SHAK: No existing data file found in primary storage. [2025-10-26T01:37:24.432079] [WARN ] [MAIN ] SHAK: No existing data found, performing full refresh instead. [2025-10-26T01:37:24.432190] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-26T01:37:24.432260] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-26T01:37:24.432368] [DEBUG] [LOCAL ] SHAK: No primary data file found to delete. [2025-10-26T01:37:24.432441] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-26T01:37:40.780427] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-26T01:37:41.179451] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-26T01:37:41.179593] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-26T01:37:41.180896] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-26T01:37:41.180998] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-26T01:37:41.182522] [DEBUG] [LOCAL ] SHAK: Trimmed 71231 records to 49337 (keeping 200 days of data) [2025-10-26T01:37:41.469928] [DEBUG] [LOCAL ] SHAK: Primary data saved (49337 records). [2025-10-26T01:37:41.470086] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-26T01:37:41.470255] [INFO ] [MAIN ] Update Progress: 1902/2366 symbols. SHAK took 17.2s. Estimated remaining time: 1h 37m 33s [2025-10-26T01:37:41.660131] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:37:41.660378] [DEBUG] [LOCAL ] SHCO: No existing data file found in primary storage. [2025-10-26T01:37:41.660452] [WARN ] [MAIN ] SHCO: No existing data found, performing full refresh instead. [2025-10-26T01:37:41.660600] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-26T01:37:41.660695] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-26T01:37:41.660779] [DEBUG] [LOCAL ] SHCO: No primary data file found to delete. [2025-10-26T01:37:41.660849] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-26T01:37:53.002714] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-26T01:37:53.368499] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-26T01:37:53.368610] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-26T01:37:53.369366] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-26T01:37:53.369445] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-26T01:37:53.370326] [DEBUG] [LOCAL ] SHCO: Trimmed 37756 records to 25577 (keeping 200 days of data) [2025-10-26T01:37:53.504300] [DEBUG] [LOCAL ] SHCO: Primary data saved (25577 records). [2025-10-26T01:37:53.504446] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-26T01:37:53.504617] [INFO ] [MAIN ] Update Progress: 1903/2366 symbols. SHCO took 12.0s. Estimated remaining time: 1h 37m 20s [2025-10-26T01:37:53.668535] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:37:53.668747] [DEBUG] [LOCAL ] SHEL: No existing data file found in primary storage. [2025-10-26T01:37:53.668818] [WARN ] [MAIN ] SHEL: No existing data found, performing full refresh instead. [2025-10-26T01:37:53.668979] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-26T01:37:53.669051] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-26T01:37:53.669130] [DEBUG] [LOCAL ] SHEL: No primary data file found to delete. [2025-10-26T01:37:53.669196] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-26T01:38:14.101461] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-26T01:38:14.482015] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-26T01:38:14.482132] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-26T01:38:14.483313] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-26T01:38:14.483397] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-26T01:38:14.484944] [DEBUG] [LOCAL ] SHEL: Trimmed 77838 records to 54455 (keeping 200 days of data) [2025-10-26T01:38:14.803098] [DEBUG] [LOCAL ] SHEL: Primary data saved (54455 records). [2025-10-26T01:38:14.803256] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-26T01:38:14.803462] [INFO ] [MAIN ] Update Progress: 1904/2366 symbols. SHEL took 21.3s. Estimated remaining time: 1h 37m 10s [2025-10-26T01:38:14.974075] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:38:14.974275] [DEBUG] [LOCAL ] SHG: No existing data file found in primary storage. [2025-10-26T01:38:14.974348] [WARN ] [MAIN ] SHG: No existing data found, performing full refresh instead. [2025-10-26T01:38:14.974477] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-26T01:38:14.974550] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-26T01:38:14.974631] [DEBUG] [LOCAL ] SHG: No primary data file found to delete. [2025-10-26T01:38:14.974723] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-26T01:38:27.581166] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-26T01:38:27.960868] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-26T01:38:27.961023] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-26T01:38:27.962931] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-26T01:38:27.963021] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-26T01:38:27.964325] [DEBUG] [LOCAL ] SHG: Trimmed 41339 records to 27055 (keeping 200 days of data) [2025-10-26T01:38:28.132626] [DEBUG] [LOCAL ] SHG: Primary data saved (27055 records). [2025-10-26T01:38:28.132882] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-26T01:38:28.133220] [INFO ] [MAIN ] Update Progress: 1905/2366 symbols. SHG took 13.3s. Estimated remaining time: 1h 36m 58s [2025-10-26T01:38:28.310830] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:38:28.311191] [DEBUG] [LOCAL ] SHO: No existing data file found in primary storage. [2025-10-26T01:38:28.311302] [WARN ] [MAIN ] SHO: No existing data found, performing full refresh instead. [2025-10-26T01:38:28.311434] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-26T01:38:28.311511] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-26T01:38:28.311596] [DEBUG] [LOCAL ] SHO: No primary data file found to delete. [2025-10-26T01:38:28.311699] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-26T01:38:43.923402] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-26T01:38:44.302836] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-26T01:38:44.302951] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-26T01:38:44.304068] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-26T01:38:44.304155] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-26T01:38:44.305592] [DEBUG] [LOCAL ] SHO: Trimmed 70674 records to 49713 (keeping 200 days of data) [2025-10-26T01:38:44.589248] [DEBUG] [LOCAL ] SHO: Primary data saved (49713 records). [2025-10-26T01:38:44.589484] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-26T01:38:44.589766] [INFO ] [MAIN ] Update Progress: 1906/2366 symbols. SHO took 16.5s. Estimated remaining time: 1h 36m 46s [2025-10-26T01:38:44.758712] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:38:44.758931] [DEBUG] [LOCAL ] SHOC: No existing data file found in primary storage. [2025-10-26T01:38:44.759017] [WARN ] [MAIN ] SHOC: No existing data found, performing full refresh instead. [2025-10-26T01:38:44.759164] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-26T01:38:44.759250] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-26T01:38:44.759362] [DEBUG] [LOCAL ] SHOC: No primary data file found to delete. [2025-10-26T01:38:44.759445] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-26T01:38:50.743688] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-26T01:38:51.138859] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-26T01:38:51.138970] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-26T01:38:51.139218] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-26T01:38:51.139312] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-26T01:38:51.139782] [DEBUG] [LOCAL ] SHOC: Trimmed 6713 records to 3055 (keeping 200 days of data) [2025-10-26T01:38:51.159056] [DEBUG] [LOCAL ] SHOC: Primary data saved (3055 records). [2025-10-26T01:38:51.159173] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-26T01:38:51.159368] [INFO ] [MAIN ] Update Progress: 1907/2366 symbols. SHOC took 6.6s. Estimated remaining time: 1h 36m 32s [2025-10-26T01:38:51.351221] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:38:51.351414] [DEBUG] [LOCAL ] SHW: No existing data file found in primary storage. [2025-10-26T01:38:51.351486] [WARN ] [MAIN ] SHW: No existing data found, performing full refresh instead. [2025-10-26T01:38:51.351599] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-26T01:38:51.351698] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-26T01:38:51.351778] [DEBUG] [LOCAL ] SHW: No primary data file found to delete. [2025-10-26T01:38:51.351847] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-26T01:39:08.596870] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-26T01:39:08.984228] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-26T01:39:08.984346] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-26T01:39:08.985498] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-26T01:39:08.985579] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-26T01:39:08.986972] [DEBUG] [LOCAL ] SHW: Trimmed 73371 records to 51141 (keeping 200 days of data) [2025-10-26T01:39:09.291726] [DEBUG] [LOCAL ] SHW: Primary data saved (51141 records). [2025-10-26T01:39:09.291893] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-26T01:39:09.292063] [INFO ] [MAIN ] Update Progress: 1908/2366 symbols. SHW took 18.1s. Estimated remaining time: 1h 36m 20s [2025-10-26T01:39:09.458147] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:39:09.458337] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-26T01:39:09.458407] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-26T01:39:09.458518] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-26T01:39:09.458590] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-26T01:39:09.458704] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-26T01:39:09.458774] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-26T01:39:10.030127] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-26T01:39:10.030209] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:39:10.030286] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-26T01:39:10.030391] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-26T01:39:10.030460] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-26T01:39:10.030756] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-26T01:39:10.031259] [INFO ] [MAIN ] Update Progress: 1909/2366 symbols. SI took 0.7s. Estimated remaining time: 1h 36m 5s [2025-10-26T01:39:10.202228] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:39:10.202685] [DEBUG] [LOCAL ] SID: No existing data file found in primary storage. [2025-10-26T01:39:10.202755] [WARN ] [MAIN ] SID: No existing data found, performing full refresh instead. [2025-10-26T01:39:10.202871] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-26T01:39:10.202942] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-26T01:39:10.203007] [DEBUG] [LOCAL ] SID: No primary data file found to delete. [2025-10-26T01:39:10.203069] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-26T01:39:25.375709] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-26T01:39:25.796856] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-26T01:39:25.797038] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-26T01:39:25.798604] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-26T01:39:25.798716] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-26T01:39:25.800550] [DEBUG] [LOCAL ] SID: Trimmed 61174 records to 43537 (keeping 200 days of data) [2025-10-26T01:39:26.054361] [DEBUG] [LOCAL ] SID: Primary data saved (43537 records). [2025-10-26T01:39:26.055008] [INFO ] [MAIN ] SID: Full history saved. [2025-10-26T01:39:26.055260] [INFO ] [MAIN ] Update Progress: 1910/2366 symbols. SID took 16.0s. Estimated remaining time: 1h 35m 53s [2025-10-26T01:39:26.235291] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:39:26.235630] [DEBUG] [LOCAL ] SIG: No existing data file found in primary storage. [2025-10-26T01:39:26.235731] [WARN ] [MAIN ] SIG: No existing data found, performing full refresh instead. [2025-10-26T01:39:26.235859] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-26T01:39:26.235934] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-26T01:39:26.236053] [DEBUG] [LOCAL ] SIG: No primary data file found to delete. [2025-10-26T01:39:26.236127] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-26T01:39:42.516082] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-26T01:39:42.901503] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-26T01:39:42.901633] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-26T01:39:42.902913] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-26T01:39:42.903012] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-26T01:39:42.904492] [DEBUG] [LOCAL ] SIG: Trimmed 67440 records to 45788 (keeping 200 days of data) [2025-10-26T01:39:43.180188] [DEBUG] [LOCAL ] SIG: Primary data saved (45788 records). [2025-10-26T01:39:43.180396] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-26T01:39:43.180689] [INFO ] [MAIN ] Update Progress: 1911/2366 symbols. SIG took 17.1s. Estimated remaining time: 1h 35m 42s [2025-10-26T01:39:43.348153] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:39:43.348342] [DEBUG] [LOCAL ] SII: No existing data file found in primary storage. [2025-10-26T01:39:43.348437] [WARN ] [MAIN ] SII: No existing data found, performing full refresh instead. [2025-10-26T01:39:43.348573] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-26T01:39:43.348667] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-26T01:39:43.348755] [DEBUG] [LOCAL ] SII: No primary data file found to delete. [2025-10-26T01:39:43.348826] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-26T01:39:54.207747] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-26T01:39:54.739844] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-26T01:39:54.739994] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-26T01:39:54.740887] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-26T01:39:54.740974] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-26T01:39:54.742081] [DEBUG] [LOCAL ] SII: Trimmed 31609 records to 24414 (keeping 200 days of data) [2025-10-26T01:39:54.916897] [DEBUG] [LOCAL ] SII: Primary data saved (24414 records). [2025-10-26T01:39:54.917068] [INFO ] [MAIN ] SII: Full history saved. [2025-10-26T01:39:54.917246] [INFO ] [MAIN ] Update Progress: 1912/2366 symbols. SII took 11.7s. Estimated remaining time: 1h 35m 29s [2025-10-26T01:39:55.105977] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:39:55.106222] [DEBUG] [LOCAL ] SILA: No existing data file found in primary storage. [2025-10-26T01:39:55.106294] [WARN ] [MAIN ] SILA: No existing data found, performing full refresh instead. [2025-10-26T01:39:55.106411] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-26T01:39:55.106481] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-26T01:39:55.106578] [DEBUG] [LOCAL ] SILA: No primary data file found to delete. [2025-10-26T01:39:55.106684] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-26T01:40:09.230718] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-26T01:40:09.598900] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-26T01:40:09.599014] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-26T01:40:09.600383] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-26T01:40:09.600462] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-26T01:40:09.601443] [DEBUG] [LOCAL ] SILA: Trimmed 44209 records to 30192 (keeping 200 days of data) [2025-10-26T01:40:09.774762] [DEBUG] [LOCAL ] SILA: Primary data saved (30192 records). [2025-10-26T01:40:09.774923] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-26T01:40:09.775093] [INFO ] [MAIN ] Update Progress: 1913/2366 symbols. SILA took 14.9s. Estimated remaining time: 1h 35m 17s [2025-10-26T01:40:09.948387] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:40:09.948620] [DEBUG] [LOCAL ] SITC: No existing data file found in primary storage. [2025-10-26T01:40:09.948713] [WARN ] [MAIN ] SITC: No existing data found, performing full refresh instead. [2025-10-26T01:40:09.948807] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-26T01:40:09.948875] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-26T01:40:09.948955] [DEBUG] [LOCAL ] SITC: No primary data file found to delete. [2025-10-26T01:40:09.949023] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-26T01:40:24.081851] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-26T01:40:24.482108] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-26T01:40:24.482233] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-26T01:40:24.483252] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-26T01:40:24.483333] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-26T01:40:24.484615] [DEBUG] [LOCAL ] SITC: Trimmed 60709 records to 42374 (keeping 200 days of data) [2025-10-26T01:40:24.720313] [DEBUG] [LOCAL ] SITC: Primary data saved (42374 records). [2025-10-26T01:40:24.720497] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-26T01:40:24.720738] [INFO ] [MAIN ] Update Progress: 1914/2366 symbols. SITC took 14.9s. Estimated remaining time: 1h 35m 5s [2025-10-26T01:40:24.893698] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:40:24.893915] [DEBUG] [LOCAL ] SITE: No existing data file found in primary storage. [2025-10-26T01:40:24.894001] [WARN ] [MAIN ] SITE: No existing data found, performing full refresh instead. [2025-10-26T01:40:24.894135] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-26T01:40:24.894224] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-26T01:40:24.894330] [DEBUG] [LOCAL ] SITE: No primary data file found to delete. [2025-10-26T01:40:24.894419] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-26T01:40:38.595925] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-26T01:40:38.970335] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-26T01:40:38.970452] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-26T01:40:38.971883] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-26T01:40:38.971962] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-26T01:40:38.973149] [DEBUG] [LOCAL ] SITE: Trimmed 50899 records to 36005 (keeping 200 days of data) [2025-10-26T01:40:39.182801] [DEBUG] [LOCAL ] SITE: Primary data saved (36005 records). [2025-10-26T01:40:39.182979] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-26T01:40:39.183173] [INFO ] [MAIN ] Update Progress: 1915/2366 symbols. SITE took 14.5s. Estimated remaining time: 1h 34m 52s [2025-10-26T01:40:39.349527] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:40:39.349749] [DEBUG] [LOCAL ] SJM: No existing data file found in primary storage. [2025-10-26T01:40:39.349822] [WARN ] [MAIN ] SJM: No existing data found, performing full refresh instead. [2025-10-26T01:40:39.349912] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-26T01:40:39.349979] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-26T01:40:39.350089] [DEBUG] [LOCAL ] SJM: No primary data file found to delete. [2025-10-26T01:40:39.350160] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-26T01:40:55.169588] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-26T01:40:55.564268] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-26T01:40:55.564377] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-26T01:40:55.565485] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-26T01:40:55.565566] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-26T01:40:55.567077] [DEBUG] [LOCAL ] SJM: Trimmed 72305 records to 50779 (keeping 200 days of data) [2025-10-26T01:40:55.873597] [DEBUG] [LOCAL ] SJM: Primary data saved (50779 records). [2025-10-26T01:40:55.873792] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-26T01:40:55.873998] [INFO ] [MAIN ] Update Progress: 1916/2366 symbols. SJM took 16.7s. Estimated remaining time: 1h 34m 41s [2025-10-26T01:40:56.045790] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:40:56.046001] [DEBUG] [LOCAL ] SJT: No existing data file found in primary storage. [2025-10-26T01:40:56.046071] [WARN ] [MAIN ] SJT: No existing data found, performing full refresh instead. [2025-10-26T01:40:56.046188] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-26T01:40:56.046259] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-26T01:40:56.046359] [DEBUG] [LOCAL ] SJT: No primary data file found to delete. [2025-10-26T01:40:56.046428] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-26T01:41:07.223491] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-26T01:41:07.615324] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-26T01:41:07.615470] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-26T01:41:07.616258] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-26T01:41:07.616339] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-26T01:41:07.617166] [DEBUG] [LOCAL ] SJT: Trimmed 31905 records to 22871 (keeping 200 days of data) [2025-10-26T01:41:07.738675] [DEBUG] [LOCAL ] SJT: Primary data saved (22871 records). [2025-10-26T01:41:07.738834] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-26T01:41:07.739189] [INFO ] [MAIN ] Update Progress: 1917/2366 symbols. SJT took 11.9s. Estimated remaining time: 1h 34m 28s [2025-10-26T01:41:07.905759] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:41:07.905978] [DEBUG] [LOCAL ] SKE: No existing data file found in primary storage. [2025-10-26T01:41:07.906050] [WARN ] [MAIN ] SKE: No existing data found, performing full refresh instead. [2025-10-26T01:41:07.906187] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-26T01:41:07.906261] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-26T01:41:07.906345] [DEBUG] [LOCAL ] SKE: No primary data file found to delete. [2025-10-26T01:41:07.906425] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-26T01:41:22.116244] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-26T01:41:22.499625] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-26T01:41:22.499760] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-26T01:41:22.500721] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-26T01:41:22.500802] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-26T01:41:22.501890] [DEBUG] [LOCAL ] SKE: Trimmed 52622 records to 37860 (keeping 200 days of data) [2025-10-26T01:41:22.710748] [DEBUG] [LOCAL ] SKE: Primary data saved (37860 records). [2025-10-26T01:41:22.710922] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-26T01:41:22.711093] [INFO ] [MAIN ] Update Progress: 1918/2366 symbols. SKE took 15.0s. Estimated remaining time: 1h 34m 16s [2025-10-26T01:41:22.881625] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:41:22.881864] [DEBUG] [LOCAL ] SKIL: No existing data file found in primary storage. [2025-10-26T01:41:22.881940] [WARN ] [MAIN ] SKIL: No existing data found, performing full refresh instead. [2025-10-26T01:41:22.882031] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-26T01:41:22.882101] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-26T01:41:22.882185] [DEBUG] [LOCAL ] SKIL: No primary data file found to delete. [2025-10-26T01:41:22.882256] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-26T01:41:30.294923] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-26T01:41:30.643976] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-26T01:41:30.644086] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-26T01:41:30.644373] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-26T01:41:30.644451] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-26T01:41:30.644926] [DEBUG] [LOCAL ] SKIL: Trimmed 10458 records to 7037 (keeping 200 days of data) [2025-10-26T01:41:30.684154] [DEBUG] [LOCAL ] SKIL: Primary data saved (7037 records). [2025-10-26T01:41:30.684287] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-26T01:41:30.684454] [INFO ] [MAIN ] Update Progress: 1919/2366 symbols. SKIL took 8.0s. Estimated remaining time: 1h 34m 2s [2025-10-26T01:41:30.848916] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:41:30.849126] [DEBUG] [LOCAL ] SKLZ: No existing data file found in primary storage. [2025-10-26T01:41:30.849216] [WARN ] [MAIN ] SKLZ: No existing data found, performing full refresh instead. [2025-10-26T01:41:30.849328] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-26T01:41:30.849398] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-26T01:41:30.849479] [DEBUG] [LOCAL ] SKLZ: No primary data file found to delete. [2025-10-26T01:41:30.849548] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-26T01:41:39.692516] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-26T01:41:40.059333] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-26T01:41:40.059455] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-26T01:41:40.060002] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-26T01:41:40.060085] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-26T01:41:40.060725] [DEBUG] [LOCAL ] SKLZ: Trimmed 17632 records to 11680 (keeping 200 days of data) [2025-10-26T01:41:40.125723] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11680 records). [2025-10-26T01:41:40.125897] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-26T01:41:40.126136] [INFO ] [MAIN ] Update Progress: 1920/2366 symbols. SKLZ took 9.4s. Estimated remaining time: 1h 33m 49s [2025-10-26T01:41:40.291032] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:41:40.291215] [DEBUG] [LOCAL ] SKM: No existing data file found in primary storage. [2025-10-26T01:41:40.291286] [WARN ] [MAIN ] SKM: No existing data found, performing full refresh instead. [2025-10-26T01:41:40.291399] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-26T01:41:40.291470] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-26T01:41:40.291582] [DEBUG] [LOCAL ] SKM: No primary data file found to delete. [2025-10-26T01:41:40.291673] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-26T01:41:54.221540] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-26T01:41:54.606669] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-26T01:41:54.606789] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-26T01:41:54.607741] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-26T01:41:54.607820] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-26T01:41:54.608942] [DEBUG] [LOCAL ] SKM: Trimmed 49462 records to 35723 (keeping 200 days of data) [2025-10-26T01:41:54.817876] [DEBUG] [LOCAL ] SKM: Primary data saved (35723 records). [2025-10-26T01:41:54.818075] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-26T01:41:54.818246] [INFO ] [MAIN ] Update Progress: 1921/2366 symbols. SKM took 14.7s. Estimated remaining time: 1h 33m 37s [2025-10-26T01:41:54.991229] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:41:54.991452] [DEBUG] [LOCAL ] SKT: No existing data file found in primary storage. [2025-10-26T01:41:54.991524] [WARN ] [MAIN ] SKT: No existing data found, performing full refresh instead. [2025-10-26T01:41:54.991695] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-26T01:41:54.991770] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-26T01:41:54.991839] [DEBUG] [LOCAL ] SKT: No primary data file found to delete. [2025-10-26T01:41:54.991905] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-26T01:42:09.786004] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-26T01:42:10.159614] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-26T01:42:10.159757] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-26T01:42:10.160879] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-26T01:42:10.160972] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-26T01:42:10.162176] [DEBUG] [LOCAL ] SKT: Trimmed 60710 records to 42760 (keeping 200 days of data) [2025-10-26T01:42:10.409730] [DEBUG] [LOCAL ] SKT: Primary data saved (42760 records). [2025-10-26T01:42:10.410010] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-26T01:42:10.410201] [INFO ] [MAIN ] Update Progress: 1922/2366 symbols. SKT took 15.6s. Estimated remaining time: 1h 33m 25s [2025-10-26T01:42:10.575399] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:42:10.575662] [DEBUG] [LOCAL ] SKY: No existing data file found in primary storage. [2025-10-26T01:42:10.575735] [WARN ] [MAIN ] SKY: No existing data found, performing full refresh instead. [2025-10-26T01:42:10.575847] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-26T01:42:10.575947] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-26T01:42:10.576060] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-10-26T01:42:10.576128] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-26T01:42:24.379891] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-26T01:42:24.780748] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-26T01:42:24.780927] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-26T01:42:24.782425] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-26T01:42:24.782511] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-26T01:42:24.784331] [DEBUG] [LOCAL ] SKY: Trimmed 54257 records to 39089 (keeping 200 days of data) [2025-10-26T01:42:25.018807] [DEBUG] [LOCAL ] SKY: Primary data saved (39089 records). [2025-10-26T01:42:25.019050] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-26T01:42:25.019335] [INFO ] [MAIN ] Update Progress: 1923/2366 symbols. SKY took 14.6s. Estimated remaining time: 1h 33m 13s [2025-10-26T01:42:25.200930] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:42:25.201204] [DEBUG] [LOCAL ] SKYH: No existing data file found in primary storage. [2025-10-26T01:42:25.201281] [WARN ] [MAIN ] SKYH: No existing data found, performing full refresh instead. [2025-10-26T01:42:25.201480] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-26T01:42:25.201559] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-26T01:42:25.201685] [DEBUG] [LOCAL ] SKYH: No primary data file found to delete. [2025-10-26T01:42:25.201757] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-26T01:42:35.271773] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-26T01:42:35.658216] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-26T01:42:35.658394] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-26T01:42:35.659137] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-26T01:42:35.659238] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-26T01:42:35.660331] [DEBUG] [LOCAL ] SKYH: Trimmed 22352 records to 15911 (keeping 200 days of data) [2025-10-26T01:42:35.753136] [DEBUG] [LOCAL ] SKYH: Primary data saved (15911 records). [2025-10-26T01:42:35.753382] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-26T01:42:35.753630] [INFO ] [MAIN ] Update Progress: 1924/2366 symbols. SKYH took 10.7s. Estimated remaining time: 1h 32m 60s [2025-10-26T01:42:35.928816] [INFO ] [MAIN ] SLAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:42:35.929100] [DEBUG] [LOCAL ] SLAI: No existing data file found in primary storage. [2025-10-26T01:42:35.929172] [WARN ] [MAIN ] SLAI: No existing data found, performing full refresh instead. [2025-10-26T01:42:35.929296] [INFO ] [MAIN ] SLAI: Wiping existing primary data before full refresh. [2025-10-26T01:42:35.929365] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-26T01:42:35.929509] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-26T01:42:35.929580] [INFO ] [MAIN ] SLAI: Starting full primary refresh. [2025-10-26T01:42:36.547616] [FATAL] [MAIN ] SLAI: Failed to fetch primary data. [2025-10-26T01:42:36.547712] [WARN ] [MAIN ] SLAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:42:36.547789] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-26T01:42:36.547890] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-26T01:42:36.547987] [INFO ] [LOCAL ] SLAI: Starting deletion of derivative data. [2025-10-26T01:42:36.548079] [DEBUG] [LOCAL ] SLAI: No derivative data file found to delete. [2025-10-26T01:42:36.548300] [INFO ] [MAIN ] Update Progress: 1925/2366 symbols. SLAI took 0.8s. Estimated remaining time: 1h 32m 44s [2025-10-26T01:42:36.724490] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:42:36.724797] [DEBUG] [LOCAL ] SLB: No existing data file found in primary storage. [2025-10-26T01:42:36.724873] [WARN ] [MAIN ] SLB: No existing data found, performing full refresh instead. [2025-10-26T01:42:36.725005] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-26T01:42:36.725082] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-26T01:42:36.725165] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-26T01:42:36.725233] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-26T01:42:55.586550] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-26T01:42:55.997116] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-26T01:42:55.997280] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-26T01:42:55.999561] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-26T01:42:55.999674] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-26T01:42:56.001814] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 54477 (keeping 200 days of data) [2025-10-26T01:42:56.382191] [DEBUG] [LOCAL ] SLB: Primary data saved (54477 records). [2025-10-26T01:42:56.382442] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-26T01:42:56.382792] [INFO ] [MAIN ] Update Progress: 1926/2366 symbols. SLB took 19.8s. Estimated remaining time: 1h 32m 33s [2025-10-26T01:42:56.609595] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:42:56.609894] [DEBUG] [LOCAL ] SLF: No existing data file found in primary storage. [2025-10-26T01:42:56.609967] [WARN ] [MAIN ] SLF: No existing data found, performing full refresh instead. [2025-10-26T01:42:56.610093] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-26T01:42:56.610206] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-26T01:42:56.610293] [DEBUG] [LOCAL ] SLF: No primary data file found to delete. [2025-10-26T01:42:56.610367] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-26T01:43:11.547423] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-26T01:43:11.942992] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-26T01:43:11.943118] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-26T01:43:11.944117] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-26T01:43:11.944202] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-26T01:43:11.945495] [DEBUG] [LOCAL ] SLF: Trimmed 56205 records to 38710 (keeping 200 days of data) [2025-10-26T01:43:12.171216] [DEBUG] [LOCAL ] SLF: Primary data saved (38710 records). [2025-10-26T01:43:12.171390] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-26T01:43:12.171568] [INFO ] [MAIN ] Update Progress: 1927/2366 symbols. SLF took 15.8s. Estimated remaining time: 1h 32m 21s [2025-10-26T01:43:12.370892] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:43:12.371132] [DEBUG] [LOCAL ] SLG: No existing data file found in primary storage. [2025-10-26T01:43:12.371205] [WARN ] [MAIN ] SLG: No existing data found, performing full refresh instead. [2025-10-26T01:43:12.371320] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-26T01:43:12.371392] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-26T01:43:12.371475] [DEBUG] [LOCAL ] SLG: No primary data file found to delete. [2025-10-26T01:43:12.371546] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-26T01:43:27.454664] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-26T01:43:27.839146] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-26T01:43:27.839261] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-26T01:43:27.840417] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-26T01:43:27.840500] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-26T01:43:27.841891] [DEBUG] [LOCAL ] SLG: Trimmed 65271 records to 46485 (keeping 200 days of data) [2025-10-26T01:43:28.112237] [DEBUG] [LOCAL ] SLG: Primary data saved (46485 records). [2025-10-26T01:43:28.112401] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-26T01:43:28.112573] [INFO ] [MAIN ] Update Progress: 1928/2366 symbols. SLG took 15.9s. Estimated remaining time: 1h 32m 9s [2025-10-26T01:43:28.284216] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:43:28.284445] [DEBUG] [LOCAL ] SLGN: No existing data file found in primary storage. [2025-10-26T01:43:28.284516] [WARN ] [MAIN ] SLGN: No existing data found, performing full refresh instead. [2025-10-26T01:43:28.284631] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-26T01:43:28.284721] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-26T01:43:28.284803] [DEBUG] [LOCAL ] SLGN: No primary data file found to delete. [2025-10-26T01:43:28.284872] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-26T01:43:42.993399] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-26T01:43:43.387438] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-26T01:43:43.387569] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-26T01:43:43.388883] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-26T01:43:43.388974] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-26T01:43:43.390332] [DEBUG] [LOCAL ] SLGN: Trimmed 59447 records to 41649 (keeping 200 days of data) [2025-10-26T01:43:43.630920] [DEBUG] [LOCAL ] SLGN: Primary data saved (41649 records). [2025-10-26T01:43:43.631072] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-26T01:43:43.631237] [INFO ] [MAIN ] Update Progress: 1929/2366 symbols. SLGN took 15.5s. Estimated remaining time: 1h 31m 58s [2025-10-26T01:43:43.796226] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:43:43.796381] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-26T01:43:43.796450] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-26T01:43:43.796561] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-26T01:43:43.796681] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-26T01:43:43.796751] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-26T01:43:43.796821] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-26T01:43:47.703273] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-26T01:43:47.905610] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-26T01:43:47.905806] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:43:47.905907] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:43:47.906003] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-26T01:43:47.906098] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-26T01:43:47.906171] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-26T01:43:47.906251] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-26T01:43:47.906408] [INFO ] [MAIN ] Update Progress: 1930/2366 symbols. SLNZ took 4.3s. Estimated remaining time: 1h 31m 43s [2025-10-26T01:43:48.097684] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:43:48.097899] [DEBUG] [LOCAL ] SLQT: No existing data file found in primary storage. [2025-10-26T01:43:48.097996] [WARN ] [MAIN ] SLQT: No existing data found, performing full refresh instead. [2025-10-26T01:43:48.098123] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-26T01:43:48.098215] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-26T01:43:48.098298] [DEBUG] [LOCAL ] SLQT: No primary data file found to delete. [2025-10-26T01:43:48.098365] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-26T01:44:03.941719] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-26T01:44:04.329616] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-26T01:44:04.329769] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-26T01:44:04.330932] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-26T01:44:04.331031] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-26T01:44:04.332462] [DEBUG] [LOCAL ] SLQT: Trimmed 63664 records to 43908 (keeping 200 days of data) [2025-10-26T01:44:04.570068] [DEBUG] [LOCAL ] SLQT: Primary data saved (43908 records). [2025-10-26T01:44:04.570246] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-26T01:44:04.570420] [INFO ] [MAIN ] Update Progress: 1931/2366 symbols. SLQT took 16.7s. Estimated remaining time: 1h 31m 31s [2025-10-26T01:44:04.740322] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:44:04.740559] [DEBUG] [LOCAL ] SLVM: No existing data file found in primary storage. [2025-10-26T01:44:04.740630] [WARN ] [MAIN ] SLVM: No existing data found, performing full refresh instead. [2025-10-26T01:44:04.740764] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-26T01:44:04.740834] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-26T01:44:04.740914] [DEBUG] [LOCAL ] SLVM: No primary data file found to delete. [2025-10-26T01:44:04.740983] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-26T01:44:16.739574] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-26T01:44:17.121537] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-26T01:44:17.121669] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-26T01:44:17.122487] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-26T01:44:17.122566] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-26T01:44:17.123448] [DEBUG] [LOCAL ] SLVM: Trimmed 40074 records to 28055 (keeping 200 days of data) [2025-10-26T01:44:17.286223] [DEBUG] [LOCAL ] SLVM: Primary data saved (28055 records). [2025-10-26T01:44:17.286380] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-26T01:44:17.286572] [INFO ] [MAIN ] Update Progress: 1932/2366 symbols. SLVM took 12.7s. Estimated remaining time: 1h 31m 19s [2025-10-26T01:44:17.453494] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:44:17.453722] [DEBUG] [LOCAL ] SM: No existing data file found in primary storage. [2025-10-26T01:44:17.453794] [WARN ] [MAIN ] SM: No existing data found, performing full refresh instead. [2025-10-26T01:44:17.453942] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-26T01:44:17.454014] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-26T01:44:17.454097] [DEBUG] [LOCAL ] SM: No primary data file found to delete. [2025-10-26T01:44:17.454173] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-26T01:44:34.324434] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-26T01:44:34.715860] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-26T01:44:34.715979] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-26T01:44:34.717131] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-26T01:44:34.717230] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-26T01:44:34.718696] [DEBUG] [LOCAL ] SM: Trimmed 75940 records to 53126 (keeping 200 days of data) [2025-10-26T01:44:35.025345] [DEBUG] [LOCAL ] SM: Primary data saved (53126 records). [2025-10-26T01:44:35.025525] [INFO ] [MAIN ] SM: Full history saved. [2025-10-26T01:44:35.025735] [INFO ] [MAIN ] Update Progress: 1933/2366 symbols. SM took 17.7s. Estimated remaining time: 1h 31m 7s [2025-10-26T01:44:35.192816] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:44:35.192984] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-26T01:44:35.193053] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-26T01:44:35.193165] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-26T01:44:35.193238] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-26T01:44:35.193317] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-26T01:44:35.193382] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-26T01:44:35.768257] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-26T01:44:35.768332] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:44:35.768405] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-26T01:44:35.768497] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-26T01:44:35.768564] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-26T01:44:35.768665] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-26T01:44:35.768816] [INFO ] [MAIN ] Update Progress: 1934/2366 symbols. SMA took 0.7s. Estimated remaining time: 1h 30m 52s [2025-10-26T01:44:35.934795] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:44:35.934985] [DEBUG] [LOCAL ] SMBK: No existing data file found in primary storage. [2025-10-26T01:44:35.935054] [WARN ] [MAIN ] SMBK: No existing data found, performing full refresh instead. [2025-10-26T01:44:35.935182] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-26T01:44:35.935268] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-26T01:44:35.935376] [DEBUG] [LOCAL ] SMBK: No primary data file found to delete. [2025-10-26T01:44:35.935463] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-26T01:44:43.819401] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-26T01:44:44.172928] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-26T01:44:44.173041] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-26T01:44:44.173348] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-26T01:44:44.173424] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-26T01:44:44.173930] [DEBUG] [LOCAL ] SMBK: Trimmed 11877 records to 8404 (keeping 200 days of data) [2025-10-26T01:44:44.221590] [DEBUG] [LOCAL ] SMBK: Primary data saved (8404 records). [2025-10-26T01:44:44.221761] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-26T01:44:44.221928] [INFO ] [MAIN ] Update Progress: 1935/2366 symbols. SMBK took 8.5s. Estimated remaining time: 1h 30m 38s [2025-10-26T01:44:44.385866] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:44:44.386092] [DEBUG] [LOCAL ] SMC: No existing data file found in primary storage. [2025-10-26T01:44:44.386165] [WARN ] [MAIN ] SMC: No existing data found, performing full refresh instead. [2025-10-26T01:44:44.386277] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-26T01:44:44.386348] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-26T01:44:44.386427] [DEBUG] [LOCAL ] SMC: No primary data file found to delete. [2025-10-26T01:44:44.386496] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-26T01:44:52.639203] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-26T01:44:53.009086] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-26T01:44:53.009250] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-26T01:44:53.009899] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-26T01:44:53.009982] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-26T01:44:53.010733] [DEBUG] [LOCAL ] SMC: Trimmed 16490 records to 11019 (keeping 200 days of data) [2025-10-26T01:44:53.076434] [DEBUG] [LOCAL ] SMC: Primary data saved (11019 records). [2025-10-26T01:44:53.076686] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-26T01:44:53.076918] [INFO ] [MAIN ] Update Progress: 1936/2366 symbols. SMC took 8.9s. Estimated remaining time: 1h 30m 25s [2025-10-26T01:44:53.248948] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:44:53.249326] [DEBUG] [LOCAL ] SMFG: No existing data file found in primary storage. [2025-10-26T01:44:53.249424] [WARN ] [MAIN ] SMFG: No existing data found, performing full refresh instead. [2025-10-26T01:44:53.249548] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-26T01:44:53.249620] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-26T01:44:53.249727] [DEBUG] [LOCAL ] SMFG: No primary data file found to delete. [2025-10-26T01:44:53.249799] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-26T01:45:10.927627] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-26T01:45:11.318142] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-26T01:45:11.318290] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-26T01:45:11.319376] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-26T01:45:11.319459] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-26T01:45:11.321057] [DEBUG] [LOCAL ] SMFG: Trimmed 69307 records to 48970 (keeping 200 days of data) [2025-10-26T01:45:11.599091] [DEBUG] [LOCAL ] SMFG: Primary data saved (48970 records). [2025-10-26T01:45:11.599273] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-26T01:45:11.599453] [INFO ] [MAIN ] Update Progress: 1937/2366 symbols. SMFG took 18.5s. Estimated remaining time: 1h 30m 14s [2025-10-26T01:45:11.766730] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:45:11.766955] [DEBUG] [LOCAL ] SMG: No existing data file found in primary storage. [2025-10-26T01:45:11.767026] [WARN ] [MAIN ] SMG: No existing data found, performing full refresh instead. [2025-10-26T01:45:11.767141] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-26T01:45:11.767212] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-26T01:45:11.767285] [DEBUG] [LOCAL ] SMG: No primary data file found to delete. [2025-10-26T01:45:11.767349] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-26T01:45:27.098178] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-26T01:45:27.496323] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-26T01:45:27.497060] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-26T01:45:27.498305] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-26T01:45:27.498393] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-26T01:45:27.499848] [DEBUG] [LOCAL ] SMG: Trimmed 62684 records to 43177 (keeping 200 days of data) [2025-10-26T01:45:27.765951] [DEBUG] [LOCAL ] SMG: Primary data saved (43177 records). [2025-10-26T01:45:27.766118] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-26T01:45:27.766308] [INFO ] [MAIN ] Update Progress: 1938/2366 symbols. SMG took 16.2s. Estimated remaining time: 1h 30m 2s [2025-10-26T01:45:27.932237] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:45:27.932429] [DEBUG] [LOCAL ] SMHI: No existing data file found in primary storage. [2025-10-26T01:45:27.932501] [WARN ] [MAIN ] SMHI: No existing data found, performing full refresh instead. [2025-10-26T01:45:27.932609] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-26T01:45:27.932699] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-26T01:45:27.932781] [DEBUG] [LOCAL ] SMHI: No primary data file found to delete. [2025-10-26T01:45:27.932830] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-26T01:45:37.100461] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-26T01:45:37.467735] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-26T01:45:37.467839] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-26T01:45:37.468403] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-26T01:45:37.468485] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-26T01:45:37.469103] [DEBUG] [LOCAL ] SMHI: Trimmed 20993 records to 12759 (keeping 200 days of data) [2025-10-26T01:45:37.535631] [DEBUG] [LOCAL ] SMHI: Primary data saved (12759 records). [2025-10-26T01:45:37.535809] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-26T01:45:37.535986] [INFO ] [MAIN ] Update Progress: 1939/2366 symbols. SMHI took 9.8s. Estimated remaining time: 1h 29m 49s [2025-10-26T01:45:37.702600] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:45:37.702819] [DEBUG] [LOCAL ] SMP: No existing data file found in primary storage. [2025-10-26T01:45:37.702894] [WARN ] [MAIN ] SMP: No existing data found, performing full refresh instead. [2025-10-26T01:45:37.703012] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-26T01:45:37.703084] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-26T01:45:37.703167] [DEBUG] [LOCAL ] SMP: No primary data file found to delete. [2025-10-26T01:45:37.703298] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-26T01:45:47.811533] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-26T01:45:48.189042] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-26T01:45:48.189171] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-26T01:45:48.189862] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-26T01:45:48.189966] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-26T01:45:48.190812] [DEBUG] [LOCAL ] SMP: Trimmed 26681 records to 18950 (keeping 200 days of data) [2025-10-26T01:45:48.301812] [DEBUG] [LOCAL ] SMP: Primary data saved (18950 records). [2025-10-26T01:45:48.301999] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-26T01:45:48.302192] [INFO ] [MAIN ] Update Progress: 1940/2366 symbols. SMP took 10.8s. Estimated remaining time: 1h 29m 36s [2025-10-26T01:45:48.471944] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:45:48.472160] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-10-26T01:45:48.472233] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-10-26T01:45:48.472344] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-26T01:45:48.472412] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-26T01:45:48.472500] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-26T01:45:48.472574] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-26T01:46:15.252682] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-26T01:46:15.640214] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-26T01:46:15.640326] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-26T01:46:15.641402] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-26T01:46:15.641484] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-26T01:46:15.642932] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 54579 (keeping 200 days of data) [2025-10-26T01:46:15.946680] [DEBUG] [LOCAL ] SMR: Primary data saved (54579 records). [2025-10-26T01:46:15.946840] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-26T01:46:15.947010] [INFO ] [MAIN ] Update Progress: 1941/2366 symbols. SMR took 27.6s. Estimated remaining time: 1h 29m 26s [2025-10-26T01:46:16.116141] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:46:16.116317] [DEBUG] [LOCAL ] SMRT: No existing data file found in primary storage. [2025-10-26T01:46:16.116389] [WARN ] [MAIN ] SMRT: No existing data found, performing full refresh instead. [2025-10-26T01:46:16.116502] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-26T01:46:16.116574] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-26T01:46:16.116682] [DEBUG] [LOCAL ] SMRT: No primary data file found to delete. [2025-10-26T01:46:16.116755] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-26T01:46:31.724154] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-26T01:46:32.106589] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-26T01:46:32.106722] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-26T01:46:32.107731] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-26T01:46:32.107812] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-26T01:46:32.109099] [DEBUG] [LOCAL ] SMRT: Trimmed 62521 records to 44278 (keeping 200 days of data) [2025-10-26T01:46:32.345103] [DEBUG] [LOCAL ] SMRT: Primary data saved (44278 records). [2025-10-26T01:46:32.345255] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-26T01:46:32.345425] [INFO ] [MAIN ] Update Progress: 1942/2366 symbols. SMRT took 16.4s. Estimated remaining time: 1h 29m 14s [2025-10-26T01:46:32.517011] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:46:32.517237] [DEBUG] [LOCAL ] SMWB: No existing data file found in primary storage. [2025-10-26T01:46:32.517312] [WARN ] [MAIN ] SMWB: No existing data found, performing full refresh instead. [2025-10-26T01:46:32.517426] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-26T01:46:32.517498] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-26T01:46:32.517582] [DEBUG] [LOCAL ] SMWB: No primary data file found to delete. [2025-10-26T01:46:32.517681] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-26T01:46:46.347746] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-26T01:46:46.729425] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-26T01:46:46.729537] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-26T01:46:46.730559] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-26T01:46:46.730660] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-26T01:46:46.731707] [DEBUG] [LOCAL ] SMWB: Trimmed 48363 records to 31857 (keeping 200 days of data) [2025-10-26T01:46:46.899395] [DEBUG] [LOCAL ] SMWB: Primary data saved (31857 records). [2025-10-26T01:46:46.899560] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-26T01:46:46.899752] [INFO ] [MAIN ] Update Progress: 1943/2366 symbols. SMWB took 14.6s. Estimated remaining time: 1h 29m 2s [2025-10-26T01:46:47.066981] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:46:47.067161] [DEBUG] [LOCAL ] SN: No existing data file found in primary storage. [2025-10-26T01:46:47.067231] [WARN ] [MAIN ] SN: No existing data found, performing full refresh instead. [2025-10-26T01:46:47.067338] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-26T01:46:47.067407] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-26T01:46:47.067467] [DEBUG] [LOCAL ] SN: No primary data file found to delete. [2025-10-26T01:46:47.067528] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-26T01:47:04.247704] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-26T01:47:04.672983] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-26T01:47:04.673113] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-26T01:47:04.674424] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-26T01:47:04.674515] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-26T01:47:04.676009] [DEBUG] [LOCAL ] SN: Trimmed 71902 records to 50731 (keeping 200 days of data) [2025-10-26T01:47:04.980040] [DEBUG] [LOCAL ] SN: Primary data saved (50731 records). [2025-10-26T01:47:04.980213] [INFO ] [MAIN ] SN: Full history saved. [2025-10-26T01:47:04.980386] [INFO ] [MAIN ] Update Progress: 1944/2366 symbols. SN took 18.1s. Estimated remaining time: 1h 28m 51s [2025-10-26T01:47:05.151614] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:47:05.151862] [DEBUG] [LOCAL ] SNA: No existing data file found in primary storage. [2025-10-26T01:47:05.151935] [WARN ] [MAIN ] SNA: No existing data found, performing full refresh instead. [2025-10-26T01:47:05.152046] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-26T01:47:05.152117] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-26T01:47:05.152196] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-10-26T01:47:05.152264] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-26T01:47:17.469464] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-26T01:47:17.844816] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-26T01:47:17.844947] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-26T01:47:17.845762] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-26T01:47:17.845841] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-26T01:47:17.846853] [DEBUG] [LOCAL ] SNA: Trimmed 39022 records to 26036 (keeping 200 days of data) [2025-10-26T01:47:18.010030] [DEBUG] [LOCAL ] SNA: Primary data saved (26036 records). [2025-10-26T01:47:18.010190] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-26T01:47:18.010367] [INFO ] [MAIN ] Update Progress: 1945/2366 symbols. SNA took 13.0s. Estimated remaining time: 1h 28m 38s [2025-10-26T01:47:18.186966] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:47:18.187153] [DEBUG] [LOCAL ] SNAP: No existing data file found in primary storage. [2025-10-26T01:47:18.187222] [WARN ] [MAIN ] SNAP: No existing data found, performing full refresh instead. [2025-10-26T01:47:18.187335] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-26T01:47:18.187406] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-26T01:47:18.187493] [DEBUG] [LOCAL ] SNAP: No primary data file found to delete. [2025-10-26T01:47:18.187564] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-26T01:47:41.065428] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-26T01:47:41.448286] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-26T01:47:41.448414] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-26T01:47:41.449714] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-26T01:47:41.449798] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-26T01:47:41.451319] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 54576 (keeping 200 days of data) [2025-10-26T01:47:41.756029] [DEBUG] [LOCAL ] SNAP: Primary data saved (54576 records). [2025-10-26T01:47:41.756213] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-26T01:47:41.756386] [INFO ] [MAIN ] Update Progress: 1946/2366 symbols. SNAP took 23.7s. Estimated remaining time: 1h 28m 28s [2025-10-26T01:47:41.922607] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:47:41.922883] [DEBUG] [LOCAL ] SNDA: No existing data file found in primary storage. [2025-10-26T01:47:41.922955] [WARN ] [MAIN ] SNDA: No existing data found, performing full refresh instead. [2025-10-26T01:47:41.923071] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-26T01:47:41.923138] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-26T01:47:41.923221] [DEBUG] [LOCAL ] SNDA: No primary data file found to delete. [2025-10-26T01:47:41.923294] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-26T01:47:48.506698] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-26T01:47:48.861213] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-26T01:47:48.861323] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-26T01:47:48.861548] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-26T01:47:48.861624] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-26T01:47:48.862064] [DEBUG] [LOCAL ] SNDA: Trimmed 7431 records to 4515 (keeping 200 days of data) [2025-10-26T01:47:48.887265] [DEBUG] [LOCAL ] SNDA: Primary data saved (4515 records). [2025-10-26T01:47:48.887400] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-26T01:47:48.887572] [INFO ] [MAIN ] Update Progress: 1947/2366 symbols. SNDA took 7.1s. Estimated remaining time: 1h 28m 14s [2025-10-26T01:47:49.053665] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:47:49.053876] [DEBUG] [LOCAL ] SNDR: No existing data file found in primary storage. [2025-10-26T01:47:49.053951] [WARN ] [MAIN ] SNDR: No existing data found, performing full refresh instead. [2025-10-26T01:47:49.054066] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-26T01:47:49.054139] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-26T01:47:49.054223] [DEBUG] [LOCAL ] SNDR: No primary data file found to delete. [2025-10-26T01:47:49.054295] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-26T01:48:04.248331] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-26T01:48:04.704746] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-26T01:48:04.704894] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-26T01:48:04.706463] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-26T01:48:04.706551] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-26T01:48:04.708204] [DEBUG] [LOCAL ] SNDR: Trimmed 60244 records to 42192 (keeping 200 days of data) [2025-10-26T01:48:04.975870] [DEBUG] [LOCAL ] SNDR: Primary data saved (42192 records). [2025-10-26T01:48:04.976090] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-26T01:48:04.976326] [INFO ] [MAIN ] Update Progress: 1948/2366 symbols. SNDR took 16.1s. Estimated remaining time: 1h 28m 2s [2025-10-26T01:48:05.161636] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:48:05.162020] [DEBUG] [LOCAL ] SNN: No existing data file found in primary storage. [2025-10-26T01:48:05.162101] [WARN ] [MAIN ] SNN: No existing data found, performing full refresh instead. [2025-10-26T01:48:05.162257] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-26T01:48:05.162338] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-26T01:48:05.162431] [DEBUG] [LOCAL ] SNN: No primary data file found to delete. [2025-10-26T01:48:05.162512] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-26T01:48:21.197186] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-26T01:48:21.596554] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-26T01:48:21.596693] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-26T01:48:21.597743] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-26T01:48:21.597823] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-26T01:48:21.599107] [DEBUG] [LOCAL ] SNN: Trimmed 63046 records to 44967 (keeping 200 days of data) [2025-10-26T01:48:21.862456] [DEBUG] [LOCAL ] SNN: Primary data saved (44967 records). [2025-10-26T01:48:21.862613] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-26T01:48:21.862806] [INFO ] [MAIN ] Update Progress: 1949/2366 symbols. SNN took 16.9s. Estimated remaining time: 1h 27m 51s [2025-10-26T01:48:22.032537] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:48:22.032747] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-10-26T01:48:22.032820] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-10-26T01:48:22.032938] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-26T01:48:22.033009] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-26T01:48:22.033067] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-26T01:48:22.033109] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-26T01:48:45.665516] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-26T01:48:46.051946] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-26T01:48:46.052075] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-26T01:48:46.053197] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-26T01:48:46.053277] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-26T01:48:46.054832] [DEBUG] [LOCAL ] SNOW: Trimmed 77718 records to 54357 (keeping 200 days of data) [2025-10-26T01:48:46.364234] [DEBUG] [LOCAL ] SNOW: Primary data saved (54357 records). [2025-10-26T01:48:46.364407] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-26T01:48:46.364579] [INFO ] [MAIN ] Update Progress: 1950/2366 symbols. SNOW took 24.5s. Estimated remaining time: 1h 27m 40s [2025-10-26T01:48:46.529354] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:48:46.529544] [DEBUG] [LOCAL ] SNV: No existing data file found in primary storage. [2025-10-26T01:48:46.529623] [WARN ] [MAIN ] SNV: No existing data found, performing full refresh instead. [2025-10-26T01:48:46.529758] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-26T01:48:46.529826] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-26T01:48:46.529886] [DEBUG] [LOCAL ] SNV: No primary data file found to delete. [2025-10-26T01:48:46.529935] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-26T01:49:02.284263] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-26T01:49:02.701973] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-26T01:49:02.702092] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-26T01:49:02.703368] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-26T01:49:02.703463] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-26T01:49:02.705025] [DEBUG] [LOCAL ] SNV: Trimmed 71874 records to 49797 (keeping 200 days of data) [2025-10-26T01:49:02.994390] [DEBUG] [LOCAL ] SNV: Primary data saved (49797 records). [2025-10-26T01:49:02.994555] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-26T01:49:02.994817] [INFO ] [MAIN ] Update Progress: 1951/2366 symbols. SNV took 16.6s. Estimated remaining time: 1h 27m 29s [2025-10-26T01:49:03.168806] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:49:03.169037] [DEBUG] [LOCAL ] SNX: No existing data file found in primary storage. [2025-10-26T01:49:03.169171] [WARN ] [MAIN ] SNX: No existing data found, performing full refresh instead. [2025-10-26T01:49:03.169319] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-26T01:49:03.169408] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-26T01:49:03.169493] [DEBUG] [LOCAL ] SNX: No primary data file found to delete. [2025-10-26T01:49:03.169562] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-26T01:49:18.608365] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-26T01:49:19.011231] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-26T01:49:19.011427] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-26T01:49:19.013221] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-26T01:49:19.013314] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-26T01:49:19.015277] [DEBUG] [LOCAL ] SNX: Trimmed 57281 records to 39416 (keeping 200 days of data) [2025-10-26T01:49:19.278201] [DEBUG] [LOCAL ] SNX: Primary data saved (39416 records). [2025-10-26T01:49:19.278428] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-26T01:49:19.278698] [INFO ] [MAIN ] Update Progress: 1952/2366 symbols. SNX took 16.3s. Estimated remaining time: 1h 27m 17s [2025-10-26T01:49:19.458541] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:49:19.458829] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-10-26T01:49:19.458905] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-10-26T01:49:19.459032] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-26T01:49:19.459106] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-26T01:49:19.459191] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-10-26T01:49:19.459264] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-26T01:49:36.929526] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-26T01:49:37.336709] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-26T01:49:37.336842] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-26T01:49:37.338276] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-26T01:49:37.338374] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-26T01:49:37.340444] [DEBUG] [LOCAL ] SO: Trimmed 77777 records to 54394 (keeping 200 days of data) [2025-10-26T01:49:37.769682] [DEBUG] [LOCAL ] SO: Primary data saved (54394 records). [2025-10-26T01:49:37.769908] [INFO ] [MAIN ] SO: Full history saved. [2025-10-26T01:49:37.770140] [INFO ] [MAIN ] Update Progress: 1953/2366 symbols. SO took 18.5s. Estimated remaining time: 1h 27m 5s [2025-10-26T01:49:37.989613] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:49:37.989874] [DEBUG] [LOCAL ] SOBO: No existing data file found in primary storage. [2025-10-26T01:49:37.989948] [WARN ] [MAIN ] SOBO: No existing data found, performing full refresh instead. [2025-10-26T01:49:37.990075] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-26T01:49:37.990163] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-26T01:49:37.990308] [DEBUG] [LOCAL ] SOBO: No primary data file found to delete. [2025-10-26T01:49:37.990399] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-26T01:49:53.289119] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-26T01:49:53.677370] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-26T01:49:53.677493] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-26T01:49:53.678495] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-26T01:49:53.678574] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-26T01:49:53.679789] [DEBUG] [LOCAL ] SOBO: Trimmed 58561 records to 39954 (keeping 200 days of data) [2025-10-26T01:49:53.911561] [DEBUG] [LOCAL ] SOBO: Primary data saved (39954 records). [2025-10-26T01:49:53.911754] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-26T01:49:53.912012] [INFO ] [MAIN ] Update Progress: 1954/2366 symbols. SOBO took 16.1s. Estimated remaining time: 1h 26m 53s [2025-10-26T01:49:54.087482] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:49:54.087712] [DEBUG] [LOCAL ] SOC: No existing data file found in primary storage. [2025-10-26T01:49:54.087799] [WARN ] [MAIN ] SOC: No existing data found, performing full refresh instead. [2025-10-26T01:49:54.087943] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-26T01:49:54.091193] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-26T01:49:54.091311] [DEBUG] [LOCAL ] SOC: No primary data file found to delete. [2025-10-26T01:49:54.091399] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-26T01:50:13.149937] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-26T01:50:13.540043] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-26T01:50:13.540169] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-26T01:50:13.541311] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-26T01:50:13.541395] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-26T01:50:13.542850] [DEBUG] [LOCAL ] SOC: Trimmed 72344 records to 52006 (keeping 200 days of data) [2025-10-26T01:50:13.840771] [DEBUG] [LOCAL ] SOC: Primary data saved (52006 records). [2025-10-26T01:50:13.840951] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-26T01:50:13.841162] [INFO ] [MAIN ] Update Progress: 1955/2366 symbols. SOC took 19.9s. Estimated remaining time: 1h 26m 42s [2025-10-26T01:50:14.008469] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:50:14.008689] [DEBUG] [LOCAL ] SOJC: No existing data file found in primary storage. [2025-10-26T01:50:14.008749] [WARN ] [MAIN ] SOJC: No existing data found, performing full refresh instead. [2025-10-26T01:50:14.008840] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-26T01:50:14.008908] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-26T01:50:14.008991] [DEBUG] [LOCAL ] SOJC: No primary data file found to delete. [2025-10-26T01:50:14.009061] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-26T01:50:20.493793] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-26T01:50:20.859215] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-26T01:50:20.859328] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-26T01:50:20.859546] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-26T01:50:20.859617] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-26T01:50:20.860091] [DEBUG] [LOCAL ] SOJC: Trimmed 7202 records to 4623 (keeping 200 days of data) [2025-10-26T01:50:20.887091] [DEBUG] [LOCAL ] SOJC: Primary data saved (4623 records). [2025-10-26T01:50:20.887200] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-26T01:50:20.887376] [INFO ] [MAIN ] Update Progress: 1956/2366 symbols. SOJC took 7.0s. Estimated remaining time: 1h 26m 28s [2025-10-26T01:50:21.054063] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:50:21.054286] [DEBUG] [LOCAL ] SOJD: No existing data file found in primary storage. [2025-10-26T01:50:21.054365] [WARN ] [MAIN ] SOJD: No existing data found, performing full refresh instead. [2025-10-26T01:50:21.054454] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-26T01:50:21.054519] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-26T01:50:21.054598] [DEBUG] [LOCAL ] SOJD: No primary data file found to delete. [2025-10-26T01:50:21.054686] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-26T01:50:30.278993] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-26T01:50:30.655561] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-26T01:50:30.655703] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-26T01:50:30.656131] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-26T01:50:30.656210] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-26T01:50:30.656835] [DEBUG] [LOCAL ] SOJD: Trimmed 19074 records to 12733 (keeping 200 days of data) [2025-10-26T01:50:30.730336] [DEBUG] [LOCAL ] SOJD: Primary data saved (12733 records). [2025-10-26T01:50:30.730489] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-26T01:50:30.730683] [INFO ] [MAIN ] Update Progress: 1957/2366 symbols. SOJD took 9.8s. Estimated remaining time: 1h 26m 15s [2025-10-26T01:50:30.898382] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:50:30.898558] [DEBUG] [LOCAL ] SOJE: No existing data file found in primary storage. [2025-10-26T01:50:30.898626] [WARN ] [MAIN ] SOJE: No existing data found, performing full refresh instead. [2025-10-26T01:50:30.898757] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-26T01:50:30.898827] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-26T01:50:30.898912] [DEBUG] [LOCAL ] SOJE: No primary data file found to delete. [2025-10-26T01:50:30.898979] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-26T01:50:38.922100] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-26T01:50:39.290392] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-26T01:50:39.290500] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-26T01:50:39.290828] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-26T01:50:39.290906] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-26T01:50:39.291405] [DEBUG] [LOCAL ] SOJE: Trimmed 13445 records to 8815 (keeping 200 days of data) [2025-10-26T01:50:39.342681] [DEBUG] [LOCAL ] SOJE: Primary data saved (8815 records). [2025-10-26T01:50:39.342827] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-26T01:50:39.343003] [INFO ] [MAIN ] Update Progress: 1958/2366 symbols. SOJE took 8.6s. Estimated remaining time: 1h 26m 2s [2025-10-26T01:50:39.508769] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:50:39.508970] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-26T01:50:39.509040] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-26T01:50:39.509125] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-26T01:50:39.509191] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-26T01:50:39.509249] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-26T01:50:39.509293] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-26T01:50:47.293771] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-10-26T01:50:47.521076] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-26T01:50:47.521506] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:50:47.521601] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:50:47.521723] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-26T01:50:47.521847] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-26T01:50:47.521940] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-26T01:50:47.522043] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-26T01:50:47.522280] [INFO ] [MAIN ] Update Progress: 1959/2366 symbols. SOJF took 8.2s. Estimated remaining time: 1h 25m 48s [2025-10-26T01:50:47.708050] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:50:47.708332] [DEBUG] [LOCAL ] SOL: No existing data file found in primary storage. [2025-10-26T01:50:47.708408] [WARN ] [MAIN ] SOL: No existing data found, performing full refresh instead. [2025-10-26T01:50:47.708740] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-26T01:50:47.708814] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-26T01:50:47.708901] [DEBUG] [LOCAL ] SOL: No primary data file found to delete. [2025-10-26T01:50:47.708973] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-26T01:50:57.368824] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-26T01:50:57.770773] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-26T01:50:57.770936] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-26T01:50:57.771505] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-26T01:50:57.771590] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-26T01:50:57.772455] [DEBUG] [LOCAL ] SOL: Trimmed 20882 records to 13703 (keeping 200 days of data) [2025-10-26T01:50:57.848177] [DEBUG] [LOCAL ] SOL: Primary data saved (13703 records). [2025-10-26T01:50:57.848366] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-26T01:50:57.848550] [INFO ] [MAIN ] Update Progress: 1960/2366 symbols. SOL took 10.3s. Estimated remaining time: 1h 25m 35s [2025-10-26T01:50:58.053543] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:50:58.053762] [DEBUG] [LOCAL ] SOLV: No existing data file found in primary storage. [2025-10-26T01:50:58.053836] [WARN ] [MAIN ] SOLV: No existing data found, performing full refresh instead. [2025-10-26T01:50:58.053949] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-26T01:50:58.054021] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-26T01:50:58.054102] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-26T01:50:58.054173] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-26T01:51:12.999697] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-26T01:51:13.386690] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-26T01:51:13.386820] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-26T01:51:13.387864] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-26T01:51:13.387943] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-26T01:51:13.389213] [DEBUG] [LOCAL ] SOLV: Trimmed 63442 records to 44046 (keeping 200 days of data) [2025-10-26T01:51:13.633348] [DEBUG] [LOCAL ] SOLV: Primary data saved (44046 records). [2025-10-26T01:51:13.633501] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-26T01:51:13.633694] [INFO ] [MAIN ] Update Progress: 1961/2366 symbols. SOLV took 15.8s. Estimated remaining time: 1h 25m 23s [2025-10-26T01:51:13.800835] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:51:13.801049] [DEBUG] [LOCAL ] SON: No existing data file found in primary storage. [2025-10-26T01:51:13.801142] [WARN ] [MAIN ] SON: No existing data found, performing full refresh instead. [2025-10-26T01:51:13.801253] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-26T01:51:13.801322] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-26T01:51:13.801401] [DEBUG] [LOCAL ] SON: No primary data file found to delete. [2025-10-26T01:51:13.801470] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-26T01:51:28.478296] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-26T01:51:28.871627] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-26T01:51:28.871772] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-26T01:51:28.873035] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-26T01:51:28.873119] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-26T01:51:28.874438] [DEBUG] [LOCAL ] SON: Trimmed 63070 records to 44308 (keeping 200 days of data) [2025-10-26T01:51:29.132143] [DEBUG] [LOCAL ] SON: Primary data saved (44308 records). [2025-10-26T01:51:29.132308] [INFO ] [MAIN ] SON: Full history saved. [2025-10-26T01:51:29.132484] [INFO ] [MAIN ] Update Progress: 1962/2366 symbols. SON took 15.5s. Estimated remaining time: 1h 25m 11s [2025-10-26T01:51:29.302242] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:51:29.302419] [DEBUG] [LOCAL ] SONY: No existing data file found in primary storage. [2025-10-26T01:51:29.302491] [WARN ] [MAIN ] SONY: No existing data found, performing full refresh instead. [2025-10-26T01:51:29.302601] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-26T01:51:29.302693] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-26T01:51:29.302775] [DEBUG] [LOCAL ] SONY: No primary data file found to delete. [2025-10-26T01:51:29.302843] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-26T01:51:48.586195] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-26T01:51:48.974660] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-26T01:51:48.974777] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-26T01:51:48.975949] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-26T01:51:48.976056] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-26T01:51:48.977480] [DEBUG] [LOCAL ] SONY: Trimmed 77411 records to 54151 (keeping 200 days of data) [2025-10-26T01:51:49.280101] [DEBUG] [LOCAL ] SONY: Primary data saved (54151 records). [2025-10-26T01:51:49.280261] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-26T01:51:49.280452] [INFO ] [MAIN ] Update Progress: 1963/2366 symbols. SONY took 20.1s. Estimated remaining time: 1h 24m 60s [2025-10-26T01:51:49.446786] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:51:49.446988] [DEBUG] [LOCAL ] SOR: No existing data file found in primary storage. [2025-10-26T01:51:49.447074] [WARN ] [MAIN ] SOR: No existing data found, performing full refresh instead. [2025-10-26T01:51:49.447212] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-26T01:51:49.447304] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-26T01:51:49.447412] [DEBUG] [LOCAL ] SOR: No primary data file found to delete. [2025-10-26T01:51:49.447502] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-26T01:51:55.082198] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-26T01:51:55.459173] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-26T01:51:55.459340] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-26T01:51:55.459526] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-26T01:51:55.459602] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-26T01:51:55.460018] [DEBUG] [LOCAL ] SOR: Trimmed 4350 records to 2842 (keeping 200 days of data) [2025-10-26T01:51:55.477281] [DEBUG] [LOCAL ] SOR: Primary data saved (2842 records). [2025-10-26T01:51:55.477370] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-26T01:51:55.477535] [INFO ] [MAIN ] Update Progress: 1964/2366 symbols. SOR took 6.2s. Estimated remaining time: 1h 24m 46s [2025-10-26T01:51:55.662674] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:51:55.662892] [DEBUG] [LOCAL ] SOS: No existing data file found in primary storage. [2025-10-26T01:51:55.662966] [WARN ] [MAIN ] SOS: No existing data found, performing full refresh instead. [2025-10-26T01:51:55.663081] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-26T01:51:55.663158] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-26T01:51:55.663241] [DEBUG] [LOCAL ] SOS: No primary data file found to delete. [2025-10-26T01:51:55.663314] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-26T01:52:03.532599] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-26T01:52:03.885130] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-26T01:52:03.885251] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-26T01:52:03.885556] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-26T01:52:03.885665] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-26T01:52:03.886155] [DEBUG] [LOCAL ] SOS: Trimmed 11285 records to 9787 (keeping 200 days of data) [2025-10-26T01:52:03.937977] [DEBUG] [LOCAL ] SOS: Primary data saved (9787 records). [2025-10-26T01:52:03.938147] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-26T01:52:03.938319] [INFO ] [MAIN ] Update Progress: 1965/2366 symbols. SOS took 8.5s. Estimated remaining time: 1h 24m 32s [2025-10-26T01:52:04.106996] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:52:04.107237] [DEBUG] [LOCAL ] SPB: No existing data file found in primary storage. [2025-10-26T01:52:04.107312] [WARN ] [MAIN ] SPB: No existing data found, performing full refresh instead. [2025-10-26T01:52:04.107427] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-26T01:52:04.107499] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-26T01:52:04.107582] [DEBUG] [LOCAL ] SPB: No primary data file found to delete. [2025-10-26T01:52:04.107673] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-26T01:52:17.054882] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-26T01:52:17.436001] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-26T01:52:17.436117] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-26T01:52:17.437143] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-26T01:52:17.437224] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-26T01:52:17.438315] [DEBUG] [LOCAL ] SPB: Trimmed 47590 records to 34283 (keeping 200 days of data) [2025-10-26T01:52:17.636479] [DEBUG] [LOCAL ] SPB: Primary data saved (34283 records). [2025-10-26T01:52:17.636637] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-26T01:52:17.636872] [INFO ] [MAIN ] Update Progress: 1966/2366 symbols. SPB took 13.7s. Estimated remaining time: 1h 24m 20s [2025-10-26T01:52:17.809685] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:52:17.809873] [DEBUG] [LOCAL ] SPCE: No existing data file found in primary storage. [2025-10-26T01:52:17.809943] [WARN ] [MAIN ] SPCE: No existing data found, performing full refresh instead. [2025-10-26T01:52:17.810063] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-26T01:52:17.810137] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-26T01:52:17.810222] [DEBUG] [LOCAL ] SPCE: No primary data file found to delete. [2025-10-26T01:52:17.810311] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-26T01:52:37.116317] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-26T01:52:37.505521] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-26T01:52:37.505668] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-26T01:52:37.506945] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-26T01:52:37.507041] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-26T01:52:37.508546] [DEBUG] [LOCAL ] SPCE: Trimmed 72703 records to 50808 (keeping 200 days of data) [2025-10-26T01:52:37.788635] [DEBUG] [LOCAL ] SPCE: Primary data saved (50808 records). [2025-10-26T01:52:37.788837] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-26T01:52:37.789040] [INFO ] [MAIN ] Update Progress: 1967/2366 symbols. SPCE took 20.2s. Estimated remaining time: 1h 24m 9s [2025-10-26T01:52:37.956162] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:52:37.956329] [DEBUG] [LOCAL ] SPE: No existing data file found in primary storage. [2025-10-26T01:52:37.956409] [WARN ] [MAIN ] SPE: No existing data found, performing full refresh instead. [2025-10-26T01:52:37.956499] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-26T01:52:37.956579] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-26T01:52:37.956693] [DEBUG] [LOCAL ] SPE: No primary data file found to delete. [2025-10-26T01:52:37.956764] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-26T01:52:45.313368] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-26T01:52:45.684583] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-26T01:52:45.684728] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-26T01:52:45.685035] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-26T01:52:45.685111] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-26T01:52:45.685579] [DEBUG] [LOCAL ] SPE: Trimmed 9754 records to 6203 (keeping 200 days of data) [2025-10-26T01:52:45.721661] [DEBUG] [LOCAL ] SPE: Primary data saved (6203 records). [2025-10-26T01:52:45.721807] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-26T01:52:45.721983] [INFO ] [MAIN ] Update Progress: 1968/2366 symbols. SPE took 7.9s. Estimated remaining time: 1h 23m 55s [2025-10-26T01:52:45.890601] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:52:45.890808] [DEBUG] [LOCAL ] SPG: No existing data file found in primary storage. [2025-10-26T01:52:45.890880] [WARN ] [MAIN ] SPG: No existing data found, performing full refresh instead. [2025-10-26T01:52:45.890993] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-26T01:52:45.891065] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-26T01:52:45.891151] [DEBUG] [LOCAL ] SPG: No primary data file found to delete. [2025-10-26T01:52:45.891222] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-26T01:53:02.331760] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-26T01:53:02.729403] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-26T01:53:02.729573] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-26T01:53:02.731287] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-26T01:53:02.731369] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-26T01:53:02.733287] [DEBUG] [LOCAL ] SPG: Trimmed 72038 records to 50667 (keeping 200 days of data) [2025-10-26T01:53:03.059322] [DEBUG] [LOCAL ] SPG: Primary data saved (50667 records). [2025-10-26T01:53:03.059547] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-26T01:53:03.059797] [INFO ] [MAIN ] Update Progress: 1969/2366 symbols. SPG took 17.3s. Estimated remaining time: 1h 23m 43s [2025-10-26T01:53:03.227610] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:53:03.227997] [DEBUG] [LOCAL ] SPGI: No existing data file found in primary storage. [2025-10-26T01:53:03.228074] [WARN ] [MAIN ] SPGI: No existing data found, performing full refresh instead. [2025-10-26T01:53:03.228177] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-26T01:53:03.228246] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-26T01:53:03.228305] [DEBUG] [LOCAL ] SPGI: No primary data file found to delete. [2025-10-26T01:53:03.228346] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-26T01:53:19.407674] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-26T01:53:19.789456] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-26T01:53:19.789582] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-26T01:53:19.790719] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-26T01:53:19.790803] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-26T01:53:19.792153] [DEBUG] [LOCAL ] SPGI: Trimmed 67816 records to 46599 (keeping 200 days of data) [2025-10-26T01:53:20.077105] [DEBUG] [LOCAL ] SPGI: Primary data saved (46599 records). [2025-10-26T01:53:20.077272] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-26T01:53:20.077497] [INFO ] [MAIN ] Update Progress: 1970/2366 symbols. SPGI took 17.0s. Estimated remaining time: 1h 23m 32s [2025-10-26T01:53:20.246664] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:53:20.246874] [DEBUG] [LOCAL ] SPH: No existing data file found in primary storage. [2025-10-26T01:53:20.246948] [WARN ] [MAIN ] SPH: No existing data found, performing full refresh instead. [2025-10-26T01:53:20.247036] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-26T01:53:20.247103] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-26T01:53:20.247188] [DEBUG] [LOCAL ] SPH: No primary data file found to delete. [2025-10-26T01:53:20.247257] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-26T01:53:31.257554] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-26T01:53:31.623985] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-26T01:53:31.624114] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-26T01:53:31.624748] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-26T01:53:31.624832] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-26T01:53:31.625635] [DEBUG] [LOCAL ] SPH: Trimmed 27681 records to 16659 (keeping 200 days of data) [2025-10-26T01:53:31.722091] [DEBUG] [LOCAL ] SPH: Primary data saved (16659 records). [2025-10-26T01:53:31.722275] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-26T01:53:31.722452] [INFO ] [MAIN ] Update Progress: 1971/2366 symbols. SPH took 11.6s. Estimated remaining time: 1h 23m 19s [2025-10-26T01:53:31.920758] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:53:31.920971] [DEBUG] [LOCAL ] SPHR: No existing data file found in primary storage. [2025-10-26T01:53:31.921045] [WARN ] [MAIN ] SPHR: No existing data found, performing full refresh instead. [2025-10-26T01:53:31.921161] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-26T01:53:31.921234] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-26T01:53:31.921319] [DEBUG] [LOCAL ] SPHR: No primary data file found to delete. [2025-10-26T01:53:31.921390] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-26T01:53:47.420952] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-26T01:53:47.818145] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-26T01:53:47.818262] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-26T01:53:47.819266] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-26T01:53:47.819370] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-26T01:53:47.820567] [DEBUG] [LOCAL ] SPHR: Trimmed 58830 records to 41291 (keeping 200 days of data) [2025-10-26T01:53:48.056192] [DEBUG] [LOCAL ] SPHR: Primary data saved (41291 records). [2025-10-26T01:53:48.056434] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-26T01:53:48.056634] [INFO ] [MAIN ] Update Progress: 1972/2366 symbols. SPHR took 16.3s. Estimated remaining time: 1h 23m 7s [2025-10-26T01:53:48.222047] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:53:48.222259] [DEBUG] [LOCAL ] SPIR: No existing data file found in primary storage. [2025-10-26T01:53:48.222332] [WARN ] [MAIN ] SPIR: No existing data found, performing full refresh instead. [2025-10-26T01:53:48.222462] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-26T01:53:48.222534] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-26T01:53:48.222618] [DEBUG] [LOCAL ] SPIR: No primary data file found to delete. [2025-10-26T01:53:48.222709] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-26T01:54:03.923752] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-26T01:54:04.335852] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-26T01:54:04.336016] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-26T01:54:04.338164] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-26T01:54:04.338255] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-26T01:54:04.339980] [DEBUG] [LOCAL ] SPIR: Trimmed 54167 records to 37930 (keeping 200 days of data) [2025-10-26T01:54:04.561502] [DEBUG] [LOCAL ] SPIR: Primary data saved (37930 records). [2025-10-26T01:54:04.561768] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-26T01:54:04.562010] [INFO ] [MAIN ] Update Progress: 1973/2366 symbols. SPIR took 16.5s. Estimated remaining time: 1h 22m 55s [2025-10-26T01:54:04.731232] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:54:04.731506] [DEBUG] [LOCAL ] SPMC: No existing data file found in primary storage. [2025-10-26T01:54:04.731579] [WARN ] [MAIN ] SPMC: No existing data found, performing full refresh instead. [2025-10-26T01:54:04.731732] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-26T01:54:04.731806] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-26T01:54:04.731887] [DEBUG] [LOCAL ] SPMC: No primary data file found to delete. [2025-10-26T01:54:04.731960] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-26T01:54:11.753711] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-26T01:54:12.132307] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-26T01:54:12.132456] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-26T01:54:12.133010] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-26T01:54:12.133129] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-26T01:54:12.133723] [DEBUG] [LOCAL ] SPMC: Trimmed 8439 records to 5362 (keeping 200 days of data) [2025-10-26T01:54:12.168539] [DEBUG] [LOCAL ] SPMC: Primary data saved (5362 records). [2025-10-26T01:54:12.168785] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-26T01:54:12.169025] [INFO ] [MAIN ] Update Progress: 1974/2366 symbols. SPMC took 7.6s. Estimated remaining time: 1h 22m 41s [2025-10-26T01:54:12.341589] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:54:12.341911] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-26T01:54:12.341988] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-26T01:54:12.342106] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-26T01:54:12.342243] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-26T01:54:12.342328] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-26T01:54:12.342395] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-26T01:54:12.900932] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-26T01:54:12.901001] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T01:54:12.901076] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-26T01:54:12.901168] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-26T01:54:12.901240] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-26T01:54:12.901320] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-26T01:54:12.901558] [INFO ] [MAIN ] Update Progress: 1975/2366 symbols. SPME took 0.7s. Estimated remaining time: 1h 22m 26s [2025-10-26T01:54:13.086189] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:54:13.086481] [DEBUG] [LOCAL ] SPNT: No existing data file found in primary storage. [2025-10-26T01:54:13.086557] [WARN ] [MAIN ] SPNT: No existing data found, performing full refresh instead. [2025-10-26T01:54:13.086702] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-26T01:54:13.086776] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-26T01:54:13.086856] [DEBUG] [LOCAL ] SPNT: No primary data file found to delete. [2025-10-26T01:54:13.086926] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-26T01:54:26.209070] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-26T01:54:26.581435] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-26T01:54:26.581542] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-26T01:54:26.582480] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-26T01:54:26.582558] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-26T01:54:26.583538] [DEBUG] [LOCAL ] SPNT: Trimmed 48389 records to 34643 (keeping 200 days of data) [2025-10-26T01:54:26.773541] [DEBUG] [LOCAL ] SPNT: Primary data saved (34643 records). [2025-10-26T01:54:26.773717] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-26T01:54:26.773874] [INFO ] [MAIN ] Update Progress: 1976/2366 symbols. SPNT took 13.9s. Estimated remaining time: 1h 22m 14s [2025-10-26T01:54:26.941055] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:54:26.941255] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-10-26T01:54:26.941326] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-10-26T01:54:26.941436] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-26T01:54:26.941515] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-26T01:54:26.941578] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-26T01:54:26.941665] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-26T01:54:48.738733] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-26T01:54:49.133411] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-26T01:54:49.133589] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-26T01:54:49.135947] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-26T01:54:49.136044] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-26T01:54:49.138112] [DEBUG] [LOCAL ] SPOT: Trimmed 73763 records to 50911 (keeping 200 days of data) [2025-10-26T01:54:49.457506] [DEBUG] [LOCAL ] SPOT: Primary data saved (50911 records). [2025-10-26T01:54:49.457759] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-26T01:54:49.458012] [INFO ] [MAIN ] Update Progress: 1977/2366 symbols. SPOT took 22.7s. Estimated remaining time: 1h 22m 3s [2025-10-26T01:54:49.635356] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:54:49.635630] [DEBUG] [LOCAL ] SPR: No existing data file found in primary storage. [2025-10-26T01:54:49.635729] [WARN ] [MAIN ] SPR: No existing data found, performing full refresh instead. [2025-10-26T01:54:49.635856] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-26T01:54:49.635930] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-26T01:54:49.636013] [DEBUG] [LOCAL ] SPR: No primary data file found to delete. [2025-10-26T01:54:49.636085] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-26T01:55:05.092099] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-26T01:55:05.495054] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-26T01:55:05.495162] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-26T01:55:05.496173] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-26T01:55:05.496250] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-26T01:55:05.497406] [DEBUG] [LOCAL ] SPR: Trimmed 59813 records to 41211 (keeping 200 days of data) [2025-10-26T01:55:05.744674] [DEBUG] [LOCAL ] SPR: Primary data saved (41211 records). [2025-10-26T01:55:05.744846] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-26T01:55:05.745021] [INFO ] [MAIN ] Update Progress: 1978/2366 symbols. SPR took 16.3s. Estimated remaining time: 1h 21m 51s [2025-10-26T01:55:05.928365] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:55:05.928581] [DEBUG] [LOCAL ] SPRU: No existing data file found in primary storage. [2025-10-26T01:55:05.928679] [WARN ] [MAIN ] SPRU: No existing data found, performing full refresh instead. [2025-10-26T01:55:05.928782] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-26T01:55:05.928853] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-26T01:55:05.928935] [DEBUG] [LOCAL ] SPRU: No primary data file found to delete. [2025-10-26T01:55:05.929008] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-26T01:55:14.904810] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-26T01:55:15.259992] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-26T01:55:15.260098] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-26T01:55:15.260396] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-26T01:55:15.260470] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-26T01:55:15.260992] [DEBUG] [LOCAL ] SPRU: Trimmed 12191 records to 10078 (keeping 200 days of data) [2025-10-26T01:55:15.314291] [DEBUG] [LOCAL ] SPRU: Primary data saved (10078 records). [2025-10-26T01:55:15.314428] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-26T01:55:15.314601] [INFO ] [MAIN ] Update Progress: 1979/2366 symbols. SPRU took 9.6s. Estimated remaining time: 1h 21m 38s [2025-10-26T01:55:15.482375] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:55:15.482575] [DEBUG] [LOCAL ] SPXC: No existing data file found in primary storage. [2025-10-26T01:55:15.482667] [WARN ] [MAIN ] SPXC: No existing data found, performing full refresh instead. [2025-10-26T01:55:15.482766] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-26T01:55:15.482815] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-26T01:55:15.482901] [DEBUG] [LOCAL ] SPXC: No primary data file found to delete. [2025-10-26T01:55:15.482974] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-26T01:55:28.955984] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-26T01:55:29.351427] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-26T01:55:29.351624] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-26T01:55:29.352443] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-26T01:55:29.352521] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-26T01:55:29.353512] [DEBUG] [LOCAL ] SPXC: Trimmed 34033 records to 23428 (keeping 200 days of data) [2025-10-26T01:55:29.493376] [DEBUG] [LOCAL ] SPXC: Primary data saved (23428 records). [2025-10-26T01:55:29.493537] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-26T01:55:29.493732] [INFO ] [MAIN ] Update Progress: 1980/2366 symbols. SPXC took 14.2s. Estimated remaining time: 1h 21m 26s [2025-10-26T01:55:29.661169] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:55:29.661406] [DEBUG] [LOCAL ] SPXX: No existing data file found in primary storage. [2025-10-26T01:55:29.661477] [WARN ] [MAIN ] SPXX: No existing data found, performing full refresh instead. [2025-10-26T01:55:29.661587] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-26T01:55:29.661678] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-26T01:55:29.661762] [DEBUG] [LOCAL ] SPXX: No primary data file found to delete. [2025-10-26T01:55:29.661828] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-26T01:55:38.204485] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-26T01:55:38.559618] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-26T01:55:38.559754] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-26T01:55:38.560080] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-26T01:55:38.560157] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-26T01:55:38.560688] [DEBUG] [LOCAL ] SPXX: Trimmed 13477 records to 9227 (keeping 200 days of data) [2025-10-26T01:55:38.613406] [DEBUG] [LOCAL ] SPXX: Primary data saved (9227 records). [2025-10-26T01:55:38.613546] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-26T01:55:38.613738] [INFO ] [MAIN ] Update Progress: 1981/2366 symbols. SPXX took 9.1s. Estimated remaining time: 1h 21m 12s [2025-10-26T01:55:38.777098] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:55:38.777273] [DEBUG] [LOCAL ] SQM: No existing data file found in primary storage. [2025-10-26T01:55:38.777346] [WARN ] [MAIN ] SQM: No existing data found, performing full refresh instead. [2025-10-26T01:55:38.777456] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-26T01:55:38.777526] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-26T01:55:38.777607] [DEBUG] [LOCAL ] SQM: No primary data file found to delete. [2025-10-26T01:55:38.777697] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-26T01:55:55.751363] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-26T01:55:56.131330] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-26T01:55:56.131453] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-26T01:55:56.132563] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-26T01:55:56.132672] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-26T01:55:56.134141] [DEBUG] [LOCAL ] SQM: Trimmed 69849 records to 49634 (keeping 200 days of data) [2025-10-26T01:55:56.408273] [DEBUG] [LOCAL ] SQM: Primary data saved (49634 records). [2025-10-26T01:55:56.408448] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-26T01:55:56.408626] [INFO ] [MAIN ] Update Progress: 1982/2366 symbols. SQM took 17.8s. Estimated remaining time: 1h 21m 1s [2025-10-26T01:55:56.575360] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:55:56.575540] [DEBUG] [LOCAL ] SQNS: No existing data file found in primary storage. [2025-10-26T01:55:56.575618] [WARN ] [MAIN ] SQNS: No existing data found, performing full refresh instead. [2025-10-26T01:55:56.575785] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-26T01:55:56.575871] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-26T01:55:56.575956] [DEBUG] [LOCAL ] SQNS: No primary data file found to delete. [2025-10-26T01:55:56.576023] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-26T01:56:09.211899] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-26T01:56:09.582037] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-26T01:56:09.582153] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-26T01:56:09.582852] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-26T01:56:09.582931] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-26T01:56:09.583768] [DEBUG] [LOCAL ] SQNS: Trimmed 33130 records to 28484 (keeping 200 days of data) [2025-10-26T01:56:09.740272] [DEBUG] [LOCAL ] SQNS: Primary data saved (28484 records). [2025-10-26T01:56:09.740455] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-26T01:56:09.740677] [INFO ] [MAIN ] Update Progress: 1983/2366 symbols. SQNS took 13.3s. Estimated remaining time: 1h 20m 48s [2025-10-26T01:56:09.906704] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:56:09.906886] [DEBUG] [LOCAL ] SR: No existing data file found in primary storage. [2025-10-26T01:56:09.906956] [WARN ] [MAIN ] SR: No existing data found, performing full refresh instead. [2025-10-26T01:56:09.907068] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-26T01:56:09.907140] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-26T01:56:09.907220] [DEBUG] [LOCAL ] SR: No primary data file found to delete. [2025-10-26T01:56:09.907269] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-26T01:56:24.468197] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-26T01:56:24.869492] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-26T01:56:24.869615] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-26T01:56:24.870631] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-26T01:56:24.870740] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-26T01:56:24.871806] [DEBUG] [LOCAL ] SR: Trimmed 46142 records to 32679 (keeping 200 days of data) [2025-10-26T01:56:25.076442] [DEBUG] [LOCAL ] SR: Primary data saved (32679 records). [2025-10-26T01:56:25.076617] [INFO ] [MAIN ] SR: Full history saved. [2025-10-26T01:56:25.076836] [INFO ] [MAIN ] Update Progress: 1984/2366 symbols. SR took 15.3s. Estimated remaining time: 1h 20m 36s [2025-10-26T01:56:25.256356] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:56:25.256571] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-10-26T01:56:25.256667] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-10-26T01:56:25.256770] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-26T01:56:25.256841] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-26T01:56:25.256908] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-10-26T01:56:25.256950] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-26T01:56:42.725101] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-26T01:56:43.128640] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-26T01:56:43.128790] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-26T01:56:43.129961] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-26T01:56:43.130043] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-26T01:56:43.131504] [DEBUG] [LOCAL ] SRE: Trimmed 77487 records to 54174 (keeping 200 days of data) [2025-10-26T01:56:43.458009] [DEBUG] [LOCAL ] SRE: Primary data saved (54174 records). [2025-10-26T01:56:43.458210] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-26T01:56:43.458386] [INFO ] [MAIN ] Update Progress: 1985/2366 symbols. SRE took 18.4s. Estimated remaining time: 1h 20m 24s [2025-10-26T01:56:43.625408] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:56:43.625581] [DEBUG] [LOCAL ] SREA: No existing data file found in primary storage. [2025-10-26T01:56:43.625672] [WARN ] [MAIN ] SREA: No existing data found, performing full refresh instead. [2025-10-26T01:56:43.625782] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-26T01:56:43.625851] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-26T01:56:43.625930] [DEBUG] [LOCAL ] SREA: No primary data file found to delete. [2025-10-26T01:56:43.625996] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-26T01:56:52.099734] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-26T01:56:52.598416] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-26T01:56:52.598616] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-26T01:56:52.599363] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-26T01:56:52.599454] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-26T01:56:52.600599] [DEBUG] [LOCAL ] SREA: Trimmed 14626 records to 9747 (keeping 200 days of data) [2025-10-26T01:56:52.692931] [DEBUG] [LOCAL ] SREA: Primary data saved (9747 records). [2025-10-26T01:56:52.693220] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-26T01:56:52.693629] [INFO ] [MAIN ] Update Progress: 1986/2366 symbols. SREA took 9.2s. Estimated remaining time: 1h 20m 11s [2025-10-26T01:56:52.916534] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:56:52.916787] [DEBUG] [LOCAL ] SRFM: No existing data file found in primary storage. [2025-10-26T01:56:52.916863] [WARN ] [MAIN ] SRFM: No existing data found, performing full refresh instead. [2025-10-26T01:56:52.916980] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-26T01:56:52.917052] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-26T01:56:52.917135] [DEBUG] [LOCAL ] SRFM: No primary data file found to delete. [2025-10-26T01:56:52.917208] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-26T01:57:09.319418] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-26T01:57:09.721620] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-26T01:57:09.721799] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-26T01:57:09.724077] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-26T01:57:09.724164] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-26T01:57:09.725805] [DEBUG] [LOCAL ] SRFM: Trimmed 51510 records to 40757 (keeping 200 days of data) [2025-10-26T01:57:09.968132] [DEBUG] [LOCAL ] SRFM: Primary data saved (40757 records). [2025-10-26T01:57:09.968378] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-26T01:57:09.968633] [INFO ] [MAIN ] Update Progress: 1987/2366 symbols. SRFM took 17.3s. Estimated remaining time: 1h 19m 59s [2025-10-26T01:57:10.188053] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:57:10.188352] [DEBUG] [LOCAL ] SRG: No existing data file found in primary storage. [2025-10-26T01:57:10.188429] [WARN ] [MAIN ] SRG: No existing data found, performing full refresh instead. [2025-10-26T01:57:10.188555] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-26T01:57:10.188631] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-26T01:57:10.188741] [DEBUG] [LOCAL ] SRG: No primary data file found to delete. [2025-10-26T01:57:10.188813] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-26T01:57:20.187196] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-26T01:57:20.579563] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-26T01:57:20.579734] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-26T01:57:20.580611] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-26T01:57:20.580718] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-26T01:57:20.581718] [DEBUG] [LOCAL ] SRG: Trimmed 23209 records to 14928 (keeping 200 days of data) [2025-10-26T01:57:20.666690] [DEBUG] [LOCAL ] SRG: Primary data saved (14928 records). [2025-10-26T01:57:20.666932] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-26T01:57:20.667181] [INFO ] [MAIN ] Update Progress: 1988/2366 symbols. SRG took 10.7s. Estimated remaining time: 1h 19m 46s [2025-10-26T01:57:20.860246] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:57:20.860593] [DEBUG] [LOCAL ] SRI: No existing data file found in primary storage. [2025-10-26T01:57:20.860695] [WARN ] [MAIN ] SRI: No existing data found, performing full refresh instead. [2025-10-26T01:57:20.860841] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-26T01:57:20.860922] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-26T01:57:20.861022] [DEBUG] [LOCAL ] SRI: No primary data file found to delete. [2025-10-26T01:57:20.861096] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-26T01:57:33.726799] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-26T01:57:34.122690] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-26T01:57:34.122812] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-26T01:57:34.123632] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-26T01:57:34.123733] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-26T01:57:34.124635] [DEBUG] [LOCAL ] SRI: Trimmed 39474 records to 26448 (keeping 200 days of data) [2025-10-26T01:57:34.269166] [DEBUG] [LOCAL ] SRI: Primary data saved (26448 records). [2025-10-26T01:57:34.269340] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-26T01:57:34.269519] [INFO ] [MAIN ] Update Progress: 1989/2366 symbols. SRI took 13.6s. Estimated remaining time: 1h 19m 34s [2025-10-26T01:57:34.454945] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:57:34.455200] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-26T01:57:34.455283] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-26T01:57:34.455418] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-26T01:57:34.455502] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-26T01:57:34.455595] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-26T01:57:34.455705] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-26T01:57:38.945207] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-26T01:57:39.131179] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-26T01:57:39.131359] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-26T01:57:39.131432] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-26T01:57:39.131511] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-26T01:57:39.131605] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-26T01:57:39.131700] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-26T01:57:39.131783] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-26T01:57:39.131946] [INFO ] [MAIN ] Update Progress: 1990/2366 symbols. SRL took 4.9s. Estimated remaining time: 1h 19m 20s [2025-10-26T01:57:39.310545] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:57:39.310843] [DEBUG] [LOCAL ] SRV: No existing data file found in primary storage. [2025-10-26T01:57:39.310916] [WARN ] [MAIN ] SRV: No existing data found, performing full refresh instead. [2025-10-26T01:57:39.311043] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-26T01:57:39.311118] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-26T01:57:39.311201] [DEBUG] [LOCAL ] SRV: No primary data file found to delete. [2025-10-26T01:57:39.311270] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-26T01:57:47.219985] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-26T01:57:47.601074] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-26T01:57:47.601224] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-26T01:57:47.601771] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-26T01:57:47.601854] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-26T01:57:47.602401] [DEBUG] [LOCAL ] SRV: Trimmed 11215 records to 7466 (keeping 200 days of data) [2025-10-26T01:57:47.650081] [DEBUG] [LOCAL ] SRV: Primary data saved (7466 records). [2025-10-26T01:57:47.650313] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-26T01:57:47.650582] [INFO ] [MAIN ] Update Progress: 1991/2366 symbols. SRV took 8.5s. Estimated remaining time: 1h 19m 6s [2025-10-26T01:57:47.828713] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:57:47.828975] [DEBUG] [LOCAL ] SSB: No existing data file found in primary storage. [2025-10-26T01:57:47.829051] [WARN ] [MAIN ] SSB: No existing data found, performing full refresh instead. [2025-10-26T01:57:47.829180] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-26T01:57:47.829254] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-26T01:57:47.829339] [DEBUG] [LOCAL ] SSB: No primary data file found to delete. [2025-10-26T01:57:47.829413] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-26T01:58:02.735393] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-26T01:58:03.115825] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-26T01:58:03.115935] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-26T01:58:03.116948] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-26T01:58:03.117027] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-26T01:58:03.118248] [DEBUG] [LOCAL ] SSB: Trimmed 61560 records to 43425 (keeping 200 days of data) [2025-10-26T01:58:03.369596] [DEBUG] [LOCAL ] SSB: Primary data saved (43425 records). [2025-10-26T01:58:03.369793] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-26T01:58:03.369977] [INFO ] [MAIN ] Update Progress: 1992/2366 symbols. SSB took 15.7s. Estimated remaining time: 1h 18m 54s [2025-10-26T01:58:03.537373] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:58:03.537545] [DEBUG] [LOCAL ] SSD: No existing data file found in primary storage. [2025-10-26T01:58:03.537615] [WARN ] [MAIN ] SSD: No existing data found, performing full refresh instead. [2025-10-26T01:58:03.537744] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-26T01:58:03.537815] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-26T01:58:03.537894] [DEBUG] [LOCAL ] SSD: No primary data file found to delete. [2025-10-26T01:58:03.537985] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-26T01:58:14.908302] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-26T01:58:15.278083] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-26T01:58:15.278197] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-26T01:58:15.278888] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-26T01:58:15.278988] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-26T01:58:15.279746] [DEBUG] [LOCAL ] SSD: Trimmed 32496 records to 22635 (keeping 200 days of data) [2025-10-26T01:58:15.417373] [DEBUG] [LOCAL ] SSD: Primary data saved (22635 records). [2025-10-26T01:58:15.417550] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-26T01:58:15.417741] [INFO ] [MAIN ] Update Progress: 1993/2366 symbols. SSD took 12.0s. Estimated remaining time: 1h 18m 41s [2025-10-26T01:58:15.584223] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:58:15.584404] [DEBUG] [LOCAL ] SSL: No existing data file found in primary storage. [2025-10-26T01:58:15.584474] [WARN ] [MAIN ] SSL: No existing data found, performing full refresh instead. [2025-10-26T01:58:15.584563] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-26T01:58:15.584630] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-26T01:58:15.584732] [DEBUG] [LOCAL ] SSL: No primary data file found to delete. [2025-10-26T01:58:15.584800] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-26T01:58:31.899172] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-26T01:58:32.289295] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-26T01:58:32.289418] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-26T01:58:32.290684] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-26T01:58:32.290789] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-26T01:58:32.292021] [DEBUG] [LOCAL ] SSL: Trimmed 60091 records to 42027 (keeping 200 days of data) [2025-10-26T01:58:32.522595] [DEBUG] [LOCAL ] SSL: Primary data saved (42027 records). [2025-10-26T01:58:32.522778] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-26T01:58:32.522949] [INFO ] [MAIN ] Update Progress: 1994/2366 symbols. SSL took 17.1s. Estimated remaining time: 1h 18m 30s [2025-10-26T01:58:32.698929] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:58:32.699164] [DEBUG] [LOCAL ] SST: No existing data file found in primary storage. [2025-10-26T01:58:32.699238] [WARN ] [MAIN ] SST: No existing data found, performing full refresh instead. [2025-10-26T01:58:32.699357] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-26T01:58:32.699433] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-26T01:58:32.699499] [DEBUG] [LOCAL ] SST: No primary data file found to delete. [2025-10-26T01:58:32.699565] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-26T01:58:41.589007] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-26T01:58:41.953620] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-26T01:58:41.953764] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-26T01:58:41.954218] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-26T01:58:41.954296] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-26T01:58:41.955006] [DEBUG] [LOCAL ] SST: Trimmed 17717 records to 11437 (keeping 200 days of data) [2025-10-26T01:58:42.023466] [DEBUG] [LOCAL ] SST: Primary data saved (11437 records). [2025-10-26T01:58:42.023631] [INFO ] [MAIN ] SST: Full history saved. [2025-10-26T01:58:42.023828] [INFO ] [MAIN ] Update Progress: 1995/2366 symbols. SST took 9.5s. Estimated remaining time: 1h 18m 16s [2025-10-26T01:58:42.196247] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:58:42.196443] [DEBUG] [LOCAL ] SSTK: No existing data file found in primary storage. [2025-10-26T01:58:42.196515] [WARN ] [MAIN ] SSTK: No existing data found, performing full refresh instead. [2025-10-26T01:58:42.196628] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-26T01:58:42.196720] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-26T01:58:42.196823] [DEBUG] [LOCAL ] SSTK: No primary data file found to delete. [2025-10-26T01:58:42.196892] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-26T01:58:54.529917] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-26T01:58:54.904773] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-26T01:58:54.904903] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-26T01:58:54.905742] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-26T01:58:54.905819] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-26T01:58:54.906756] [DEBUG] [LOCAL ] SSTK: Trimmed 41364 records to 25564 (keeping 200 days of data) [2025-10-26T01:58:55.055028] [DEBUG] [LOCAL ] SSTK: Primary data saved (25564 records). [2025-10-26T01:58:55.055188] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-26T01:58:55.055364] [INFO ] [MAIN ] Update Progress: 1996/2366 symbols. SSTK took 13.0s. Estimated remaining time: 1h 18m 4s [2025-10-26T01:58:55.225811] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:58:55.226037] [DEBUG] [LOCAL ] ST: No existing data file found in primary storage. [2025-10-26T01:58:55.226108] [WARN ] [MAIN ] ST: No existing data found, performing full refresh instead. [2025-10-26T01:58:55.226221] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-26T01:58:55.226291] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-26T01:58:55.226371] [DEBUG] [LOCAL ] ST: No primary data file found to delete. [2025-10-26T01:58:55.226439] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-26T01:59:11.404969] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-26T01:59:11.804758] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-26T01:59:11.805036] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-26T01:59:11.806137] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-26T01:59:11.806216] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-26T01:59:11.807610] [DEBUG] [LOCAL ] ST: Trimmed 72118 records to 50376 (keeping 200 days of data) [2025-10-26T01:59:12.097713] [DEBUG] [LOCAL ] ST: Primary data saved (50376 records). [2025-10-26T01:59:12.097874] [INFO ] [MAIN ] ST: Full history saved. [2025-10-26T01:59:12.098078] [INFO ] [MAIN ] Update Progress: 1997/2366 symbols. ST took 17.0s. Estimated remaining time: 1h 17m 52s [2025-10-26T01:59:12.267443] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:59:12.267685] [DEBUG] [LOCAL ] STAG: No existing data file found in primary storage. [2025-10-26T01:59:12.267758] [WARN ] [MAIN ] STAG: No existing data found, performing full refresh instead. [2025-10-26T01:59:12.267871] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-26T01:59:12.270903] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-26T01:59:12.271025] [DEBUG] [LOCAL ] STAG: No primary data file found to delete. [2025-10-26T01:59:12.271104] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-26T01:59:29.711137] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-26T01:59:30.111096] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-26T01:59:30.111209] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-26T01:59:30.112298] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-26T01:59:30.112378] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-26T01:59:30.113796] [DEBUG] [LOCAL ] STAG: Trimmed 72549 records to 50774 (keeping 200 days of data) [2025-10-26T01:59:30.409053] [DEBUG] [LOCAL ] STAG: Primary data saved (50774 records). [2025-10-26T01:59:30.409238] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-26T01:59:30.409417] [INFO ] [MAIN ] Update Progress: 1998/2366 symbols. STAG took 18.3s. Estimated remaining time: 1h 17m 40s [2025-10-26T01:59:30.581744] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:59:30.581959] [DEBUG] [LOCAL ] STC: No existing data file found in primary storage. [2025-10-26T01:59:30.582030] [WARN ] [MAIN ] STC: No existing data found, performing full refresh instead. [2025-10-26T01:59:30.582140] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-26T01:59:30.582210] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-26T01:59:30.582291] [DEBUG] [LOCAL ] STC: No primary data file found to delete. [2025-10-26T01:59:30.582361] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-26T01:59:41.340200] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-26T01:59:41.947723] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-26T01:59:41.947907] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-26T01:59:41.949091] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-26T01:59:41.949268] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-26T01:59:41.950538] [DEBUG] [LOCAL ] STC: Trimmed 25631 records to 17730 (keeping 200 days of data) [2025-10-26T01:59:42.096059] [DEBUG] [LOCAL ] STC: Primary data saved (17730 records). [2025-10-26T01:59:42.096254] [INFO ] [MAIN ] STC: Full history saved. [2025-10-26T01:59:42.096438] [INFO ] [MAIN ] Update Progress: 1999/2366 symbols. STC took 11.7s. Estimated remaining time: 1h 17m 27s [2025-10-26T01:59:42.281543] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:59:42.281845] [DEBUG] [LOCAL ] STE: No existing data file found in primary storage. [2025-10-26T01:59:42.281935] [WARN ] [MAIN ] STE: No existing data found, performing full refresh instead. [2025-10-26T01:59:42.282082] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-26T01:59:42.282174] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-26T01:59:42.282280] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-26T01:59:42.282362] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-26T01:59:56.956257] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-26T01:59:57.333688] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-26T01:59:57.333800] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-26T01:59:57.334739] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-26T01:59:57.334817] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-26T01:59:57.335837] [DEBUG] [LOCAL ] STE: Trimmed 50771 records to 35501 (keeping 200 days of data) [2025-10-26T01:59:57.544711] [DEBUG] [LOCAL ] STE: Primary data saved (35501 records). [2025-10-26T01:59:57.544869] [INFO ] [MAIN ] STE: Full history saved. [2025-10-26T01:59:57.545039] [INFO ] [MAIN ] Update Progress: 2000/2366 symbols. STE took 15.4s. Estimated remaining time: 1h 17m 15s [2025-10-26T01:59:57.712294] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T01:59:57.712480] [DEBUG] [LOCAL ] STEL: No existing data file found in primary storage. [2025-10-26T01:59:57.712551] [WARN ] [MAIN ] STEL: No existing data found, performing full refresh instead. [2025-10-26T01:59:57.712660] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-26T01:59:57.712733] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-26T01:59:57.712793] [DEBUG] [LOCAL ] STEL: No primary data file found to delete. [2025-10-26T01:59:57.712856] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-26T02:00:11.604926] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-26T02:00:12.040761] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-26T02:00:12.040977] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-26T02:00:12.042546] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-26T02:00:12.042668] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-26T02:00:12.044097] [DEBUG] [LOCAL ] STEL: Trimmed 32370 records to 22596 (keeping 200 days of data) [2025-10-26T02:00:12.183937] [DEBUG] [LOCAL ] STEL: Primary data saved (22596 records). [2025-10-26T02:00:12.184161] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-26T02:00:12.184405] [INFO ] [MAIN ] Update Progress: 2001/2366 symbols. STEL took 14.6s. Estimated remaining time: 1h 17m 3s [2025-10-26T02:00:12.371984] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:00:12.372284] [DEBUG] [LOCAL ] STEM: No existing data file found in primary storage. [2025-10-26T02:00:12.372360] [WARN ] [MAIN ] STEM: No existing data found, performing full refresh instead. [2025-10-26T02:00:12.372491] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-26T02:00:12.372566] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-26T02:00:12.372676] [DEBUG] [LOCAL ] STEM: No primary data file found to delete. [2025-10-26T02:00:12.372755] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-26T02:00:30.239344] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-26T02:00:30.643295] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-26T02:00:30.643449] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-26T02:00:30.644818] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-26T02:00:30.644899] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-26T02:00:30.646581] [DEBUG] [LOCAL ] STEM: Trimmed 60460 records to 38856 (keeping 200 days of data) [2025-10-26T02:00:30.888103] [DEBUG] [LOCAL ] STEM: Primary data saved (38856 records). [2025-10-26T02:00:30.888398] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-26T02:00:30.888753] [INFO ] [MAIN ] Update Progress: 2002/2366 symbols. STEM took 18.7s. Estimated remaining time: 1h 16m 51s [2025-10-26T02:00:31.066359] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:00:31.066691] [DEBUG] [LOCAL ] STEW: No existing data file found in primary storage. [2025-10-26T02:00:31.066775] [WARN ] [MAIN ] STEW: No existing data found, performing full refresh instead. [2025-10-26T02:00:31.066901] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-26T02:00:31.066972] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-26T02:00:31.067054] [DEBUG] [LOCAL ] STEW: No primary data file found to delete. [2025-10-26T02:00:31.067123] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-26T02:00:40.391259] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-26T02:00:40.778101] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-26T02:00:40.778270] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-26T02:00:40.779371] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-26T02:00:40.779460] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-26T02:00:40.780499] [DEBUG] [LOCAL ] STEW: Trimmed 21775 records to 15263 (keeping 200 days of data) [2025-10-26T02:00:40.881384] [DEBUG] [LOCAL ] STEW: Primary data saved (15263 records). [2025-10-26T02:00:40.881616] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-26T02:00:40.881876] [INFO ] [MAIN ] Update Progress: 2003/2366 symbols. STEW took 10.0s. Estimated remaining time: 1h 16m 38s [2025-10-26T02:00:41.082104] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:00:41.082471] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-26T02:00:41.082550] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-26T02:00:41.082750] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-26T02:00:41.082823] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-26T02:00:41.082948] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-26T02:00:41.083020] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-26T02:00:45.755555] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-26T02:00:45.945893] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-26T02:00:45.946134] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-26T02:00:45.946223] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-26T02:00:45.946305] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-26T02:00:45.946411] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-26T02:00:45.946491] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-26T02:00:45.946578] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-26T02:00:45.946834] [INFO ] [MAIN ] Update Progress: 2004/2366 symbols. STG took 5.1s. Estimated remaining time: 1h 16m 24s [2025-10-26T02:00:46.135991] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:00:46.136322] [DEBUG] [LOCAL ] STK: No existing data file found in primary storage. [2025-10-26T02:00:46.136402] [WARN ] [MAIN ] STK: No existing data found, performing full refresh instead. [2025-10-26T02:00:46.136554] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-26T02:00:46.136632] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-26T02:00:46.136745] [DEBUG] [LOCAL ] STK: No primary data file found to delete. [2025-10-26T02:00:46.136822] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-26T02:00:53.868310] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-26T02:00:54.248211] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-26T02:00:54.248346] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-26T02:00:54.248767] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-26T02:00:54.248850] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-26T02:00:54.249413] [DEBUG] [LOCAL ] STK: Trimmed 14396 records to 9856 (keeping 200 days of data) [2025-10-26T02:00:54.306951] [DEBUG] [LOCAL ] STK: Primary data saved (9856 records). [2025-10-26T02:00:54.307123] [INFO ] [MAIN ] STK: Full history saved. [2025-10-26T02:00:54.307446] [INFO ] [MAIN ] Update Progress: 2005/2366 symbols. STK took 8.4s. Estimated remaining time: 1h 16m 11s [2025-10-26T02:00:54.481121] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:00:54.481311] [DEBUG] [LOCAL ] STLA: No existing data file found in primary storage. [2025-10-26T02:00:54.481382] [WARN ] [MAIN ] STLA: No existing data found, performing full refresh instead. [2025-10-26T02:00:54.481494] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-26T02:00:54.481565] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-26T02:00:54.481670] [DEBUG] [LOCAL ] STLA: No primary data file found to delete. [2025-10-26T02:00:54.481743] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-26T02:01:16.274718] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-26T02:01:16.665748] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-26T02:01:16.665865] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-26T02:01:16.667024] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-26T02:01:16.667106] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-26T02:01:16.668578] [DEBUG] [LOCAL ] STLA: Trimmed 77664 records to 54332 (keeping 200 days of data) [2025-10-26T02:01:16.974999] [DEBUG] [LOCAL ] STLA: Primary data saved (54332 records). [2025-10-26T02:01:16.975161] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-26T02:01:16.975486] [INFO ] [MAIN ] Update Progress: 2006/2366 symbols. STLA took 22.7s. Estimated remaining time: 1h 15m 60s [2025-10-26T02:01:17.151317] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:01:17.151529] [DEBUG] [LOCAL ] STM: No existing data file found in primary storage. [2025-10-26T02:01:17.151621] [WARN ] [MAIN ] STM: No existing data found, performing full refresh instead. [2025-10-26T02:01:17.151790] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-26T02:01:17.151888] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-26T02:01:17.151992] [DEBUG] [LOCAL ] STM: No primary data file found to delete. [2025-10-26T02:01:17.152067] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-26T02:01:37.190100] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-26T02:01:37.575296] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-26T02:01:37.575450] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-26T02:01:37.576620] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-26T02:01:37.576746] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-26T02:01:37.578294] [DEBUG] [LOCAL ] STM: Trimmed 77697 records to 54353 (keeping 200 days of data) [2025-10-26T02:01:37.892881] [DEBUG] [LOCAL ] STM: Primary data saved (54353 records). [2025-10-26T02:01:37.893071] [INFO ] [MAIN ] STM: Full history saved. [2025-10-26T02:01:37.893403] [INFO ] [MAIN ] Update Progress: 2007/2366 symbols. STM took 20.9s. Estimated remaining time: 1h 15m 49s [2025-10-26T02:01:38.059399] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:01:38.059634] [DEBUG] [LOCAL ] STN: No existing data file found in primary storage. [2025-10-26T02:01:38.059738] [WARN ] [MAIN ] STN: No existing data found, performing full refresh instead. [2025-10-26T02:01:38.059876] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-26T02:01:38.059975] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-26T02:01:38.060086] [DEBUG] [LOCAL ] STN: No primary data file found to delete. [2025-10-26T02:01:38.060176] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-26T02:01:49.203610] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-26T02:01:49.592303] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-26T02:01:49.592421] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-26T02:01:49.593169] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-26T02:01:49.593250] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-26T02:01:49.594040] [DEBUG] [LOCAL ] STN: Trimmed 32673 records to 22808 (keeping 200 days of data) [2025-10-26T02:01:49.731689] [DEBUG] [LOCAL ] STN: Primary data saved (22808 records). [2025-10-26T02:01:49.731859] [INFO ] [MAIN ] STN: Full history saved. [2025-10-26T02:01:49.732040] [INFO ] [MAIN ] Update Progress: 2008/2366 symbols. STN took 11.8s. Estimated remaining time: 1h 15m 36s [2025-10-26T02:01:49.898047] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:01:49.898257] [DEBUG] [LOCAL ] STNG: No existing data file found in primary storage. [2025-10-26T02:01:49.898329] [WARN ] [MAIN ] STNG: No existing data found, performing full refresh instead. [2025-10-26T02:01:49.898437] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-26T02:01:49.898508] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-26T02:01:49.898593] [DEBUG] [LOCAL ] STNG: No primary data file found to delete. [2025-10-26T02:01:49.898709] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-26T02:02:06.717531] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-26T02:02:07.106550] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-26T02:02:07.106702] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-26T02:02:07.107755] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-26T02:02:07.107836] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-26T02:02:07.109095] [DEBUG] [LOCAL ] STNG: Trimmed 64010 records to 43856 (keeping 200 days of data) [2025-10-26T02:02:07.357287] [DEBUG] [LOCAL ] STNG: Primary data saved (43856 records). [2025-10-26T02:02:07.357444] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-26T02:02:07.357597] [INFO ] [MAIN ] Update Progress: 2009/2366 symbols. STNG took 17.6s. Estimated remaining time: 1h 15m 24s [2025-10-26T02:02:07.523253] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:02:07.523455] [DEBUG] [LOCAL ] STRV: No existing data file found in primary storage. [2025-10-26T02:02:07.523525] [WARN ] [MAIN ] STRV: No existing data found, performing full refresh instead. [2025-10-26T02:02:07.523639] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-26T02:02:07.523731] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-26T02:02:07.523815] [DEBUG] [LOCAL ] STRV: No primary data file found to delete. [2025-10-26T02:02:07.523881] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-26T02:02:16.745934] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-26T02:02:17.118342] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-26T02:02:17.118491] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-26T02:02:17.118980] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-26T02:02:17.119062] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-26T02:02:17.119631] [DEBUG] [LOCAL ] STRV: Trimmed 17206 records to 10789 (keeping 200 days of data) [2025-10-26T02:02:17.182984] [DEBUG] [LOCAL ] STRV: Primary data saved (10789 records). [2025-10-26T02:02:17.183146] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-26T02:02:17.183366] [INFO ] [MAIN ] Update Progress: 2010/2366 symbols. STRV took 9.8s. Estimated remaining time: 1h 15m 11s [2025-10-26T02:02:17.354310] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:02:17.354531] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-10-26T02:02:17.354608] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-10-26T02:02:17.354755] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-26T02:02:17.354828] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-26T02:02:17.354913] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-26T02:02:17.354986] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-26T02:02:34.643217] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-26T02:02:35.036598] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-26T02:02:35.036766] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-26T02:02:35.037900] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-26T02:02:35.038010] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-26T02:02:35.039602] [DEBUG] [LOCAL ] STT: Trimmed 74537 records to 51873 (keeping 200 days of data) [2025-10-26T02:02:35.359086] [DEBUG] [LOCAL ] STT: Primary data saved (51873 records). [2025-10-26T02:02:35.359282] [INFO ] [MAIN ] STT: Full history saved. [2025-10-26T02:02:35.359486] [INFO ] [MAIN ] Update Progress: 2011/2366 symbols. STT took 18.2s. Estimated remaining time: 1h 14m 59s [2025-10-26T02:02:35.529781] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:02:35.529966] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-26T02:02:35.530036] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-26T02:02:35.530148] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-26T02:02:35.530218] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-26T02:02:35.530299] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-26T02:02:35.530367] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-26T02:02:36.096307] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-26T02:02:36.096395] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:02:36.096489] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-26T02:02:36.096610] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-26T02:02:36.096729] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-26T02:02:36.096835] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-26T02:02:36.097059] [INFO ] [MAIN ] Update Progress: 2012/2366 symbols. STUB took 0.7s. Estimated remaining time: 1h 14m 44s [2025-10-26T02:02:36.281133] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:02:36.282543] [DEBUG] [LOCAL ] STVN: No existing data file found in primary storage. [2025-10-26T02:02:36.282616] [WARN ] [MAIN ] STVN: No existing data found, performing full refresh instead. [2025-10-26T02:02:36.282815] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-26T02:02:36.282910] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-26T02:02:36.283016] [DEBUG] [LOCAL ] STVN: No primary data file found to delete. [2025-10-26T02:02:36.283109] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-26T02:02:48.643906] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-26T02:02:49.015210] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-26T02:02:49.015319] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-26T02:02:49.016122] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-26T02:02:49.016201] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-26T02:02:49.017119] [DEBUG] [LOCAL ] STVN: Trimmed 39202 records to 27085 (keeping 200 days of data) [2025-10-26T02:02:49.168412] [DEBUG] [LOCAL ] STVN: Primary data saved (27085 records). [2025-10-26T02:02:49.168580] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-26T02:02:49.168787] [INFO ] [MAIN ] Update Progress: 2013/2366 symbols. STVN took 13.1s. Estimated remaining time: 1h 14m 32s [2025-10-26T02:02:49.338756] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:02:49.338965] [DEBUG] [LOCAL ] STWD: No existing data file found in primary storage. [2025-10-26T02:02:49.339036] [WARN ] [MAIN ] STWD: No existing data found, performing full refresh instead. [2025-10-26T02:02:49.339146] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-26T02:02:49.339215] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-26T02:02:49.339294] [DEBUG] [LOCAL ] STWD: No primary data file found to delete. [2025-10-26T02:02:49.339361] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-26T02:03:06.428019] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-26T02:03:06.850394] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-26T02:03:06.850518] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-26T02:03:06.851825] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-26T02:03:06.851936] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-26T02:03:06.853465] [DEBUG] [LOCAL ] STWD: Trimmed 75361 records to 52724 (keeping 200 days of data) [2025-10-26T02:03:07.183242] [DEBUG] [LOCAL ] STWD: Primary data saved (52724 records). [2025-10-26T02:03:07.183387] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-26T02:03:07.183594] [INFO ] [MAIN ] Update Progress: 2014/2366 symbols. STWD took 18.0s. Estimated remaining time: 1h 14m 20s [2025-10-26T02:03:07.349908] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:07.350077] [DEBUG] [LOCAL ] STXD: No existing data file found in primary storage. [2025-10-26T02:03:07.350143] [WARN ] [MAIN ] STXD: No existing data found, performing full refresh instead. [2025-10-26T02:03:07.350252] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-26T02:03:07.350322] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-26T02:03:07.350428] [DEBUG] [LOCAL ] STXD: No primary data file found to delete. [2025-10-26T02:03:07.350499] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-26T02:03:11.840828] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-26T02:03:12.192077] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-26T02:03:12.192188] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-26T02:03:12.192321] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-26T02:03:12.192396] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-26T02:03:12.192797] [DEBUG] [LOCAL ] STXD: Trimmed 2163 records to 1361 (keeping 200 days of data) [2025-10-26T02:03:12.201116] [DEBUG] [LOCAL ] STXD: Primary data saved (1361 records). [2025-10-26T02:03:12.201195] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-26T02:03:12.201357] [INFO ] [MAIN ] Update Progress: 2015/2366 symbols. STXD took 5.0s. Estimated remaining time: 1h 14m 6s [2025-10-26T02:03:12.365618] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:12.365782] [DEBUG] [LOCAL ] STXE: No existing data file found in primary storage. [2025-10-26T02:03:12.365852] [WARN ] [MAIN ] STXE: No existing data found, performing full refresh instead. [2025-10-26T02:03:12.365962] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-26T02:03:12.366031] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-26T02:03:12.366110] [DEBUG] [LOCAL ] STXE: No primary data file found to delete. [2025-10-26T02:03:12.366184] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-26T02:03:17.582878] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-26T02:03:17.970692] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-26T02:03:17.970829] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-26T02:03:17.970992] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-26T02:03:17.971066] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-26T02:03:17.971453] [DEBUG] [LOCAL ] STXE: Trimmed 3464 records to 2082 (keeping 200 days of data) [2025-10-26T02:03:17.984169] [DEBUG] [LOCAL ] STXE: Primary data saved (2082 records). [2025-10-26T02:03:17.984255] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-26T02:03:17.984420] [INFO ] [MAIN ] Update Progress: 2016/2366 symbols. STXE took 5.8s. Estimated remaining time: 1h 13m 52s [2025-10-26T02:03:18.150778] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:18.150985] [DEBUG] [LOCAL ] STXG: No existing data file found in primary storage. [2025-10-26T02:03:18.151056] [WARN ] [MAIN ] STXG: No existing data found, performing full refresh instead. [2025-10-26T02:03:18.151168] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-26T02:03:18.151243] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-26T02:03:18.151385] [DEBUG] [LOCAL ] STXG: No primary data file found to delete. [2025-10-26T02:03:18.151454] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-26T02:03:25.056876] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-26T02:03:25.408713] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-26T02:03:25.408852] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-26T02:03:25.409020] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-26T02:03:25.409093] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-26T02:03:25.409484] [DEBUG] [LOCAL ] STXG: Trimmed 4039 records to 2333 (keeping 200 days of data) [2025-10-26T02:03:25.423734] [DEBUG] [LOCAL ] STXG: Primary data saved (2333 records). [2025-10-26T02:03:25.423816] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-26T02:03:25.423982] [INFO ] [MAIN ] Update Progress: 2017/2366 symbols. STXG took 7.4s. Estimated remaining time: 1h 13m 39s [2025-10-26T02:03:25.589268] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:25.589442] [DEBUG] [LOCAL ] STXK: No existing data file found in primary storage. [2025-10-26T02:03:25.589513] [WARN ] [MAIN ] STXK: No existing data found, performing full refresh instead. [2025-10-26T02:03:25.589625] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-26T02:03:25.589719] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-26T02:03:25.589801] [DEBUG] [LOCAL ] STXK: No primary data file found to delete. [2025-10-26T02:03:25.589870] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-26T02:03:30.146025] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-26T02:03:30.503040] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-26T02:03:30.503158] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-26T02:03:30.503305] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-26T02:03:30.503383] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-26T02:03:30.503845] [DEBUG] [LOCAL ] STXK: Trimmed 2375 records to 1497 (keeping 200 days of data) [2025-10-26T02:03:30.513129] [DEBUG] [LOCAL ] STXK: Primary data saved (1497 records). [2025-10-26T02:03:30.513211] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-26T02:03:30.513403] [INFO ] [MAIN ] Update Progress: 2018/2366 symbols. STXK took 5.1s. Estimated remaining time: 1h 13m 25s [2025-10-26T02:03:30.677820] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:30.678024] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-26T02:03:30.678093] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-26T02:03:30.678182] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-26T02:03:30.678249] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-26T02:03:30.678328] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-26T02:03:30.678397] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-26T02:03:34.836089] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-26T02:03:35.013053] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-26T02:03:35.013246] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-26T02:03:35.013316] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-26T02:03:35.013389] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-26T02:03:35.013480] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-26T02:03:35.013552] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-26T02:03:35.013672] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-26T02:03:35.013854] [INFO ] [MAIN ] Update Progress: 2019/2366 symbols. STXM took 4.5s. Estimated remaining time: 1h 13m 11s [2025-10-26T02:03:35.184583] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:35.184815] [DEBUG] [LOCAL ] STXT: No existing data file found in primary storage. [2025-10-26T02:03:35.184888] [WARN ] [MAIN ] STXT: No existing data found, performing full refresh instead. [2025-10-26T02:03:35.185002] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-26T02:03:35.185073] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-26T02:03:35.185154] [DEBUG] [LOCAL ] STXT: No primary data file found to delete. [2025-10-26T02:03:35.185221] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-26T02:03:40.765271] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-26T02:03:41.122919] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-26T02:03:41.123044] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-26T02:03:41.123255] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-26T02:03:41.123333] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-26T02:03:41.123748] [DEBUG] [LOCAL ] STXT: Trimmed 3864 records to 2551 (keeping 200 days of data) [2025-10-26T02:03:41.138887] [DEBUG] [LOCAL ] STXT: Primary data saved (2551 records). [2025-10-26T02:03:41.138974] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-26T02:03:41.139152] [INFO ] [MAIN ] Update Progress: 2020/2366 symbols. STXT took 6.1s. Estimated remaining time: 1h 12m 57s [2025-10-26T02:03:41.334808] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:41.335028] [DEBUG] [LOCAL ] STXV: No existing data file found in primary storage. [2025-10-26T02:03:41.335100] [WARN ] [MAIN ] STXV: No existing data found, performing full refresh instead. [2025-10-26T02:03:41.335212] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-26T02:03:41.335284] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-26T02:03:41.335365] [DEBUG] [LOCAL ] STXV: No primary data file found to delete. [2025-10-26T02:03:41.335435] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-26T02:03:45.782660] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-26T02:03:46.153807] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-26T02:03:46.153938] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-26T02:03:46.154107] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-26T02:03:46.154202] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-26T02:03:46.154608] [DEBUG] [LOCAL ] STXV: Trimmed 2518 records to 1482 (keeping 200 days of data) [2025-10-26T02:03:46.163706] [DEBUG] [LOCAL ] STXV: Primary data saved (1482 records). [2025-10-26T02:03:46.163808] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-26T02:03:46.163996] [INFO ] [MAIN ] Update Progress: 2021/2366 symbols. STXV took 5.0s. Estimated remaining time: 1h 12m 43s [2025-10-26T02:03:46.331373] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:03:46.331599] [DEBUG] [LOCAL ] STZ: No existing data file found in primary storage. [2025-10-26T02:03:46.331709] [WARN ] [MAIN ] STZ: No existing data found, performing full refresh instead. [2025-10-26T02:03:46.331850] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-26T02:03:46.331940] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-26T02:03:46.332048] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-26T02:03:46.332134] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-26T02:04:06.672361] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-26T02:04:07.246758] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-26T02:04:07.246947] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-26T02:04:07.249125] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-26T02:04:07.249257] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-26T02:04:07.251415] [DEBUG] [LOCAL ] STZ: Trimmed 76200 records to 53174 (keeping 200 days of data) [2025-10-26T02:04:07.650345] [DEBUG] [LOCAL ] STZ: Primary data saved (53174 records). [2025-10-26T02:04:07.650568] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-26T02:04:07.650760] [INFO ] [MAIN ] Update Progress: 2022/2366 symbols. STZ took 21.5s. Estimated remaining time: 1h 12m 32s [2025-10-26T02:04:07.829444] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:04:07.829716] [DEBUG] [LOCAL ] SU: No existing data file found in primary storage. [2025-10-26T02:04:07.829791] [WARN ] [MAIN ] SU: No existing data found, performing full refresh instead. [2025-10-26T02:04:07.829906] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-26T02:04:07.829980] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-26T02:04:07.830065] [DEBUG] [LOCAL ] SU: No primary data file found to delete. [2025-10-26T02:04:07.830136] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-26T02:04:26.091412] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-26T02:04:26.484946] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-26T02:04:26.485091] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-26T02:04:26.486273] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-26T02:04:26.486362] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-26T02:04:26.487888] [DEBUG] [LOCAL ] SU: Trimmed 77566 records to 54206 (keeping 200 days of data) [2025-10-26T02:04:26.802218] [DEBUG] [LOCAL ] SU: Primary data saved (54206 records). [2025-10-26T02:04:26.802390] [INFO ] [MAIN ] SU: Full history saved. [2025-10-26T02:04:26.802578] [INFO ] [MAIN ] Update Progress: 2023/2366 symbols. SU took 19.2s. Estimated remaining time: 1h 12m 20s [2025-10-26T02:04:26.973594] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:04:26.973830] [DEBUG] [LOCAL ] SUI: No existing data file found in primary storage. [2025-10-26T02:04:26.973908] [WARN ] [MAIN ] SUI: No existing data found, performing full refresh instead. [2025-10-26T02:04:26.974025] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-26T02:04:26.974098] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-26T02:04:26.974157] [DEBUG] [LOCAL ] SUI: No primary data file found to delete. [2025-10-26T02:04:26.974225] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-26T02:04:43.303430] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-26T02:04:43.683814] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-26T02:04:43.683943] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-26T02:04:43.684979] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-26T02:04:43.685062] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-26T02:04:43.686325] [DEBUG] [LOCAL ] SUI: Trimmed 60663 records to 42361 (keeping 200 days of data) [2025-10-26T02:04:43.942379] [DEBUG] [LOCAL ] SUI: Primary data saved (42361 records). [2025-10-26T02:04:43.942546] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-26T02:04:43.942747] [INFO ] [MAIN ] Update Progress: 2024/2366 symbols. SUI took 17.1s. Estimated remaining time: 1h 12m 8s [2025-10-26T02:04:44.112334] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:04:44.112527] [DEBUG] [LOCAL ] SUN: No existing data file found in primary storage. [2025-10-26T02:04:44.112664] [WARN ] [MAIN ] SUN: No existing data found, performing full refresh instead. [2025-10-26T02:04:44.112779] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-26T02:04:44.112849] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-26T02:04:44.112930] [DEBUG] [LOCAL ] SUN: No primary data file found to delete. [2025-10-26T02:04:44.112999] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-26T02:04:58.837427] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-26T02:04:59.232233] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-26T02:04:59.232356] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-26T02:04:59.233452] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-26T02:04:59.233536] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-26T02:04:59.234826] [DEBUG] [LOCAL ] SUN: Trimmed 55652 records to 39278 (keeping 200 days of data) [2025-10-26T02:04:59.467171] [DEBUG] [LOCAL ] SUN: Primary data saved (39278 records). [2025-10-26T02:04:59.467347] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-26T02:04:59.467525] [INFO ] [MAIN ] Update Progress: 2025/2366 symbols. SUN took 15.5s. Estimated remaining time: 1h 11m 56s [2025-10-26T02:04:59.644032] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:04:59.644247] [DEBUG] [LOCAL ] SUPV: No existing data file found in primary storage. [2025-10-26T02:04:59.644321] [WARN ] [MAIN ] SUPV: No existing data found, performing full refresh instead. [2025-10-26T02:04:59.644439] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-26T02:04:59.644512] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-26T02:04:59.644596] [DEBUG] [LOCAL ] SUPV: No primary data file found to delete. [2025-10-26T02:04:59.644691] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-26T02:05:17.719062] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-26T02:05:18.115229] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-26T02:05:18.115384] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-26T02:05:18.116541] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-26T02:05:18.116624] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-26T02:05:18.118194] [DEBUG] [LOCAL ] SUPV: Trimmed 69019 records to 48820 (keeping 200 days of data) [2025-10-26T02:05:18.394208] [DEBUG] [LOCAL ] SUPV: Primary data saved (48820 records). [2025-10-26T02:05:18.394393] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-26T02:05:18.394574] [INFO ] [MAIN ] Update Progress: 2026/2366 symbols. SUPV took 18.9s. Estimated remaining time: 1h 11m 45s [2025-10-26T02:05:18.573431] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:05:18.573690] [DEBUG] [LOCAL ] SUZ: No existing data file found in primary storage. [2025-10-26T02:05:18.573769] [WARN ] [MAIN ] SUZ: No existing data found, performing full refresh instead. [2025-10-26T02:05:18.573884] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-26T02:05:18.573956] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-26T02:05:18.574045] [DEBUG] [LOCAL ] SUZ: No primary data file found to delete. [2025-10-26T02:05:18.574096] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-26T02:05:35.580418] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-26T02:05:35.963019] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-26T02:05:35.963455] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-26T02:05:35.964529] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-26T02:05:35.964610] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-26T02:05:35.965932] [DEBUG] [LOCAL ] SUZ: Trimmed 66655 records to 46126 (keeping 200 days of data) [2025-10-26T02:05:36.221628] [DEBUG] [LOCAL ] SUZ: Primary data saved (46126 records). [2025-10-26T02:05:36.221849] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-26T02:05:36.222040] [INFO ] [MAIN ] Update Progress: 2027/2366 symbols. SUZ took 17.8s. Estimated remaining time: 1h 11m 33s [2025-10-26T02:05:36.391415] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:05:36.391611] [DEBUG] [LOCAL ] SVV: No existing data file found in primary storage. [2025-10-26T02:05:36.391700] [WARN ] [MAIN ] SVV: No existing data found, performing full refresh instead. [2025-10-26T02:05:36.391812] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-26T02:05:36.391882] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-26T02:05:36.391965] [DEBUG] [LOCAL ] SVV: No primary data file found to delete. [2025-10-26T02:05:36.392030] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-26T02:05:52.192665] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-26T02:05:52.582622] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-26T02:05:52.582767] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-26T02:05:52.583853] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-26T02:05:52.583933] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-26T02:05:52.585217] [DEBUG] [LOCAL ] SVV: Trimmed 57566 records to 40891 (keeping 200 days of data) [2025-10-26T02:05:52.808101] [DEBUG] [LOCAL ] SVV: Primary data saved (40891 records). [2025-10-26T02:05:52.808255] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-26T02:05:52.808428] [INFO ] [MAIN ] Update Progress: 2028/2366 symbols. SVV took 16.6s. Estimated remaining time: 1h 11m 21s [2025-10-26T02:05:52.978145] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:05:52.978365] [DEBUG] [LOCAL ] SW: No existing data file found in primary storage. [2025-10-26T02:05:52.978436] [WARN ] [MAIN ] SW: No existing data found, performing full refresh instead. [2025-10-26T02:05:52.978546] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-26T02:05:52.978614] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-26T02:05:52.978720] [DEBUG] [LOCAL ] SW: No primary data file found to delete. [2025-10-26T02:05:52.978789] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-26T02:06:11.134412] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-26T02:06:11.517881] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-26T02:06:11.518041] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-26T02:06:11.519413] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-26T02:06:11.519498] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-26T02:06:11.521127] [DEBUG] [LOCAL ] SW: Trimmed 77120 records to 53955 (keeping 200 days of data) [2025-10-26T02:06:11.838361] [DEBUG] [LOCAL ] SW: Primary data saved (53955 records). [2025-10-26T02:06:11.838532] [INFO ] [MAIN ] SW: Full history saved. [2025-10-26T02:06:11.838736] [INFO ] [MAIN ] Update Progress: 2029/2366 symbols. SW took 19.0s. Estimated remaining time: 1h 11m 9s [2025-10-26T02:06:12.005931] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:06:12.006123] [DEBUG] [LOCAL ] SWK: No existing data file found in primary storage. [2025-10-26T02:06:12.006198] [WARN ] [MAIN ] SWK: No existing data found, performing full refresh instead. [2025-10-26T02:06:12.006319] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-26T02:06:12.006393] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-26T02:06:12.006478] [DEBUG] [LOCAL ] SWK: No primary data file found to delete. [2025-10-26T02:06:12.006576] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-26T02:06:29.997607] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-26T02:06:30.406689] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-26T02:06:30.406825] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-26T02:06:30.408133] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-26T02:06:30.408251] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-26T02:06:30.409811] [DEBUG] [LOCAL ] SWK: Trimmed 75520 records to 53110 (keeping 200 days of data) [2025-10-26T02:06:30.723817] [DEBUG] [LOCAL ] SWK: Primary data saved (53110 records). [2025-10-26T02:06:30.723977] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-26T02:06:30.724168] [INFO ] [MAIN ] Update Progress: 2030/2366 symbols. SWK took 18.9s. Estimated remaining time: 1h 10m 58s [2025-10-26T02:06:30.895380] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:06:30.895670] [DEBUG] [LOCAL ] SWX: No existing data file found in primary storage. [2025-10-26T02:06:30.895745] [WARN ] [MAIN ] SWX: No existing data found, performing full refresh instead. [2025-10-26T02:06:30.895839] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-26T02:06:30.895907] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-26T02:06:30.895988] [DEBUG] [LOCAL ] SWX: No primary data file found to delete. [2025-10-26T02:06:30.896059] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-26T02:06:43.828686] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-26T02:06:44.200390] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-26T02:06:44.200521] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-26T02:06:44.201475] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-26T02:06:44.201572] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-26T02:06:44.202806] [DEBUG] [LOCAL ] SWX: Trimmed 43817 records to 30913 (keeping 200 days of data) [2025-10-26T02:06:44.384209] [DEBUG] [LOCAL ] SWX: Primary data saved (30913 records). [2025-10-26T02:06:44.384403] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-26T02:06:44.384672] [INFO ] [MAIN ] Update Progress: 2031/2366 symbols. SWX took 13.7s. Estimated remaining time: 1h 10m 45s [2025-10-26T02:06:44.555088] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:06:44.555317] [DEBUG] [LOCAL ] SWZ: No existing data file found in primary storage. [2025-10-26T02:06:44.555402] [WARN ] [MAIN ] SWZ: No existing data found, performing full refresh instead. [2025-10-26T02:06:44.555558] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-26T02:06:44.555669] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-26T02:06:44.555778] [DEBUG] [LOCAL ] SWZ: No primary data file found to delete. [2025-10-26T02:06:44.555857] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-26T02:06:51.549091] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-26T02:06:51.929132] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-26T02:06:51.929259] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-26T02:06:51.929533] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-26T02:06:51.929612] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-26T02:06:51.930109] [DEBUG] [LOCAL ] SWZ: Trimmed 8261 records to 6024 (keeping 200 days of data) [2025-10-26T02:06:51.966667] [DEBUG] [LOCAL ] SWZ: Primary data saved (6024 records). [2025-10-26T02:06:51.966840] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-26T02:06:51.967044] [INFO ] [MAIN ] Update Progress: 2032/2366 symbols. SWZ took 7.6s. Estimated remaining time: 1h 10m 31s [2025-10-26T02:06:52.134072] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:06:52.134331] [DEBUG] [LOCAL ] SXC: No existing data file found in primary storage. [2025-10-26T02:06:52.134404] [WARN ] [MAIN ] SXC: No existing data found, performing full refresh instead. [2025-10-26T02:06:52.134518] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-26T02:06:52.134590] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-26T02:06:52.134697] [DEBUG] [LOCAL ] SXC: No primary data file found to delete. [2025-10-26T02:06:52.134769] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-26T02:07:07.630587] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-26T02:07:08.017338] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-26T02:07:08.017468] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-26T02:07:08.018515] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-26T02:07:08.018595] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-26T02:07:08.019780] [DEBUG] [LOCAL ] SXC: Trimmed 60859 records to 42081 (keeping 200 days of data) [2025-10-26T02:07:08.252035] [DEBUG] [LOCAL ] SXC: Primary data saved (42081 records). [2025-10-26T02:07:08.252191] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-26T02:07:08.252361] [INFO ] [MAIN ] Update Progress: 2033/2366 symbols. SXC took 16.3s. Estimated remaining time: 1h 10m 19s [2025-10-26T02:07:08.418906] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:07:08.419101] [DEBUG] [LOCAL ] SXI: No existing data file found in primary storage. [2025-10-26T02:07:08.419171] [WARN ] [MAIN ] SXI: No existing data found, performing full refresh instead. [2025-10-26T02:07:08.419282] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-26T02:07:08.419352] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-26T02:07:08.419438] [DEBUG] [LOCAL ] SXI: No primary data file found to delete. [2025-10-26T02:07:08.419506] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-26T02:07:16.693953] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-26T02:07:17.072932] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-26T02:07:17.073074] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-26T02:07:17.073464] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-26T02:07:17.073541] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-26T02:07:17.074351] [DEBUG] [LOCAL ] SXI: Trimmed 15931 records to 12150 (keeping 200 days of data) [2025-10-26T02:07:17.148962] [DEBUG] [LOCAL ] SXI: Primary data saved (12150 records). [2025-10-26T02:07:17.149148] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-26T02:07:17.149330] [INFO ] [MAIN ] Update Progress: 2034/2366 symbols. SXI took 8.9s. Estimated remaining time: 1h 10m 6s [2025-10-26T02:07:17.316433] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:07:17.316623] [DEBUG] [LOCAL ] SXT: No existing data file found in primary storage. [2025-10-26T02:07:17.316719] [WARN ] [MAIN ] SXT: No existing data found, performing full refresh instead. [2025-10-26T02:07:17.316833] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-26T02:07:17.316905] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-26T02:07:17.316987] [DEBUG] [LOCAL ] SXT: No primary data file found to delete. [2025-10-26T02:07:17.317057] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-26T02:07:29.559076] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-26T02:07:29.951407] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-26T02:07:29.951536] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-26T02:07:29.952696] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-26T02:07:29.952808] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-26T02:07:29.953835] [DEBUG] [LOCAL ] SXT: Trimmed 39643 records to 29944 (keeping 200 days of data) [2025-10-26T02:07:30.131097] [DEBUG] [LOCAL ] SXT: Primary data saved (29944 records). [2025-10-26T02:07:30.131265] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-26T02:07:30.131519] [INFO ] [MAIN ] Update Progress: 2035/2366 symbols. SXT took 13.0s. Estimated remaining time: 1h 9m 54s [2025-10-26T02:07:30.298195] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:07:30.298374] [DEBUG] [LOCAL ] SYF: No existing data file found in primary storage. [2025-10-26T02:07:30.298469] [WARN ] [MAIN ] SYF: No existing data found, performing full refresh instead. [2025-10-26T02:07:30.298623] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-26T02:07:30.298726] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-26T02:07:30.298831] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-10-26T02:07:30.298917] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-26T02:07:47.717699] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-26T02:07:48.120468] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-26T02:07:48.120577] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-26T02:07:48.121893] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-26T02:07:48.121977] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-26T02:07:48.123423] [DEBUG] [LOCAL ] SYF: Trimmed 77581 records to 54231 (keeping 200 days of data) [2025-10-26T02:07:48.462387] [DEBUG] [LOCAL ] SYF: Primary data saved (54231 records). [2025-10-26T02:07:48.462540] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-26T02:07:48.462736] [INFO ] [MAIN ] Update Progress: 2036/2366 symbols. SYF took 18.3s. Estimated remaining time: 1h 9m 42s [2025-10-26T02:07:48.632217] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:07:48.632423] [DEBUG] [LOCAL ] SYK: No existing data file found in primary storage. [2025-10-26T02:07:48.632493] [WARN ] [MAIN ] SYK: No existing data found, performing full refresh instead. [2025-10-26T02:07:48.632604] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-26T02:07:48.632695] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-26T02:07:48.632781] [DEBUG] [LOCAL ] SYK: No primary data file found to delete. [2025-10-26T02:07:48.632847] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-26T02:08:05.677281] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-26T02:08:06.089687] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-26T02:08:06.089833] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-26T02:08:06.090948] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-26T02:08:06.091030] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-26T02:08:06.092366] [DEBUG] [LOCAL ] SYK: Trimmed 69152 records to 47477 (keeping 200 days of data) [2025-10-26T02:08:06.386299] [DEBUG] [LOCAL ] SYK: Primary data saved (47477 records). [2025-10-26T02:08:06.386455] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-26T02:08:06.386630] [INFO ] [MAIN ] Update Progress: 2037/2366 symbols. SYK took 17.9s. Estimated remaining time: 1h 9m 30s [2025-10-26T02:08:06.555167] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:08:06.555369] [DEBUG] [LOCAL ] SYY: No existing data file found in primary storage. [2025-10-26T02:08:06.555442] [WARN ] [MAIN ] SYY: No existing data found, performing full refresh instead. [2025-10-26T02:08:06.555554] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-26T02:08:06.555624] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-26T02:08:06.555748] [DEBUG] [LOCAL ] SYY: No primary data file found to delete. [2025-10-26T02:08:06.555818] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-26T02:08:23.959164] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-26T02:08:24.348066] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-26T02:08:24.348228] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-26T02:08:24.349353] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-26T02:08:24.349432] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-26T02:08:24.350875] [DEBUG] [LOCAL ] SYY: Trimmed 77243 records to 53973 (keeping 200 days of data) [2025-10-26T02:08:24.669116] [DEBUG] [LOCAL ] SYY: Primary data saved (53973 records). [2025-10-26T02:08:24.669277] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-26T02:08:24.669463] [INFO ] [MAIN ] Update Progress: 2038/2366 symbols. SYY took 18.3s. Estimated remaining time: 1h 9m 18s [2025-10-26T02:08:24.841923] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:08:24.842144] [DEBUG] [LOCAL ] T: No existing data file found in primary storage. [2025-10-26T02:08:24.842219] [WARN ] [MAIN ] T: No existing data found, performing full refresh instead. [2025-10-26T02:08:24.842333] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-26T02:08:24.842404] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-26T02:08:24.842485] [DEBUG] [LOCAL ] T: No primary data file found to delete. [2025-10-26T02:08:24.842554] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-26T02:08:46.466223] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-26T02:08:46.856884] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-26T02:08:46.856997] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-26T02:08:46.858159] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-26T02:08:46.858242] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-26T02:08:46.859749] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 54578 (keeping 200 days of data) [2025-10-26T02:08:47.185163] [DEBUG] [LOCAL ] T: Primary data saved (54578 records). [2025-10-26T02:08:47.185316] [INFO ] [MAIN ] T: Full history saved. [2025-10-26T02:08:47.185531] [INFO ] [MAIN ] Update Progress: 2039/2366 symbols. T took 22.5s. Estimated remaining time: 1h 9m 7s [2025-10-26T02:08:47.364292] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:08:47.364507] [DEBUG] [LOCAL ] TAC: No existing data file found in primary storage. [2025-10-26T02:08:47.364580] [WARN ] [MAIN ] TAC: No existing data found, performing full refresh instead. [2025-10-26T02:08:47.364721] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-26T02:08:47.364796] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-26T02:08:47.364878] [DEBUG] [LOCAL ] TAC: No primary data file found to delete. [2025-10-26T02:08:47.364947] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-26T02:09:03.708183] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-26T02:09:04.117036] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-26T02:09:04.117163] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-26T02:09:04.118374] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-26T02:09:04.118460] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-26T02:09:04.119870] [DEBUG] [LOCAL ] TAC: Trimmed 64796 records to 44150 (keeping 200 days of data) [2025-10-26T02:09:04.380193] [DEBUG] [LOCAL ] TAC: Primary data saved (44150 records). [2025-10-26T02:09:04.380385] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-26T02:09:04.380592] [INFO ] [MAIN ] Update Progress: 2040/2366 symbols. TAC took 17.2s. Estimated remaining time: 1h 8m 55s [2025-10-26T02:09:04.549634] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:09:04.549845] [DEBUG] [LOCAL ] TAK: No existing data file found in primary storage. [2025-10-26T02:09:04.549916] [WARN ] [MAIN ] TAK: No existing data found, performing full refresh instead. [2025-10-26T02:09:04.550028] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-26T02:09:04.550117] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-26T02:09:04.550206] [DEBUG] [LOCAL ] TAK: No primary data file found to delete. [2025-10-26T02:09:04.550274] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-26T02:09:25.011584] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-26T02:09:25.422572] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-26T02:09:25.422740] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-26T02:09:25.423874] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-26T02:09:25.423956] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-26T02:09:25.425372] [DEBUG] [LOCAL ] TAK: Trimmed 72026 records to 50930 (keeping 200 days of data) [2025-10-26T02:09:25.719417] [DEBUG] [LOCAL ] TAK: Primary data saved (50930 records). [2025-10-26T02:09:25.719592] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-26T02:09:25.719796] [INFO ] [MAIN ] Update Progress: 2041/2366 symbols. TAK took 21.3s. Estimated remaining time: 1h 8m 44s [2025-10-26T02:09:25.887703] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:09:25.887951] [DEBUG] [LOCAL ] TAL: No existing data file found in primary storage. [2025-10-26T02:09:25.888028] [WARN ] [MAIN ] TAL: No existing data found, performing full refresh instead. [2025-10-26T02:09:25.888142] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-26T02:09:25.888214] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-26T02:09:25.888297] [DEBUG] [LOCAL ] TAL: No primary data file found to delete. [2025-10-26T02:09:25.888370] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-26T02:09:45.999399] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-26T02:09:46.414082] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-26T02:09:46.414243] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-26T02:09:46.415959] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-26T02:09:46.416049] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-26T02:09:46.418101] [DEBUG] [LOCAL ] TAL: Trimmed 75683 records to 52442 (keeping 200 days of data) [2025-10-26T02:09:46.738631] [DEBUG] [LOCAL ] TAL: Primary data saved (52442 records). [2025-10-26T02:09:46.738881] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-26T02:09:46.739149] [INFO ] [MAIN ] Update Progress: 2042/2366 symbols. TAL took 21.0s. Estimated remaining time: 1h 8m 32s [2025-10-26T02:09:46.920289] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:09:46.920576] [DEBUG] [LOCAL ] TALO: No existing data file found in primary storage. [2025-10-26T02:09:46.920678] [WARN ] [MAIN ] TALO: No existing data found, performing full refresh instead. [2025-10-26T02:09:46.920811] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-26T02:09:46.920897] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-26T02:09:46.920985] [DEBUG] [LOCAL ] TALO: No primary data file found to delete. [2025-10-26T02:09:46.921060] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-26T02:10:04.006516] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-26T02:10:04.406084] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-26T02:10:04.406207] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-26T02:10:04.407357] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-26T02:10:04.407440] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-26T02:10:04.409397] [DEBUG] [LOCAL ] TALO: Trimmed 73407 records to 51719 (keeping 200 days of data) [2025-10-26T02:10:04.711869] [DEBUG] [LOCAL ] TALO: Primary data saved (51719 records). [2025-10-26T02:10:04.712047] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-26T02:10:04.712428] [INFO ] [MAIN ] Update Progress: 2043/2366 symbols. TALO took 18.0s. Estimated remaining time: 1h 8m 21s [2025-10-26T02:10:04.888619] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:10:04.888858] [DEBUG] [LOCAL ] TAP: No existing data file found in primary storage. [2025-10-26T02:10:04.888929] [WARN ] [MAIN ] TAP: No existing data found, performing full refresh instead. [2025-10-26T02:10:04.889043] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-26T02:10:04.889114] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-26T02:10:04.889196] [DEBUG] [LOCAL ] TAP: No primary data file found to delete. [2025-10-26T02:10:04.889265] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-26T02:10:23.361790] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-26T02:10:23.759988] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-26T02:10:23.760102] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-26T02:10:23.761345] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-26T02:10:23.761426] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-26T02:10:23.762861] [DEBUG] [LOCAL ] TAP: Trimmed 76517 records to 53722 (keeping 200 days of data) [2025-10-26T02:10:24.074570] [DEBUG] [LOCAL ] TAP: Primary data saved (53722 records). [2025-10-26T02:10:24.074748] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-26T02:10:24.075042] [INFO ] [MAIN ] Update Progress: 2044/2366 symbols. TAP took 19.4s. Estimated remaining time: 1h 8m 9s [2025-10-26T02:10:24.247783] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:10:24.248059] [DEBUG] [LOCAL ] TBB: No existing data file found in primary storage. [2025-10-26T02:10:24.248134] [WARN ] [MAIN ] TBB: No existing data found, performing full refresh instead. [2025-10-26T02:10:24.248255] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-26T02:10:24.248334] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-26T02:10:24.248416] [DEBUG] [LOCAL ] TBB: No primary data file found to delete. [2025-10-26T02:10:24.248485] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-26T02:10:32.848608] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-26T02:10:33.223035] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-26T02:10:33.223161] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-26T02:10:33.223639] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-26T02:10:33.223756] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-26T02:10:33.224436] [DEBUG] [LOCAL ] TBB: Trimmed 16196 records to 11390 (keeping 200 days of data) [2025-10-26T02:10:33.300569] [DEBUG] [LOCAL ] TBB: Primary data saved (11390 records). [2025-10-26T02:10:33.300796] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-26T02:10:33.300989] [INFO ] [MAIN ] Update Progress: 2045/2366 symbols. TBB took 9.2s. Estimated remaining time: 1h 7m 56s [2025-10-26T02:10:33.529798] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:10:33.530043] [DEBUG] [LOCAL ] TBBB: No existing data file found in primary storage. [2025-10-26T02:10:33.530118] [WARN ] [MAIN ] TBBB: No existing data found, performing full refresh instead. [2025-10-26T02:10:33.530251] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-26T02:10:33.530349] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-26T02:10:33.530437] [DEBUG] [LOCAL ] TBBB: No primary data file found to delete. [2025-10-26T02:10:33.530509] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-26T02:10:48.605288] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-26T02:10:48.997094] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-26T02:10:48.997224] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-26T02:10:48.998230] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-26T02:10:48.998310] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-26T02:10:48.999459] [DEBUG] [LOCAL ] TBBB: Trimmed 52327 records to 36125 (keeping 200 days of data) [2025-10-26T02:10:49.201302] [DEBUG] [LOCAL ] TBBB: Primary data saved (36125 records). [2025-10-26T02:10:49.201467] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-26T02:10:49.201670] [INFO ] [MAIN ] Update Progress: 2046/2366 symbols. TBBB took 15.9s. Estimated remaining time: 1h 7m 43s [2025-10-26T02:10:49.375512] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:10:49.375744] [DEBUG] [LOCAL ] TBI: No existing data file found in primary storage. [2025-10-26T02:10:49.375819] [WARN ] [MAIN ] TBI: No existing data found, performing full refresh instead. [2025-10-26T02:10:49.375935] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-26T02:10:49.376008] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-26T02:10:49.376095] [DEBUG] [LOCAL ] TBI: No primary data file found to delete. [2025-10-26T02:10:49.376166] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-26T02:11:00.917968] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-26T02:11:01.309435] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-26T02:11:01.309604] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-26T02:11:01.310771] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-26T02:11:01.310883] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-26T02:11:01.312256] [DEBUG] [LOCAL ] TBI: Trimmed 32129 records to 23059 (keeping 200 days of data) [2025-10-26T02:11:01.443453] [DEBUG] [LOCAL ] TBI: Primary data saved (23059 records). [2025-10-26T02:11:01.443670] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-26T02:11:01.443895] [INFO ] [MAIN ] Update Progress: 2047/2366 symbols. TBI took 12.2s. Estimated remaining time: 1h 7m 31s [2025-10-26T02:11:01.622903] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:01.623227] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-26T02:11:01.623304] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-26T02:11:01.623490] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-26T02:11:01.623566] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-26T02:11:01.623673] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-26T02:11:01.623747] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-26T02:11:05.660026] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-26T02:11:05.853540] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-26T02:11:05.853802] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-26T02:11:05.853876] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-26T02:11:05.853951] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-26T02:11:05.854075] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-26T02:11:05.854191] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-26T02:11:05.854272] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-26T02:11:05.854431] [INFO ] [MAIN ] Update Progress: 2048/2366 symbols. TBLU took 4.4s. Estimated remaining time: 1h 7m 17s [2025-10-26T02:11:06.019190] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:06.019376] [DEBUG] [LOCAL ] TBN: No existing data file found in primary storage. [2025-10-26T02:11:06.019445] [WARN ] [MAIN ] TBN: No existing data found, performing full refresh instead. [2025-10-26T02:11:06.019588] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-26T02:11:06.019681] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-26T02:11:06.019763] [DEBUG] [LOCAL ] TBN: No primary data file found to delete. [2025-10-26T02:11:06.019830] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-26T02:11:12.050180] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-26T02:11:12.426192] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-26T02:11:12.426312] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-26T02:11:12.426562] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-26T02:11:12.426668] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-26T02:11:12.427171] [DEBUG] [LOCAL ] TBN: Trimmed 6308 records to 4423 (keeping 200 days of data) [2025-10-26T02:11:12.452500] [DEBUG] [LOCAL ] TBN: Primary data saved (4423 records). [2025-10-26T02:11:12.452700] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-26T02:11:12.452928] [INFO ] [MAIN ] Update Progress: 2049/2366 symbols. TBN took 6.6s. Estimated remaining time: 1h 7m 3s [2025-10-26T02:11:12.620792] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:12.620996] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-26T02:11:12.621090] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-26T02:11:12.621238] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-26T02:11:12.621315] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-26T02:11:12.621420] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-26T02:11:12.621507] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-26T02:11:13.219469] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-26T02:11:13.219557] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:11:13.219671] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-26T02:11:13.219788] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-26T02:11:13.219876] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-26T02:11:13.219979] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-26T02:11:13.220218] [INFO ] [MAIN ] Update Progress: 2050/2366 symbols. TCAI took 0.8s. Estimated remaining time: 1h 6m 49s [2025-10-26T02:11:13.391069] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:13.391275] [DEBUG] [LOCAL ] TCBX: No existing data file found in primary storage. [2025-10-26T02:11:13.391364] [WARN ] [MAIN ] TCBX: No existing data found, performing full refresh instead. [2025-10-26T02:11:13.391520] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-26T02:11:13.391605] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-26T02:11:13.391731] [DEBUG] [LOCAL ] TCBX: No primary data file found to delete. [2025-10-26T02:11:13.391813] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-26T02:11:21.905131] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-26T02:11:22.265829] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-26T02:11:22.265943] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-26T02:11:22.266346] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-26T02:11:22.266423] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-26T02:11:22.266974] [DEBUG] [LOCAL ] TCBX: Trimmed 15779 records to 10345 (keeping 200 days of data) [2025-10-26T02:11:22.329798] [DEBUG] [LOCAL ] TCBX: Primary data saved (10345 records). [2025-10-26T02:11:22.330040] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-26T02:11:22.330316] [INFO ] [MAIN ] Update Progress: 2051/2366 symbols. TCBX took 9.1s. Estimated remaining time: 1h 6m 35s [2025-10-26T02:11:22.512174] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:22.512471] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-26T02:11:22.512547] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-26T02:11:22.512700] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-26T02:11:22.512777] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-26T02:11:22.512861] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-26T02:11:22.512932] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-26T02:11:23.090066] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-26T02:11:23.090140] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:11:23.090220] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-26T02:11:23.090325] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-26T02:11:23.090399] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-26T02:11:23.090483] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-26T02:11:23.090720] [INFO ] [MAIN ] Update Progress: 2052/2366 symbols. TCPA took 0.8s. Estimated remaining time: 1h 6m 21s [2025-10-26T02:11:23.269084] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:23.269360] [DEBUG] [LOCAL ] TD: No existing data file found in primary storage. [2025-10-26T02:11:23.269436] [WARN ] [MAIN ] TD: No existing data found, performing full refresh instead. [2025-10-26T02:11:23.269563] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-26T02:11:23.269637] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-26T02:11:23.269749] [DEBUG] [LOCAL ] TD: No primary data file found to delete. [2025-10-26T02:11:23.269820] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-26T02:11:42.003055] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-26T02:11:42.396267] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-26T02:11:42.396400] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-26T02:11:42.397750] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-26T02:11:42.397845] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-26T02:11:42.399391] [DEBUG] [LOCAL ] TD: Trimmed 75839 records to 52951 (keeping 200 days of data) [2025-10-26T02:11:42.725457] [DEBUG] [LOCAL ] TD: Primary data saved (52951 records). [2025-10-26T02:11:42.725633] [INFO ] [MAIN ] TD: Full history saved. [2025-10-26T02:11:42.725835] [INFO ] [MAIN ] Update Progress: 2053/2366 symbols. TD took 19.6s. Estimated remaining time: 1h 6m 9s [2025-10-26T02:11:42.896164] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:42.896382] [DEBUG] [LOCAL ] TDC: No existing data file found in primary storage. [2025-10-26T02:11:42.896452] [WARN ] [MAIN ] TDC: No existing data found, performing full refresh instead. [2025-10-26T02:11:42.896620] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-26T02:11:42.896709] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-26T02:11:42.896794] [DEBUG] [LOCAL ] TDC: No primary data file found to delete. [2025-10-26T02:11:42.896863] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-26T02:11:58.729909] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-26T02:11:59.113926] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-26T02:11:59.114038] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-26T02:11:59.115141] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-26T02:11:59.115222] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-26T02:11:59.116498] [DEBUG] [LOCAL ] TDC: Trimmed 67849 records to 47089 (keeping 200 days of data) [2025-10-26T02:11:59.374568] [DEBUG] [LOCAL ] TDC: Primary data saved (47089 records). [2025-10-26T02:11:59.374746] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-26T02:11:59.374904] [INFO ] [MAIN ] Update Progress: 2054/2366 symbols. TDC took 16.6s. Estimated remaining time: 1h 5m 57s [2025-10-26T02:11:59.548841] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:11:59.549314] [DEBUG] [LOCAL ] TDF: No existing data file found in primary storage. [2025-10-26T02:11:59.549391] [WARN ] [MAIN ] TDF: No existing data found, performing full refresh instead. [2025-10-26T02:11:59.549506] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-26T02:11:59.549578] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-26T02:11:59.549685] [DEBUG] [LOCAL ] TDF: No primary data file found to delete. [2025-10-26T02:11:59.549759] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-26T02:12:07.385629] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-26T02:12:07.821463] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-26T02:12:07.821637] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-26T02:12:07.822094] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-26T02:12:07.822177] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-26T02:12:07.822817] [DEBUG] [LOCAL ] TDF: Trimmed 10226 records to 6255 (keeping 200 days of data) [2025-10-26T02:12:07.861593] [DEBUG] [LOCAL ] TDF: Primary data saved (6255 records). [2025-10-26T02:12:07.861821] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-26T02:12:07.862060] [INFO ] [MAIN ] Update Progress: 2055/2366 symbols. TDF took 8.5s. Estimated remaining time: 1h 5m 44s [2025-10-26T02:12:08.039186] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:12:08.039507] [DEBUG] [LOCAL ] TDG: No existing data file found in primary storage. [2025-10-26T02:12:08.039586] [WARN ] [MAIN ] TDG: No existing data found, performing full refresh instead. [2025-10-26T02:12:08.039745] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-26T02:12:08.039822] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-26T02:12:08.039908] [DEBUG] [LOCAL ] TDG: No primary data file found to delete. [2025-10-26T02:12:08.039983] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-26T02:12:19.970978] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-26T02:12:20.364782] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-26T02:12:20.364938] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-26T02:12:20.366419] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-26T02:12:20.366508] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-26T02:12:20.367550] [DEBUG] [LOCAL ] TDG: Trimmed 32022 records to 22248 (keeping 200 days of data) [2025-10-26T02:12:20.514812] [DEBUG] [LOCAL ] TDG: Primary data saved (22248 records). [2025-10-26T02:12:20.515067] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-26T02:12:20.515338] [INFO ] [MAIN ] Update Progress: 2056/2366 symbols. TDG took 12.7s. Estimated remaining time: 1h 5m 31s [2025-10-26T02:12:20.692987] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:12:20.693275] [DEBUG] [LOCAL ] TDOC: No existing data file found in primary storage. [2025-10-26T02:12:20.693351] [WARN ] [MAIN ] TDOC: No existing data found, performing full refresh instead. [2025-10-26T02:12:20.693482] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-26T02:12:20.693557] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-26T02:12:20.693667] [DEBUG] [LOCAL ] TDOC: No primary data file found to delete. [2025-10-26T02:12:20.693745] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-26T02:12:41.876317] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-26T02:12:42.271259] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-26T02:12:42.271377] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-26T02:12:42.272704] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-26T02:12:42.272798] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-26T02:12:42.274341] [DEBUG] [LOCAL ] TDOC: Trimmed 77445 records to 54148 (keeping 200 days of data) [2025-10-26T02:12:42.571111] [DEBUG] [LOCAL ] TDOC: Primary data saved (54148 records). [2025-10-26T02:12:42.571286] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-26T02:12:42.571516] [INFO ] [MAIN ] Update Progress: 2057/2366 symbols. TDOC took 22.1s. Estimated remaining time: 1h 5m 20s [2025-10-26T02:12:42.746238] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:12:42.746455] [DEBUG] [LOCAL ] TDS: No existing data file found in primary storage. [2025-10-26T02:12:42.746513] [WARN ] [MAIN ] TDS: No existing data found, performing full refresh instead. [2025-10-26T02:12:42.746694] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-26T02:12:42.746792] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-26T02:12:42.746904] [DEBUG] [LOCAL ] TDS: No primary data file found to delete. [2025-10-26T02:12:42.746996] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-26T02:12:58.276551] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-26T02:12:58.684574] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-26T02:12:58.684725] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-26T02:12:58.685834] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-26T02:12:58.685920] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-26T02:12:58.687261] [DEBUG] [LOCAL ] TDS: Trimmed 61170 records to 42599 (keeping 200 days of data) [2025-10-26T02:12:58.939368] [DEBUG] [LOCAL ] TDS: Primary data saved (42599 records). [2025-10-26T02:12:58.939546] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-26T02:12:58.939777] [INFO ] [MAIN ] Update Progress: 2058/2366 symbols. TDS took 16.4s. Estimated remaining time: 1h 5m 8s [2025-10-26T02:12:59.123567] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:12:59.123839] [DEBUG] [LOCAL ] TDW: No existing data file found in primary storage. [2025-10-26T02:12:59.123925] [WARN ] [MAIN ] TDW: No existing data found, performing full refresh instead. [2025-10-26T02:12:59.124070] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-26T02:12:59.124160] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-26T02:12:59.124260] [DEBUG] [LOCAL ] TDW: No primary data file found to delete. [2025-10-26T02:12:59.124348] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-26T02:13:15.620875] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-26T02:13:15.997924] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-26T02:13:15.998039] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-26T02:13:15.999148] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-26T02:13:15.999229] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-26T02:13:16.000486] [DEBUG] [LOCAL ] TDW: Trimmed 66696 records to 45613 (keeping 200 days of data) [2025-10-26T02:13:16.249603] [DEBUG] [LOCAL ] TDW: Primary data saved (45613 records). [2025-10-26T02:13:16.249758] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-26T02:13:16.249946] [INFO ] [MAIN ] Update Progress: 2059/2366 symbols. TDW took 17.3s. Estimated remaining time: 1h 4m 56s [2025-10-26T02:13:16.415683] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:13:16.415859] [DEBUG] [LOCAL ] TDY: No existing data file found in primary storage. [2025-10-26T02:13:16.415908] [WARN ] [MAIN ] TDY: No existing data found, performing full refresh instead. [2025-10-26T02:13:16.415982] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-26T02:13:16.416048] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-26T02:13:16.416105] [DEBUG] [LOCAL ] TDY: No primary data file found to delete. [2025-10-26T02:13:16.416207] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-26T02:13:27.883762] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-26T02:13:28.249960] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-26T02:13:28.250081] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-26T02:13:28.250826] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-26T02:13:28.250913] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-26T02:13:28.251771] [DEBUG] [LOCAL ] TDY: Trimmed 32156 records to 22473 (keeping 200 days of data) [2025-10-26T02:13:28.379051] [DEBUG] [LOCAL ] TDY: Primary data saved (22473 records). [2025-10-26T02:13:28.379212] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-26T02:13:28.379469] [INFO ] [MAIN ] Update Progress: 2060/2366 symbols. TDY took 12.1s. Estimated remaining time: 1h 4m 43s [2025-10-26T02:13:28.549548] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:13:28.549789] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-26T02:13:28.549861] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-26T02:13:28.549973] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-26T02:13:28.550089] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-26T02:13:28.550174] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-26T02:13:28.550246] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-26T02:13:29.110999] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-26T02:13:29.111092] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:13:29.111186] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-26T02:13:29.111312] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-26T02:13:29.111396] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-26T02:13:29.111536] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-26T02:13:29.111831] [INFO ] [MAIN ] Update Progress: 2061/2366 symbols. TE took 0.7s. Estimated remaining time: 1h 4m 28s [2025-10-26T02:13:29.294400] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:13:29.294711] [DEBUG] [LOCAL ] TEAF: No existing data file found in primary storage. [2025-10-26T02:13:29.294791] [WARN ] [MAIN ] TEAF: No existing data found, performing full refresh instead. [2025-10-26T02:13:29.295121] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-26T02:13:29.295199] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-26T02:13:29.295286] [DEBUG] [LOCAL ] TEAF: No primary data file found to delete. [2025-10-26T02:13:29.295397] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-26T02:13:36.527110] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-26T02:13:36.889781] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-26T02:13:36.889895] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-26T02:13:36.890174] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-26T02:13:36.890275] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-26T02:13:36.890765] [DEBUG] [LOCAL ] TEAF: Trimmed 10191 records to 7439 (keeping 200 days of data) [2025-10-26T02:13:36.934450] [DEBUG] [LOCAL ] TEAF: Primary data saved (7439 records). [2025-10-26T02:13:36.934607] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-26T02:13:36.934870] [INFO ] [MAIN ] Update Progress: 2062/2366 symbols. TEAF took 7.8s. Estimated remaining time: 1h 4m 15s [2025-10-26T02:13:37.100402] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:13:37.100620] [DEBUG] [LOCAL ] TECK: No existing data file found in primary storage. [2025-10-26T02:13:37.100712] [WARN ] [MAIN ] TECK: No existing data found, performing full refresh instead. [2025-10-26T02:13:37.100851] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-26T02:13:37.100925] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-26T02:13:37.101005] [DEBUG] [LOCAL ] TECK: No primary data file found to delete. [2025-10-26T02:13:37.101075] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-26T02:13:55.435592] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-26T02:13:55.862598] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-26T02:13:55.862780] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-26T02:13:55.864814] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-26T02:13:55.864939] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-26T02:13:55.867013] [DEBUG] [LOCAL ] TECK: Trimmed 77530 records to 54209 (keeping 200 days of data) [2025-10-26T02:13:56.209325] [DEBUG] [LOCAL ] TECK: Primary data saved (54209 records). [2025-10-26T02:13:56.209584] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-26T02:13:56.209883] [INFO ] [MAIN ] Update Progress: 2063/2366 symbols. TECK took 19.3s. Estimated remaining time: 1h 4m 3s [2025-10-26T02:13:56.388236] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:13:56.388527] [DEBUG] [LOCAL ] TEF: No existing data file found in primary storage. [2025-10-26T02:13:56.388603] [WARN ] [MAIN ] TEF: No existing data found, performing full refresh instead. [2025-10-26T02:13:56.388754] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-26T02:13:56.388832] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-26T02:13:56.388918] [DEBUG] [LOCAL ] TEF: No primary data file found to delete. [2025-10-26T02:13:56.388994] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-26T02:14:12.213843] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-26T02:14:12.613740] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-26T02:14:12.613859] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-26T02:14:12.614933] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-26T02:14:12.615014] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-26T02:14:12.616204] [DEBUG] [LOCAL ] TEF: Trimmed 54319 records to 37237 (keeping 200 days of data) [2025-10-26T02:14:12.824946] [DEBUG] [LOCAL ] TEF: Primary data saved (37237 records). [2025-10-26T02:14:12.825138] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-26T02:14:12.825322] [INFO ] [MAIN ] Update Progress: 2064/2366 symbols. TEF took 16.6s. Estimated remaining time: 1h 3m 51s [2025-10-26T02:14:13.009853] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:14:13.010077] [DEBUG] [LOCAL ] TEI: No existing data file found in primary storage. [2025-10-26T02:14:13.010149] [WARN ] [MAIN ] TEI: No existing data found, performing full refresh instead. [2025-10-26T02:14:13.010269] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-26T02:14:13.010340] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-26T02:14:13.010445] [DEBUG] [LOCAL ] TEI: No primary data file found to delete. [2025-10-26T02:14:13.010534] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-26T02:14:24.275423] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-26T02:14:24.654421] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-26T02:14:24.654545] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-26T02:14:24.655278] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-26T02:14:24.655359] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-26T02:14:24.656129] [DEBUG] [LOCAL ] TEI: Trimmed 30696 records to 21375 (keeping 200 days of data) [2025-10-26T02:14:24.773994] [DEBUG] [LOCAL ] TEI: Primary data saved (21375 records). [2025-10-26T02:14:24.774149] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-26T02:14:24.774320] [INFO ] [MAIN ] Update Progress: 2065/2366 symbols. TEI took 11.9s. Estimated remaining time: 1h 3m 38s [2025-10-26T02:14:24.965298] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:14:24.965521] [DEBUG] [LOCAL ] TEL: No existing data file found in primary storage. [2025-10-26T02:14:24.965592] [WARN ] [MAIN ] TEL: No existing data found, performing full refresh instead. [2025-10-26T02:14:24.965705] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-26T02:14:24.965778] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-26T02:14:24.965838] [DEBUG] [LOCAL ] TEL: No primary data file found to delete. [2025-10-26T02:14:24.965901] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-26T02:14:41.751199] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-26T02:14:42.136130] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-26T02:14:42.136272] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-26T02:14:42.137467] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-26T02:14:42.137568] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-26T02:14:42.139200] [DEBUG] [LOCAL ] TEL: Trimmed 73858 records to 51778 (keeping 200 days of data) [2025-10-26T02:14:42.453106] [DEBUG] [LOCAL ] TEL: Primary data saved (51778 records). [2025-10-26T02:14:42.453291] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-26T02:14:42.453498] [INFO ] [MAIN ] Update Progress: 2066/2366 symbols. TEL took 17.7s. Estimated remaining time: 1h 3m 27s [2025-10-26T02:14:42.624062] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:14:42.624303] [DEBUG] [LOCAL ] TEN: No existing data file found in primary storage. [2025-10-26T02:14:42.624374] [WARN ] [MAIN ] TEN: No existing data found, performing full refresh instead. [2025-10-26T02:14:42.624488] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-26T02:14:42.624559] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-26T02:14:42.624639] [DEBUG] [LOCAL ] TEN: No primary data file found to delete. [2025-10-26T02:14:42.624759] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-26T02:14:56.200980] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-26T02:14:56.586883] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-26T02:14:56.587063] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-26T02:14:56.588772] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-26T02:14:56.588860] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-26T02:14:56.590433] [DEBUG] [LOCAL ] TEN: Trimmed 44017 records to 30706 (keeping 200 days of data) [2025-10-26T02:14:56.773401] [DEBUG] [LOCAL ] TEN: Primary data saved (30706 records). [2025-10-26T02:14:56.773662] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-26T02:14:56.774052] [INFO ] [MAIN ] Update Progress: 2067/2366 symbols. TEN took 14.3s. Estimated remaining time: 1h 3m 14s [2025-10-26T02:14:56.960567] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:14:56.960903] [DEBUG] [LOCAL ] TEO: No existing data file found in primary storage. [2025-10-26T02:14:56.960979] [WARN ] [MAIN ] TEO: No existing data found, performing full refresh instead. [2025-10-26T02:14:56.961110] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-26T02:14:56.961185] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-26T02:14:56.961270] [DEBUG] [LOCAL ] TEO: No primary data file found to delete. [2025-10-26T02:14:56.961343] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-26T02:15:08.819048] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-26T02:15:09.270856] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-26T02:15:09.271023] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-26T02:15:09.272345] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-26T02:15:09.272437] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-26T02:15:09.273858] [DEBUG] [LOCAL ] TEO: Trimmed 32810 records to 23331 (keeping 200 days of data) [2025-10-26T02:15:09.412984] [DEBUG] [LOCAL ] TEO: Primary data saved (23331 records). [2025-10-26T02:15:09.413226] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-26T02:15:09.413475] [INFO ] [MAIN ] Update Progress: 2068/2366 symbols. TEO took 12.6s. Estimated remaining time: 1h 3m 1s [2025-10-26T02:15:09.606233] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:15:09.606569] [DEBUG] [LOCAL ] TEVA: No existing data file found in primary storage. [2025-10-26T02:15:09.606677] [WARN ] [MAIN ] TEVA: No existing data found, performing full refresh instead. [2025-10-26T02:15:09.606871] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-26T02:15:09.606966] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-26T02:15:09.607061] [DEBUG] [LOCAL ] TEVA: No primary data file found to delete. [2025-10-26T02:15:09.607135] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-26T02:15:31.059439] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-26T02:15:31.465709] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-26T02:15:31.465918] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-26T02:15:31.467269] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-26T02:15:31.467360] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-26T02:15:31.469003] [DEBUG] [LOCAL ] TEVA: Trimmed 77779 records to 54396 (keeping 200 days of data) [2025-10-26T02:15:31.785761] [DEBUG] [LOCAL ] TEVA: Primary data saved (54396 records). [2025-10-26T02:15:31.785917] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-26T02:15:31.786069] [INFO ] [MAIN ] Update Progress: 2069/2366 symbols. TEVA took 22.4s. Estimated remaining time: 1h 2m 50s [2025-10-26T02:15:31.956089] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:15:31.956302] [DEBUG] [LOCAL ] TEX: No existing data file found in primary storage. [2025-10-26T02:15:31.956429] [WARN ] [MAIN ] TEX: No existing data found, performing full refresh instead. [2025-10-26T02:15:31.956548] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-26T02:15:31.956622] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-26T02:15:31.956746] [DEBUG] [LOCAL ] TEX: No primary data file found to delete. [2025-10-26T02:15:31.956819] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-26T02:15:47.330360] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-26T02:15:47.746240] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-26T02:15:47.746388] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-26T02:15:47.747574] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-26T02:15:47.747679] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-26T02:15:47.749346] [DEBUG] [LOCAL ] TEX: Trimmed 64427 records to 44139 (keeping 200 days of data) [2025-10-26T02:15:48.014861] [DEBUG] [LOCAL ] TEX: Primary data saved (44139 records). [2025-10-26T02:15:48.015010] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-26T02:15:48.015224] [INFO ] [MAIN ] Update Progress: 2070/2366 symbols. TEX took 16.2s. Estimated remaining time: 1h 2m 38s [2025-10-26T02:15:48.185036] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:15:48.185249] [DEBUG] [LOCAL ] TFC: No existing data file found in primary storage. [2025-10-26T02:15:48.185319] [WARN ] [MAIN ] TFC: No existing data found, performing full refresh instead. [2025-10-26T02:15:48.185464] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-26T02:15:48.185538] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-26T02:15:48.185619] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-10-26T02:15:48.185707] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-26T02:16:05.996233] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-26T02:16:06.399589] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-26T02:16:06.399726] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-26T02:16:06.401092] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-26T02:16:06.401179] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-26T02:16:06.402808] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 54447 (keeping 200 days of data) [2025-10-26T02:16:06.724833] [DEBUG] [LOCAL ] TFC: Primary data saved (54447 records). [2025-10-26T02:16:06.725029] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-26T02:16:06.725213] [INFO ] [MAIN ] Update Progress: 2071/2366 symbols. TFC took 18.7s. Estimated remaining time: 1h 2m 26s [2025-10-26T02:16:06.897401] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:16:06.897595] [DEBUG] [LOCAL ] TFII: No existing data file found in primary storage. [2025-10-26T02:16:06.897687] [WARN ] [MAIN ] TFII: No existing data found, performing full refresh instead. [2025-10-26T02:16:06.897838] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-26T02:16:06.897940] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-26T02:16:06.898035] [DEBUG] [LOCAL ] TFII: No primary data file found to delete. [2025-10-26T02:16:06.898109] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-26T02:16:20.691793] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-26T02:16:21.083234] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-26T02:16:21.083369] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-26T02:16:21.084349] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-26T02:16:21.084431] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-26T02:16:21.085660] [DEBUG] [LOCAL ] TFII: Trimmed 47919 records to 32645 (keeping 200 days of data) [2025-10-26T02:16:21.276555] [DEBUG] [LOCAL ] TFII: Primary data saved (32645 records). [2025-10-26T02:16:21.276731] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-26T02:16:21.276913] [INFO ] [MAIN ] Update Progress: 2072/2366 symbols. TFII took 14.6s. Estimated remaining time: 1h 2m 14s [2025-10-26T02:16:21.442606] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:16:21.442835] [DEBUG] [LOCAL ] TFIN: No existing data file found in primary storage. [2025-10-26T02:16:21.442906] [WARN ] [MAIN ] TFIN: No existing data found, performing full refresh instead. [2025-10-26T02:16:21.443017] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-26T02:16:21.443123] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-26T02:16:21.443206] [DEBUG] [LOCAL ] TFIN: No primary data file found to delete. [2025-10-26T02:16:21.443271] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-26T02:16:32.856995] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-26T02:16:33.247390] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-26T02:16:33.247539] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-26T02:16:33.248955] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-26T02:16:33.249042] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-26T02:16:33.250055] [DEBUG] [LOCAL ] TFIN: Trimmed 32700 records to 23939 (keeping 200 days of data) [2025-10-26T02:16:33.406283] [DEBUG] [LOCAL ] TFIN: Primary data saved (23939 records). [2025-10-26T02:16:33.406513] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-26T02:16:33.406806] [INFO ] [MAIN ] Update Progress: 2073/2366 symbols. TFIN took 12.1s. Estimated remaining time: 1h 2m 1s [2025-10-26T02:16:33.597030] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:16:33.597348] [DEBUG] [LOCAL ] TFPM: No existing data file found in primary storage. [2025-10-26T02:16:33.597479] [WARN ] [MAIN ] TFPM: No existing data found, performing full refresh instead. [2025-10-26T02:16:33.597621] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-26T02:16:33.597726] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-26T02:16:33.597813] [DEBUG] [LOCAL ] TFPM: No primary data file found to delete. [2025-10-26T02:16:33.597919] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-26T02:16:48.910257] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-26T02:16:49.311689] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-26T02:16:49.311846] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-26T02:16:49.313540] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-26T02:16:49.313628] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-26T02:16:49.315336] [DEBUG] [LOCAL ] TFPM: Trimmed 53154 records to 40431 (keeping 200 days of data) [2025-10-26T02:16:49.570548] [DEBUG] [LOCAL ] TFPM: Primary data saved (40431 records). [2025-10-26T02:16:49.570799] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-26T02:16:49.571125] [INFO ] [MAIN ] Update Progress: 2074/2366 symbols. TFPM took 16.2s. Estimated remaining time: 1h 1m 49s [2025-10-26T02:16:49.766452] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:16:49.766791] [DEBUG] [LOCAL ] TFX: No existing data file found in primary storage. [2025-10-26T02:16:49.766898] [WARN ] [MAIN ] TFX: No existing data found, performing full refresh instead. [2025-10-26T02:16:49.767029] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-26T02:16:49.767104] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-26T02:16:49.767188] [DEBUG] [LOCAL ] TFX: No primary data file found to delete. [2025-10-26T02:16:49.767291] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-26T02:17:04.598913] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-26T02:17:04.973013] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-26T02:17:04.973122] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-26T02:17:04.974178] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-26T02:17:04.974261] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-26T02:17:04.975441] [DEBUG] [LOCAL ] TFX: Trimmed 54620 records to 35998 (keeping 200 days of data) [2025-10-26T02:17:05.186757] [DEBUG] [LOCAL ] TFX: Primary data saved (35998 records). [2025-10-26T02:17:05.186917] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-26T02:17:05.187098] [INFO ] [MAIN ] Update Progress: 2075/2366 symbols. TFX took 15.6s. Estimated remaining time: 1h 1m 36s [2025-10-26T02:17:05.351495] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:17:05.351737] [DEBUG] [LOCAL ] TG: No existing data file found in primary storage. [2025-10-26T02:17:05.351806] [WARN ] [MAIN ] TG: No existing data found, performing full refresh instead. [2025-10-26T02:17:05.351892] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-26T02:17:05.351982] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-26T02:17:05.352070] [DEBUG] [LOCAL ] TG: No primary data file found to delete. [2025-10-26T02:17:05.352136] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-26T02:17:13.933898] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-26T02:17:14.396315] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-26T02:17:14.396441] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-26T02:17:14.396841] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-26T02:17:14.396922] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-26T02:17:14.397450] [DEBUG] [LOCAL ] TG: Trimmed 15101 records to 10776 (keeping 200 days of data) [2025-10-26T02:17:14.455136] [DEBUG] [LOCAL ] TG: Primary data saved (10776 records). [2025-10-26T02:17:14.455301] [INFO ] [MAIN ] TG: Full history saved. [2025-10-26T02:17:14.455480] [INFO ] [MAIN ] Update Progress: 2076/2366 symbols. TG took 9.3s. Estimated remaining time: 1h 1m 23s [2025-10-26T02:17:14.620107] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:17:14.620333] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-26T02:17:14.620413] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-26T02:17:14.620532] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-26T02:17:14.620600] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-26T02:17:14.620692] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-26T02:17:14.620777] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-26T02:17:15.192763] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-26T02:17:15.192832] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:17:15.192906] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-26T02:17:15.192997] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-26T02:17:15.193067] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-26T02:17:15.193147] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-26T02:17:15.193302] [INFO ] [MAIN ] Update Progress: 2077/2366 symbols. TGE took 0.7s. Estimated remaining time: 1h 1m 9s [2025-10-26T02:17:15.363273] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:17:15.363467] [DEBUG] [LOCAL ] TGLS: No existing data file found in primary storage. [2025-10-26T02:17:15.363579] [WARN ] [MAIN ] TGLS: No existing data found, performing full refresh instead. [2025-10-26T02:17:15.363714] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-26T02:17:15.363846] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-26T02:17:15.363927] [DEBUG] [LOCAL ] TGLS: No primary data file found to delete. [2025-10-26T02:17:15.363994] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-26T02:17:28.574488] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-26T02:17:28.980107] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-26T02:17:28.980226] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-26T02:17:28.981053] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-26T02:17:28.981133] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-26T02:17:28.982049] [DEBUG] [LOCAL ] TGLS: Trimmed 40389 records to 27881 (keeping 200 days of data) [2025-10-26T02:17:29.146772] [DEBUG] [LOCAL ] TGLS: Primary data saved (27881 records). [2025-10-26T02:17:29.146933] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-26T02:17:29.147109] [INFO ] [MAIN ] Update Progress: 2078/2366 symbols. TGLS took 14.0s. Estimated remaining time: 1h 0m 56s [2025-10-26T02:17:29.325873] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:17:29.326088] [DEBUG] [LOCAL ] TGNA: No existing data file found in primary storage. [2025-10-26T02:17:29.326165] [WARN ] [MAIN ] TGNA: No existing data found, performing full refresh instead. [2025-10-26T02:17:29.326314] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-26T02:17:29.326392] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-26T02:17:29.326478] [DEBUG] [LOCAL ] TGNA: No primary data file found to delete. [2025-10-26T02:17:29.326553] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-26T02:17:45.344269] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-26T02:17:45.725231] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-26T02:17:45.725356] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-26T02:17:45.726454] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-26T02:17:45.726537] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-26T02:17:45.728059] [DEBUG] [LOCAL ] TGNA: Trimmed 69970 records to 49132 (keeping 200 days of data) [2025-10-26T02:17:46.010666] [DEBUG] [LOCAL ] TGNA: Primary data saved (49132 records). [2025-10-26T02:17:46.010843] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-26T02:17:46.011060] [INFO ] [MAIN ] Update Progress: 2079/2366 symbols. TGNA took 16.9s. Estimated remaining time: 1h 0m 44s [2025-10-26T02:17:46.176569] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:17:46.176786] [DEBUG] [LOCAL ] TGS: No existing data file found in primary storage. [2025-10-26T02:17:46.176859] [WARN ] [MAIN ] TGS: No existing data found, performing full refresh instead. [2025-10-26T02:17:46.177006] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-26T02:17:46.177077] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-26T02:17:46.177158] [DEBUG] [LOCAL ] TGS: No primary data file found to delete. [2025-10-26T02:17:46.177229] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-26T02:18:00.189987] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-26T02:18:00.580890] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-26T02:18:00.581045] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-26T02:18:00.582523] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-26T02:18:00.582610] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-26T02:18:00.584147] [DEBUG] [LOCAL ] TGS: Trimmed 48701 records to 34390 (keeping 200 days of data) [2025-10-26T02:18:00.784741] [DEBUG] [LOCAL ] TGS: Primary data saved (34390 records). [2025-10-26T02:18:00.784998] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-26T02:18:00.785239] [INFO ] [MAIN ] Update Progress: 2080/2366 symbols. TGS took 14.8s. Estimated remaining time: 1h 0m 32s [2025-10-26T02:18:00.954801] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:18:00.955079] [DEBUG] [LOCAL ] TGT: No existing data file found in primary storage. [2025-10-26T02:18:00.955153] [WARN ] [MAIN ] TGT: No existing data found, performing full refresh instead. [2025-10-26T02:18:00.955285] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-26T02:18:00.955359] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-26T02:18:00.955420] [DEBUG] [LOCAL ] TGT: No primary data file found to delete. [2025-10-26T02:18:00.955489] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-26T02:18:21.554523] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-26T02:18:21.955576] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-26T02:18:21.955742] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-26T02:18:21.956995] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-26T02:18:21.957123] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-26T02:18:21.958754] [DEBUG] [LOCAL ] TGT: Trimmed 77955 records to 54557 (keeping 200 days of data) [2025-10-26T02:18:22.304229] [DEBUG] [LOCAL ] TGT: Primary data saved (54557 records). [2025-10-26T02:18:22.304425] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-26T02:18:22.304592] [INFO ] [MAIN ] Update Progress: 2081/2366 symbols. TGT took 21.5s. Estimated remaining time: 1h 0m 20s [2025-10-26T02:18:22.475919] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:18:22.476142] [DEBUG] [LOCAL ] THC: No existing data file found in primary storage. [2025-10-26T02:18:22.476220] [WARN ] [MAIN ] THC: No existing data found, performing full refresh instead. [2025-10-26T02:18:22.476369] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-26T02:18:22.476448] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-26T02:18:22.476528] [DEBUG] [LOCAL ] THC: No primary data file found to delete. [2025-10-26T02:18:22.476600] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-26T02:18:38.874559] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-26T02:18:39.411844] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-26T02:18:39.412029] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-26T02:18:39.413896] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-26T02:18:39.414009] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-26T02:18:39.415900] [DEBUG] [LOCAL ] THC: Trimmed 68644 records to 47339 (keeping 200 days of data) [2025-10-26T02:18:39.730669] [DEBUG] [LOCAL ] THC: Primary data saved (47339 records). [2025-10-26T02:18:39.730835] [INFO ] [MAIN ] THC: Full history saved. [2025-10-26T02:18:39.731018] [INFO ] [MAIN ] Update Progress: 2082/2366 symbols. THC took 17.4s. Estimated remaining time: 1h 0m 8s [2025-10-26T02:18:39.909051] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:18:39.909269] [DEBUG] [LOCAL ] THG: No existing data file found in primary storage. [2025-10-26T02:18:39.909341] [WARN ] [MAIN ] THG: No existing data found, performing full refresh instead. [2025-10-26T02:18:39.909456] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-26T02:18:39.909525] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-26T02:18:39.909608] [DEBUG] [LOCAL ] THG: No primary data file found to delete. [2025-10-26T02:18:39.909753] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-26T02:18:50.556091] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-26T02:18:50.935142] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-26T02:18:50.935254] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-26T02:18:50.935947] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-26T02:18:50.936024] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-26T02:18:50.936863] [DEBUG] [LOCAL ] THG: Trimmed 31553 records to 21799 (keeping 200 days of data) [2025-10-26T02:18:51.071241] [DEBUG] [LOCAL ] THG: Primary data saved (21799 records). [2025-10-26T02:18:51.071408] [INFO ] [MAIN ] THG: Full history saved. [2025-10-26T02:18:51.071586] [INFO ] [MAIN ] Update Progress: 2083/2366 symbols. THG took 11.3s. Estimated remaining time: 59m 55s [2025-10-26T02:18:51.245133] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:18:51.245333] [DEBUG] [LOCAL ] THIR: No existing data file found in primary storage. [2025-10-26T02:18:51.245401] [WARN ] [MAIN ] THIR: No existing data found, performing full refresh instead. [2025-10-26T02:18:51.245516] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-26T02:18:51.245588] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-26T02:18:51.245698] [DEBUG] [LOCAL ] THIR: No primary data file found to delete. [2025-10-26T02:18:51.245760] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-26T02:18:56.166369] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-26T02:18:56.549240] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-26T02:18:56.549354] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-26T02:18:56.549502] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-26T02:18:56.549578] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-26T02:18:56.549962] [DEBUG] [LOCAL ] THIR: Trimmed 2982 records to 2494 (keeping 200 days of data) [2025-10-26T02:18:56.564181] [DEBUG] [LOCAL ] THIR: Primary data saved (2494 records). [2025-10-26T02:18:56.564263] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-26T02:18:56.564436] [INFO ] [MAIN ] Update Progress: 2084/2366 symbols. THIR took 5.5s. Estimated remaining time: 59m 42s [2025-10-26T02:18:56.747021] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:18:56.747206] [DEBUG] [LOCAL ] THLV: No existing data file found in primary storage. [2025-10-26T02:18:56.747280] [WARN ] [MAIN ] THLV: No existing data found, performing full refresh instead. [2025-10-26T02:18:56.747393] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-26T02:18:56.747466] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-26T02:18:56.747550] [DEBUG] [LOCAL ] THLV: No primary data file found to delete. [2025-10-26T02:18:56.747621] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-26T02:19:01.530000] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-26T02:19:01.907523] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-26T02:19:01.907674] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-26T02:19:01.907840] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-26T02:19:01.907944] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-26T02:19:01.908323] [DEBUG] [LOCAL ] THLV: Trimmed 2513 records to 1510 (keeping 200 days of data) [2025-10-26T02:19:01.917511] [DEBUG] [LOCAL ] THLV: Primary data saved (1510 records). [2025-10-26T02:19:01.917599] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-26T02:19:01.917795] [INFO ] [MAIN ] Update Progress: 2085/2366 symbols. THLV took 5.4s. Estimated remaining time: 59m 28s [2025-10-26T02:19:02.114413] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:19:02.114682] [DEBUG] [LOCAL ] THO: No existing data file found in primary storage. [2025-10-26T02:19:02.114756] [WARN ] [MAIN ] THO: No existing data found, performing full refresh instead. [2025-10-26T02:19:02.114889] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-26T02:19:02.114969] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-26T02:19:02.115057] [DEBUG] [LOCAL ] THO: No primary data file found to delete. [2025-10-26T02:19:02.115133] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-26T02:19:17.769160] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-26T02:19:18.198164] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-26T02:19:18.198356] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-26T02:19:18.200188] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-26T02:19:18.200279] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-26T02:19:18.202210] [DEBUG] [LOCAL ] THO: Trimmed 60115 records to 41472 (keeping 200 days of data) [2025-10-26T02:19:18.472920] [DEBUG] [LOCAL ] THO: Primary data saved (41472 records). [2025-10-26T02:19:18.473141] [INFO ] [MAIN ] THO: Full history saved. [2025-10-26T02:19:18.473378] [INFO ] [MAIN ] Update Progress: 2086/2366 symbols. THO took 16.6s. Estimated remaining time: 59m 16s [2025-10-26T02:19:18.650058] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:19:18.650376] [DEBUG] [LOCAL ] THQ: No existing data file found in primary storage. [2025-10-26T02:19:18.650452] [WARN ] [MAIN ] THQ: No existing data found, performing full refresh instead. [2025-10-26T02:19:18.650579] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-26T02:19:18.650678] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-26T02:19:18.650764] [DEBUG] [LOCAL ] THQ: No primary data file found to delete. [2025-10-26T02:19:18.650837] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-26T02:19:30.231230] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-26T02:19:30.610684] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-26T02:19:30.610830] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-26T02:19:30.612026] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-26T02:19:30.612109] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-26T02:19:30.613211] [DEBUG] [LOCAL ] THQ: Trimmed 34632 records to 25615 (keeping 200 days of data) [2025-10-26T02:19:30.773410] [DEBUG] [LOCAL ] THQ: Primary data saved (25615 records). [2025-10-26T02:19:30.773699] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-26T02:19:30.774026] [INFO ] [MAIN ] Update Progress: 2087/2366 symbols. THQ took 12.3s. Estimated remaining time: 59m 3s [2025-10-26T02:19:30.948399] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:19:30.948723] [DEBUG] [LOCAL ] THR: No existing data file found in primary storage. [2025-10-26T02:19:30.948796] [WARN ] [MAIN ] THR: No existing data found, performing full refresh instead. [2025-10-26T02:19:30.948922] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-26T02:19:30.948996] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-26T02:19:30.949079] [DEBUG] [LOCAL ] THR: No primary data file found to delete. [2025-10-26T02:19:30.949151] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-26T02:19:41.736394] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-26T02:19:42.136268] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-26T02:19:42.136456] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-26T02:19:42.137558] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-26T02:19:42.137677] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-26T02:19:42.138987] [DEBUG] [LOCAL ] THR: Trimmed 28767 records to 19716 (keeping 200 days of data) [2025-10-26T02:19:42.257031] [DEBUG] [LOCAL ] THR: Primary data saved (19716 records). [2025-10-26T02:19:42.257235] [INFO ] [MAIN ] THR: Full history saved. [2025-10-26T02:19:42.257432] [INFO ] [MAIN ] Update Progress: 2088/2366 symbols. THR took 11.5s. Estimated remaining time: 58m 50s [2025-10-26T02:19:42.424413] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:19:42.424620] [DEBUG] [LOCAL ] THS: No existing data file found in primary storage. [2025-10-26T02:19:42.424799] [WARN ] [MAIN ] THS: No existing data found, performing full refresh instead. [2025-10-26T02:19:42.424915] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-26T02:19:42.424990] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-26T02:19:42.425074] [DEBUG] [LOCAL ] THS: No primary data file found to delete. [2025-10-26T02:19:42.425142] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-26T02:19:56.138899] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-26T02:19:56.522964] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-26T02:19:56.523102] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-26T02:19:56.524087] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-26T02:19:56.524167] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-26T02:19:56.525420] [DEBUG] [LOCAL ] THS: Trimmed 54577 records to 39128 (keeping 200 days of data) [2025-10-26T02:19:56.752085] [DEBUG] [LOCAL ] THS: Primary data saved (39128 records). [2025-10-26T02:19:56.752299] [INFO ] [MAIN ] THS: Full history saved. [2025-10-26T02:19:56.752527] [INFO ] [MAIN ] Update Progress: 2089/2366 symbols. THS took 14.5s. Estimated remaining time: 58m 38s [2025-10-26T02:19:56.920635] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:19:56.920871] [DEBUG] [LOCAL ] THW: No existing data file found in primary storage. [2025-10-26T02:19:56.920941] [WARN ] [MAIN ] THW: No existing data found, performing full refresh instead. [2025-10-26T02:19:56.921053] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-26T02:19:56.921123] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-26T02:19:56.921203] [DEBUG] [LOCAL ] THW: No primary data file found to delete. [2025-10-26T02:19:56.921268] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-26T02:20:08.317911] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-26T02:20:08.705481] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-26T02:20:08.705616] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-26T02:20:08.706348] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-26T02:20:08.706429] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-26T02:20:08.707352] [DEBUG] [LOCAL ] THW: Trimmed 28726 records to 19817 (keeping 200 days of data) [2025-10-26T02:20:08.828094] [DEBUG] [LOCAL ] THW: Primary data saved (19817 records). [2025-10-26T02:20:08.828278] [INFO ] [MAIN ] THW: Full history saved. [2025-10-26T02:20:08.828466] [INFO ] [MAIN ] Update Progress: 2090/2366 symbols. THW took 12.1s. Estimated remaining time: 58m 25s [2025-10-26T02:20:09.002310] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:20:09.002550] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-26T02:20:09.002629] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-26T02:20:09.002761] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-26T02:20:09.002854] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-26T02:20:09.002938] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-26T02:20:09.003007] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-26T02:20:09.597844] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-26T02:20:09.597956] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:20:09.598046] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-26T02:20:09.598159] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-26T02:20:09.598253] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-26T02:20:09.598355] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-26T02:20:09.598613] [INFO ] [MAIN ] Update Progress: 2091/2366 symbols. TIC took 0.8s. Estimated remaining time: 58m 11s [2025-10-26T02:20:09.775444] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:20:09.775691] [DEBUG] [LOCAL ] TIMB: No existing data file found in primary storage. [2025-10-26T02:20:09.775782] [WARN ] [MAIN ] TIMB: No existing data found, performing full refresh instead. [2025-10-26T02:20:09.775920] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-26T02:20:09.776008] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-26T02:20:09.776111] [DEBUG] [LOCAL ] TIMB: No primary data file found to delete. [2025-10-26T02:20:09.776196] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-26T02:20:24.876284] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-26T02:20:25.270539] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-26T02:20:25.270697] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-26T02:20:25.271697] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-26T02:20:25.271780] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-26T02:20:25.273025] [DEBUG] [LOCAL ] TIMB: Trimmed 53022 records to 35194 (keeping 200 days of data) [2025-10-26T02:20:25.479137] [DEBUG] [LOCAL ] TIMB: Primary data saved (35194 records). [2025-10-26T02:20:25.479311] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-26T02:20:25.479490] [INFO ] [MAIN ] Update Progress: 2092/2366 symbols. TIMB took 15.9s. Estimated remaining time: 57m 58s [2025-10-26T02:20:25.647211] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:20:25.647433] [DEBUG] [LOCAL ] TISI: No existing data file found in primary storage. [2025-10-26T02:20:25.647520] [WARN ] [MAIN ] TISI: No existing data found, performing full refresh instead. [2025-10-26T02:20:25.647694] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-26T02:20:25.647777] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-26T02:20:25.647900] [DEBUG] [LOCAL ] TISI: No primary data file found to delete. [2025-10-26T02:20:25.647989] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-26T02:20:31.239319] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-26T02:20:31.643231] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-26T02:20:31.643356] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-26T02:20:31.643545] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-26T02:20:31.643616] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-26T02:20:31.644179] [DEBUG] [LOCAL ] TISI: Trimmed 4849 records to 3227 (keeping 200 days of data) [2025-10-26T02:20:31.663818] [DEBUG] [LOCAL ] TISI: Primary data saved (3227 records). [2025-10-26T02:20:31.663982] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-26T02:20:31.664177] [INFO ] [MAIN ] Update Progress: 2093/2366 symbols. TISI took 6.2s. Estimated remaining time: 57m 45s [2025-10-26T02:20:31.840332] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:20:31.840680] [DEBUG] [LOCAL ] TIXT: No existing data file found in primary storage. [2025-10-26T02:20:31.840754] [WARN ] [MAIN ] TIXT: No existing data found, performing full refresh instead. [2025-10-26T02:20:31.840842] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-26T02:20:31.840909] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-26T02:20:31.840971] [DEBUG] [LOCAL ] TIXT: No primary data file found to delete. [2025-10-26T02:20:31.841012] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-26T02:20:43.931279] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-26T02:20:44.299275] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-26T02:20:44.299383] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-26T02:20:44.300135] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-26T02:20:44.300216] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-26T02:20:44.301174] [DEBUG] [LOCAL ] TIXT: Trimmed 45962 records to 32965 (keeping 200 days of data) [2025-10-26T02:20:44.473571] [DEBUG] [LOCAL ] TIXT: Primary data saved (32965 records). [2025-10-26T02:20:44.473752] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-26T02:20:44.473930] [INFO ] [MAIN ] Update Progress: 2094/2366 symbols. TIXT took 12.8s. Estimated remaining time: 57m 32s [2025-10-26T02:20:44.641787] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:20:44.642017] [DEBUG] [LOCAL ] TJX: No existing data file found in primary storage. [2025-10-26T02:20:44.642089] [WARN ] [MAIN ] TJX: No existing data found, performing full refresh instead. [2025-10-26T02:20:44.642201] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-26T02:20:44.642274] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-26T02:20:44.642335] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-10-26T02:20:44.642399] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-26T02:21:03.704781] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-26T02:21:04.088945] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-26T02:21:04.089058] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-26T02:21:04.090221] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-26T02:21:04.090301] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-26T02:21:04.091758] [DEBUG] [LOCAL ] TJX: Trimmed 77830 records to 54440 (keeping 200 days of data) [2025-10-26T02:21:04.427631] [DEBUG] [LOCAL ] TJX: Primary data saved (54440 records). [2025-10-26T02:21:04.427834] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-26T02:21:04.428029] [INFO ] [MAIN ] Update Progress: 2095/2366 symbols. TJX took 20.0s. Estimated remaining time: 57m 20s [2025-10-26T02:21:04.597688] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:21:04.597910] [DEBUG] [LOCAL ] TK: No existing data file found in primary storage. [2025-10-26T02:21:04.597982] [WARN ] [MAIN ] TK: No existing data found, performing full refresh instead. [2025-10-26T02:21:04.598093] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-26T02:21:04.598164] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-26T02:21:04.598246] [DEBUG] [LOCAL ] TK: No primary data file found to delete. [2025-10-26T02:21:04.598316] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-26T02:21:19.676881] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-26T02:21:20.064024] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-26T02:21:20.064146] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-26T02:21:20.065330] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-26T02:21:20.065426] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-26T02:21:20.066631] [DEBUG] [LOCAL ] TK: Trimmed 56284 records to 39621 (keeping 200 days of data) [2025-10-26T02:21:20.278527] [DEBUG] [LOCAL ] TK: Primary data saved (39621 records). [2025-10-26T02:21:20.278706] [INFO ] [MAIN ] TK: Full history saved. [2025-10-26T02:21:20.279009] [INFO ] [MAIN ] Update Progress: 2096/2366 symbols. TK took 15.9s. Estimated remaining time: 57m 8s [2025-10-26T02:21:20.449401] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:21:20.449570] [DEBUG] [LOCAL ] TKC: No existing data file found in primary storage. [2025-10-26T02:21:20.449640] [WARN ] [MAIN ] TKC: No existing data found, performing full refresh instead. [2025-10-26T02:21:20.449770] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-26T02:21:20.449840] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-26T02:21:20.449922] [DEBUG] [LOCAL ] TKC: No primary data file found to delete. [2025-10-26T02:21:20.449991] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-26T02:21:35.288593] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-26T02:21:35.691933] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-26T02:21:35.692049] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-26T02:21:35.693038] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-26T02:21:35.693116] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-26T02:21:35.694296] [DEBUG] [LOCAL ] TKC: Trimmed 54648 records to 40667 (keeping 200 days of data) [2025-10-26T02:21:35.915448] [DEBUG] [LOCAL ] TKC: Primary data saved (40667 records). [2025-10-26T02:21:35.915602] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-26T02:21:35.915784] [INFO ] [MAIN ] Update Progress: 2097/2366 symbols. TKC took 15.6s. Estimated remaining time: 56m 56s [2025-10-26T02:21:36.086737] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:21:36.087111] [DEBUG] [LOCAL ] TKO: No existing data file found in primary storage. [2025-10-26T02:21:36.087182] [WARN ] [MAIN ] TKO: No existing data found, performing full refresh instead. [2025-10-26T02:21:36.087292] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-26T02:21:36.087361] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-26T02:21:36.087443] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-10-26T02:21:36.087511] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-26T02:21:52.113722] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-26T02:21:52.532480] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-26T02:21:52.532614] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-26T02:21:52.533919] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-26T02:21:52.534031] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-26T02:21:52.535692] [DEBUG] [LOCAL ] TKO: Trimmed 65544 records to 44140 (keeping 200 days of data) [2025-10-26T02:21:52.821085] [DEBUG] [LOCAL ] TKO: Primary data saved (44140 records). [2025-10-26T02:21:52.821257] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-26T02:21:52.821434] [INFO ] [MAIN ] Update Progress: 2098/2366 symbols. TKO took 16.9s. Estimated remaining time: 56m 44s [2025-10-26T02:21:52.991586] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:21:52.991826] [DEBUG] [LOCAL ] TKR: No existing data file found in primary storage. [2025-10-26T02:21:52.991901] [WARN ] [MAIN ] TKR: No existing data found, performing full refresh instead. [2025-10-26T02:21:52.992017] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-26T02:21:52.992112] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-26T02:21:52.992171] [DEBUG] [LOCAL ] TKR: No primary data file found to delete. [2025-10-26T02:21:52.992237] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-26T02:22:07.556822] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-26T02:22:07.935781] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-26T02:22:07.935905] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-26T02:22:07.936920] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-26T02:22:07.936998] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-26T02:22:07.938294] [DEBUG] [LOCAL ] TKR: Trimmed 57787 records to 39746 (keeping 200 days of data) [2025-10-26T02:22:08.167693] [DEBUG] [LOCAL ] TKR: Primary data saved (39746 records). [2025-10-26T02:22:08.167881] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-26T02:22:08.168092] [INFO ] [MAIN ] Update Progress: 2099/2366 symbols. TKR took 15.3s. Estimated remaining time: 56m 31s [2025-10-26T02:22:08.341600] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:22:08.341817] [DEBUG] [LOCAL ] TLK: No existing data file found in primary storage. [2025-10-26T02:22:08.341888] [WARN ] [MAIN ] TLK: No existing data found, performing full refresh instead. [2025-10-26T02:22:08.342000] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-26T02:22:08.342071] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-26T02:22:08.342155] [DEBUG] [LOCAL ] TLK: No primary data file found to delete. [2025-10-26T02:22:08.342222] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-26T02:22:24.389000] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-26T02:22:24.785272] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-26T02:22:24.785410] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-26T02:22:24.786520] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-26T02:22:24.786607] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-26T02:22:24.788061] [DEBUG] [LOCAL ] TLK: Trimmed 57741 records to 39341 (keeping 200 days of data) [2025-10-26T02:22:25.026739] [DEBUG] [LOCAL ] TLK: Primary data saved (39341 records). [2025-10-26T02:22:25.027106] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-26T02:22:25.027292] [INFO ] [MAIN ] Update Progress: 2100/2366 symbols. TLK took 16.9s. Estimated remaining time: 56m 19s [2025-10-26T02:22:25.207289] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:22:25.207516] [DEBUG] [LOCAL ] TLYS: No existing data file found in primary storage. [2025-10-26T02:22:25.207591] [WARN ] [MAIN ] TLYS: No existing data found, performing full refresh instead. [2025-10-26T02:22:25.207737] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-26T02:22:25.207790] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-26T02:22:25.207896] [DEBUG] [LOCAL ] TLYS: No primary data file found to delete. [2025-10-26T02:22:25.207971] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-26T02:22:34.804319] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-26T02:22:35.200252] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-26T02:22:35.200369] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-26T02:22:35.200927] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-26T02:22:35.201010] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-26T02:22:35.201615] [DEBUG] [LOCAL ] TLYS: Trimmed 21085 records to 16665 (keeping 200 days of data) [2025-10-26T02:22:35.291197] [DEBUG] [LOCAL ] TLYS: Primary data saved (16665 records). [2025-10-26T02:22:35.291362] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-26T02:22:35.291558] [INFO ] [MAIN ] Update Progress: 2101/2366 symbols. TLYS took 10.3s. Estimated remaining time: 56m 6s [2025-10-26T02:22:35.460835] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:22:35.461047] [DEBUG] [LOCAL ] TM: No existing data file found in primary storage. [2025-10-26T02:22:35.461119] [WARN ] [MAIN ] TM: No existing data found, performing full refresh instead. [2025-10-26T02:22:35.461230] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-26T02:22:35.461299] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-26T02:22:35.461381] [DEBUG] [LOCAL ] TM: No primary data file found to delete. [2025-10-26T02:22:35.461452] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-26T02:22:51.321810] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-26T02:22:51.695126] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-26T02:22:51.695257] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-26T02:22:51.696219] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-26T02:22:51.696305] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-26T02:22:51.697375] [DEBUG] [LOCAL ] TM: Trimmed 51763 records to 36470 (keeping 200 days of data) [2025-10-26T02:22:51.908394] [DEBUG] [LOCAL ] TM: Primary data saved (36470 records). [2025-10-26T02:22:51.908554] [INFO ] [MAIN ] TM: Full history saved. [2025-10-26T02:22:51.908759] [INFO ] [MAIN ] Update Progress: 2102/2366 symbols. TM took 16.6s. Estimated remaining time: 55m 54s [2025-10-26T02:22:52.074677] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:22:52.074879] [DEBUG] [LOCAL ] TME: No existing data file found in primary storage. [2025-10-26T02:22:52.074950] [WARN ] [MAIN ] TME: No existing data found, performing full refresh instead. [2025-10-26T02:22:52.075064] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-26T02:22:52.075135] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-26T02:22:52.075214] [DEBUG] [LOCAL ] TME: No primary data file found to delete. [2025-10-26T02:22:52.075282] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-26T02:23:15.847416] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-26T02:23:16.262888] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-26T02:23:16.263003] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-26T02:23:16.264178] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-26T02:23:16.264258] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-26T02:23:16.265764] [DEBUG] [LOCAL ] TME: Trimmed 77153 records to 53968 (keeping 200 days of data) [2025-10-26T02:23:16.577926] [DEBUG] [LOCAL ] TME: Primary data saved (53968 records). [2025-10-26T02:23:16.578097] [INFO ] [MAIN ] TME: Full history saved. [2025-10-26T02:23:16.578315] [INFO ] [MAIN ] Update Progress: 2103/2366 symbols. TME took 24.7s. Estimated remaining time: 55m 43s [2025-10-26T02:23:16.753947] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:23:16.754164] [DEBUG] [LOCAL ] TMHC: No existing data file found in primary storage. [2025-10-26T02:23:16.754271] [WARN ] [MAIN ] TMHC: No existing data found, performing full refresh instead. [2025-10-26T02:23:16.754387] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-26T02:23:16.754458] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-26T02:23:16.754537] [DEBUG] [LOCAL ] TMHC: No primary data file found to delete. [2025-10-26T02:23:16.754608] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-26T02:23:32.509559] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-26T02:23:32.905861] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-26T02:23:32.906002] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-26T02:23:32.907097] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-26T02:23:32.907176] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-26T02:23:32.908563] [DEBUG] [LOCAL ] TMHC: Trimmed 66806 records to 46402 (keeping 200 days of data) [2025-10-26T02:23:33.168436] [DEBUG] [LOCAL ] TMHC: Primary data saved (46402 records). [2025-10-26T02:23:33.168602] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-26T02:23:33.168827] [INFO ] [MAIN ] Update Progress: 2104/2366 symbols. TMHC took 16.6s. Estimated remaining time: 55m 30s [2025-10-26T02:23:33.336093] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:23:33.336275] [DEBUG] [LOCAL ] TMO: No existing data file found in primary storage. [2025-10-26T02:23:33.336345] [WARN ] [MAIN ] TMO: No existing data found, performing full refresh instead. [2025-10-26T02:23:33.336463] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-26T02:23:33.336562] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-26T02:23:33.336664] [DEBUG] [LOCAL ] TMO: No primary data file found to delete. [2025-10-26T02:23:33.336738] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-26T02:23:52.072364] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-26T02:23:52.454510] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-26T02:23:52.454625] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-26T02:23:52.455761] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-26T02:23:52.455841] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-26T02:23:52.457326] [DEBUG] [LOCAL ] TMO: Trimmed 75752 records to 53155 (keeping 200 days of data) [2025-10-26T02:23:52.775310] [DEBUG] [LOCAL ] TMO: Primary data saved (53155 records). [2025-10-26T02:23:52.775513] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-26T02:23:52.775730] [INFO ] [MAIN ] Update Progress: 2105/2366 symbols. TMO took 19.6s. Estimated remaining time: 55m 19s [2025-10-26T02:23:52.946396] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:23:52.946621] [DEBUG] [LOCAL ] TNC: No existing data file found in primary storage. [2025-10-26T02:23:52.946717] [WARN ] [MAIN ] TNC: No existing data found, performing full refresh instead. [2025-10-26T02:23:52.946858] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-26T02:23:52.946932] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-26T02:23:52.947013] [DEBUG] [LOCAL ] TNC: No primary data file found to delete. [2025-10-26T02:23:52.947081] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-26T02:24:02.679222] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-26T02:24:03.037942] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-26T02:24:03.038056] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-26T02:24:03.038565] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-26T02:24:03.038668] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-26T02:24:03.039298] [DEBUG] [LOCAL ] TNC: Trimmed 22075 records to 14258 (keeping 200 days of data) [2025-10-26T02:24:03.121714] [DEBUG] [LOCAL ] TNC: Primary data saved (14258 records). [2025-10-26T02:24:03.121872] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-26T02:24:03.122244] [INFO ] [MAIN ] Update Progress: 2106/2366 symbols. TNC took 10.3s. Estimated remaining time: 55m 6s [2025-10-26T02:24:03.290235] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:24:03.290461] [DEBUG] [LOCAL ] TNET: No existing data file found in primary storage. [2025-10-26T02:24:03.290542] [WARN ] [MAIN ] TNET: No existing data found, performing full refresh instead. [2025-10-26T02:24:03.290747] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-26T02:24:03.290839] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-26T02:24:03.290921] [DEBUG] [LOCAL ] TNET: No primary data file found to delete. [2025-10-26T02:24:03.290989] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-26T02:24:16.358704] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-26T02:24:16.815376] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-26T02:24:16.815538] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-26T02:24:16.816583] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-26T02:24:16.816707] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-26T02:24:16.817952] [DEBUG] [LOCAL ] TNET: Trimmed 41919 records to 28621 (keeping 200 days of data) [2025-10-26T02:24:16.990262] [DEBUG] [LOCAL ] TNET: Primary data saved (28621 records). [2025-10-26T02:24:16.990452] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-26T02:24:16.990679] [INFO ] [MAIN ] Update Progress: 2107/2366 symbols. TNET took 13.9s. Estimated remaining time: 54m 53s [2025-10-26T02:24:17.156537] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:24:17.156750] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-26T02:24:17.156847] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-26T02:24:17.156997] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-26T02:24:17.157080] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-26T02:24:17.157180] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-26T02:24:17.157259] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-26T02:24:17.729572] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-26T02:24:17.729665] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:24:17.729741] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-26T02:24:17.729832] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-26T02:24:17.729900] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-26T02:24:17.729979] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-26T02:24:17.730132] [INFO ] [MAIN ] Update Progress: 2108/2366 symbols. TNGY took 0.7s. Estimated remaining time: 54m 39s [2025-10-26T02:24:17.897029] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:24:17.897200] [DEBUG] [LOCAL ] TNK: No existing data file found in primary storage. [2025-10-26T02:24:17.897270] [WARN ] [MAIN ] TNK: No existing data found, performing full refresh instead. [2025-10-26T02:24:17.897375] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-26T02:24:17.897444] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-26T02:24:17.897522] [DEBUG] [LOCAL ] TNK: No primary data file found to delete. [2025-10-26T02:24:17.897588] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-26T02:24:32.980673] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-26T02:24:33.377730] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-26T02:24:33.377890] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-26T02:24:33.378864] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-26T02:24:33.378944] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-26T02:24:33.380072] [DEBUG] [LOCAL ] TNK: Trimmed 51967 records to 35900 (keeping 200 days of data) [2025-10-26T02:24:33.587889] [DEBUG] [LOCAL ] TNK: Primary data saved (35900 records). [2025-10-26T02:24:33.588083] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-26T02:24:33.588281] [INFO ] [MAIN ] Update Progress: 2109/2366 symbols. TNK took 15.9s. Estimated remaining time: 54m 26s [2025-10-26T02:24:33.765418] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:24:33.765666] [DEBUG] [LOCAL ] TNL: No existing data file found in primary storage. [2025-10-26T02:24:33.765742] [WARN ] [MAIN ] TNL: No existing data found, performing full refresh instead. [2025-10-26T02:24:33.765856] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-26T02:24:33.765926] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-26T02:24:33.766010] [DEBUG] [LOCAL ] TNL: No primary data file found to delete. [2025-10-26T02:24:33.766082] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-26T02:24:48.468988] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-26T02:24:48.853474] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-26T02:24:48.853632] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-26T02:24:48.855428] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-26T02:24:48.855522] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-26T02:24:48.857315] [DEBUG] [LOCAL ] TNL: Trimmed 59792 records to 42380 (keeping 200 days of data) [2025-10-26T02:24:49.125416] [DEBUG] [LOCAL ] TNL: Primary data saved (42380 records). [2025-10-26T02:24:49.125579] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-26T02:24:49.125780] [INFO ] [MAIN ] Update Progress: 2110/2366 symbols. TNL took 15.5s. Estimated remaining time: 54m 14s [2025-10-26T02:24:49.298294] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:24:49.298504] [DEBUG] [LOCAL ] TOL: No existing data file found in primary storage. [2025-10-26T02:24:49.298574] [WARN ] [MAIN ] TOL: No existing data found, performing full refresh instead. [2025-10-26T02:24:49.298707] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-26T02:24:49.298779] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-26T02:24:49.298860] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-10-26T02:24:49.298928] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-26T02:25:07.189090] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-26T02:25:07.594300] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-26T02:25:07.594415] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-26T02:25:07.595535] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-26T02:25:07.595616] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-26T02:25:07.597034] [DEBUG] [LOCAL ] TOL: Trimmed 73647 records to 51173 (keeping 200 days of data) [2025-10-26T02:25:07.915941] [DEBUG] [LOCAL ] TOL: Primary data saved (51173 records). [2025-10-26T02:25:07.916098] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-26T02:25:07.916275] [INFO ] [MAIN ] Update Progress: 2111/2366 symbols. TOL took 18.8s. Estimated remaining time: 54m 2s [2025-10-26T02:25:08.094744] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:25:08.095259] [DEBUG] [LOCAL ] TOST: No existing data file found in primary storage. [2025-10-26T02:25:08.095334] [WARN ] [MAIN ] TOST: No existing data found, performing full refresh instead. [2025-10-26T02:25:08.095446] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-26T02:25:08.095518] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-26T02:25:08.095603] [DEBUG] [LOCAL ] TOST: No primary data file found to delete. [2025-10-26T02:25:08.095695] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-26T02:25:28.742371] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-26T02:25:29.153638] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-26T02:25:29.153788] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-26T02:25:29.154930] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-26T02:25:29.155009] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-26T02:25:29.156403] [DEBUG] [LOCAL ] TOST: Trimmed 77853 records to 54470 (keeping 200 days of data) [2025-10-26T02:25:29.462741] [DEBUG] [LOCAL ] TOST: Primary data saved (54470 records). [2025-10-26T02:25:29.462904] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-26T02:25:29.463083] [INFO ] [MAIN ] Update Progress: 2112/2366 symbols. TOST took 21.5s. Estimated remaining time: 53m 50s [2025-10-26T02:25:29.627452] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:25:29.627662] [DEBUG] [LOCAL ] TPB: No existing data file found in primary storage. [2025-10-26T02:25:29.627729] [WARN ] [MAIN ] TPB: No existing data found, performing full refresh instead. [2025-10-26T02:25:29.627808] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-26T02:25:29.627894] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-26T02:25:29.627961] [DEBUG] [LOCAL ] TPB: No primary data file found to delete. [2025-10-26T02:25:29.628024] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-26T02:25:41.638374] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-26T02:25:42.015075] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-26T02:25:42.015208] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-26T02:25:42.015986] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-26T02:25:42.016067] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-26T02:25:42.016992] [DEBUG] [LOCAL ] TPB: Trimmed 36211 records to 26581 (keeping 200 days of data) [2025-10-26T02:25:42.173456] [DEBUG] [LOCAL ] TPB: Primary data saved (26581 records). [2025-10-26T02:25:42.173619] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-26T02:25:42.173822] [INFO ] [MAIN ] Update Progress: 2113/2366 symbols. TPB took 12.7s. Estimated remaining time: 53m 38s [2025-10-26T02:25:42.343852] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:25:42.344075] [DEBUG] [LOCAL ] TPC: No existing data file found in primary storage. [2025-10-26T02:25:42.344147] [WARN ] [MAIN ] TPC: No existing data found, performing full refresh instead. [2025-10-26T02:25:42.344268] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-26T02:25:42.344340] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-26T02:25:42.344427] [DEBUG] [LOCAL ] TPC: No primary data file found to delete. [2025-10-26T02:25:42.344495] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-26T02:25:57.506885] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-26T02:25:57.920862] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-26T02:25:57.921006] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-26T02:25:57.922565] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-26T02:25:57.922689] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-26T02:25:57.924083] [DEBUG] [LOCAL ] TPC: Trimmed 55530 records to 39657 (keeping 200 days of data) [2025-10-26T02:25:58.167004] [DEBUG] [LOCAL ] TPC: Primary data saved (39657 records). [2025-10-26T02:25:58.167189] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-26T02:25:58.167430] [INFO ] [MAIN ] Update Progress: 2114/2366 symbols. TPC took 16.0s. Estimated remaining time: 53m 25s [2025-10-26T02:25:58.336208] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:25:58.336413] [DEBUG] [LOCAL ] TPH: No existing data file found in primary storage. [2025-10-26T02:25:58.336501] [WARN ] [MAIN ] TPH: No existing data found, performing full refresh instead. [2025-10-26T02:25:58.336700] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-26T02:25:58.336783] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-26T02:25:58.336887] [DEBUG] [LOCAL ] TPH: No primary data file found to delete. [2025-10-26T02:25:58.336968] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-26T02:26:13.940281] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-26T02:26:14.347723] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-26T02:26:14.347862] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-26T02:26:14.348918] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-26T02:26:14.348999] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-26T02:26:14.350241] [DEBUG] [LOCAL ] TPH: Trimmed 65048 records to 45447 (keeping 200 days of data) [2025-10-26T02:26:14.599022] [DEBUG] [LOCAL ] TPH: Primary data saved (45447 records). [2025-10-26T02:26:14.599181] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-26T02:26:14.599361] [INFO ] [MAIN ] Update Progress: 2115/2366 symbols. TPH took 16.4s. Estimated remaining time: 53m 13s [2025-10-26T02:26:14.763681] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:26:14.763869] [DEBUG] [LOCAL ] TPL: No existing data file found in primary storage. [2025-10-26T02:26:14.763940] [WARN ] [MAIN ] TPL: No existing data found, performing full refresh instead. [2025-10-26T02:26:14.764053] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-26T02:26:14.764125] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-26T02:26:14.764207] [DEBUG] [LOCAL ] TPL: No primary data file found to delete. [2025-10-26T02:26:14.764261] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-26T02:26:24.144487] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-26T02:26:24.515797] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-26T02:26:24.515919] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-26T02:26:24.516333] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-26T02:26:24.516411] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-26T02:26:24.516989] [DEBUG] [LOCAL ] TPL: Trimmed 17460 records to 12363 (keeping 200 days of data) [2025-10-26T02:26:24.595167] [DEBUG] [LOCAL ] TPL: Primary data saved (12363 records). [2025-10-26T02:26:24.595346] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-26T02:26:24.595531] [INFO ] [MAIN ] Update Progress: 2116/2366 symbols. TPL took 10.0s. Estimated remaining time: 53m 0s [2025-10-26T02:26:24.766091] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:26:24.766287] [DEBUG] [LOCAL ] TPR: No existing data file found in primary storage. [2025-10-26T02:26:24.766363] [WARN ] [MAIN ] TPR: No existing data found, performing full refresh instead. [2025-10-26T02:26:24.766472] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-26T02:26:24.766544] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-26T02:26:24.766612] [DEBUG] [LOCAL ] TPR: No primary data file found to delete. [2025-10-26T02:26:24.766697] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-26T02:26:41.707754] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-26T02:26:42.103688] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-26T02:26:42.103828] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-26T02:26:42.104995] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-26T02:26:42.105076] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-26T02:26:42.106503] [DEBUG] [LOCAL ] TPR: Trimmed 77483 records to 54128 (keeping 200 days of data) [2025-10-26T02:26:42.429907] [DEBUG] [LOCAL ] TPR: Primary data saved (54128 records). [2025-10-26T02:26:42.430100] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-26T02:26:42.430259] [INFO ] [MAIN ] Update Progress: 2117/2366 symbols. TPR took 17.8s. Estimated remaining time: 52m 48s [2025-10-26T02:26:42.601954] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:26:42.602157] [DEBUG] [LOCAL ] TPVG: No existing data file found in primary storage. [2025-10-26T02:26:42.602248] [WARN ] [MAIN ] TPVG: No existing data found, performing full refresh instead. [2025-10-26T02:26:42.602362] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-26T02:26:42.602432] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-26T02:26:42.602511] [DEBUG] [LOCAL ] TPVG: No primary data file found to delete. [2025-10-26T02:26:42.602580] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-26T02:26:56.213950] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-26T02:26:56.580837] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-26T02:26:56.580952] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-26T02:26:56.581733] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-26T02:26:56.581813] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-26T02:26:56.582706] [DEBUG] [LOCAL ] TPVG: Trimmed 39257 records to 27576 (keeping 200 days of data) [2025-10-26T02:26:56.734422] [DEBUG] [LOCAL ] TPVG: Primary data saved (27576 records). [2025-10-26T02:26:56.734580] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-26T02:26:56.734778] [INFO ] [MAIN ] Update Progress: 2118/2366 symbols. TPVG took 14.3s. Estimated remaining time: 52m 35s [2025-10-26T02:26:56.906593] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:26:56.906792] [DEBUG] [LOCAL ] TPYP: No existing data file found in primary storage. [2025-10-26T02:26:56.906866] [WARN ] [MAIN ] TPYP: No existing data found, performing full refresh instead. [2025-10-26T02:26:56.906980] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-26T02:26:56.907053] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-26T02:26:56.907135] [DEBUG] [LOCAL ] TPYP: No primary data file found to delete. [2025-10-26T02:26:56.907204] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-26T02:27:04.881539] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-26T02:27:05.248108] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-26T02:27:05.248247] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-26T02:27:05.248579] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-26T02:27:05.248677] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-26T02:27:05.249241] [DEBUG] [LOCAL ] TPYP: Trimmed 12256 records to 7969 (keeping 200 days of data) [2025-10-26T02:27:05.297143] [DEBUG] [LOCAL ] TPYP: Primary data saved (7969 records). [2025-10-26T02:27:05.297330] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-26T02:27:05.297514] [INFO ] [MAIN ] Update Progress: 2119/2366 symbols. TPYP took 8.6s. Estimated remaining time: 52m 22s [2025-10-26T02:27:05.502758] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:27:05.502983] [DEBUG] [LOCAL ] TPZ: No existing data file found in primary storage. [2025-10-26T02:27:05.503080] [WARN ] [MAIN ] TPZ: No existing data found, performing full refresh instead. [2025-10-26T02:27:05.503203] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-26T02:27:05.503280] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-26T02:27:05.503379] [DEBUG] [LOCAL ] TPZ: No primary data file found to delete. [2025-10-26T02:27:05.503464] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-26T02:27:12.643446] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-26T02:27:13.009628] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-26T02:27:13.009762] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-26T02:27:13.010009] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-26T02:27:13.010086] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-26T02:27:13.010516] [DEBUG] [LOCAL ] TPZ: Trimmed 8292 records to 4637 (keeping 200 days of data) [2025-10-26T02:27:13.038195] [DEBUG] [LOCAL ] TPZ: Primary data saved (4637 records). [2025-10-26T02:27:13.038292] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-26T02:27:13.038480] [INFO ] [MAIN ] Update Progress: 2120/2366 symbols. TPZ took 7.7s. Estimated remaining time: 52m 9s [2025-10-26T02:27:13.204510] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:27:13.204719] [DEBUG] [LOCAL ] TR: No existing data file found in primary storage. [2025-10-26T02:27:13.204789] [WARN ] [MAIN ] TR: No existing data found, performing full refresh instead. [2025-10-26T02:27:13.204897] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-26T02:27:13.204967] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-26T02:27:13.205026] [DEBUG] [LOCAL ] TR: No primary data file found to delete. [2025-10-26T02:27:13.205086] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-26T02:27:25.303863] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-26T02:27:25.667133] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-26T02:27:25.667271] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-26T02:27:25.667942] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-26T02:27:25.668021] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-26T02:27:25.668792] [DEBUG] [LOCAL ] TR: Trimmed 25572 records to 19477 (keeping 200 days of data) [2025-10-26T02:27:25.782985] [DEBUG] [LOCAL ] TR: Primary data saved (19477 records). [2025-10-26T02:27:25.783159] [INFO ] [MAIN ] TR: Full history saved. [2025-10-26T02:27:25.783334] [INFO ] [MAIN ] Update Progress: 2121/2366 symbols. TR took 12.7s. Estimated remaining time: 51m 56s [2025-10-26T02:27:25.949565] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:27:25.949836] [DEBUG] [LOCAL ] TRAK: No existing data file found in primary storage. [2025-10-26T02:27:25.949906] [WARN ] [MAIN ] TRAK: No existing data found, performing full refresh instead. [2025-10-26T02:27:25.949991] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-26T02:27:25.950059] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-26T02:27:25.950139] [DEBUG] [LOCAL ] TRAK: No primary data file found to delete. [2025-10-26T02:27:25.950260] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-26T02:27:34.588693] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-26T02:27:34.941301] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-26T02:27:34.941414] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-26T02:27:34.941779] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-26T02:27:34.941856] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-26T02:27:34.942352] [DEBUG] [LOCAL ] TRAK: Trimmed 13622 records to 9673 (keeping 200 days of data) [2025-10-26T02:27:34.998103] [DEBUG] [LOCAL ] TRAK: Primary data saved (9673 records). [2025-10-26T02:27:34.998256] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-26T02:27:34.998434] [INFO ] [MAIN ] Update Progress: 2122/2366 symbols. TRAK took 9.2s. Estimated remaining time: 51m 43s [2025-10-26T02:27:35.169015] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:27:35.169231] [DEBUG] [LOCAL ] TRC: No existing data file found in primary storage. [2025-10-26T02:27:35.169349] [WARN ] [MAIN ] TRC: No existing data found, performing full refresh instead. [2025-10-26T02:27:35.169486] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-26T02:27:35.169575] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-26T02:27:35.169708] [DEBUG] [LOCAL ] TRC: No primary data file found to delete. [2025-10-26T02:27:35.169795] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-26T02:27:44.968577] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-26T02:27:45.335928] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-26T02:27:45.336068] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-26T02:27:45.336622] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-26T02:27:45.336719] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-26T02:27:45.337367] [DEBUG] [LOCAL ] TRC: Trimmed 21716 records to 15510 (keeping 200 days of data) [2025-10-26T02:27:45.423396] [DEBUG] [LOCAL ] TRC: Primary data saved (15510 records). [2025-10-26T02:27:45.423552] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-26T02:27:45.423748] [INFO ] [MAIN ] Update Progress: 2123/2366 symbols. TRC took 10.4s. Estimated remaining time: 51m 30s [2025-10-26T02:27:45.591675] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:27:45.591886] [DEBUG] [LOCAL ] TREX: No existing data file found in primary storage. [2025-10-26T02:27:45.591959] [WARN ] [MAIN ] TREX: No existing data found, performing full refresh instead. [2025-10-26T02:27:45.592095] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-26T02:27:45.592191] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-26T02:27:45.592281] [DEBUG] [LOCAL ] TREX: No primary data file found to delete. [2025-10-26T02:27:45.592349] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-26T02:28:02.901046] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-26T02:28:03.310023] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-26T02:28:03.310152] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-26T02:28:03.311270] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-26T02:28:03.311354] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-26T02:28:03.312797] [DEBUG] [LOCAL ] TREX: Trimmed 71903 records to 50512 (keeping 200 days of data) [2025-10-26T02:28:03.604921] [DEBUG] [LOCAL ] TREX: Primary data saved (50512 records). [2025-10-26T02:28:03.605111] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-26T02:28:03.605304] [INFO ] [MAIN ] Update Progress: 2124/2366 symbols. TREX took 18.2s. Estimated remaining time: 51m 18s [2025-10-26T02:28:03.779309] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:28:03.779530] [DEBUG] [LOCAL ] TRGP: No existing data file found in primary storage. [2025-10-26T02:28:03.779608] [WARN ] [MAIN ] TRGP: No existing data found, performing full refresh instead. [2025-10-26T02:28:03.779747] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-26T02:28:03.779820] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-26T02:28:03.779903] [DEBUG] [LOCAL ] TRGP: No primary data file found to delete. [2025-10-26T02:28:03.779975] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-26T02:28:21.423977] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-26T02:28:21.829050] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-26T02:28:21.829237] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-26T02:28:21.830637] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-26T02:28:21.830767] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-26T02:28:21.832365] [DEBUG] [LOCAL ] TRGP: Trimmed 73601 records to 51432 (keeping 200 days of data) [2025-10-26T02:28:22.134470] [DEBUG] [LOCAL ] TRGP: Primary data saved (51432 records). [2025-10-26T02:28:22.134627] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-26T02:28:22.134816] [INFO ] [MAIN ] Update Progress: 2125/2366 symbols. TRGP took 18.5s. Estimated remaining time: 51m 6s [2025-10-26T02:28:22.302471] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:28:22.302728] [DEBUG] [LOCAL ] TRN: No existing data file found in primary storage. [2025-10-26T02:28:22.302823] [WARN ] [MAIN ] TRN: No existing data found, performing full refresh instead. [2025-10-26T02:28:22.302973] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-26T02:28:22.303077] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-26T02:28:22.303184] [DEBUG] [LOCAL ] TRN: No primary data file found to delete. [2025-10-26T02:28:22.303265] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-26T02:28:36.342867] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-26T02:28:36.744262] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-26T02:28:36.744398] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-26T02:28:36.745528] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-26T02:28:36.745622] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-26T02:28:36.746737] [DEBUG] [LOCAL ] TRN: Trimmed 52499 records to 36624 (keeping 200 days of data) [2025-10-26T02:28:36.960364] [DEBUG] [LOCAL ] TRN: Primary data saved (36624 records). [2025-10-26T02:28:36.960524] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-26T02:28:36.960733] [INFO ] [MAIN ] Update Progress: 2126/2366 symbols. TRN took 14.8s. Estimated remaining time: 50m 53s [2025-10-26T02:28:37.125176] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:28:37.125361] [DEBUG] [LOCAL ] TRNO: No existing data file found in primary storage. [2025-10-26T02:28:37.125434] [WARN ] [MAIN ] TRNO: No existing data found, performing full refresh instead. [2025-10-26T02:28:37.125549] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-26T02:28:37.125622] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-26T02:28:37.125729] [DEBUG] [LOCAL ] TRNO: No primary data file found to delete. [2025-10-26T02:28:37.125801] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-26T02:28:52.234003] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-26T02:28:52.668416] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-26T02:28:52.668553] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-26T02:28:52.669774] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-26T02:28:52.669865] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-26T02:28:52.671370] [DEBUG] [LOCAL ] TRNO: Trimmed 62713 records to 44180 (keeping 200 days of data) [2025-10-26T02:28:52.935248] [DEBUG] [LOCAL ] TRNO: Primary data saved (44180 records). [2025-10-26T02:28:52.935409] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-26T02:28:52.935588] [INFO ] [MAIN ] Update Progress: 2127/2366 symbols. TRNO took 16.0s. Estimated remaining time: 50m 41s [2025-10-26T02:28:53.109354] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:28:53.109589] [DEBUG] [LOCAL ] TROX: No existing data file found in primary storage. [2025-10-26T02:28:53.109682] [WARN ] [MAIN ] TROX: No existing data found, performing full refresh instead. [2025-10-26T02:28:53.109817] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-26T02:28:53.109890] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-26T02:28:53.109972] [DEBUG] [LOCAL ] TROX: No primary data file found to delete. [2025-10-26T02:28:53.110068] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-26T02:29:10.757024] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-26T02:29:11.190591] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-26T02:29:11.190736] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-26T02:29:11.192061] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-26T02:29:11.192171] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-26T02:29:11.193799] [DEBUG] [LOCAL ] TROX: Trimmed 74173 records to 52959 (keeping 200 days of data) [2025-10-26T02:29:11.501112] [DEBUG] [LOCAL ] TROX: Primary data saved (52959 records). [2025-10-26T02:29:11.501287] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-26T02:29:11.501468] [INFO ] [MAIN ] Update Progress: 2128/2366 symbols. TROX took 18.6s. Estimated remaining time: 50m 29s [2025-10-26T02:29:11.670299] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:29:11.670499] [DEBUG] [LOCAL ] TRP: No existing data file found in primary storage. [2025-10-26T02:29:11.670570] [WARN ] [MAIN ] TRP: No existing data found, performing full refresh instead. [2025-10-26T02:29:11.670706] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-26T02:29:11.670780] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-26T02:29:11.670860] [DEBUG] [LOCAL ] TRP: No primary data file found to delete. [2025-10-26T02:29:11.670937] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-26T02:29:28.782494] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-26T02:29:29.182762] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-26T02:29:29.182890] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-26T02:29:29.184078] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-26T02:29:29.184161] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-26T02:29:29.185746] [DEBUG] [LOCAL ] TRP: Trimmed 75779 records to 52901 (keeping 200 days of data) [2025-10-26T02:29:29.494937] [DEBUG] [LOCAL ] TRP: Primary data saved (52901 records). [2025-10-26T02:29:29.495107] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-26T02:29:29.495292] [INFO ] [MAIN ] Update Progress: 2129/2366 symbols. TRP took 18.0s. Estimated remaining time: 50m 17s [2025-10-26T02:29:29.672111] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:29:29.672325] [DEBUG] [LOCAL ] TRTX: No existing data file found in primary storage. [2025-10-26T02:29:29.672421] [WARN ] [MAIN ] TRTX: No existing data found, performing full refresh instead. [2025-10-26T02:29:29.672577] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-26T02:29:29.672704] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-26T02:29:29.672795] [DEBUG] [LOCAL ] TRTX: No primary data file found to delete. [2025-10-26T02:29:29.672869] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-26T02:29:44.313522] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-26T02:29:44.700075] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-26T02:29:44.700239] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-26T02:29:44.701264] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-26T02:29:44.701353] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-26T02:29:44.702603] [DEBUG] [LOCAL ] TRTX: Trimmed 52967 records to 37308 (keeping 200 days of data) [2025-10-26T02:29:44.912057] [DEBUG] [LOCAL ] TRTX: Primary data saved (37308 records). [2025-10-26T02:29:44.912216] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-26T02:29:44.912403] [INFO ] [MAIN ] Update Progress: 2130/2366 symbols. TRTX took 15.4s. Estimated remaining time: 50m 4s [2025-10-26T02:29:45.077624] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:29:45.077842] [DEBUG] [LOCAL ] TRU: No existing data file found in primary storage. [2025-10-26T02:29:45.077922] [WARN ] [MAIN ] TRU: No existing data found, performing full refresh instead. [2025-10-26T02:29:45.078032] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-26T02:29:45.078103] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-26T02:29:45.078187] [DEBUG] [LOCAL ] TRU: No primary data file found to delete. [2025-10-26T02:29:45.078258] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-26T02:30:02.740118] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-26T02:30:03.204489] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-26T02:30:03.204688] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-26T02:30:03.206865] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-26T02:30:03.206957] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-26T02:30:03.209090] [DEBUG] [LOCAL ] TRU: Trimmed 74197 records to 52218 (keeping 200 days of data) [2025-10-26T02:30:03.544289] [DEBUG] [LOCAL ] TRU: Primary data saved (52218 records). [2025-10-26T02:30:03.544537] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-26T02:30:03.544840] [INFO ] [MAIN ] Update Progress: 2131/2366 symbols. TRU took 18.6s. Estimated remaining time: 49m 52s [2025-10-26T02:30:03.724120] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:30:03.724374] [DEBUG] [LOCAL ] TRV: No existing data file found in primary storage. [2025-10-26T02:30:03.724449] [WARN ] [MAIN ] TRV: No existing data found, performing full refresh instead. [2025-10-26T02:30:03.724572] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-26T02:30:03.724680] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-26T02:30:03.724768] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-10-26T02:30:03.724841] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-26T02:30:21.403109] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-26T02:30:21.832455] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-26T02:30:21.832628] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-26T02:30:21.834341] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-26T02:30:21.834435] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-26T02:30:21.836530] [DEBUG] [LOCAL ] TRV: Trimmed 69992 records to 48221 (keeping 200 days of data) [2025-10-26T02:30:22.153839] [DEBUG] [LOCAL ] TRV: Primary data saved (48221 records). [2025-10-26T02:30:22.154070] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-26T02:30:22.154347] [INFO ] [MAIN ] Update Progress: 2132/2366 symbols. TRV took 18.6s. Estimated remaining time: 49m 40s [2025-10-26T02:30:22.343843] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:30:22.344153] [DEBUG] [LOCAL ] TS: No existing data file found in primary storage. [2025-10-26T02:30:22.344234] [WARN ] [MAIN ] TS: No existing data found, performing full refresh instead. [2025-10-26T02:30:22.344369] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-26T02:30:22.344445] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-26T02:30:22.344535] [DEBUG] [LOCAL ] TS: No primary data file found to delete. [2025-10-26T02:30:22.344612] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-26T02:30:40.378102] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-26T02:30:40.793513] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-26T02:30:40.793717] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-26T02:30:40.796147] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-26T02:30:40.796244] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-26T02:30:40.798443] [DEBUG] [LOCAL ] TS: Trimmed 74913 records to 52416 (keeping 200 days of data) [2025-10-26T02:30:41.125288] [DEBUG] [LOCAL ] TS: Primary data saved (52416 records). [2025-10-26T02:30:41.125542] [INFO ] [MAIN ] TS: Full history saved. [2025-10-26T02:30:41.125820] [INFO ] [MAIN ] Update Progress: 2133/2366 symbols. TS took 19.0s. Estimated remaining time: 49m 28s [2025-10-26T02:30:41.306911] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:30:41.307140] [DEBUG] [LOCAL ] TSE: No existing data file found in primary storage. [2025-10-26T02:30:41.307216] [WARN ] [MAIN ] TSE: No existing data found, performing full refresh instead. [2025-10-26T02:30:41.307344] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-26T02:30:41.307420] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-26T02:30:41.307505] [DEBUG] [LOCAL ] TSE: No primary data file found to delete. [2025-10-26T02:30:41.307579] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-26T02:30:54.183831] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-26T02:30:54.582962] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-26T02:30:54.583082] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-26T02:30:54.584059] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-26T02:30:54.584144] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-26T02:30:54.585159] [DEBUG] [LOCAL ] TSE: Trimmed 40896 records to 28300 (keeping 200 days of data) [2025-10-26T02:30:54.745371] [DEBUG] [LOCAL ] TSE: Primary data saved (28300 records). [2025-10-26T02:30:54.745552] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-26T02:30:54.745773] [INFO ] [MAIN ] Update Progress: 2134/2366 symbols. TSE took 13.6s. Estimated remaining time: 49m 16s [2025-10-26T02:30:54.910806] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:30:54.910991] [DEBUG] [LOCAL ] TSI: No existing data file found in primary storage. [2025-10-26T02:30:54.911062] [WARN ] [MAIN ] TSI: No existing data found, performing full refresh instead. [2025-10-26T02:30:54.911174] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-26T02:30:54.911247] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-26T02:30:54.911327] [DEBUG] [LOCAL ] TSI: No primary data file found to delete. [2025-10-26T02:30:54.911394] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-26T02:31:03.543772] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-26T02:31:03.947991] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-26T02:31:03.948106] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-26T02:31:03.948470] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-26T02:31:03.948549] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-26T02:31:03.949070] [DEBUG] [LOCAL ] TSI: Trimmed 13954 records to 8268 (keeping 200 days of data) [2025-10-26T02:31:03.993784] [DEBUG] [LOCAL ] TSI: Primary data saved (8268 records). [2025-10-26T02:31:03.993942] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-26T02:31:03.994119] [INFO ] [MAIN ] Update Progress: 2135/2366 symbols. TSI took 9.2s. Estimated remaining time: 49m 2s [2025-10-26T02:31:04.160266] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:31:04.160483] [DEBUG] [LOCAL ] TSLX: No existing data file found in primary storage. [2025-10-26T02:31:04.160555] [WARN ] [MAIN ] TSLX: No existing data found, performing full refresh instead. [2025-10-26T02:31:04.160723] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-26T02:31:04.160860] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-26T02:31:04.160955] [DEBUG] [LOCAL ] TSLX: No primary data file found to delete. [2025-10-26T02:31:04.161023] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-26T02:31:18.643578] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-26T02:31:19.033748] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-26T02:31:19.033879] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-26T02:31:19.034839] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-26T02:31:19.034940] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-26T02:31:19.036065] [DEBUG] [LOCAL ] TSLX: Trimmed 50934 records to 36286 (keeping 200 days of data) [2025-10-26T02:31:19.246043] [DEBUG] [LOCAL ] TSLX: Primary data saved (36286 records). [2025-10-26T02:31:19.246227] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-26T02:31:19.246424] [INFO ] [MAIN ] Update Progress: 2136/2366 symbols. TSLX took 15.3s. Estimated remaining time: 48m 50s [2025-10-26T02:31:19.421095] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:31:19.421305] [DEBUG] [LOCAL ] TSM: No existing data file found in primary storage. [2025-10-26T02:31:19.421392] [WARN ] [MAIN ] TSM: No existing data found, performing full refresh instead. [2025-10-26T02:31:19.421535] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-26T02:31:19.421625] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-26T02:31:19.421754] [DEBUG] [LOCAL ] TSM: No primary data file found to delete. [2025-10-26T02:31:19.421841] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-26T02:31:45.835736] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-26T02:31:46.242902] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-26T02:31:46.243019] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-26T02:31:46.244294] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-26T02:31:46.244380] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-26T02:31:46.245954] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 54599 (keeping 200 days of data) [2025-10-26T02:31:46.583175] [DEBUG] [LOCAL ] TSM: Primary data saved (54599 records). [2025-10-26T02:31:46.583356] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-26T02:31:46.583541] [INFO ] [MAIN ] Update Progress: 2137/2366 symbols. TSM took 27.3s. Estimated remaining time: 48m 39s [2025-10-26T02:31:46.750721] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:31:46.750928] [DEBUG] [LOCAL ] TSN: No existing data file found in primary storage. [2025-10-26T02:31:46.751005] [WARN ] [MAIN ] TSN: No existing data found, performing full refresh instead. [2025-10-26T02:31:46.751119] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-26T02:31:46.751192] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-26T02:31:46.751277] [DEBUG] [LOCAL ] TSN: No primary data file found to delete. [2025-10-26T02:31:46.751347] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-26T02:32:05.381021] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-26T02:32:05.777298] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-26T02:32:05.777424] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-26T02:32:05.778622] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-26T02:32:05.778727] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-26T02:32:05.780249] [DEBUG] [LOCAL ] TSN: Trimmed 76677 records to 53854 (keeping 200 days of data) [2025-10-26T02:32:06.100064] [DEBUG] [LOCAL ] TSN: Primary data saved (53854 records). [2025-10-26T02:32:06.100283] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-26T02:32:06.100498] [INFO ] [MAIN ] Update Progress: 2138/2366 symbols. TSN took 19.5s. Estimated remaining time: 48m 27s [2025-10-26T02:32:06.265413] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:32:06.265601] [DEBUG] [LOCAL ] TSQ: No existing data file found in primary storage. [2025-10-26T02:32:06.265696] [WARN ] [MAIN ] TSQ: No existing data found, performing full refresh instead. [2025-10-26T02:32:06.265809] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-26T02:32:06.265878] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-26T02:32:06.265936] [DEBUG] [LOCAL ] TSQ: No primary data file found to delete. [2025-10-26T02:32:06.265997] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-26T02:32:14.958072] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-26T02:32:15.348070] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-26T02:32:15.348189] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-26T02:32:15.348588] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-26T02:32:15.348687] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-26T02:32:15.349241] [DEBUG] [LOCAL ] TSQ: Trimmed 16425 records to 11871 (keeping 200 days of data) [2025-10-26T02:32:15.414259] [DEBUG] [LOCAL ] TSQ: Primary data saved (11871 records). [2025-10-26T02:32:15.414422] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-26T02:32:15.414602] [INFO ] [MAIN ] Update Progress: 2139/2366 symbols. TSQ took 9.3s. Estimated remaining time: 48m 14s [2025-10-26T02:32:15.585741] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:32:15.586395] [DEBUG] [LOCAL ] TT: No existing data file found in primary storage. [2025-10-26T02:32:15.586466] [WARN ] [MAIN ] TT: No existing data found, performing full refresh instead. [2025-10-26T02:32:15.586619] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-26T02:32:15.586711] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-26T02:32:15.586794] [DEBUG] [LOCAL ] TT: No primary data file found to delete. [2025-10-26T02:32:15.586860] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-26T02:32:32.737996] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-26T02:32:33.149425] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-26T02:32:33.149543] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-26T02:32:33.150755] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-26T02:32:33.150837] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-26T02:32:33.152217] [DEBUG] [LOCAL ] TT: Trimmed 69945 records to 47694 (keeping 200 days of data) [2025-10-26T02:32:33.443446] [DEBUG] [LOCAL ] TT: Primary data saved (47694 records). [2025-10-26T02:32:33.443619] [INFO ] [MAIN ] TT: Full history saved. [2025-10-26T02:32:33.443825] [INFO ] [MAIN ] Update Progress: 2140/2366 symbols. TT took 18.0s. Estimated remaining time: 48m 2s [2025-10-26T02:32:33.626556] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:32:33.626794] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-26T02:32:33.626881] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-26T02:32:33.627018] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-26T02:32:33.627106] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-26T02:32:33.627216] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-26T02:32:33.627303] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-26T02:32:34.203846] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-26T02:32:34.203932] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:32:34.204045] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-26T02:32:34.204155] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-26T02:32:34.204243] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-26T02:32:34.204341] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-26T02:32:34.204575] [INFO ] [MAIN ] Update Progress: 2141/2366 symbols. TTAM took 0.8s. Estimated remaining time: 47m 48s [2025-10-26T02:32:34.374798] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:32:34.374986] [DEBUG] [LOCAL ] TTC: No existing data file found in primary storage. [2025-10-26T02:32:34.375054] [WARN ] [MAIN ] TTC: No existing data found, performing full refresh instead. [2025-10-26T02:32:34.375166] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-26T02:32:34.375236] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-26T02:32:34.375313] [DEBUG] [LOCAL ] TTC: No primary data file found to delete. [2025-10-26T02:32:34.375379] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-26T02:32:49.255768] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-26T02:32:49.648140] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-26T02:32:49.648286] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-26T02:32:49.649365] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-26T02:32:49.649445] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-26T02:32:49.650808] [DEBUG] [LOCAL ] TTC: Trimmed 61742 records to 42012 (keeping 200 days of data) [2025-10-26T02:32:49.901538] [DEBUG] [LOCAL ] TTC: Primary data saved (42012 records). [2025-10-26T02:32:49.901713] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-26T02:32:49.901894] [INFO ] [MAIN ] Update Progress: 2142/2366 symbols. TTC took 15.7s. Estimated remaining time: 47m 35s [2025-10-26T02:32:50.068197] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:32:50.068415] [DEBUG] [LOCAL ] TTE: No existing data file found in primary storage. [2025-10-26T02:32:50.068486] [WARN ] [MAIN ] TTE: No existing data found, performing full refresh instead. [2025-10-26T02:32:50.068595] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-26T02:32:50.068687] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-26T02:32:50.068768] [DEBUG] [LOCAL ] TTE: No primary data file found to delete. [2025-10-26T02:32:50.068835] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-26T02:33:09.261320] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-26T02:33:09.642040] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-26T02:33:09.642151] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-26T02:33:09.643293] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-26T02:33:09.643373] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-26T02:33:09.644800] [DEBUG] [LOCAL ] TTE: Trimmed 75024 records to 52265 (keeping 200 days of data) [2025-10-26T02:33:09.951326] [DEBUG] [LOCAL ] TTE: Primary data saved (52265 records). [2025-10-26T02:33:09.951496] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-26T02:33:09.951704] [INFO ] [MAIN ] Update Progress: 2143/2366 symbols. TTE took 20.0s. Estimated remaining time: 47m 23s [2025-10-26T02:33:10.120111] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:33:10.120341] [DEBUG] [LOCAL ] TTI: No existing data file found in primary storage. [2025-10-26T02:33:10.120418] [WARN ] [MAIN ] TTI: No existing data found, performing full refresh instead. [2025-10-26T02:33:10.120541] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-26T02:33:10.120690] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-26T02:33:10.120776] [DEBUG] [LOCAL ] TTI: No primary data file found to delete. [2025-10-26T02:33:10.120842] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-26T02:33:26.690027] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-26T02:33:27.072302] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-26T02:33:27.072419] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-26T02:33:27.073783] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-26T02:33:27.073881] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-26T02:33:27.075348] [DEBUG] [LOCAL ] TTI: Trimmed 66607 records to 47416 (keeping 200 days of data) [2025-10-26T02:33:27.336422] [DEBUG] [LOCAL ] TTI: Primary data saved (47416 records). [2025-10-26T02:33:27.336619] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-26T02:33:27.337045] [INFO ] [MAIN ] Update Progress: 2144/2366 symbols. TTI took 17.4s. Estimated remaining time: 47m 11s [2025-10-26T02:33:27.505316] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:33:27.505535] [DEBUG] [LOCAL ] TU: No existing data file found in primary storage. [2025-10-26T02:33:27.505631] [WARN ] [MAIN ] TU: No existing data found, performing full refresh instead. [2025-10-26T02:33:27.505799] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-26T02:33:27.505893] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-26T02:33:27.505981] [DEBUG] [LOCAL ] TU: No primary data file found to delete. [2025-10-26T02:33:27.506061] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-26T02:33:44.834068] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-26T02:33:45.227369] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-26T02:33:45.227500] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-26T02:33:45.228778] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-26T02:33:45.228866] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-26T02:33:45.230422] [DEBUG] [LOCAL ] TU: Trimmed 72818 records to 50476 (keeping 200 days of data) [2025-10-26T02:33:45.527967] [DEBUG] [LOCAL ] TU: Primary data saved (50476 records). [2025-10-26T02:33:45.528132] [INFO ] [MAIN ] TU: Full history saved. [2025-10-26T02:33:45.528353] [INFO ] [MAIN ] Update Progress: 2145/2366 symbols. TU took 18.2s. Estimated remaining time: 46m 59s [2025-10-26T02:33:45.696130] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:33:45.696320] [DEBUG] [LOCAL ] TUYA: No existing data file found in primary storage. [2025-10-26T02:33:45.696394] [WARN ] [MAIN ] TUYA: No existing data found, performing full refresh instead. [2025-10-26T02:33:45.696511] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-26T02:33:45.696585] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-26T02:33:45.696697] [DEBUG] [LOCAL ] TUYA: No primary data file found to delete. [2025-10-26T02:33:45.696772] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-26T02:34:02.846588] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-26T02:34:03.267384] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-26T02:34:03.267541] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-26T02:34:03.269387] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-26T02:34:03.269477] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-26T02:34:03.271273] [DEBUG] [LOCAL ] TUYA: Trimmed 67042 records to 46333 (keeping 200 days of data) [2025-10-26T02:34:03.535504] [DEBUG] [LOCAL ] TUYA: Primary data saved (46333 records). [2025-10-26T02:34:03.535791] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-26T02:34:03.536048] [INFO ] [MAIN ] Update Progress: 2146/2366 symbols. TUYA took 18.0s. Estimated remaining time: 46m 46s [2025-10-26T02:34:03.719719] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:34:03.720055] [DEBUG] [LOCAL ] TV: No existing data file found in primary storage. [2025-10-26T02:34:03.720132] [WARN ] [MAIN ] TV: No existing data found, performing full refresh instead. [2025-10-26T02:34:03.720261] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-26T02:34:03.720337] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-26T02:34:03.720443] [DEBUG] [LOCAL ] TV: No primary data file found to delete. [2025-10-26T02:34:03.720521] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-26T02:34:19.442343] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-26T02:34:19.839828] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-26T02:34:19.839977] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-26T02:34:19.841433] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-26T02:34:19.841550] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-26T02:34:19.843181] [DEBUG] [LOCAL ] TV: Trimmed 60749 records to 41765 (keeping 200 days of data) [2025-10-26T02:34:20.104330] [DEBUG] [LOCAL ] TV: Primary data saved (41765 records). [2025-10-26T02:34:20.104671] [INFO ] [MAIN ] TV: Full history saved. [2025-10-26T02:34:20.104974] [INFO ] [MAIN ] Update Progress: 2147/2366 symbols. TV took 16.6s. Estimated remaining time: 46m 34s [2025-10-26T02:34:20.284167] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:34:20.284574] [DEBUG] [LOCAL ] TVC: No existing data file found in primary storage. [2025-10-26T02:34:20.284681] [WARN ] [MAIN ] TVC: No existing data found, performing full refresh instead. [2025-10-26T02:34:20.284809] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-26T02:34:20.284887] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-26T02:34:20.284981] [DEBUG] [LOCAL ] TVC: No primary data file found to delete. [2025-10-26T02:34:20.285060] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-26T02:34:26.474421] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-26T02:34:26.840013] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-26T02:34:26.840148] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-26T02:34:26.840358] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-26T02:34:26.840457] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-26T02:34:26.840908] [DEBUG] [LOCAL ] TVC: Trimmed 5000 records to 3130 (keeping 200 days of data) [2025-10-26T02:34:26.860215] [DEBUG] [LOCAL ] TVC: Primary data saved (3130 records). [2025-10-26T02:34:26.860371] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-26T02:34:26.860571] [INFO ] [MAIN ] Update Progress: 2148/2366 symbols. TVC took 6.8s. Estimated remaining time: 46m 21s [2025-10-26T02:34:27.038504] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:34:27.038744] [DEBUG] [LOCAL ] TVE: No existing data file found in primary storage. [2025-10-26T02:34:27.038831] [WARN ] [MAIN ] TVE: No existing data found, performing full refresh instead. [2025-10-26T02:34:27.038966] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-26T02:34:27.039056] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-26T02:34:27.039165] [DEBUG] [LOCAL ] TVE: No primary data file found to delete. [2025-10-26T02:34:27.039253] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-26T02:34:32.648079] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-26T02:34:33.022678] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-26T02:34:33.022790] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-26T02:34:33.023007] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-26T02:34:33.023084] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-26T02:34:33.023474] [DEBUG] [LOCAL ] TVE: Trimmed 4196 records to 2565 (keeping 200 days of data) [2025-10-26T02:34:33.038674] [DEBUG] [LOCAL ] TVE: Primary data saved (2565 records). [2025-10-26T02:34:33.038768] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-26T02:34:33.038937] [INFO ] [MAIN ] Update Progress: 2149/2366 symbols. TVE took 6.2s. Estimated remaining time: 46m 7s [2025-10-26T02:34:33.206455] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:34:33.206692] [DEBUG] [LOCAL ] TWI: No existing data file found in primary storage. [2025-10-26T02:34:33.206766] [WARN ] [MAIN ] TWI: No existing data found, performing full refresh instead. [2025-10-26T02:34:33.206877] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-26T02:34:33.206949] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-26T02:34:33.207030] [DEBUG] [LOCAL ] TWI: No primary data file found to delete. [2025-10-26T02:34:33.207101] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-26T02:34:46.621076] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-26T02:34:47.000125] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-26T02:34:47.000236] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-26T02:34:47.001335] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-26T02:34:47.001415] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-26T02:34:47.002487] [DEBUG] [LOCAL ] TWI: Trimmed 51946 records to 34221 (keeping 200 days of data) [2025-10-26T02:34:47.188057] [DEBUG] [LOCAL ] TWI: Primary data saved (34221 records). [2025-10-26T02:34:47.188239] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-26T02:34:47.188419] [INFO ] [MAIN ] Update Progress: 2150/2366 symbols. TWI took 14.1s. Estimated remaining time: 45m 55s [2025-10-26T02:34:47.356732] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:34:47.356952] [DEBUG] [LOCAL ] TWLO: No existing data file found in primary storage. [2025-10-26T02:34:47.357028] [WARN ] [MAIN ] TWLO: No existing data found, performing full refresh instead. [2025-10-26T02:34:47.357140] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-26T02:34:47.357211] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-26T02:34:47.357292] [DEBUG] [LOCAL ] TWLO: No primary data file found to delete. [2025-10-26T02:34:47.357362] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-26T02:35:07.940053] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-26T02:35:08.369112] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-26T02:35:08.369255] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-26T02:35:08.370511] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-26T02:35:08.370603] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-26T02:35:08.372198] [DEBUG] [LOCAL ] TWLO: Trimmed 76584 records to 53533 (keeping 200 days of data) [2025-10-26T02:35:08.827738] [DEBUG] [LOCAL ] TWLO: Primary data saved (53533 records). [2025-10-26T02:35:08.827994] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-26T02:35:08.828297] [INFO ] [MAIN ] Update Progress: 2151/2366 symbols. TWLO took 21.6s. Estimated remaining time: 45m 43s [2025-10-26T02:35:09.073118] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:35:09.073391] [DEBUG] [LOCAL ] TWN: No existing data file found in primary storage. [2025-10-26T02:35:09.073485] [WARN ] [MAIN ] TWN: No existing data found, performing full refresh instead. [2025-10-26T02:35:09.073640] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-26T02:35:09.073788] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-26T02:35:09.073899] [DEBUG] [LOCAL ] TWN: No primary data file found to delete. [2025-10-26T02:35:09.073987] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-26T02:35:15.389768] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-26T02:35:15.759187] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-26T02:35:15.759336] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-26T02:35:15.759608] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-26T02:35:15.759709] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-26T02:35:15.760167] [DEBUG] [LOCAL ] TWN: Trimmed 5176 records to 3248 (keeping 200 days of data) [2025-10-26T02:35:15.782959] [DEBUG] [LOCAL ] TWN: Primary data saved (3248 records). [2025-10-26T02:35:15.783158] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-26T02:35:15.783386] [INFO ] [MAIN ] Update Progress: 2152/2366 symbols. TWN took 7.0s. Estimated remaining time: 45m 29s [2025-10-26T02:35:15.955680] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:35:15.955874] [DEBUG] [LOCAL ] TWO: No existing data file found in primary storage. [2025-10-26T02:35:15.955948] [WARN ] [MAIN ] TWO: No existing data found, performing full refresh instead. [2025-10-26T02:35:15.956064] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-26T02:35:15.956136] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-26T02:35:15.956218] [DEBUG] [LOCAL ] TWO: No primary data file found to delete. [2025-10-26T02:35:15.956288] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-26T02:35:32.098248] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-26T02:35:32.486224] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-26T02:35:32.486343] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-26T02:35:32.487500] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-26T02:35:32.487580] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-26T02:35:32.489003] [DEBUG] [LOCAL ] TWO: Trimmed 69272 records to 49236 (keeping 200 days of data) [2025-10-26T02:35:32.773530] [DEBUG] [LOCAL ] TWO: Primary data saved (49236 records). [2025-10-26T02:35:32.773790] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-26T02:35:32.773970] [INFO ] [MAIN ] Update Progress: 2153/2366 symbols. TWO took 17.0s. Estimated remaining time: 45m 17s [2025-10-26T02:35:32.938196] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:35:32.938419] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-26T02:35:32.938491] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-26T02:35:32.938579] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-26T02:35:32.938667] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-26T02:35:32.938740] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-26T02:35:32.938903] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-26T02:35:33.508095] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-26T02:35:33.508166] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:35:33.508241] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-26T02:35:33.508334] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-26T02:35:33.508405] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-26T02:35:33.508485] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-26T02:35:33.508699] [INFO ] [MAIN ] Update Progress: 2154/2366 symbols. TWOD took 0.7s. Estimated remaining time: 45m 3s [2025-10-26T02:35:33.684393] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:35:33.684595] [DEBUG] [LOCAL ] TX: No existing data file found in primary storage. [2025-10-26T02:35:33.684695] [WARN ] [MAIN ] TX: No existing data found, performing full refresh instead. [2025-10-26T02:35:33.684817] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-26T02:35:33.684889] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-26T02:35:33.684970] [DEBUG] [LOCAL ] TX: No primary data file found to delete. [2025-10-26T02:35:33.685039] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-26T02:35:45.366808] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-26T02:35:45.734382] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-26T02:35:45.734499] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-26T02:35:45.735273] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-26T02:35:45.735355] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-26T02:35:45.736271] [DEBUG] [LOCAL ] TX: Trimmed 35432 records to 23413 (keeping 200 days of data) [2025-10-26T02:35:45.873787] [DEBUG] [LOCAL ] TX: Primary data saved (23413 records). [2025-10-26T02:35:45.873946] [INFO ] [MAIN ] TX: Full history saved. [2025-10-26T02:35:45.874170] [INFO ] [MAIN ] Update Progress: 2155/2366 symbols. TX took 12.4s. Estimated remaining time: 44m 50s [2025-10-26T02:35:46.041237] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:35:46.041455] [DEBUG] [LOCAL ] TXNM: No existing data file found in primary storage. [2025-10-26T02:35:46.041530] [WARN ] [MAIN ] TXNM: No existing data found, performing full refresh instead. [2025-10-26T02:35:46.041681] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-26T02:35:46.041752] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-26T02:35:46.041833] [DEBUG] [LOCAL ] TXNM: No primary data file found to delete. [2025-10-26T02:35:46.041906] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-26T02:36:01.465378] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-26T02:36:01.926164] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-26T02:36:01.926307] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-26T02:36:01.927599] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-26T02:36:01.927705] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-26T02:36:01.929670] [DEBUG] [LOCAL ] TXNM: Trimmed 62715 records to 43369 (keeping 200 days of data) [2025-10-26T02:36:02.207871] [DEBUG] [LOCAL ] TXNM: Primary data saved (43369 records). [2025-10-26T02:36:02.208034] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-26T02:36:02.208219] [INFO ] [MAIN ] Update Progress: 2156/2366 symbols. TXNM took 16.3s. Estimated remaining time: 44m 38s [2025-10-26T02:36:02.378840] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:36:02.379049] [DEBUG] [LOCAL ] TXO: No existing data file found in primary storage. [2025-10-26T02:36:02.379119] [WARN ] [MAIN ] TXO: No existing data found, performing full refresh instead. [2025-10-26T02:36:02.379236] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-26T02:36:02.379309] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-26T02:36:02.379397] [DEBUG] [LOCAL ] TXO: No primary data file found to delete. [2025-10-26T02:36:02.379468] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-26T02:36:13.305898] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-26T02:36:13.696531] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-26T02:36:13.696680] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-26T02:36:13.697371] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-26T02:36:13.697454] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-26T02:36:13.698301] [DEBUG] [LOCAL ] TXO: Trimmed 27314 records to 20250 (keeping 200 days of data) [2025-10-26T02:36:13.831766] [DEBUG] [LOCAL ] TXO: Primary data saved (20250 records). [2025-10-26T02:36:13.831931] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-26T02:36:13.832139] [INFO ] [MAIN ] Update Progress: 2157/2366 symbols. TXO took 11.6s. Estimated remaining time: 44m 25s [2025-10-26T02:36:14.023428] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:36:14.023631] [DEBUG] [LOCAL ] TXT: No existing data file found in primary storage. [2025-10-26T02:36:14.023719] [WARN ] [MAIN ] TXT: No existing data found, performing full refresh instead. [2025-10-26T02:36:14.023829] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-26T02:36:14.023901] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-26T02:36:14.023986] [DEBUG] [LOCAL ] TXT: No primary data file found to delete. [2025-10-26T02:36:14.024056] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-26T02:36:30.704175] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-26T02:36:31.088255] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-26T02:36:31.088389] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-26T02:36:31.089610] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-26T02:36:31.089745] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-26T02:36:31.091273] [DEBUG] [LOCAL ] TXT: Trimmed 72461 records to 50277 (keeping 200 days of data) [2025-10-26T02:36:31.387539] [DEBUG] [LOCAL ] TXT: Primary data saved (50277 records). [2025-10-26T02:36:31.387740] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-26T02:36:31.387974] [INFO ] [MAIN ] Update Progress: 2158/2366 symbols. TXT took 17.6s. Estimated remaining time: 44m 13s [2025-10-26T02:36:31.552883] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:36:31.553110] [DEBUG] [LOCAL ] TY: No existing data file found in primary storage. [2025-10-26T02:36:31.553185] [WARN ] [MAIN ] TY: No existing data found, performing full refresh instead. [2025-10-26T02:36:31.553301] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-26T02:36:31.553375] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-26T02:36:31.553459] [DEBUG] [LOCAL ] TY: No primary data file found to delete. [2025-10-26T02:36:31.553532] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-26T02:36:39.552163] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-26T02:36:39.921950] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-26T02:36:39.922099] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-26T02:36:39.922584] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-26T02:36:39.922693] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-26T02:36:39.923242] [DEBUG] [LOCAL ] TY: Trimmed 11277 records to 7594 (keeping 200 days of data) [2025-10-26T02:36:39.973237] [DEBUG] [LOCAL ] TY: Primary data saved (7594 records). [2025-10-26T02:36:39.973484] [INFO ] [MAIN ] TY: Full history saved. [2025-10-26T02:36:39.973757] [INFO ] [MAIN ] Update Progress: 2159/2366 symbols. TY took 8.6s. Estimated remaining time: 43m 60s [2025-10-26T02:36:40.143148] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:36:40.143447] [DEBUG] [LOCAL ] TYG: No existing data file found in primary storage. [2025-10-26T02:36:40.143529] [WARN ] [MAIN ] TYG: No existing data found, performing full refresh instead. [2025-10-26T02:36:40.143708] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-26T02:36:40.143819] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-26T02:36:40.143905] [DEBUG] [LOCAL ] TYG: No primary data file found to delete. [2025-10-26T02:36:40.143979] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-26T02:36:49.970811] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-26T02:36:50.359876] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-26T02:36:50.360035] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-26T02:36:50.360757] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-26T02:36:50.360839] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-26T02:36:50.361636] [DEBUG] [LOCAL ] TYG: Trimmed 22049 records to 14185 (keeping 200 days of data) [2025-10-26T02:36:50.454206] [DEBUG] [LOCAL ] TYG: Primary data saved (14185 records). [2025-10-26T02:36:50.454448] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-26T02:36:50.454726] [INFO ] [MAIN ] Update Progress: 2160/2366 symbols. TYG took 10.5s. Estimated remaining time: 43m 47s [2025-10-26T02:36:50.627753] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:36:50.628062] [DEBUG] [LOCAL ] TYL: No existing data file found in primary storage. [2025-10-26T02:36:50.628138] [WARN ] [MAIN ] TYL: No existing data found, performing full refresh instead. [2025-10-26T02:36:50.628236] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-26T02:36:50.628306] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-26T02:36:50.628368] [DEBUG] [LOCAL ] TYL: No primary data file found to delete. [2025-10-26T02:36:50.628433] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-26T02:37:02.591199] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-26T02:37:02.952515] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-26T02:37:02.952631] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-26T02:37:02.953376] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-26T02:37:02.953456] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-26T02:37:02.954270] [DEBUG] [LOCAL ] TYL: Trimmed 31616 records to 22275 (keeping 200 days of data) [2025-10-26T02:37:03.085501] [DEBUG] [LOCAL ] TYL: Primary data saved (22275 records). [2025-10-26T02:37:03.085686] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-26T02:37:03.085909] [INFO ] [MAIN ] Update Progress: 2161/2366 symbols. TYL took 12.6s. Estimated remaining time: 43m 34s [2025-10-26T02:37:03.255092] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:37:03.255267] [DEBUG] [LOCAL ] U: No existing data file found in primary storage. [2025-10-26T02:37:03.255337] [WARN ] [MAIN ] U: No existing data found, performing full refresh instead. [2025-10-26T02:37:03.255455] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-26T02:37:03.255525] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-26T02:37:03.255617] [DEBUG] [LOCAL ] U: No primary data file found to delete. [2025-10-26T02:37:03.255714] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-26T02:37:27.240485] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-26T02:37:27.655904] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-26T02:37:27.656089] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-26T02:37:27.657977] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-26T02:37:27.658065] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-26T02:37:27.660272] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 54579 (keeping 200 days of data) [2025-10-26T02:37:27.994626] [DEBUG] [LOCAL ] U: Primary data saved (54579 records). [2025-10-26T02:37:27.994893] [INFO ] [MAIN ] U: Full history saved. [2025-10-26T02:37:27.995185] [INFO ] [MAIN ] Update Progress: 2162/2366 symbols. U took 24.9s. Estimated remaining time: 43m 22s [2025-10-26T02:37:28.167809] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:37:28.168087] [DEBUG] [LOCAL ] UA: No existing data file found in primary storage. [2025-10-26T02:37:28.168164] [WARN ] [MAIN ] UA: No existing data found, performing full refresh instead. [2025-10-26T02:37:28.168294] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-26T02:37:28.168370] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-26T02:37:28.168441] [DEBUG] [LOCAL ] UA: No primary data file found to delete. [2025-10-26T02:37:28.168510] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-26T02:37:45.263984] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-26T02:37:45.670289] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-26T02:37:45.670462] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-26T02:37:45.672470] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-26T02:37:45.672557] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-26T02:37:45.674675] [DEBUG] [LOCAL ] UA: Trimmed 73210 records to 51187 (keeping 200 days of data) [2025-10-26T02:37:45.961343] [DEBUG] [LOCAL ] UA: Primary data saved (51187 records). [2025-10-26T02:37:45.961577] [INFO ] [MAIN ] UA: Full history saved. [2025-10-26T02:37:45.961845] [INFO ] [MAIN ] Update Progress: 2163/2366 symbols. UA took 18.0s. Estimated remaining time: 43m 10s [2025-10-26T02:37:46.137098] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:37:46.137356] [DEBUG] [LOCAL ] UAA: No existing data file found in primary storage. [2025-10-26T02:37:46.137439] [WARN ] [MAIN ] UAA: No existing data found, performing full refresh instead. [2025-10-26T02:37:46.137569] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-26T02:37:46.137666] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-26T02:37:46.137754] [DEBUG] [LOCAL ] UAA: No primary data file found to delete. [2025-10-26T02:37:46.137856] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-26T02:38:04.471913] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-26T02:38:04.875481] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-26T02:38:04.875633] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-26T02:38:04.878103] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-26T02:38:04.878197] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-26T02:38:04.880167] [DEBUG] [LOCAL ] UAA: Trimmed 77642 records to 54277 (keeping 200 days of data) [2025-10-26T02:38:05.200349] [DEBUG] [LOCAL ] UAA: Primary data saved (54277 records). [2025-10-26T02:38:05.200593] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-26T02:38:05.200899] [INFO ] [MAIN ] Update Progress: 2164/2366 symbols. UAA took 19.2s. Estimated remaining time: 42m 58s [2025-10-26T02:38:05.383297] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:38:05.383739] [DEBUG] [LOCAL ] UAN: No existing data file found in primary storage. [2025-10-26T02:38:05.383825] [WARN ] [MAIN ] UAN: No existing data found, performing full refresh instead. [2025-10-26T02:38:05.383959] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-26T02:38:05.384037] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-26T02:38:05.384124] [DEBUG] [LOCAL ] UAN: No primary data file found to delete. [2025-10-26T02:38:05.384201] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-26T02:38:12.526065] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-26T02:38:12.881318] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-26T02:38:12.881516] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-26T02:38:12.881796] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-26T02:38:12.881893] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-26T02:38:12.882348] [DEBUG] [LOCAL ] UAN: Trimmed 7856 records to 5387 (keeping 200 days of data) [2025-10-26T02:38:12.915694] [DEBUG] [LOCAL ] UAN: Primary data saved (5387 records). [2025-10-26T02:38:12.915880] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-26T02:38:12.916084] [INFO ] [MAIN ] Update Progress: 2165/2366 symbols. UAN took 7.7s. Estimated remaining time: 42m 45s [2025-10-26T02:38:13.091113] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:38:13.091380] [DEBUG] [LOCAL ] UBER: No existing data file found in primary storage. [2025-10-26T02:38:13.091465] [WARN ] [MAIN ] UBER: No existing data found, performing full refresh instead. [2025-10-26T02:38:13.091602] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-26T02:38:13.091710] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-26T02:38:13.091817] [DEBUG] [LOCAL ] UBER: No primary data file found to delete. [2025-10-26T02:38:13.091907] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-26T02:38:36.422867] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-26T02:38:36.808509] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-26T02:38:36.808626] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-26T02:38:36.809811] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-26T02:38:36.809893] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-26T02:38:36.811338] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 54586 (keeping 200 days of data) [2025-10-26T02:38:37.121878] [DEBUG] [LOCAL ] UBER: Primary data saved (54586 records). [2025-10-26T02:38:37.122046] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-26T02:38:37.122227] [INFO ] [MAIN ] Update Progress: 2166/2366 symbols. UBER took 24.2s. Estimated remaining time: 42m 33s [2025-10-26T02:38:37.312629] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:38:37.312889] [DEBUG] [LOCAL ] UBS: No existing data file found in primary storage. [2025-10-26T02:38:37.312958] [WARN ] [MAIN ] UBS: No existing data found, performing full refresh instead. [2025-10-26T02:38:37.313067] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-26T02:38:37.313138] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-26T02:38:37.313200] [DEBUG] [LOCAL ] UBS: No primary data file found to delete. [2025-10-26T02:38:37.313262] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-26T02:38:55.538786] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-26T02:38:55.933733] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-26T02:38:55.933846] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-26T02:38:55.935124] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-26T02:38:55.935205] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-26T02:38:55.936526] [DEBUG] [LOCAL ] UBS: Trimmed 75942 records to 53024 (keeping 200 days of data) [2025-10-26T02:38:56.231781] [DEBUG] [LOCAL ] UBS: Primary data saved (53024 records). [2025-10-26T02:38:56.231942] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-26T02:38:56.232122] [INFO ] [MAIN ] Update Progress: 2167/2366 symbols. UBS took 19.1s. Estimated remaining time: 42m 21s [2025-10-26T02:38:56.396153] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:38:56.396317] [DEBUG] [LOCAL ] UCB: No existing data file found in primary storage. [2025-10-26T02:38:56.396391] [WARN ] [MAIN ] UCB: No existing data found, performing full refresh instead. [2025-10-26T02:38:56.396520] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-26T02:38:56.396591] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-26T02:38:56.396697] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-26T02:38:56.396770] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-26T02:39:11.247809] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-26T02:39:11.642313] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-26T02:39:11.642437] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-26T02:39:11.643519] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-26T02:39:11.643605] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-26T02:39:11.644806] [DEBUG] [LOCAL ] UCB: Trimmed 55081 records to 38273 (keeping 200 days of data) [2025-10-26T02:39:11.874991] [DEBUG] [LOCAL ] UCB: Primary data saved (38273 records). [2025-10-26T02:39:11.875165] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-26T02:39:11.875345] [INFO ] [MAIN ] Update Progress: 2168/2366 symbols. UCB took 15.6s. Estimated remaining time: 42m 8s [2025-10-26T02:39:12.041935] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:39:12.042154] [DEBUG] [LOCAL ] UDR: No existing data file found in primary storage. [2025-10-26T02:39:12.042238] [WARN ] [MAIN ] UDR: No existing data found, performing full refresh instead. [2025-10-26T02:39:12.042354] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-26T02:39:12.042432] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-26T02:39:12.042516] [DEBUG] [LOCAL ] UDR: No primary data file found to delete. [2025-10-26T02:39:12.042585] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-26T02:39:28.866838] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-26T02:39:29.263507] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-26T02:39:29.263950] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-26T02:39:29.265142] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-26T02:39:29.265224] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-26T02:39:29.266664] [DEBUG] [LOCAL ] UDR: Trimmed 75143 records to 52880 (keeping 200 days of data) [2025-10-26T02:39:29.576022] [DEBUG] [LOCAL ] UDR: Primary data saved (52880 records). [2025-10-26T02:39:29.576177] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-26T02:39:29.576362] [INFO ] [MAIN ] Update Progress: 2169/2366 symbols. UDR took 17.7s. Estimated remaining time: 41m 56s [2025-10-26T02:39:29.742904] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:39:29.743108] [DEBUG] [LOCAL ] UE: No existing data file found in primary storage. [2025-10-26T02:39:29.743179] [WARN ] [MAIN ] UE: No existing data found, performing full refresh instead. [2025-10-26T02:39:29.743291] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-26T02:39:29.743361] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-26T02:39:29.743442] [DEBUG] [LOCAL ] UE: No primary data file found to delete. [2025-10-26T02:39:29.743517] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-26T02:39:43.803991] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-26T02:39:44.185555] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-26T02:39:44.185687] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-26T02:39:44.186629] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-26T02:39:44.186725] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-26T02:39:44.187970] [DEBUG] [LOCAL ] UE: Trimmed 60961 records to 43003 (keeping 200 days of data) [2025-10-26T02:39:44.433395] [DEBUG] [LOCAL ] UE: Primary data saved (43003 records). [2025-10-26T02:39:44.433553] [INFO ] [MAIN ] UE: Full history saved. [2025-10-26T02:39:44.433754] [INFO ] [MAIN ] Update Progress: 2170/2366 symbols. UE took 14.9s. Estimated remaining time: 41m 43s [2025-10-26T02:39:44.603154] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:39:44.603382] [DEBUG] [LOCAL ] UFI: No existing data file found in primary storage. [2025-10-26T02:39:44.603456] [WARN ] [MAIN ] UFI: No existing data found, performing full refresh instead. [2025-10-26T02:39:44.603572] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-26T02:39:44.603661] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-26T02:39:44.603749] [DEBUG] [LOCAL ] UFI: No primary data file found to delete. [2025-10-26T02:39:44.603815] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-26T02:39:52.064583] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-26T02:39:52.425565] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-26T02:39:52.425731] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-26T02:39:52.426203] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-26T02:39:52.426286] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-26T02:39:52.426860] [DEBUG] [LOCAL ] UFI: Trimmed 12373 records to 8278 (keeping 200 days of data) [2025-10-26T02:39:52.473032] [DEBUG] [LOCAL ] UFI: Primary data saved (8278 records). [2025-10-26T02:39:52.473210] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-26T02:39:52.473393] [INFO ] [MAIN ] Update Progress: 2171/2366 symbols. UFI took 8.0s. Estimated remaining time: 41m 30s [2025-10-26T02:39:52.638432] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:39:52.638618] [DEBUG] [LOCAL ] UGI: No existing data file found in primary storage. [2025-10-26T02:39:52.638711] [WARN ] [MAIN ] UGI: No existing data found, performing full refresh instead. [2025-10-26T02:39:52.638822] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-26T02:39:52.638893] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-26T02:39:52.638975] [DEBUG] [LOCAL ] UGI: No primary data file found to delete. [2025-10-26T02:39:52.639044] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-26T02:40:08.969341] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-26T02:40:09.382039] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-26T02:40:09.382212] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-26T02:40:09.384208] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-26T02:40:09.384311] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-26T02:40:09.386417] [DEBUG] [LOCAL ] UGI: Trimmed 73392 records to 51162 (keeping 200 days of data) [2025-10-26T02:40:09.710700] [DEBUG] [LOCAL ] UGI: Primary data saved (51162 records). [2025-10-26T02:40:09.710902] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-26T02:40:09.711104] [INFO ] [MAIN ] Update Progress: 2172/2366 symbols. UGI took 17.2s. Estimated remaining time: 41m 18s [2025-10-26T02:40:09.895483] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:40:09.895724] [DEBUG] [LOCAL ] UGP: No existing data file found in primary storage. [2025-10-26T02:40:09.895800] [WARN ] [MAIN ] UGP: No existing data found, performing full refresh instead. [2025-10-26T02:40:09.895917] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-26T02:40:09.895991] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-26T02:40:09.896073] [DEBUG] [LOCAL ] UGP: No primary data file found to delete. [2025-10-26T02:40:09.896144] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-26T02:40:25.655444] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-26T02:40:26.047159] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-26T02:40:26.047290] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-26T02:40:26.048730] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-26T02:40:26.048817] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-26T02:40:26.050139] [DEBUG] [LOCAL ] UGP: Trimmed 62219 records to 43667 (keeping 200 days of data) [2025-10-26T02:40:26.286380] [DEBUG] [LOCAL ] UGP: Primary data saved (43667 records). [2025-10-26T02:40:26.286536] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-26T02:40:26.286734] [INFO ] [MAIN ] Update Progress: 2173/2366 symbols. UGP took 16.6s. Estimated remaining time: 41m 5s [2025-10-26T02:40:26.455983] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:40:26.456224] [DEBUG] [LOCAL ] UHAL: No existing data file found in primary storage. [2025-10-26T02:40:26.456298] [WARN ] [MAIN ] UHAL: No existing data found, performing full refresh instead. [2025-10-26T02:40:26.456414] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-26T02:40:26.456484] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-26T02:40:26.456563] [DEBUG] [LOCAL ] UHAL: No primary data file found to delete. [2025-10-26T02:40:26.456629] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-26T02:40:36.650803] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-26T02:40:37.022108] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-26T02:40:37.022237] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-26T02:40:37.022792] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-26T02:40:37.022875] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-26T02:40:37.023599] [DEBUG] [LOCAL ] UHAL: Trimmed 23401 records to 17058 (keeping 200 days of data) [2025-10-26T02:40:37.119356] [DEBUG] [LOCAL ] UHAL: Primary data saved (17058 records). [2025-10-26T02:40:37.119545] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-26T02:40:37.119752] [INFO ] [MAIN ] Update Progress: 2174/2366 symbols. UHAL took 10.8s. Estimated remaining time: 40m 52s [2025-10-26T02:40:37.288514] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:40:37.288740] [DEBUG] [LOCAL ] UHS: No existing data file found in primary storage. [2025-10-26T02:40:37.288812] [WARN ] [MAIN ] UHS: No existing data found, performing full refresh instead. [2025-10-26T02:40:37.288939] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-26T02:40:37.289034] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-26T02:40:37.289141] [DEBUG] [LOCAL ] UHS: No primary data file found to delete. [2025-10-26T02:40:37.289224] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-26T02:40:52.044606] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-26T02:40:52.444581] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-26T02:40:52.444712] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-26T02:40:52.445758] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-26T02:40:52.445839] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-26T02:40:52.447023] [DEBUG] [LOCAL ] UHS: Trimmed 58172 records to 40169 (keeping 200 days of data) [2025-10-26T02:40:52.687561] [DEBUG] [LOCAL ] UHS: Primary data saved (40169 records). [2025-10-26T02:40:52.687738] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-26T02:40:52.687944] [INFO ] [MAIN ] Update Progress: 2175/2366 symbols. UHS took 15.6s. Estimated remaining time: 40m 40s [2025-10-26T02:40:52.860765] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:40:52.861020] [DEBUG] [LOCAL ] UHT: No existing data file found in primary storage. [2025-10-26T02:40:52.861138] [WARN ] [MAIN ] UHT: No existing data found, performing full refresh instead. [2025-10-26T02:40:52.861284] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-26T02:40:52.861359] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-26T02:40:52.861452] [DEBUG] [LOCAL ] UHT: No primary data file found to delete. [2025-10-26T02:40:52.861522] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-26T02:41:00.665668] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-26T02:41:01.042336] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-26T02:41:01.042483] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-26T02:41:01.042933] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-26T02:41:01.043016] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-26T02:41:01.043748] [DEBUG] [LOCAL ] UHT: Trimmed 15019 records to 10342 (keeping 200 days of data) [2025-10-26T02:41:01.104865] [DEBUG] [LOCAL ] UHT: Primary data saved (10342 records). [2025-10-26T02:41:01.105044] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-26T02:41:01.105277] [INFO ] [MAIN ] Update Progress: 2176/2366 symbols. UHT took 8.4s. Estimated remaining time: 40m 27s [2025-10-26T02:41:01.271937] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:41:01.272145] [DEBUG] [LOCAL ] UI: No existing data file found in primary storage. [2025-10-26T02:41:01.272238] [WARN ] [MAIN ] UI: No existing data found, performing full refresh instead. [2025-10-26T02:41:01.272386] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-26T02:41:01.272485] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-26T02:41:01.272593] [DEBUG] [LOCAL ] UI: No primary data file found to delete. [2025-10-26T02:41:01.272705] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-26T02:41:11.207269] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-26T02:41:11.593830] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-26T02:41:11.593966] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-26T02:41:11.594506] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-26T02:41:11.594590] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-26T02:41:11.595497] [DEBUG] [LOCAL ] UI: Trimmed 19845 records to 14418 (keeping 200 days of data) [2025-10-26T02:41:11.685763] [DEBUG] [LOCAL ] UI: Primary data saved (14418 records). [2025-10-26T02:41:11.685925] [INFO ] [MAIN ] UI: Full history saved. [2025-10-26T02:41:11.686109] [INFO ] [MAIN ] Update Progress: 2177/2366 symbols. UI took 10.6s. Estimated remaining time: 40m 14s [2025-10-26T02:41:11.864077] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:41:11.864278] [DEBUG] [LOCAL ] UIS: No existing data file found in primary storage. [2025-10-26T02:41:11.864353] [WARN ] [MAIN ] UIS: No existing data found, performing full refresh instead. [2025-10-26T02:41:11.864470] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-26T02:41:11.864544] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-26T02:41:11.864629] [DEBUG] [LOCAL ] UIS: No primary data file found to delete. [2025-10-26T02:41:11.864723] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-26T02:41:26.503867] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-26T02:41:26.898487] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-26T02:41:26.898626] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-26T02:41:26.899684] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-26T02:41:26.899768] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-26T02:41:26.900988] [DEBUG] [LOCAL ] UIS: Trimmed 52015 records to 37070 (keeping 200 days of data) [2025-10-26T02:41:27.100677] [DEBUG] [LOCAL ] UIS: Primary data saved (37070 records). [2025-10-26T02:41:27.100863] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-26T02:41:27.101041] [INFO ] [MAIN ] Update Progress: 2178/2366 symbols. UIS took 15.4s. Estimated remaining time: 40m 1s [2025-10-26T02:41:27.268981] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:41:27.269179] [DEBUG] [LOCAL ] UL: No existing data file found in primary storage. [2025-10-26T02:41:27.269249] [WARN ] [MAIN ] UL: No existing data found, performing full refresh instead. [2025-10-26T02:41:27.269362] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-26T02:41:27.269431] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-26T02:41:27.269517] [DEBUG] [LOCAL ] UL: No primary data file found to delete. [2025-10-26T02:41:27.269596] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-26T02:41:46.154973] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-26T02:41:46.543935] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-26T02:41:46.544051] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-26T02:41:46.545241] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-26T02:41:46.545322] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-26T02:41:46.546782] [DEBUG] [LOCAL ] UL: Trimmed 77077 records to 53844 (keeping 200 days of data) [2025-10-26T02:41:46.856006] [DEBUG] [LOCAL ] UL: Primary data saved (53844 records). [2025-10-26T02:41:46.856167] [INFO ] [MAIN ] UL: Full history saved. [2025-10-26T02:41:46.856350] [INFO ] [MAIN ] Update Progress: 2179/2366 symbols. UL took 19.8s. Estimated remaining time: 39m 49s [2025-10-26T02:41:47.022668] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:41:47.022839] [DEBUG] [LOCAL ] ULS: No existing data file found in primary storage. [2025-10-26T02:41:47.022910] [WARN ] [MAIN ] ULS: No existing data found, performing full refresh instead. [2025-10-26T02:41:47.023020] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-26T02:41:47.023091] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-26T02:41:47.023177] [DEBUG] [LOCAL ] ULS: No primary data file found to delete. [2025-10-26T02:41:47.023247] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-26T02:42:00.895395] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-26T02:42:01.308845] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-26T02:42:01.308993] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-26T02:42:01.310542] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-26T02:42:01.310629] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-26T02:42:01.312257] [DEBUG] [LOCAL ] ULS: Trimmed 53725 records to 38913 (keeping 200 days of data) [2025-10-26T02:42:01.556682] [DEBUG] [LOCAL ] ULS: Primary data saved (38913 records). [2025-10-26T02:42:01.556870] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-26T02:42:01.557064] [INFO ] [MAIN ] Update Progress: 2180/2366 symbols. ULS took 14.7s. Estimated remaining time: 39m 36s [2025-10-26T02:42:01.733549] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:42:01.733891] [DEBUG] [LOCAL ] UMC: No existing data file found in primary storage. [2025-10-26T02:42:01.733965] [WARN ] [MAIN ] UMC: No existing data found, performing full refresh instead. [2025-10-26T02:42:01.734085] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-26T02:42:01.734158] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-26T02:42:01.734242] [DEBUG] [LOCAL ] UMC: No primary data file found to delete. [2025-10-26T02:42:01.734321] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-26T02:42:19.874570] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-26T02:42:20.263256] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-26T02:42:20.263402] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-26T02:42:20.264746] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-26T02:42:20.264848] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-26T02:42:20.266402] [DEBUG] [LOCAL ] UMC: Trimmed 76658 records to 53439 (keeping 200 days of data) [2025-10-26T02:42:20.563355] [DEBUG] [LOCAL ] UMC: Primary data saved (53439 records). [2025-10-26T02:42:20.563521] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-26T02:42:20.563719] [INFO ] [MAIN ] Update Progress: 2181/2366 symbols. UMC took 19.0s. Estimated remaining time: 39m 24s [2025-10-26T02:42:20.728420] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:42:20.728620] [DEBUG] [LOCAL ] UMH: No existing data file found in primary storage. [2025-10-26T02:42:20.728709] [WARN ] [MAIN ] UMH: No existing data found, performing full refresh instead. [2025-10-26T02:42:20.728821] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-26T02:42:20.728892] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-26T02:42:20.728972] [DEBUG] [LOCAL ] UMH: No primary data file found to delete. [2025-10-26T02:42:20.729039] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-26T02:42:34.085768] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-26T02:42:34.499322] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-26T02:42:34.499480] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-26T02:42:34.500609] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-26T02:42:34.500719] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-26T02:42:34.501870] [DEBUG] [LOCAL ] UMH: Trimmed 47477 records to 34721 (keeping 200 days of data) [2025-10-26T02:42:34.712089] [DEBUG] [LOCAL ] UMH: Primary data saved (34721 records). [2025-10-26T02:42:34.712252] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-26T02:42:34.712481] [INFO ] [MAIN ] Update Progress: 2182/2366 symbols. UMH took 14.1s. Estimated remaining time: 39m 12s [2025-10-26T02:42:34.885525] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:42:34.885757] [DEBUG] [LOCAL ] UNF: No existing data file found in primary storage. [2025-10-26T02:42:34.885833] [WARN ] [MAIN ] UNF: No existing data found, performing full refresh instead. [2025-10-26T02:42:34.885945] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-26T02:42:34.886023] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-26T02:42:34.886102] [DEBUG] [LOCAL ] UNF: No primary data file found to delete. [2025-10-26T02:42:34.886169] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-26T02:42:43.459029] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-26T02:42:43.817924] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-26T02:42:43.818064] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-26T02:42:43.818535] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-26T02:42:43.818635] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-26T02:42:43.819360] [DEBUG] [LOCAL ] UNF: Trimmed 17890 records to 12082 (keeping 200 days of data) [2025-10-26T02:42:43.894785] [DEBUG] [LOCAL ] UNF: Primary data saved (12082 records). [2025-10-26T02:42:43.895008] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-26T02:42:43.895247] [INFO ] [MAIN ] Update Progress: 2183/2366 symbols. UNF took 9.2s. Estimated remaining time: 38m 58s [2025-10-26T02:42:44.063172] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:42:44.063397] [DEBUG] [LOCAL ] UNFI: No existing data file found in primary storage. [2025-10-26T02:42:44.063523] [WARN ] [MAIN ] UNFI: No existing data found, performing full refresh instead. [2025-10-26T02:42:44.063684] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-26T02:42:44.063774] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-26T02:42:44.063887] [DEBUG] [LOCAL ] UNFI: No primary data file found to delete. [2025-10-26T02:42:44.063974] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-26T02:42:58.706746] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-26T02:42:59.122440] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-26T02:42:59.122584] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-26T02:42:59.124446] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-26T02:42:59.124537] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-26T02:42:59.126385] [DEBUG] [LOCAL ] UNFI: Trimmed 59891 records to 43201 (keeping 200 days of data) [2025-10-26T02:42:59.382983] [DEBUG] [LOCAL ] UNFI: Primary data saved (43201 records). [2025-10-26T02:42:59.383196] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-26T02:42:59.383514] [INFO ] [MAIN ] Update Progress: 2184/2366 symbols. UNFI took 15.5s. Estimated remaining time: 38m 46s [2025-10-26T02:42:59.557631] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:42:59.557928] [DEBUG] [LOCAL ] UNH: No existing data file found in primary storage. [2025-10-26T02:42:59.558004] [WARN ] [MAIN ] UNH: No existing data found, performing full refresh instead. [2025-10-26T02:42:59.558208] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-26T02:42:59.558283] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-26T02:42:59.558368] [DEBUG] [LOCAL ] UNH: No primary data file found to delete. [2025-10-26T02:42:59.558442] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-26T02:43:23.943941] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-26T02:43:24.362029] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-26T02:43:24.362184] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-26T02:43:24.363848] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-26T02:43:24.363936] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-26T02:43:24.365928] [DEBUG] [LOCAL ] UNH: Trimmed 77960 records to 54599 (keeping 200 days of data) [2025-10-26T02:43:24.722181] [DEBUG] [LOCAL ] UNH: Primary data saved (54599 records). [2025-10-26T02:43:24.722456] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-26T02:43:24.722738] [INFO ] [MAIN ] Update Progress: 2185/2366 symbols. UNH took 25.3s. Estimated remaining time: 38m 34s [2025-10-26T02:43:24.893467] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:43:24.893797] [DEBUG] [LOCAL ] UNM: No existing data file found in primary storage. [2025-10-26T02:43:24.893875] [WARN ] [MAIN ] UNM: No existing data found, performing full refresh instead. [2025-10-26T02:43:24.894008] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-26T02:43:24.894083] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-26T02:43:24.894170] [DEBUG] [LOCAL ] UNM: No primary data file found to delete. [2025-10-26T02:43:24.894245] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-26T02:43:41.358060] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-26T02:43:41.767061] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-26T02:43:41.767235] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-26T02:43:41.769299] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-26T02:43:41.769400] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-26T02:43:41.771535] [DEBUG] [LOCAL ] UNM: Trimmed 69920 records to 48593 (keeping 200 days of data) [2025-10-26T02:43:42.095557] [DEBUG] [LOCAL ] UNM: Primary data saved (48593 records). [2025-10-26T02:43:42.095812] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-26T02:43:42.096064] [INFO ] [MAIN ] Update Progress: 2186/2366 symbols. UNM took 17.4s. Estimated remaining time: 38m 22s [2025-10-26T02:43:42.275841] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:43:42.276143] [DEBUG] [LOCAL ] UNMA: No existing data file found in primary storage. [2025-10-26T02:43:42.276219] [WARN ] [MAIN ] UNMA: No existing data found, performing full refresh instead. [2025-10-26T02:43:42.276348] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-26T02:43:42.276422] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-26T02:43:42.276503] [DEBUG] [LOCAL ] UNMA: No primary data file found to delete. [2025-10-26T02:43:42.276576] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-26T02:43:48.475022] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-26T02:43:48.827284] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-26T02:43:48.827398] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-26T02:43:48.827583] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-26T02:43:48.827690] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-26T02:43:48.828129] [DEBUG] [LOCAL ] UNMA: Trimmed 5398 records to 3442 (keeping 200 days of data) [2025-10-26T02:43:48.849016] [DEBUG] [LOCAL ] UNMA: Primary data saved (3442 records). [2025-10-26T02:43:48.849136] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-26T02:43:48.849335] [INFO ] [MAIN ] Update Progress: 2187/2366 symbols. UNMA took 6.8s. Estimated remaining time: 38m 8s [2025-10-26T02:43:49.019879] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:43:49.020102] [DEBUG] [LOCAL ] UNP: No existing data file found in primary storage. [2025-10-26T02:43:49.020187] [WARN ] [MAIN ] UNP: No existing data found, performing full refresh instead. [2025-10-26T02:43:49.020320] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-26T02:43:49.020401] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-26T02:43:49.020494] [DEBUG] [LOCAL ] UNP: No primary data file found to delete. [2025-10-26T02:43:49.020577] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-26T02:44:08.405783] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-26T02:44:08.863840] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-26T02:44:08.863979] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-26T02:44:08.865290] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-26T02:44:08.865375] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-26T02:44:08.866961] [DEBUG] [LOCAL ] UNP: Trimmed 77156 records to 54142 (keeping 200 days of data) [2025-10-26T02:44:09.254048] [DEBUG] [LOCAL ] UNP: Primary data saved (54142 records). [2025-10-26T02:44:09.254214] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-26T02:44:09.254394] [INFO ] [MAIN ] Update Progress: 2188/2366 symbols. UNP took 20.4s. Estimated remaining time: 37m 56s [2025-10-26T02:44:09.424107] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:44:09.424334] [DEBUG] [LOCAL ] UP: No existing data file found in primary storage. [2025-10-26T02:44:09.424406] [WARN ] [MAIN ] UP: No existing data found, performing full refresh instead. [2025-10-26T02:44:09.424520] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-26T02:44:09.424590] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-26T02:44:09.424696] [DEBUG] [LOCAL ] UP: No primary data file found to delete. [2025-10-26T02:44:09.424786] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-26T02:44:26.011364] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-26T02:44:26.384621] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-26T02:44:26.384748] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-26T02:44:26.385838] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-26T02:44:26.385923] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-26T02:44:26.387249] [DEBUG] [LOCAL ] UP: Trimmed 63064 records to 45147 (keeping 200 days of data) [2025-10-26T02:44:26.631442] [DEBUG] [LOCAL ] UP: Primary data saved (45147 records). [2025-10-26T02:44:26.631673] [INFO ] [MAIN ] UP: Full history saved. [2025-10-26T02:44:26.631935] [INFO ] [MAIN ] Update Progress: 2189/2366 symbols. UP took 17.4s. Estimated remaining time: 37m 44s [2025-10-26T02:44:26.815874] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:44:26.816085] [DEBUG] [LOCAL ] UPS: No existing data file found in primary storage. [2025-10-26T02:44:26.816162] [WARN ] [MAIN ] UPS: No existing data found, performing full refresh instead. [2025-10-26T02:44:26.816288] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-26T02:44:26.816361] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-26T02:44:26.816441] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-10-26T02:44:26.816512] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-26T02:44:48.542678] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-26T02:44:48.955927] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-26T02:44:48.956105] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-26T02:44:48.957846] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-26T02:44:48.957967] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-26T02:44:48.960196] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 54501 (keeping 200 days of data) [2025-10-26T02:44:49.300073] [DEBUG] [LOCAL ] UPS: Primary data saved (54501 records). [2025-10-26T02:44:49.300308] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-26T02:44:49.300555] [INFO ] [MAIN ] Update Progress: 2190/2366 symbols. UPS took 22.7s. Estimated remaining time: 37m 32s [2025-10-26T02:44:49.482808] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:44:49.483169] [DEBUG] [LOCAL ] URI: No existing data file found in primary storage. [2025-10-26T02:44:49.483252] [WARN ] [MAIN ] URI: No existing data found, performing full refresh instead. [2025-10-26T02:44:49.483389] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-26T02:44:49.483466] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-26T02:44:49.483555] [DEBUG] [LOCAL ] URI: No primary data file found to delete. [2025-10-26T02:44:49.483632] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-26T02:45:04.592114] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-26T02:45:05.028836] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-26T02:45:05.028974] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-26T02:45:05.029952] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-26T02:45:05.030033] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-26T02:45:05.031145] [DEBUG] [LOCAL ] URI: Trimmed 52714 records to 34924 (keeping 200 days of data) [2025-10-26T02:45:05.240585] [DEBUG] [LOCAL ] URI: Primary data saved (34924 records). [2025-10-26T02:45:05.240770] [INFO ] [MAIN ] URI: Full history saved. [2025-10-26T02:45:05.240950] [INFO ] [MAIN ] Update Progress: 2191/2366 symbols. URI took 15.9s. Estimated remaining time: 37m 19s [2025-10-26T02:45:05.406606] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:45:05.406865] [DEBUG] [LOCAL ] USA: No existing data file found in primary storage. [2025-10-26T02:45:05.406938] [WARN ] [MAIN ] USA: No existing data found, performing full refresh instead. [2025-10-26T02:45:05.407052] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-26T02:45:05.407123] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-26T02:45:05.407204] [DEBUG] [LOCAL ] USA: No primary data file found to delete. [2025-10-26T02:45:05.407275] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-26T02:45:20.456490] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-26T02:45:20.830076] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-26T02:45:20.830193] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-26T02:45:20.831125] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-26T02:45:20.831205] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-26T02:45:20.832343] [DEBUG] [LOCAL ] USA: Trimmed 52514 records to 36914 (keeping 200 days of data) [2025-10-26T02:45:21.034000] [DEBUG] [LOCAL ] USA: Primary data saved (36914 records). [2025-10-26T02:45:21.034157] [INFO ] [MAIN ] USA: Full history saved. [2025-10-26T02:45:21.034335] [INFO ] [MAIN ] Update Progress: 2192/2366 symbols. USA took 15.8s. Estimated remaining time: 37m 7s [2025-10-26T02:45:21.199256] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:45:21.199439] [DEBUG] [LOCAL ] USAC: No existing data file found in primary storage. [2025-10-26T02:45:21.199511] [WARN ] [MAIN ] USAC: No existing data found, performing full refresh instead. [2025-10-26T02:45:21.199621] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-26T02:45:21.199717] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-26T02:45:21.199802] [DEBUG] [LOCAL ] USAC: No primary data file found to delete. [2025-10-26T02:45:21.199870] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-26T02:45:33.077941] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-26T02:45:33.445961] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-26T02:45:33.446078] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-26T02:45:33.446830] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-26T02:45:33.446907] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-26T02:45:33.447794] [DEBUG] [LOCAL ] USAC: Trimmed 35363 records to 22044 (keeping 200 days of data) [2025-10-26T02:45:33.572274] [DEBUG] [LOCAL ] USAC: Primary data saved (22044 records). [2025-10-26T02:45:33.572427] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-26T02:45:33.572606] [INFO ] [MAIN ] Update Progress: 2193/2366 symbols. USAC took 12.5s. Estimated remaining time: 36m 54s [2025-10-26T02:45:33.746710] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:45:33.747145] [DEBUG] [LOCAL ] USB: No existing data file found in primary storage. [2025-10-26T02:45:33.747219] [WARN ] [MAIN ] USB: No existing data found, performing full refresh instead. [2025-10-26T02:45:33.747334] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-26T02:45:33.747406] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-26T02:45:33.747490] [DEBUG] [LOCAL ] USB: No primary data file found to delete. [2025-10-26T02:45:33.747559] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-26T02:45:51.714697] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-26T02:45:52.120937] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-26T02:45:52.121055] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-26T02:45:52.122238] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-26T02:45:52.122360] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-26T02:45:52.123815] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 54468 (keeping 200 days of data) [2025-10-26T02:45:52.447219] [DEBUG] [LOCAL ] USB: Primary data saved (54468 records). [2025-10-26T02:45:52.447390] [INFO ] [MAIN ] USB: Full history saved. [2025-10-26T02:45:52.447587] [INFO ] [MAIN ] Update Progress: 2194/2366 symbols. USB took 18.9s. Estimated remaining time: 36m 42s [2025-10-26T02:45:52.622043] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:45:52.622267] [DEBUG] [LOCAL ] USFD: No existing data file found in primary storage. [2025-10-26T02:45:52.622355] [WARN ] [MAIN ] USFD: No existing data found, performing full refresh instead. [2025-10-26T02:45:52.622494] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-26T02:45:52.622584] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-26T02:45:52.622719] [DEBUG] [LOCAL ] USFD: No primary data file found to delete. [2025-10-26T02:45:52.622803] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-26T02:46:09.845864] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-26T02:46:10.243968] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-26T02:46:10.244077] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-26T02:46:10.245239] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-26T02:46:10.245319] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-26T02:46:10.246733] [DEBUG] [LOCAL ] USFD: Trimmed 74295 records to 51851 (keeping 200 days of data) [2025-10-26T02:46:10.539699] [DEBUG] [LOCAL ] USFD: Primary data saved (51851 records). [2025-10-26T02:46:10.539858] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-26T02:46:10.540043] [INFO ] [MAIN ] Update Progress: 2195/2366 symbols. USFD took 18.1s. Estimated remaining time: 36m 29s [2025-10-26T02:46:10.711261] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:46:10.711448] [DEBUG] [LOCAL ] USNA: No existing data file found in primary storage. [2025-10-26T02:46:10.711518] [WARN ] [MAIN ] USNA: No existing data found, performing full refresh instead. [2025-10-26T02:46:10.711627] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-26T02:46:10.711727] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-26T02:46:10.711809] [DEBUG] [LOCAL ] USNA: No primary data file found to delete. [2025-10-26T02:46:10.711887] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-26T02:46:20.858310] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-26T02:46:21.232449] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-26T02:46:21.232581] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-26T02:46:21.233199] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-26T02:46:21.233277] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-26T02:46:21.234192] [DEBUG] [LOCAL ] USNA: Trimmed 27251 records to 18372 (keeping 200 days of data) [2025-10-26T02:46:21.334722] [DEBUG] [LOCAL ] USNA: Primary data saved (18372 records). [2025-10-26T02:46:21.334881] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-26T02:46:21.335061] [INFO ] [MAIN ] Update Progress: 2196/2366 symbols. USNA took 10.8s. Estimated remaining time: 36m 16s [2025-10-26T02:46:21.505241] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:46:21.505449] [DEBUG] [LOCAL ] USPH: No existing data file found in primary storage. [2025-10-26T02:46:21.505521] [WARN ] [MAIN ] USPH: No existing data found, performing full refresh instead. [2025-10-26T02:46:21.505635] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-26T02:46:21.505754] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-26T02:46:21.505817] [DEBUG] [LOCAL ] USPH: No primary data file found to delete. [2025-10-26T02:46:21.505866] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-26T02:46:32.052721] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-26T02:46:32.442426] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-26T02:46:32.442581] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-26T02:46:32.443470] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-26T02:46:32.443555] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-26T02:46:32.444518] [DEBUG] [LOCAL ] USPH: Trimmed 22976 records to 17161 (keeping 200 days of data) [2025-10-26T02:46:32.552199] [DEBUG] [LOCAL ] USPH: Primary data saved (17161 records). [2025-10-26T02:46:32.552485] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-26T02:46:32.552774] [INFO ] [MAIN ] Update Progress: 2197/2366 symbols. USPH took 11.2s. Estimated remaining time: 36m 3s [2025-10-26T02:46:32.737119] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:46:32.737460] [DEBUG] [LOCAL ] UTF: No existing data file found in primary storage. [2025-10-26T02:46:32.737540] [WARN ] [MAIN ] UTF: No existing data found, performing full refresh instead. [2025-10-26T02:46:32.737699] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-26T02:46:32.737804] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-26T02:46:32.737892] [DEBUG] [LOCAL ] UTF: No primary data file found to delete. [2025-10-26T02:46:32.737969] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-26T02:46:47.148492] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-26T02:46:47.520704] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-26T02:46:47.520820] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-26T02:46:47.521723] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-26T02:46:47.521803] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-26T02:46:47.522870] [DEBUG] [LOCAL ] UTF: Trimmed 44082 records to 31575 (keeping 200 days of data) [2025-10-26T02:46:47.706810] [DEBUG] [LOCAL ] UTF: Primary data saved (31575 records). [2025-10-26T02:46:47.706974] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-26T02:46:47.707159] [INFO ] [MAIN ] Update Progress: 2198/2366 symbols. UTF took 15.2s. Estimated remaining time: 35m 51s [2025-10-26T02:46:47.881779] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:46:47.881959] [DEBUG] [LOCAL ] UTI: No existing data file found in primary storage. [2025-10-26T02:46:47.882038] [WARN ] [MAIN ] UTI: No existing data found, performing full refresh instead. [2025-10-26T02:46:47.882161] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-26T02:46:47.882236] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-26T02:46:47.882315] [DEBUG] [LOCAL ] UTI: No primary data file found to delete. [2025-10-26T02:46:47.882385] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-26T02:47:04.264425] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-26T02:47:04.638259] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-26T02:47:04.638382] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-26T02:47:04.639465] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-26T02:47:04.639544] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-26T02:47:04.640736] [DEBUG] [LOCAL ] UTI: Trimmed 59014 records to 40977 (keeping 200 days of data) [2025-10-26T02:47:04.868938] [DEBUG] [LOCAL ] UTI: Primary data saved (40977 records). [2025-10-26T02:47:04.869088] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-26T02:47:04.869317] [INFO ] [MAIN ] Update Progress: 2199/2366 symbols. UTI took 17.2s. Estimated remaining time: 35m 38s [2025-10-26T02:47:05.033200] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:47:05.033400] [DEBUG] [LOCAL ] UTL: No existing data file found in primary storage. [2025-10-26T02:47:05.033474] [WARN ] [MAIN ] UTL: No existing data found, performing full refresh instead. [2025-10-26T02:47:05.033585] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-26T02:47:05.033678] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-26T02:47:05.033762] [DEBUG] [LOCAL ] UTL: No primary data file found to delete. [2025-10-26T02:47:05.033829] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-26T02:47:13.625858] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-26T02:47:13.987265] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-26T02:47:13.987404] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-26T02:47:13.987875] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-26T02:47:13.987971] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-26T02:47:13.988614] [DEBUG] [LOCAL ] UTL: Trimmed 15830 records to 11946 (keeping 200 days of data) [2025-10-26T02:47:14.056285] [DEBUG] [LOCAL ] UTL: Primary data saved (11946 records). [2025-10-26T02:47:14.056471] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-26T02:47:14.056693] [INFO ] [MAIN ] Update Progress: 2200/2366 symbols. UTL took 9.2s. Estimated remaining time: 35m 25s [2025-10-26T02:47:14.223791] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:47:14.223997] [DEBUG] [LOCAL ] UTZ: No existing data file found in primary storage. [2025-10-26T02:47:14.224079] [WARN ] [MAIN ] UTZ: No existing data found, performing full refresh instead. [2025-10-26T02:47:14.224208] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-26T02:47:14.224294] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-26T02:47:14.224401] [DEBUG] [LOCAL ] UTZ: No primary data file found to delete. [2025-10-26T02:47:14.224486] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-26T02:47:32.500832] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-26T02:47:32.883551] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-26T02:47:32.883685] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-26T02:47:32.884809] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-26T02:47:32.884896] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-26T02:47:32.886260] [DEBUG] [LOCAL ] UTZ: Trimmed 64391 records to 44785 (keeping 200 days of data) [2025-10-26T02:47:33.144355] [DEBUG] [LOCAL ] UTZ: Primary data saved (44785 records). [2025-10-26T02:47:33.144511] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-26T02:47:33.144710] [INFO ] [MAIN ] Update Progress: 2201/2366 symbols. UTZ took 19.1s. Estimated remaining time: 35m 13s [2025-10-26T02:47:33.314461] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:47:33.314679] [DEBUG] [LOCAL ] UVE: No existing data file found in primary storage. [2025-10-26T02:47:33.314755] [WARN ] [MAIN ] UVE: No existing data found, performing full refresh instead. [2025-10-26T02:47:33.314874] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-26T02:47:33.314945] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-26T02:47:33.315025] [DEBUG] [LOCAL ] UVE: No primary data file found to delete. [2025-10-26T02:47:33.315091] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-26T02:47:45.086440] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-26T02:47:45.458613] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-26T02:47:45.458870] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-26T02:47:45.459611] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-26T02:47:45.459752] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-26T02:47:45.460614] [DEBUG] [LOCAL ] UVE: Trimmed 30438 records to 22288 (keeping 200 days of data) [2025-10-26T02:47:45.586817] [DEBUG] [LOCAL ] UVE: Primary data saved (22288 records). [2025-10-26T02:47:45.586990] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-26T02:47:45.587246] [INFO ] [MAIN ] Update Progress: 2202/2366 symbols. UVE took 12.4s. Estimated remaining time: 35m 0s [2025-10-26T02:47:45.753074] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:47:45.753284] [DEBUG] [LOCAL ] UVV: No existing data file found in primary storage. [2025-10-26T02:47:45.753371] [WARN ] [MAIN ] UVV: No existing data found, performing full refresh instead. [2025-10-26T02:47:45.753521] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-26T02:47:45.753606] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-26T02:47:45.753739] [DEBUG] [LOCAL ] UVV: No primary data file found to delete. [2025-10-26T02:47:45.753821] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-26T02:47:59.618414] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-26T02:47:59.984557] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-26T02:47:59.984724] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-26T02:47:59.985403] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-26T02:47:59.985486] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-26T02:47:59.986296] [DEBUG] [LOCAL ] UVV: Trimmed 30187 records to 22966 (keeping 200 days of data) [2025-10-26T02:48:00.123239] [DEBUG] [LOCAL ] UVV: Primary data saved (22966 records). [2025-10-26T02:48:00.123398] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-26T02:48:00.123585] [INFO ] [MAIN ] Update Progress: 2203/2366 symbols. UVV took 14.5s. Estimated remaining time: 34m 47s [2025-10-26T02:48:00.289835] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:48:00.290052] [DEBUG] [LOCAL ] UWMC: No existing data file found in primary storage. [2025-10-26T02:48:00.290125] [WARN ] [MAIN ] UWMC: No existing data found, performing full refresh instead. [2025-10-26T02:48:00.290233] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-26T02:48:00.290303] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-26T02:48:00.290371] [DEBUG] [LOCAL ] UWMC: No primary data file found to delete. [2025-10-26T02:48:00.290433] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-26T02:48:18.724464] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-26T02:48:19.110253] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-26T02:48:19.110403] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-26T02:48:19.111566] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-26T02:48:19.111682] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-26T02:48:19.113100] [DEBUG] [LOCAL ] UWMC: Trimmed 75938 records to 53737 (keeping 200 days of data) [2025-10-26T02:48:19.410371] [DEBUG] [LOCAL ] UWMC: Primary data saved (53737 records). [2025-10-26T02:48:19.410534] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-26T02:48:19.410737] [INFO ] [MAIN ] Update Progress: 2204/2366 symbols. UWMC took 19.3s. Estimated remaining time: 34m 35s [2025-10-26T02:48:19.578125] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:48:19.578346] [DEBUG] [LOCAL ] UZD: No existing data file found in primary storage. [2025-10-26T02:48:19.578427] [WARN ] [MAIN ] UZD: No existing data found, performing full refresh instead. [2025-10-26T02:48:19.578555] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-26T02:48:19.578625] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-26T02:48:19.578722] [DEBUG] [LOCAL ] UZD: No primary data file found to delete. [2025-10-26T02:48:19.578789] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-26T02:48:26.233098] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-26T02:48:26.610516] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-26T02:48:26.610627] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-26T02:48:26.610952] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-26T02:48:26.611029] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-26T02:48:26.611493] [DEBUG] [LOCAL ] UZD: Trimmed 8783 records to 5808 (keeping 200 days of data) [2025-10-26T02:48:26.646557] [DEBUG] [LOCAL ] UZD: Primary data saved (5808 records). [2025-10-26T02:48:26.646739] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-26T02:48:26.646930] [INFO ] [MAIN ] Update Progress: 2205/2366 symbols. UZD took 7.2s. Estimated remaining time: 34m 22s [2025-10-26T02:48:26.820732] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:48:26.820946] [DEBUG] [LOCAL ] UZE: No existing data file found in primary storage. [2025-10-26T02:48:26.821019] [WARN ] [MAIN ] UZE: No existing data found, performing full refresh instead. [2025-10-26T02:48:26.821136] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-26T02:48:26.821209] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-26T02:48:26.821295] [DEBUG] [LOCAL ] UZE: No primary data file found to delete. [2025-10-26T02:48:26.821366] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-26T02:48:34.121707] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-26T02:48:34.476394] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-26T02:48:34.476504] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-26T02:48:34.476783] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-26T02:48:34.476862] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-26T02:48:34.477277] [DEBUG] [LOCAL ] UZE: Trimmed 9691 records to 6962 (keeping 200 days of data) [2025-10-26T02:48:34.517634] [DEBUG] [LOCAL ] UZE: Primary data saved (6962 records). [2025-10-26T02:48:34.517810] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-26T02:48:34.517991] [INFO ] [MAIN ] Update Progress: 2206/2366 symbols. UZE took 7.9s. Estimated remaining time: 34m 9s [2025-10-26T02:48:34.682791] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:48:34.682949] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-26T02:48:34.682998] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-26T02:48:34.683100] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-26T02:48:34.683168] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-26T02:48:34.683248] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-26T02:48:34.683322] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-26T02:48:41.255838] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-26T02:48:41.432201] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T02:48:41.432441] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-26T02:48:41.432529] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-26T02:48:41.432582] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-26T02:48:41.432669] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-26T02:48:41.432783] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-26T02:48:41.432867] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-26T02:48:41.433032] [INFO ] [MAIN ] Update Progress: 2207/2366 symbols. UZF took 6.9s. Estimated remaining time: 33m 55s [2025-10-26T02:48:41.597525] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:48:41.597726] [DEBUG] [LOCAL ] V: No existing data file found in primary storage. [2025-10-26T02:48:41.597797] [WARN ] [MAIN ] V: No existing data found, performing full refresh instead. [2025-10-26T02:48:41.597911] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-26T02:48:41.597980] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-26T02:48:41.598040] [DEBUG] [LOCAL ] V: No primary data file found to delete. [2025-10-26T02:48:41.598100] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-26T02:49:03.128149] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-26T02:49:03.511933] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-26T02:49:03.512069] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-26T02:49:03.513244] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-26T02:49:03.513329] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-26T02:49:03.514801] [DEBUG] [LOCAL ] V: Trimmed 77922 records to 54526 (keeping 200 days of data) [2025-10-26T02:49:03.839424] [DEBUG] [LOCAL ] V: Primary data saved (54526 records). [2025-10-26T02:49:03.839598] [INFO ] [MAIN ] V: Full history saved. [2025-10-26T02:49:03.839804] [INFO ] [MAIN ] Update Progress: 2208/2366 symbols. V took 22.4s. Estimated remaining time: 33m 43s [2025-10-26T02:49:04.015836] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:49:04.016044] [DEBUG] [LOCAL ] VAC: No existing data file found in primary storage. [2025-10-26T02:49:04.016118] [WARN ] [MAIN ] VAC: No existing data found, performing full refresh instead. [2025-10-26T02:49:04.016233] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-26T02:49:04.016305] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-26T02:49:04.016388] [DEBUG] [LOCAL ] VAC: No primary data file found to delete. [2025-10-26T02:49:04.016459] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-26T02:49:17.753520] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-26T02:49:18.131937] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-26T02:49:18.132053] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-26T02:49:18.133031] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-26T02:49:18.133109] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-26T02:49:18.134210] [DEBUG] [LOCAL ] VAC: Trimmed 48775 records to 34142 (keeping 200 days of data) [2025-10-26T02:49:18.333225] [DEBUG] [LOCAL ] VAC: Primary data saved (34142 records). [2025-10-26T02:49:18.333384] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-26T02:49:18.333566] [INFO ] [MAIN ] Update Progress: 2209/2366 symbols. VAC took 14.5s. Estimated remaining time: 33m 31s [2025-10-26T02:49:18.501166] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:49:18.501358] [DEBUG] [LOCAL ] VAL: No existing data file found in primary storage. [2025-10-26T02:49:18.501435] [WARN ] [MAIN ] VAL: No existing data found, performing full refresh instead. [2025-10-26T02:49:18.501553] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-26T02:49:18.501620] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-26T02:49:18.501721] [DEBUG] [LOCAL ] VAL: No primary data file found to delete. [2025-10-26T02:49:18.501791] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-26T02:49:35.552390] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-26T02:49:35.969969] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-26T02:49:35.970139] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-26T02:49:35.972242] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-26T02:49:35.972368] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-26T02:49:35.974562] [DEBUG] [LOCAL ] VAL: Trimmed 72939 records to 50604 (keeping 200 days of data) [2025-10-26T02:49:36.283074] [DEBUG] [LOCAL ] VAL: Primary data saved (50604 records). [2025-10-26T02:49:36.283335] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-26T02:49:36.283612] [INFO ] [MAIN ] Update Progress: 2210/2366 symbols. VAL took 17.9s. Estimated remaining time: 33m 18s [2025-10-26T02:49:36.459179] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:49:36.459459] [DEBUG] [LOCAL ] VALE: No existing data file found in primary storage. [2025-10-26T02:49:36.459539] [WARN ] [MAIN ] VALE: No existing data found, performing full refresh instead. [2025-10-26T02:49:36.459694] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-26T02:49:36.459771] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-26T02:49:36.459857] [DEBUG] [LOCAL ] VALE: No primary data file found to delete. [2025-10-26T02:49:36.459931] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-26T02:49:56.519384] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-26T02:49:56.926448] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-26T02:49:56.926571] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-26T02:49:56.927766] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-26T02:49:56.927849] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-26T02:49:56.929284] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 54473 (keeping 200 days of data) [2025-10-26T02:49:57.248197] [DEBUG] [LOCAL ] VALE: Primary data saved (54473 records). [2025-10-26T02:49:57.248361] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-26T02:49:57.248535] [INFO ] [MAIN ] Update Progress: 2211/2366 symbols. VALE took 21.0s. Estimated remaining time: 33m 6s [2025-10-26T02:49:57.429142] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:49:57.429362] [DEBUG] [LOCAL ] VATE: No existing data file found in primary storage. [2025-10-26T02:49:57.429436] [WARN ] [MAIN ] VATE: No existing data found, performing full refresh instead. [2025-10-26T02:49:57.429562] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-26T02:49:57.429638] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-26T02:49:57.429747] [DEBUG] [LOCAL ] VATE: No primary data file found to delete. [2025-10-26T02:49:57.429821] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-26T02:50:04.994975] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-26T02:50:05.388081] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-26T02:50:05.388217] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-26T02:50:05.388519] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-26T02:50:05.388595] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-26T02:50:05.389073] [DEBUG] [LOCAL ] VATE: Trimmed 10679 records to 5125 (keeping 200 days of data) [2025-10-26T02:50:05.416902] [DEBUG] [LOCAL ] VATE: Primary data saved (5125 records). [2025-10-26T02:50:05.417065] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-26T02:50:05.417302] [INFO ] [MAIN ] Update Progress: 2212/2366 symbols. VATE took 8.2s. Estimated remaining time: 32m 53s [2025-10-26T02:50:05.635047] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:50:05.635346] [DEBUG] [LOCAL ] VBF: No existing data file found in primary storage. [2025-10-26T02:50:05.635423] [WARN ] [MAIN ] VBF: No existing data found, performing full refresh instead. [2025-10-26T02:50:05.635574] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-26T02:50:05.635711] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-26T02:50:05.635830] [DEBUG] [LOCAL ] VBF: No primary data file found to delete. [2025-10-26T02:50:05.635907] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-26T02:50:13.719841] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-26T02:50:14.071948] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-26T02:50:14.072055] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-26T02:50:14.072313] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-26T02:50:14.072387] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-26T02:50:14.072881] [DEBUG] [LOCAL ] VBF: Trimmed 10926 records to 7259 (keeping 200 days of data) [2025-10-26T02:50:14.114398] [DEBUG] [LOCAL ] VBF: Primary data saved (7259 records). [2025-10-26T02:50:14.114506] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-26T02:50:14.114683] [INFO ] [MAIN ] Update Progress: 2213/2366 symbols. VBF took 8.7s. Estimated remaining time: 32m 40s [2025-10-26T02:50:14.283586] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:50:14.283784] [DEBUG] [LOCAL ] VCV: No existing data file found in primary storage. [2025-10-26T02:50:14.283854] [WARN ] [MAIN ] VCV: No existing data found, performing full refresh instead. [2025-10-26T02:50:14.283945] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-26T02:50:14.284019] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-26T02:50:14.284074] [DEBUG] [LOCAL ] VCV: No primary data file found to delete. [2025-10-26T02:50:14.284135] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-26T02:50:22.992082] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-26T02:50:23.352120] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-26T02:50:23.352234] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-26T02:50:23.352637] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-26T02:50:23.352735] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-26T02:50:23.353309] [DEBUG] [LOCAL ] VCV: Trimmed 18356 records to 13331 (keeping 200 days of data) [2025-10-26T02:50:23.429618] [DEBUG] [LOCAL ] VCV: Primary data saved (13331 records). [2025-10-26T02:50:23.429809] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-26T02:50:23.430003] [INFO ] [MAIN ] Update Progress: 2214/2366 symbols. VCV took 9.3s. Estimated remaining time: 32m 27s [2025-10-26T02:50:23.624298] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:50:23.624561] [DEBUG] [LOCAL ] VEEV: No existing data file found in primary storage. [2025-10-26T02:50:23.624838] [WARN ] [MAIN ] VEEV: No existing data found, performing full refresh instead. [2025-10-26T02:50:23.625001] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-26T02:50:23.625093] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-26T02:50:23.625186] [DEBUG] [LOCAL ] VEEV: No primary data file found to delete. [2025-10-26T02:50:23.625270] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-26T02:50:40.434820] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-26T02:50:40.823818] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-26T02:50:40.823943] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-26T02:50:40.825067] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-26T02:50:40.825183] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-26T02:50:40.826465] [DEBUG] [LOCAL ] VEEV: Trimmed 68333 records to 47767 (keeping 200 days of data) [2025-10-26T02:50:41.100520] [DEBUG] [LOCAL ] VEEV: Primary data saved (47767 records). [2025-10-26T02:50:41.100693] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-26T02:50:41.100859] [INFO ] [MAIN ] Update Progress: 2215/2366 symbols. VEEV took 17.7s. Estimated remaining time: 32m 14s [2025-10-26T02:50:41.269622] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:50:41.269849] [DEBUG] [LOCAL ] VEL: No existing data file found in primary storage. [2025-10-26T02:50:41.269919] [WARN ] [MAIN ] VEL: No existing data found, performing full refresh instead. [2025-10-26T02:50:41.270030] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-26T02:50:41.270103] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-26T02:50:41.270199] [DEBUG] [LOCAL ] VEL: No primary data file found to delete. [2025-10-26T02:50:41.270283] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-26T02:50:49.071788] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-26T02:50:49.432469] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-26T02:50:49.432590] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-26T02:50:49.433018] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-26T02:50:49.433104] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-26T02:50:49.433673] [DEBUG] [LOCAL ] VEL: Trimmed 17173 records to 12041 (keeping 200 days of data) [2025-10-26T02:50:49.500344] [DEBUG] [LOCAL ] VEL: Primary data saved (12041 records). [2025-10-26T02:50:49.500506] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-26T02:50:49.500710] [INFO ] [MAIN ] Update Progress: 2216/2366 symbols. VEL took 8.4s. Estimated remaining time: 32m 1s [2025-10-26T02:50:49.668416] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:50:49.668608] [DEBUG] [LOCAL ] VET: No existing data file found in primary storage. [2025-10-26T02:50:49.668706] [WARN ] [MAIN ] VET: No existing data found, performing full refresh instead. [2025-10-26T02:50:49.668826] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-26T02:50:49.668900] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-26T02:50:49.668981] [DEBUG] [LOCAL ] VET: No primary data file found to delete. [2025-10-26T02:50:49.669052] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-26T02:51:05.181068] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-26T02:51:05.575849] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-26T02:51:05.575979] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-26T02:51:05.577057] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-26T02:51:05.577135] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-26T02:51:05.578397] [DEBUG] [LOCAL ] VET: Trimmed 64465 records to 44676 (keeping 200 days of data) [2025-10-26T02:51:05.832696] [DEBUG] [LOCAL ] VET: Primary data saved (44676 records). [2025-10-26T02:51:05.832897] [INFO ] [MAIN ] VET: Full history saved. [2025-10-26T02:51:05.833090] [INFO ] [MAIN ] Update Progress: 2217/2366 symbols. VET took 16.3s. Estimated remaining time: 31m 49s [2025-10-26T02:51:06.022943] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:51:06.023137] [DEBUG] [LOCAL ] VFC: No existing data file found in primary storage. [2025-10-26T02:51:06.023209] [WARN ] [MAIN ] VFC: No existing data found, performing full refresh instead. [2025-10-26T02:51:06.023320] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-26T02:51:06.023391] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-26T02:51:06.023522] [DEBUG] [LOCAL ] VFC: No primary data file found to delete. [2025-10-26T02:51:06.023595] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-26T02:51:23.664610] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-26T02:51:24.058386] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-26T02:51:24.058535] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-26T02:51:24.059960] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-26T02:51:24.060077] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-26T02:51:24.061689] [DEBUG] [LOCAL ] VFC: Trimmed 77752 records to 54386 (keeping 200 days of data) [2025-10-26T02:51:24.383274] [DEBUG] [LOCAL ] VFC: Primary data saved (54386 records). [2025-10-26T02:51:24.383457] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-26T02:51:24.383676] [INFO ] [MAIN ] Update Progress: 2218/2366 symbols. VFC took 18.6s. Estimated remaining time: 31m 36s [2025-10-26T02:51:24.553798] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:51:24.554020] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-26T02:51:24.554110] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-26T02:51:24.554250] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-26T02:51:24.554341] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-26T02:51:24.554448] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-26T02:51:24.554536] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-26T02:51:42.878022] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-10-26T02:51:43.070521] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-26T02:51:43.071280] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-10-26T02:51:43.071355] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-10-26T02:51:43.071433] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-26T02:51:43.071537] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-26T02:51:43.071610] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-26T02:51:43.071722] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-26T02:51:43.071838] [INFO ] [MAIN ] Update Progress: 2219/2366 symbols. VG took 18.7s. Estimated remaining time: 31m 24s [2025-10-26T02:51:43.241156] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:51:43.241332] [DEBUG] [LOCAL ] VGI: No existing data file found in primary storage. [2025-10-26T02:51:43.241403] [WARN ] [MAIN ] VGI: No existing data found, performing full refresh instead. [2025-10-26T02:51:43.241516] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-26T02:51:43.241586] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-26T02:51:43.241699] [DEBUG] [LOCAL ] VGI: No primary data file found to delete. [2025-10-26T02:51:43.241771] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-26T02:51:49.662945] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-26T02:51:50.021009] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-26T02:51:50.021164] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-26T02:51:50.021418] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-26T02:51:50.021495] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-26T02:51:50.021945] [DEBUG] [LOCAL ] VGI: Trimmed 7517 records to 5258 (keeping 200 days of data) [2025-10-26T02:51:50.051434] [DEBUG] [LOCAL ] VGI: Primary data saved (5258 records). [2025-10-26T02:51:50.051558] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-26T02:51:50.051777] [INFO ] [MAIN ] Update Progress: 2220/2366 symbols. VGI took 7.0s. Estimated remaining time: 31m 10s [2025-10-26T02:51:50.219028] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:51:50.219168] [DEBUG] [LOCAL ] VGM: No existing data file found in primary storage. [2025-10-26T02:51:50.219236] [WARN ] [MAIN ] VGM: No existing data found, performing full refresh instead. [2025-10-26T02:51:50.219348] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-26T02:51:50.219418] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-26T02:51:50.219497] [DEBUG] [LOCAL ] VGM: No primary data file found to delete. [2025-10-26T02:51:50.219563] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-26T02:51:59.969509] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-26T02:52:00.339726] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-26T02:52:00.339835] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-26T02:52:00.340376] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-26T02:52:00.340453] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-26T02:52:00.341214] [DEBUG] [LOCAL ] VGM: Trimmed 25702 records to 18809 (keeping 200 days of data) [2025-10-26T02:52:00.450480] [DEBUG] [LOCAL ] VGM: Primary data saved (18809 records). [2025-10-26T02:52:00.450639] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-26T02:52:00.450841] [INFO ] [MAIN ] Update Progress: 2221/2366 symbols. VGM took 10.4s. Estimated remaining time: 30m 58s [2025-10-26T02:52:00.639594] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:52:00.639819] [DEBUG] [LOCAL ] VHI: No existing data file found in primary storage. [2025-10-26T02:52:00.639890] [WARN ] [MAIN ] VHI: No existing data found, performing full refresh instead. [2025-10-26T02:52:00.640005] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-26T02:52:00.640077] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-26T02:52:00.640157] [DEBUG] [LOCAL ] VHI: No primary data file found to delete. [2025-10-26T02:52:00.640232] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-26T02:52:06.615587] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-26T02:52:06.964284] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-26T02:52:06.964396] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-26T02:52:06.964565] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-26T02:52:06.964658] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-26T02:52:06.965041] [DEBUG] [LOCAL ] VHI: Trimmed 4302 records to 2692 (keeping 200 days of data) [2025-10-26T02:52:06.981451] [DEBUG] [LOCAL ] VHI: Primary data saved (2692 records). [2025-10-26T02:52:06.981618] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-26T02:52:06.981825] [INFO ] [MAIN ] Update Progress: 2222/2366 symbols. VHI took 6.5s. Estimated remaining time: 30m 44s [2025-10-26T02:52:07.151725] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:52:07.151906] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-26T02:52:07.151978] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-26T02:52:07.152093] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-26T02:52:07.152167] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-26T02:52:07.152249] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-26T02:52:07.152321] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-26T02:52:07.728505] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-26T02:52:07.728575] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:52:07.728690] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-26T02:52:07.728786] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-26T02:52:07.728854] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-26T02:52:07.728933] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-26T02:52:07.729093] [INFO ] [MAIN ] Update Progress: 2223/2366 symbols. VIA took 0.7s. Estimated remaining time: 30m 31s [2025-10-26T02:52:07.897471] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:52:07.897717] [DEBUG] [LOCAL ] VICI: No existing data file found in primary storage. [2025-10-26T02:52:07.897788] [WARN ] [MAIN ] VICI: No existing data found, performing full refresh instead. [2025-10-26T02:52:07.897876] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-26T02:52:07.897941] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-26T02:52:07.897999] [DEBUG] [LOCAL ] VICI: No primary data file found to delete. [2025-10-26T02:52:07.898059] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-26T02:52:25.537120] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-26T02:52:25.925059] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-26T02:52:25.925176] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-26T02:52:25.926489] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-26T02:52:25.926579] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-26T02:52:25.928181] [DEBUG] [LOCAL ] VICI: Trimmed 77802 records to 54432 (keeping 200 days of data) [2025-10-26T02:52:26.248000] [DEBUG] [LOCAL ] VICI: Primary data saved (54432 records). [2025-10-26T02:52:26.248171] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-26T02:52:26.248405] [INFO ] [MAIN ] Update Progress: 2224/2366 symbols. VICI took 18.5s. Estimated remaining time: 30m 18s [2025-10-26T02:52:26.418315] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:52:26.418563] [DEBUG] [LOCAL ] VIK: No existing data file found in primary storage. [2025-10-26T02:52:26.418676] [WARN ] [MAIN ] VIK: No existing data found, performing full refresh instead. [2025-10-26T02:52:26.418833] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-26T02:52:26.418922] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-26T02:52:26.419017] [DEBUG] [LOCAL ] VIK: No primary data file found to delete. [2025-10-26T02:52:26.419101] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-26T02:52:43.224247] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-26T02:52:43.616249] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-26T02:52:43.616372] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-26T02:52:43.617533] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-26T02:52:43.617616] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-26T02:52:43.619160] [DEBUG] [LOCAL ] VIK: Trimmed 75877 records to 53049 (keeping 200 days of data) [2025-10-26T02:52:43.921016] [DEBUG] [LOCAL ] VIK: Primary data saved (53049 records). [2025-10-26T02:52:43.921206] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-26T02:52:43.921488] [INFO ] [MAIN ] Update Progress: 2225/2366 symbols. VIK took 17.7s. Estimated remaining time: 30m 6s [2025-10-26T02:52:44.090290] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:52:44.090493] [DEBUG] [LOCAL ] VIPS: No existing data file found in primary storage. [2025-10-26T02:52:44.090566] [WARN ] [MAIN ] VIPS: No existing data found, performing full refresh instead. [2025-10-26T02:52:44.090705] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-26T02:52:44.090817] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-26T02:52:44.090907] [DEBUG] [LOCAL ] VIPS: No primary data file found to delete. [2025-10-26T02:52:44.090978] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-26T02:53:01.349770] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-26T02:53:01.763962] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-26T02:53:01.764137] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-26T02:53:01.766119] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-26T02:53:01.766205] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-26T02:53:01.768327] [DEBUG] [LOCAL ] VIPS: Trimmed 74849 records to 51979 (keeping 200 days of data) [2025-10-26T02:53:02.088737] [DEBUG] [LOCAL ] VIPS: Primary data saved (51979 records). [2025-10-26T02:53:02.088960] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-26T02:53:02.089206] [INFO ] [MAIN ] Update Progress: 2226/2366 symbols. VIPS took 18.2s. Estimated remaining time: 29m 53s [2025-10-26T02:53:02.262985] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:53:02.263414] [DEBUG] [LOCAL ] VIRT: No existing data file found in primary storage. [2025-10-26T02:53:02.263489] [WARN ] [MAIN ] VIRT: No existing data found, performing full refresh instead. [2025-10-26T02:53:02.263614] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-26T02:53:02.263706] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-26T02:53:02.263791] [DEBUG] [LOCAL ] VIRT: No primary data file found to delete. [2025-10-26T02:53:02.263865] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-26T02:53:17.578926] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-26T02:53:17.973390] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-26T02:53:17.973539] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-26T02:53:17.975324] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-26T02:53:17.975413] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-26T02:53:17.977272] [DEBUG] [LOCAL ] VIRT: Trimmed 67549 records to 47117 (keeping 200 days of data) [2025-10-26T02:53:18.269268] [DEBUG] [LOCAL ] VIRT: Primary data saved (47117 records). [2025-10-26T02:53:18.269511] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-26T02:53:18.269843] [INFO ] [MAIN ] Update Progress: 2227/2366 symbols. VIRT took 16.2s. Estimated remaining time: 29m 41s [2025-10-26T02:53:18.445953] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:53:18.446241] [DEBUG] [LOCAL ] VIST: No existing data file found in primary storage. [2025-10-26T02:53:18.446319] [WARN ] [MAIN ] VIST: No existing data found, performing full refresh instead. [2025-10-26T02:53:18.446446] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-26T02:53:18.446521] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-26T02:53:18.446611] [DEBUG] [LOCAL ] VIST: No primary data file found to delete. [2025-10-26T02:53:18.446747] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-26T02:53:34.651713] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-26T02:53:35.061554] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-26T02:53:35.061735] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-26T02:53:35.063688] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-26T02:53:35.063772] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-26T02:53:35.065574] [DEBUG] [LOCAL ] VIST: Trimmed 67550 records to 47407 (keeping 200 days of data) [2025-10-26T02:53:35.349204] [DEBUG] [LOCAL ] VIST: Primary data saved (47407 records). [2025-10-26T02:53:35.349474] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-26T02:53:35.349753] [INFO ] [MAIN ] Update Progress: 2228/2366 symbols. VIST took 17.1s. Estimated remaining time: 29m 28s [2025-10-26T02:53:35.531792] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:53:35.532115] [DEBUG] [LOCAL ] VIV: No existing data file found in primary storage. [2025-10-26T02:53:35.532190] [WARN ] [MAIN ] VIV: No existing data found, performing full refresh instead. [2025-10-26T02:53:35.532341] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-26T02:53:35.532433] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-26T02:53:35.532544] [DEBUG] [LOCAL ] VIV: No primary data file found to delete. [2025-10-26T02:53:35.532621] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-26T02:53:50.797389] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-26T02:53:51.197603] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-26T02:53:51.197793] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-26T02:53:51.199796] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-26T02:53:51.199884] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-26T02:53:51.201727] [DEBUG] [LOCAL ] VIV: Trimmed 64261 records to 45137 (keeping 200 days of data) [2025-10-26T02:53:51.490248] [DEBUG] [LOCAL ] VIV: Primary data saved (45137 records). [2025-10-26T02:53:51.490495] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-26T02:53:51.490741] [INFO ] [MAIN ] Update Progress: 2229/2366 symbols. VIV took 16.1s. Estimated remaining time: 29m 16s [2025-10-26T02:53:51.673000] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:53:51.673234] [DEBUG] [LOCAL ] VKQ: No existing data file found in primary storage. [2025-10-26T02:53:51.673311] [WARN ] [MAIN ] VKQ: No existing data found, performing full refresh instead. [2025-10-26T02:53:51.673430] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-26T02:53:51.673505] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-26T02:53:51.673589] [DEBUG] [LOCAL ] VKQ: No primary data file found to delete. [2025-10-26T02:53:51.673690] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-26T02:54:02.190343] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-26T02:54:02.556374] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-26T02:54:02.556492] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-26T02:54:02.557133] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-26T02:54:02.557213] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-26T02:54:02.557992] [DEBUG] [LOCAL ] VKQ: Trimmed 24508 records to 18013 (keeping 200 days of data) [2025-10-26T02:54:02.659032] [DEBUG] [LOCAL ] VKQ: Primary data saved (18013 records). [2025-10-26T02:54:02.659198] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-26T02:54:02.659388] [INFO ] [MAIN ] Update Progress: 2230/2366 symbols. VKQ took 11.2s. Estimated remaining time: 29m 3s [2025-10-26T02:54:02.828999] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:54:02.829238] [DEBUG] [LOCAL ] VLN: No existing data file found in primary storage. [2025-10-26T02:54:02.829322] [WARN ] [MAIN ] VLN: No existing data found, performing full refresh instead. [2025-10-26T02:54:02.829452] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-26T02:54:02.829536] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-26T02:54:02.829630] [DEBUG] [LOCAL ] VLN: No primary data file found to delete. [2025-10-26T02:54:02.829737] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-26T02:54:15.768077] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-26T02:54:16.165939] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-26T02:54:16.166082] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-26T02:54:16.167010] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-26T02:54:16.167090] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-26T02:54:16.168083] [DEBUG] [LOCAL ] VLN: Trimmed 43203 records to 31504 (keeping 200 days of data) [2025-10-26T02:54:16.354405] [DEBUG] [LOCAL ] VLN: Primary data saved (31504 records). [2025-10-26T02:54:16.354585] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-26T02:54:16.354792] [INFO ] [MAIN ] Update Progress: 2231/2366 symbols. VLN took 13.7s. Estimated remaining time: 28m 50s [2025-10-26T02:54:16.523490] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:54:16.523777] [DEBUG] [LOCAL ] VLO: No existing data file found in primary storage. [2025-10-26T02:54:16.523849] [WARN ] [MAIN ] VLO: No existing data found, performing full refresh instead. [2025-10-26T02:54:16.523963] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-26T02:54:16.524034] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-26T02:54:16.524115] [DEBUG] [LOCAL ] VLO: No primary data file found to delete. [2025-10-26T02:54:16.524184] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-26T02:54:34.287566] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-26T02:54:34.670462] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-26T02:54:34.670573] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-26T02:54:34.671860] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-26T02:54:34.671947] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-26T02:54:34.673481] [DEBUG] [LOCAL ] VLO: Trimmed 76910 records to 53730 (keeping 200 days of data) [2025-10-26T02:54:35.002816] [DEBUG] [LOCAL ] VLO: Primary data saved (53730 records). [2025-10-26T02:54:35.002976] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-26T02:54:35.003241] [INFO ] [MAIN ] Update Progress: 2232/2366 symbols. VLO took 18.6s. Estimated remaining time: 28m 37s [2025-10-26T02:54:35.170715] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:54:35.170977] [DEBUG] [LOCAL ] VLRS: No existing data file found in primary storage. [2025-10-26T02:54:35.171072] [WARN ] [MAIN ] VLRS: No existing data found, performing full refresh instead. [2025-10-26T02:54:35.171221] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-26T02:54:35.171311] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-26T02:54:35.171414] [DEBUG] [LOCAL ] VLRS: No primary data file found to delete. [2025-10-26T02:54:35.171496] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-26T02:54:49.347577] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-26T02:54:49.730833] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-26T02:54:49.730957] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-26T02:54:49.732219] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-26T02:54:49.732302] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-26T02:54:49.733483] [DEBUG] [LOCAL ] VLRS: Trimmed 58351 records to 39917 (keeping 200 days of data) [2025-10-26T02:54:49.947468] [DEBUG] [LOCAL ] VLRS: Primary data saved (39917 records). [2025-10-26T02:54:49.947629] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-26T02:54:49.947862] [INFO ] [MAIN ] Update Progress: 2233/2366 symbols. VLRS took 14.9s. Estimated remaining time: 28m 25s [2025-10-26T02:54:50.120045] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:54:50.120248] [DEBUG] [LOCAL ] VLT: No existing data file found in primary storage. [2025-10-26T02:54:50.120321] [WARN ] [MAIN ] VLT: No existing data found, performing full refresh instead. [2025-10-26T02:54:50.120462] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-26T02:54:50.120540] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-26T02:54:50.120597] [DEBUG] [LOCAL ] VLT: No primary data file found to delete. [2025-10-26T02:54:50.120681] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-26T02:54:56.696895] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-26T02:54:57.077804] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-26T02:54:57.077918] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-26T02:54:57.078176] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-26T02:54:57.078256] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-26T02:54:57.078775] [DEBUG] [LOCAL ] VLT: Trimmed 7380 records to 4325 (keeping 200 days of data) [2025-10-26T02:54:57.104224] [DEBUG] [LOCAL ] VLT: Primary data saved (4325 records). [2025-10-26T02:54:57.104316] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-26T02:54:57.104488] [INFO ] [MAIN ] Update Progress: 2234/2366 symbols. VLT took 7.2s. Estimated remaining time: 28m 12s [2025-10-26T02:54:57.277350] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:54:57.277571] [DEBUG] [LOCAL ] VLTO: No existing data file found in primary storage. [2025-10-26T02:54:57.277682] [WARN ] [MAIN ] VLTO: No existing data found, performing full refresh instead. [2025-10-26T02:54:57.277807] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-26T02:54:57.277879] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-26T02:54:57.277964] [DEBUG] [LOCAL ] VLTO: No primary data file found to delete. [2025-10-26T02:54:57.278050] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-26T02:55:12.947863] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-26T02:55:13.339194] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-26T02:55:13.339312] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-26T02:55:13.340386] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-26T02:55:13.340466] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-26T02:55:13.341761] [DEBUG] [LOCAL ] VLTO: Trimmed 67334 records to 46678 (keeping 200 days of data) [2025-10-26T02:55:13.617977] [DEBUG] [LOCAL ] VLTO: Primary data saved (46678 records). [2025-10-26T02:55:13.618138] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-26T02:55:13.618316] [INFO ] [MAIN ] Update Progress: 2235/2366 symbols. VLTO took 16.5s. Estimated remaining time: 27m 59s [2025-10-26T02:55:13.786748] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:55:13.786932] [DEBUG] [LOCAL ] VMC: No existing data file found in primary storage. [2025-10-26T02:55:13.787003] [WARN ] [MAIN ] VMC: No existing data found, performing full refresh instead. [2025-10-26T02:55:13.787111] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-26T02:55:13.787182] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-26T02:55:13.787242] [DEBUG] [LOCAL ] VMC: No primary data file found to delete. [2025-10-26T02:55:13.787304] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-26T02:55:28.711864] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-26T02:55:29.088158] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-26T02:55:29.088279] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-26T02:55:29.089327] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-26T02:55:29.089407] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-26T02:55:29.090638] [DEBUG] [LOCAL ] VMC: Trimmed 62281 records to 42689 (keeping 200 days of data) [2025-10-26T02:55:29.349129] [DEBUG] [LOCAL ] VMC: Primary data saved (42689 records). [2025-10-26T02:55:29.349286] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-26T02:55:29.349486] [INFO ] [MAIN ] Update Progress: 2236/2366 symbols. VMC took 15.7s. Estimated remaining time: 27m 46s [2025-10-26T02:55:29.518745] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:55:29.518994] [DEBUG] [LOCAL ] VMI: No existing data file found in primary storage. [2025-10-26T02:55:29.519068] [WARN ] [MAIN ] VMI: No existing data found, performing full refresh instead. [2025-10-26T02:55:29.519182] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-26T02:55:29.519253] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-26T02:55:29.519333] [DEBUG] [LOCAL ] VMI: No primary data file found to delete. [2025-10-26T02:55:29.519404] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-26T02:55:39.238577] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-26T02:55:39.606072] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-26T02:55:39.606201] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-26T02:55:39.606726] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-26T02:55:39.606808] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-26T02:55:39.607597] [DEBUG] [LOCAL ] VMI: Trimmed 21395 records to 15127 (keeping 200 days of data) [2025-10-26T02:55:39.700333] [DEBUG] [LOCAL ] VMI: Primary data saved (15127 records). [2025-10-26T02:55:39.700507] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-26T02:55:39.700714] [INFO ] [MAIN ] Update Progress: 2237/2366 symbols. VMI took 10.4s. Estimated remaining time: 27m 33s [2025-10-26T02:55:39.873701] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:55:39.873923] [DEBUG] [LOCAL ] VMO: No existing data file found in primary storage. [2025-10-26T02:55:39.873996] [WARN ] [MAIN ] VMO: No existing data found, performing full refresh instead. [2025-10-26T02:55:39.874128] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-26T02:55:39.874204] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-26T02:55:39.874285] [DEBUG] [LOCAL ] VMO: No primary data file found to delete. [2025-10-26T02:55:39.874355] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-26T02:55:50.576448] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-26T02:55:50.940593] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-26T02:55:50.940722] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-26T02:55:50.941381] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-26T02:55:50.941464] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-26T02:55:50.942205] [DEBUG] [LOCAL ] VMO: Trimmed 30721 records to 20898 (keeping 200 days of data) [2025-10-26T02:55:51.058195] [DEBUG] [LOCAL ] VMO: Primary data saved (20898 records). [2025-10-26T02:55:51.058346] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-26T02:55:51.058526] [INFO ] [MAIN ] Update Progress: 2238/2366 symbols. VMO took 11.4s. Estimated remaining time: 27m 20s [2025-10-26T02:55:51.223948] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:55:51.224126] [DEBUG] [LOCAL ] VNO: No existing data file found in primary storage. [2025-10-26T02:55:51.224197] [WARN ] [MAIN ] VNO: No existing data found, performing full refresh instead. [2025-10-26T02:55:51.224305] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-26T02:55:51.224385] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-26T02:55:51.224456] [DEBUG] [LOCAL ] VNO: No primary data file found to delete. [2025-10-26T02:55:51.224522] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-26T02:56:06.687966] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-26T02:56:07.076915] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-26T02:56:07.077042] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-26T02:56:07.078615] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-26T02:56:07.078718] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-26T02:56:07.080076] [DEBUG] [LOCAL ] VNO: Trimmed 70426 records to 49435 (keeping 200 days of data) [2025-10-26T02:56:07.354398] [DEBUG] [LOCAL ] VNO: Primary data saved (49435 records). [2025-10-26T02:56:07.354571] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-26T02:56:07.354884] [INFO ] [MAIN ] Update Progress: 2239/2366 symbols. VNO took 16.3s. Estimated remaining time: 27m 8s [2025-10-26T02:56:07.530135] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:56:07.530353] [DEBUG] [LOCAL ] VNT: No existing data file found in primary storage. [2025-10-26T02:56:07.530435] [WARN ] [MAIN ] VNT: No existing data found, performing full refresh instead. [2025-10-26T02:56:07.530575] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-26T02:56:07.530699] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-26T02:56:07.530806] [DEBUG] [LOCAL ] VNT: No primary data file found to delete. [2025-10-26T02:56:07.530889] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-26T02:56:22.552255] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-26T02:56:22.977965] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-26T02:56:22.978082] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-26T02:56:22.979175] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-26T02:56:22.979257] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-26T02:56:22.980513] [DEBUG] [LOCAL ] VNT: Trimmed 64280 records to 44559 (keeping 200 days of data) [2025-10-26T02:56:23.239676] [DEBUG] [LOCAL ] VNT: Primary data saved (44559 records). [2025-10-26T02:56:23.239847] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-26T02:56:23.240042] [INFO ] [MAIN ] Update Progress: 2240/2366 symbols. VNT took 15.9s. Estimated remaining time: 26m 55s [2025-10-26T02:56:23.404637] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:56:23.404873] [DEBUG] [LOCAL ] VOC: No existing data file found in primary storage. [2025-10-26T02:56:23.404945] [WARN ] [MAIN ] VOC: No existing data found, performing full refresh instead. [2025-10-26T02:56:23.405057] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-26T02:56:23.405133] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-26T02:56:23.405215] [DEBUG] [LOCAL ] VOC: No primary data file found to delete. [2025-10-26T02:56:23.405286] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-26T02:56:31.971947] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-26T02:56:32.327615] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-26T02:56:32.327771] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-26T02:56:32.328147] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-26T02:56:32.328225] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-26T02:56:32.328758] [DEBUG] [LOCAL ] VOC: Trimmed 13332 records to 9214 (keeping 200 days of data) [2025-10-26T02:56:32.382750] [DEBUG] [LOCAL ] VOC: Primary data saved (9214 records). [2025-10-26T02:56:32.382939] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-26T02:56:32.383135] [INFO ] [MAIN ] Update Progress: 2241/2366 symbols. VOC took 9.1s. Estimated remaining time: 26m 42s [2025-10-26T02:56:32.554533] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:56:32.554822] [DEBUG] [LOCAL ] VOYA: No existing data file found in primary storage. [2025-10-26T02:56:32.554898] [WARN ] [MAIN ] VOYA: No existing data found, performing full refresh instead. [2025-10-26T02:56:32.555010] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-26T02:56:32.555079] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-26T02:56:32.555160] [DEBUG] [LOCAL ] VOYA: No primary data file found to delete. [2025-10-26T02:56:32.555228] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-26T02:56:47.092393] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-26T02:56:47.477084] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-26T02:56:47.477233] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-26T02:56:47.478563] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-26T02:56:47.478686] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-26T02:56:47.480274] [DEBUG] [LOCAL ] VOYA: Trimmed 61459 records to 42281 (keeping 200 days of data) [2025-10-26T02:56:47.727570] [DEBUG] [LOCAL ] VOYA: Primary data saved (42281 records). [2025-10-26T02:56:47.727776] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-26T02:56:47.727929] [INFO ] [MAIN ] Update Progress: 2242/2366 symbols. VOYA took 15.3s. Estimated remaining time: 26m 30s [2025-10-26T02:56:47.894701] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:56:47.894901] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-26T02:56:47.894973] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-26T02:56:47.895084] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-26T02:56:47.895155] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-26T02:56:47.895236] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-26T02:56:47.895305] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-26T02:56:48.479189] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-26T02:56:48.479277] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T02:56:48.479372] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-26T02:56:48.479491] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-26T02:56:48.479579] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-26T02:56:48.479710] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-26T02:56:48.479920] [INFO ] [MAIN ] Update Progress: 2243/2366 symbols. VOYG took 0.8s. Estimated remaining time: 26m 16s [2025-10-26T02:56:48.655834] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:56:48.656009] [DEBUG] [LOCAL ] VPG: No existing data file found in primary storage. [2025-10-26T02:56:48.656079] [WARN ] [MAIN ] VPG: No existing data found, performing full refresh instead. [2025-10-26T02:56:48.656189] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-26T02:56:48.656266] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-26T02:56:48.656346] [DEBUG] [LOCAL ] VPG: No primary data file found to delete. [2025-10-26T02:56:48.656421] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-26T02:56:58.103201] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-26T02:56:58.491793] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-26T02:56:58.491905] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-26T02:56:58.492476] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-26T02:56:58.492551] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-26T02:56:58.493241] [DEBUG] [LOCAL ] VPG: Trimmed 23218 records to 17113 (keeping 200 days of data) [2025-10-26T02:56:58.587396] [DEBUG] [LOCAL ] VPG: Primary data saved (17113 records). [2025-10-26T02:56:58.587553] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-26T02:56:58.587773] [INFO ] [MAIN ] Update Progress: 2244/2366 symbols. VPG took 10.1s. Estimated remaining time: 26m 3s [2025-10-26T02:56:58.758785] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:56:58.758959] [DEBUG] [LOCAL ] VPV: No existing data file found in primary storage. [2025-10-26T02:56:58.759033] [WARN ] [MAIN ] VPV: No existing data found, performing full refresh instead. [2025-10-26T02:56:58.759152] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-26T02:56:58.759225] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-26T02:56:58.759283] [DEBUG] [LOCAL ] VPV: No primary data file found to delete. [2025-10-26T02:56:58.759346] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-26T02:57:05.755969] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-26T02:57:06.142179] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-26T02:57:06.142334] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-26T02:57:06.142679] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-26T02:57:06.142763] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-26T02:57:06.143307] [DEBUG] [LOCAL ] VPV: Trimmed 8805 records to 5255 (keeping 200 days of data) [2025-10-26T02:57:06.175791] [DEBUG] [LOCAL ] VPV: Primary data saved (5255 records). [2025-10-26T02:57:06.175980] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-26T02:57:06.176227] [INFO ] [MAIN ] Update Progress: 2245/2366 symbols. VPV took 7.6s. Estimated remaining time: 25m 50s [2025-10-26T02:57:06.357493] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:57:06.357819] [DEBUG] [LOCAL ] VRE: No existing data file found in primary storage. [2025-10-26T02:57:06.357895] [WARN ] [MAIN ] VRE: No existing data found, performing full refresh instead. [2025-10-26T02:57:06.358023] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-26T02:57:06.358098] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-26T02:57:06.358185] [DEBUG] [LOCAL ] VRE: No primary data file found to delete. [2025-10-26T02:57:06.358257] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-26T02:57:19.364912] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-26T02:57:19.736424] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-26T02:57:19.736539] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-26T02:57:19.737483] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-26T02:57:19.737564] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-26T02:57:19.738608] [DEBUG] [LOCAL ] VRE: Trimmed 48759 records to 35725 (keeping 200 days of data) [2025-10-26T02:57:19.949726] [DEBUG] [LOCAL ] VRE: Primary data saved (35725 records). [2025-10-26T02:57:19.949907] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-26T02:57:19.950096] [INFO ] [MAIN ] Update Progress: 2246/2366 symbols. VRE took 13.8s. Estimated remaining time: 25m 37s [2025-10-26T02:57:20.118917] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:57:20.119123] [DEBUG] [LOCAL ] VRT: No existing data file found in primary storage. [2025-10-26T02:57:20.119194] [WARN ] [MAIN ] VRT: No existing data found, performing full refresh instead. [2025-10-26T02:57:20.119309] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-26T02:57:20.119386] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-26T02:57:20.119487] [DEBUG] [LOCAL ] VRT: No primary data file found to delete. [2025-10-26T02:57:20.119571] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-26T02:57:43.565717] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-26T02:57:43.968086] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-26T02:57:43.968266] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-26T02:57:43.970311] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-26T02:57:43.970429] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-26T02:57:43.972685] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 54533 (keeping 200 days of data) [2025-10-26T02:57:44.317926] [DEBUG] [LOCAL ] VRT: Primary data saved (54533 records). [2025-10-26T02:57:44.318119] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-26T02:57:44.318311] [INFO ] [MAIN ] Update Progress: 2247/2366 symbols. VRT took 24.4s. Estimated remaining time: 25m 25s [2025-10-26T02:57:44.487205] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:57:44.487430] [DEBUG] [LOCAL ] VRTS: No existing data file found in primary storage. [2025-10-26T02:57:44.487505] [WARN ] [MAIN ] VRTS: No existing data found, performing full refresh instead. [2025-10-26T02:57:44.487660] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-26T02:57:44.487739] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-26T02:57:44.487822] [DEBUG] [LOCAL ] VRTS: No primary data file found to delete. [2025-10-26T02:57:44.487892] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-26T02:57:52.163457] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-26T02:57:52.526016] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-26T02:57:52.526131] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-26T02:57:52.526464] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-26T02:57:52.526542] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-26T02:57:52.527076] [DEBUG] [LOCAL ] VRTS: Trimmed 11905 records to 9517 (keeping 200 days of data) [2025-10-26T02:57:52.584291] [DEBUG] [LOCAL ] VRTS: Primary data saved (9517 records). [2025-10-26T02:57:52.584432] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-26T02:57:52.584617] [INFO ] [MAIN ] Update Progress: 2248/2366 symbols. VRTS took 8.3s. Estimated remaining time: 25m 12s [2025-10-26T02:57:52.780311] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:57:52.780601] [DEBUG] [LOCAL ] VSCO: No existing data file found in primary storage. [2025-10-26T02:57:52.780678] [WARN ] [MAIN ] VSCO: No existing data found, performing full refresh instead. [2025-10-26T02:57:52.780801] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-26T02:57:52.780874] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-26T02:57:52.780968] [DEBUG] [LOCAL ] VSCO: No primary data file found to delete. [2025-10-26T02:57:52.781066] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-26T02:58:10.409744] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-26T02:58:10.823729] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-26T02:58:10.824257] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-26T02:58:10.825755] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-26T02:58:10.825847] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-26T02:58:10.827452] [DEBUG] [LOCAL ] VSCO: Trimmed 76425 records to 53444 (keeping 200 days of data) [2025-10-26T02:58:11.136850] [DEBUG] [LOCAL ] VSCO: Primary data saved (53444 records). [2025-10-26T02:58:11.137024] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-26T02:58:11.137210] [INFO ] [MAIN ] Update Progress: 2249/2366 symbols. VSCO took 18.6s. Estimated remaining time: 24m 59s [2025-10-26T02:58:11.305989] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:58:11.306268] [DEBUG] [LOCAL ] VSH: No existing data file found in primary storage. [2025-10-26T02:58:11.306339] [WARN ] [MAIN ] VSH: No existing data found, performing full refresh instead. [2025-10-26T02:58:11.306450] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-26T02:58:11.306520] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-26T02:58:11.306601] [DEBUG] [LOCAL ] VSH: No primary data file found to delete. [2025-10-26T02:58:11.306692] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-26T02:58:27.340022] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-26T02:58:27.749875] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-26T02:58:27.750041] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-26T02:58:27.752072] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-26T02:58:27.752167] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-26T02:58:27.754154] [DEBUG] [LOCAL ] VSH: Trimmed 70993 records to 49004 (keeping 200 days of data) [2025-10-26T02:58:28.062729] [DEBUG] [LOCAL ] VSH: Primary data saved (49004 records). [2025-10-26T02:58:28.063018] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-26T02:58:28.063311] [INFO ] [MAIN ] Update Progress: 2250/2366 symbols. VSH took 16.9s. Estimated remaining time: 24m 47s [2025-10-26T02:58:28.243613] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:58:28.243927] [DEBUG] [LOCAL ] VST: No existing data file found in primary storage. [2025-10-26T02:58:28.244004] [WARN ] [MAIN ] VST: No existing data found, performing full refresh instead. [2025-10-26T02:58:28.244107] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-26T02:58:28.244178] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-26T02:58:28.244254] [DEBUG] [LOCAL ] VST: No primary data file found to delete. [2025-10-26T02:58:28.244333] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-26T02:58:51.603235] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-26T02:58:52.001091] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-26T02:58:52.001227] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-26T02:58:52.002438] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-26T02:58:52.002523] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-26T02:58:52.004090] [DEBUG] [LOCAL ] VST: Trimmed 77888 records to 54489 (keeping 200 days of data) [2025-10-26T02:58:52.335547] [DEBUG] [LOCAL ] VST: Primary data saved (54489 records). [2025-10-26T02:58:52.335761] [INFO ] [MAIN ] VST: Full history saved. [2025-10-26T02:58:52.335967] [INFO ] [MAIN ] Update Progress: 2251/2366 symbols. VST took 24.3s. Estimated remaining time: 24m 35s [2025-10-26T02:58:52.503349] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:58:52.503560] [DEBUG] [LOCAL ] VSTS: No existing data file found in primary storage. [2025-10-26T02:58:52.503634] [WARN ] [MAIN ] VSTS: No existing data found, performing full refresh instead. [2025-10-26T02:58:52.503769] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-26T02:58:52.503842] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-26T02:58:52.503923] [DEBUG] [LOCAL ] VSTS: No primary data file found to delete. [2025-10-26T02:58:52.504008] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-26T02:59:07.870810] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-26T02:59:08.263319] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-26T02:59:08.263470] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-26T02:59:08.264713] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-26T02:59:08.264797] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-26T02:59:08.266307] [DEBUG] [LOCAL ] VSTS: Trimmed 69712 records to 49534 (keeping 200 days of data) [2025-10-26T02:59:08.530953] [DEBUG] [LOCAL ] VSTS: Primary data saved (49534 records). [2025-10-26T02:59:08.531107] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-26T02:59:08.531316] [INFO ] [MAIN ] Update Progress: 2252/2366 symbols. VSTS took 16.2s. Estimated remaining time: 24m 22s [2025-10-26T02:59:08.699264] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:59:08.699458] [DEBUG] [LOCAL ] VTEX: No existing data file found in primary storage. [2025-10-26T02:59:08.699529] [WARN ] [MAIN ] VTEX: No existing data found, performing full refresh instead. [2025-10-26T02:59:08.699638] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-26T02:59:08.699740] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-26T02:59:08.699831] [DEBUG] [LOCAL ] VTEX: No primary data file found to delete. [2025-10-26T02:59:08.699898] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-26T02:59:24.121151] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-26T02:59:24.521179] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-26T02:59:24.521314] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-26T02:59:24.522534] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-26T02:59:24.522627] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-26T02:59:24.524104] [DEBUG] [LOCAL ] VTEX: Trimmed 61083 records to 43417 (keeping 200 days of data) [2025-10-26T02:59:24.778195] [DEBUG] [LOCAL ] VTEX: Primary data saved (43417 records). [2025-10-26T02:59:24.778367] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-26T02:59:24.778615] [INFO ] [MAIN ] Update Progress: 2253/2366 symbols. VTEX took 16.2s. Estimated remaining time: 24m 9s [2025-10-26T02:59:24.972761] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:59:24.972994] [DEBUG] [LOCAL ] VTLE: No existing data file found in primary storage. [2025-10-26T02:59:24.973065] [WARN ] [MAIN ] VTLE: No existing data found, performing full refresh instead. [2025-10-26T02:59:24.973161] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-26T02:59:24.973237] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-26T02:59:24.973341] [DEBUG] [LOCAL ] VTLE: No primary data file found to delete. [2025-10-26T02:59:24.973427] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-26T02:59:40.429822] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-26T02:59:40.828633] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-26T02:59:40.828772] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-26T02:59:40.829865] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-26T02:59:40.829943] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-26T02:59:40.831281] [DEBUG] [LOCAL ] VTLE: Trimmed 68303 records to 48151 (keeping 200 days of data) [2025-10-26T02:59:41.093587] [DEBUG] [LOCAL ] VTLE: Primary data saved (48151 records). [2025-10-26T02:59:41.093770] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-26T02:59:41.093951] [INFO ] [MAIN ] Update Progress: 2254/2366 symbols. VTLE took 16.3s. Estimated remaining time: 23m 57s [2025-10-26T02:59:41.259882] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:59:41.260096] [DEBUG] [LOCAL ] VTMX: No existing data file found in primary storage. [2025-10-26T02:59:41.260170] [WARN ] [MAIN ] VTMX: No existing data found, performing full refresh instead. [2025-10-26T02:59:41.260265] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-26T02:59:41.260332] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-26T02:59:41.260415] [DEBUG] [LOCAL ] VTMX: No primary data file found to delete. [2025-10-26T02:59:41.260479] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-26T02:59:51.318913] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-26T02:59:51.720666] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-26T02:59:51.720833] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-26T02:59:51.721918] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-26T02:59:51.722002] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-26T02:59:51.723433] [DEBUG] [LOCAL ] VTMX: Trimmed 26035 records to 17960 (keeping 200 days of data) [2025-10-26T02:59:51.837596] [DEBUG] [LOCAL ] VTMX: Primary data saved (17960 records). [2025-10-26T02:59:51.837888] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-26T02:59:51.838143] [INFO ] [MAIN ] Update Progress: 2255/2366 symbols. VTMX took 10.7s. Estimated remaining time: 23m 44s [2025-10-26T02:59:52.013195] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T02:59:52.013499] [DEBUG] [LOCAL ] VTN: No existing data file found in primary storage. [2025-10-26T02:59:52.013582] [WARN ] [MAIN ] VTN: No existing data found, performing full refresh instead. [2025-10-26T02:59:52.013742] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-26T02:59:52.013824] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-26T02:59:52.013908] [DEBUG] [LOCAL ] VTN: No primary data file found to delete. [2025-10-26T02:59:52.013983] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-26T02:59:59.625026] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-26T03:00:00.032961] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-26T03:00:00.033108] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-26T03:00:00.033610] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-26T03:00:00.033714] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-26T03:00:00.034306] [DEBUG] [LOCAL ] VTN: Trimmed 11011 records to 7382 (keeping 200 days of data) [2025-10-26T03:00:00.080943] [DEBUG] [LOCAL ] VTN: Primary data saved (7382 records). [2025-10-26T03:00:00.081156] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-26T03:00:00.081401] [INFO ] [MAIN ] Update Progress: 2256/2366 symbols. VTN took 8.2s. Estimated remaining time: 23m 31s [2025-10-26T03:00:00.264493] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:00:00.264777] [DEBUG] [LOCAL ] VTOL: No existing data file found in primary storage. [2025-10-26T03:00:00.264856] [WARN ] [MAIN ] VTOL: No existing data found, performing full refresh instead. [2025-10-26T03:00:00.265003] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-26T03:00:00.265078] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-26T03:00:00.265202] [DEBUG] [LOCAL ] VTOL: No primary data file found to delete. [2025-10-26T03:00:00.265283] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-26T03:00:10.860289] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-26T03:00:11.231249] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-26T03:00:11.231384] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-26T03:00:11.232057] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-26T03:00:11.232139] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-26T03:00:11.232907] [DEBUG] [LOCAL ] VTOL: Trimmed 26515 records to 19635 (keeping 200 days of data) [2025-10-26T03:00:11.339789] [DEBUG] [LOCAL ] VTOL: Primary data saved (19635 records). [2025-10-26T03:00:11.339957] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-26T03:00:11.340139] [INFO ] [MAIN ] Update Progress: 2257/2366 symbols. VTOL took 11.3s. Estimated remaining time: 23m 18s [2025-10-26T03:00:11.512984] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:00:11.513190] [DEBUG] [LOCAL ] VTR: No existing data file found in primary storage. [2025-10-26T03:00:11.513265] [WARN ] [MAIN ] VTR: No existing data found, performing full refresh instead. [2025-10-26T03:00:11.513382] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-26T03:00:11.513457] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-26T03:00:11.513518] [DEBUG] [LOCAL ] VTR: No primary data file found to delete. [2025-10-26T03:00:11.513586] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-26T03:00:28.488568] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-26T03:00:28.899321] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-26T03:00:28.899474] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-26T03:00:28.901845] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-26T03:00:28.901935] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-26T03:00:28.904293] [DEBUG] [LOCAL ] VTR: Trimmed 76432 records to 53420 (keeping 200 days of data) [2025-10-26T03:00:29.260154] [DEBUG] [LOCAL ] VTR: Primary data saved (53420 records). [2025-10-26T03:00:29.260406] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-26T03:00:29.260691] [INFO ] [MAIN ] Update Progress: 2258/2366 symbols. VTR took 17.9s. Estimated remaining time: 23m 5s [2025-10-26T03:00:29.434431] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:00:29.434807] [DEBUG] [LOCAL ] VTS: No existing data file found in primary storage. [2025-10-26T03:00:29.434885] [WARN ] [MAIN ] VTS: No existing data found, performing full refresh instead. [2025-10-26T03:00:29.435017] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-26T03:00:29.435092] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-26T03:00:29.435158] [DEBUG] [LOCAL ] VTS: No primary data file found to delete. [2025-10-26T03:00:29.435224] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-26T03:00:41.262525] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-26T03:00:41.652791] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-26T03:00:41.652976] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-26T03:00:41.654930] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-26T03:00:41.655019] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-26T03:00:41.656517] [DEBUG] [LOCAL ] VTS: Trimmed 41603 records to 30241 (keeping 200 days of data) [2025-10-26T03:00:41.859036] [DEBUG] [LOCAL ] VTS: Primary data saved (30241 records). [2025-10-26T03:00:41.859303] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-26T03:00:41.859571] [INFO ] [MAIN ] Update Progress: 2259/2366 symbols. VTS took 12.6s. Estimated remaining time: 22m 52s [2025-10-26T03:00:42.038627] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:00:42.038939] [DEBUG] [LOCAL ] VVR: No existing data file found in primary storage. [2025-10-26T03:00:42.039017] [WARN ] [MAIN ] VVR: No existing data found, performing full refresh instead. [2025-10-26T03:00:42.039149] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-26T03:00:42.039225] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-26T03:00:42.039313] [DEBUG] [LOCAL ] VVR: No primary data file found to delete. [2025-10-26T03:00:42.039388] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-26T03:00:55.105609] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-26T03:00:55.474485] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-26T03:00:55.474612] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-26T03:00:55.475558] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-26T03:00:55.475659] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-26T03:00:55.476612] [DEBUG] [LOCAL ] VVR: Trimmed 46658 records to 31590 (keeping 200 days of data) [2025-10-26T03:00:55.648665] [DEBUG] [LOCAL ] VVR: Primary data saved (31590 records). [2025-10-26T03:00:55.648825] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-26T03:00:55.649196] [INFO ] [MAIN ] Update Progress: 2260/2366 symbols. VVR took 13.8s. Estimated remaining time: 22m 40s [2025-10-26T03:00:55.820286] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:00:55.820745] [DEBUG] [LOCAL ] VVV: No existing data file found in primary storage. [2025-10-26T03:00:55.820841] [WARN ] [MAIN ] VVV: No existing data found, performing full refresh instead. [2025-10-26T03:00:55.820995] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-26T03:00:55.821075] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-26T03:00:55.821179] [DEBUG] [LOCAL ] VVV: No primary data file found to delete. [2025-10-26T03:00:55.821256] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-26T03:01:11.619588] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-26T03:01:12.017596] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-26T03:01:12.017799] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-26T03:01:12.019081] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-26T03:01:12.019183] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-26T03:01:12.020663] [DEBUG] [LOCAL ] VVV: Trimmed 72454 records to 50855 (keeping 200 days of data) [2025-10-26T03:01:12.308835] [DEBUG] [LOCAL ] VVV: Primary data saved (50855 records). [2025-10-26T03:01:12.309516] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-26T03:01:12.309753] [INFO ] [MAIN ] Update Progress: 2261/2366 symbols. VVV took 16.7s. Estimated remaining time: 22m 27s [2025-10-26T03:01:12.480744] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:01:12.481022] [DEBUG] [LOCAL ] VVX: No existing data file found in primary storage. [2025-10-26T03:01:12.481112] [WARN ] [MAIN ] VVX: No existing data found, performing full refresh instead. [2025-10-26T03:01:12.481249] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-26T03:01:12.481340] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-26T03:01:12.481447] [DEBUG] [LOCAL ] VVX: No primary data file found to delete. [2025-10-26T03:01:12.481535] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-26T03:01:23.564672] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-26T03:01:23.940000] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-26T03:01:23.940118] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-26T03:01:23.940837] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-26T03:01:23.940917] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-26T03:01:23.941767] [DEBUG] [LOCAL ] VVX: Trimmed 33072 records to 23327 (keeping 200 days of data) [2025-10-26T03:01:24.072903] [DEBUG] [LOCAL ] VVX: Primary data saved (23327 records). [2025-10-26T03:01:24.073066] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-26T03:01:24.073251] [INFO ] [MAIN ] Update Progress: 2262/2366 symbols. VVX took 11.8s. Estimated remaining time: 22m 14s [2025-10-26T03:01:24.243299] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:01:24.243490] [DEBUG] [LOCAL ] VYX: No existing data file found in primary storage. [2025-10-26T03:01:24.243562] [WARN ] [MAIN ] VYX: No existing data found, performing full refresh instead. [2025-10-26T03:01:24.243703] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-26T03:01:24.243799] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-26T03:01:24.243889] [DEBUG] [LOCAL ] VYX: No primary data file found to delete. [2025-10-26T03:01:24.243965] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-26T03:01:40.525557] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-26T03:01:40.931324] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-26T03:01:40.931454] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-26T03:01:40.932587] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-26T03:01:40.932698] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-26T03:01:40.934067] [DEBUG] [LOCAL ] VYX: Trimmed 70163 records to 48961 (keeping 200 days of data) [2025-10-26T03:01:41.207832] [DEBUG] [LOCAL ] VYX: Primary data saved (48961 records). [2025-10-26T03:01:41.207996] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-26T03:01:41.208177] [INFO ] [MAIN ] Update Progress: 2263/2366 symbols. VYX took 17.1s. Estimated remaining time: 22m 1s [2025-10-26T03:01:41.379917] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:01:41.380126] [DEBUG] [LOCAL ] VZ: No existing data file found in primary storage. [2025-10-26T03:01:41.380200] [WARN ] [MAIN ] VZ: No existing data found, performing full refresh instead. [2025-10-26T03:01:41.380311] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-26T03:01:41.380380] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-26T03:01:41.380445] [DEBUG] [LOCAL ] VZ: No primary data file found to delete. [2025-10-26T03:01:41.380507] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-26T03:02:02.084572] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-26T03:02:02.475439] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-26T03:02:02.475578] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-26T03:02:02.477049] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-26T03:02:02.477148] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-26T03:02:02.478822] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 54571 (keeping 200 days of data) [2025-10-26T03:02:02.812902] [DEBUG] [LOCAL ] VZ: Primary data saved (54571 records). [2025-10-26T03:02:02.813103] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-26T03:02:02.813316] [INFO ] [MAIN ] Update Progress: 2264/2366 symbols. VZ took 21.6s. Estimated remaining time: 21m 49s [2025-10-26T03:02:02.983271] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:02:02.983470] [DEBUG] [LOCAL ] W: No existing data file found in primary storage. [2025-10-26T03:02:02.983541] [WARN ] [MAIN ] W: No existing data found, performing full refresh instead. [2025-10-26T03:02:02.983679] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-26T03:02:02.983752] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-26T03:02:02.983832] [DEBUG] [LOCAL ] W: No primary data file found to delete. [2025-10-26T03:02:02.983900] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-26T03:02:21.507427] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-26T03:02:21.902044] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-26T03:02:21.902176] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-26T03:02:21.903365] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-26T03:02:21.903448] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-26T03:02:21.904985] [DEBUG] [LOCAL ] W: Trimmed 77506 records to 54179 (keeping 200 days of data) [2025-10-26T03:02:22.207882] [DEBUG] [LOCAL ] W: Primary data saved (54179 records). [2025-10-26T03:02:22.208062] [INFO ] [MAIN ] W: Full history saved. [2025-10-26T03:02:22.208257] [INFO ] [MAIN ] Update Progress: 2265/2366 symbols. W took 19.4s. Estimated remaining time: 21m 36s [2025-10-26T03:02:22.378958] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:02:22.379170] [DEBUG] [LOCAL ] WAB: No existing data file found in primary storage. [2025-10-26T03:02:22.379239] [WARN ] [MAIN ] WAB: No existing data found, performing full refresh instead. [2025-10-26T03:02:22.379351] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-26T03:02:22.379420] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-26T03:02:22.379515] [DEBUG] [LOCAL ] WAB: No primary data file found to delete. [2025-10-26T03:02:22.379598] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-26T03:02:36.761916] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-26T03:02:37.140261] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-26T03:02:37.140376] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-26T03:02:37.141452] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-26T03:02:37.141531] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-26T03:02:37.142834] [DEBUG] [LOCAL ] WAB: Trimmed 64396 records to 44422 (keeping 200 days of data) [2025-10-26T03:02:37.415134] [DEBUG] [LOCAL ] WAB: Primary data saved (44422 records). [2025-10-26T03:02:37.415304] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-26T03:02:37.415494] [INFO ] [MAIN ] Update Progress: 2266/2366 symbols. WAB took 15.2s. Estimated remaining time: 21m 24s [2025-10-26T03:02:37.581060] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:02:37.581249] [DEBUG] [LOCAL ] WAL: No existing data file found in primary storage. [2025-10-26T03:02:37.581322] [WARN ] [MAIN ] WAL: No existing data found, performing full refresh instead. [2025-10-26T03:02:37.581437] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-26T03:02:37.581511] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-26T03:02:37.581593] [DEBUG] [LOCAL ] WAL: No primary data file found to delete. [2025-10-26T03:02:37.581692] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-26T03:02:52.104581] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-26T03:02:52.503517] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-26T03:02:52.503668] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-26T03:02:52.505170] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-26T03:02:52.505268] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-26T03:02:52.506704] [DEBUG] [LOCAL ] WAL: Trimmed 67339 records to 46382 (keeping 200 days of data) [2025-10-26T03:02:52.781387] [DEBUG] [LOCAL ] WAL: Primary data saved (46382 records). [2025-10-26T03:02:52.781567] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-26T03:02:52.781839] [INFO ] [MAIN ] Update Progress: 2267/2366 symbols. WAL took 15.4s. Estimated remaining time: 21m 11s [2025-10-26T03:02:52.951483] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:02:52.951718] [DEBUG] [LOCAL ] WAT: No existing data file found in primary storage. [2025-10-26T03:02:52.951797] [WARN ] [MAIN ] WAT: No existing data found, performing full refresh instead. [2025-10-26T03:02:52.951921] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-26T03:02:52.951994] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-26T03:02:52.952076] [DEBUG] [LOCAL ] WAT: No primary data file found to delete. [2025-10-26T03:02:52.952145] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-26T03:03:06.517752] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-26T03:03:06.887546] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-26T03:03:06.887727] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-26T03:03:06.888850] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-26T03:03:06.888931] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-26T03:03:06.889999] [DEBUG] [LOCAL ] WAT: Trimmed 50937 records to 36177 (keeping 200 days of data) [2025-10-26T03:03:07.096346] [DEBUG] [LOCAL ] WAT: Primary data saved (36177 records). [2025-10-26T03:03:07.096517] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-26T03:03:07.096750] [INFO ] [MAIN ] Update Progress: 2268/2366 symbols. WAT took 14.3s. Estimated remaining time: 20m 58s [2025-10-26T03:03:07.261956] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:03:07.262134] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-26T03:03:07.262205] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-26T03:03:07.262322] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-26T03:03:07.262391] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-26T03:03:07.262470] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-26T03:03:07.262542] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-26T03:03:07.829755] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-26T03:03:07.829834] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T03:03:07.829904] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-26T03:03:07.829992] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-26T03:03:07.830060] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-26T03:03:07.830138] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-26T03:03:07.830299] [INFO ] [MAIN ] Update Progress: 2269/2366 symbols. WBI took 0.7s. Estimated remaining time: 20m 45s [2025-10-26T03:03:07.999628] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:03:07.999940] [DEBUG] [LOCAL ] WBS: No existing data file found in primary storage. [2025-10-26T03:03:08.000013] [WARN ] [MAIN ] WBS: No existing data found, performing full refresh instead. [2025-10-26T03:03:08.000125] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-26T03:03:08.000195] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-26T03:03:08.000273] [DEBUG] [LOCAL ] WBS: No primary data file found to delete. [2025-10-26T03:03:08.000342] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-26T03:03:22.925738] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-26T03:03:23.320404] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-26T03:03:23.320524] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-26T03:03:23.321684] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-26T03:03:23.321765] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-26T03:03:23.323146] [DEBUG] [LOCAL ] WBS: Trimmed 70399 records to 49577 (keeping 200 days of data) [2025-10-26T03:03:23.686025] [DEBUG] [LOCAL ] WBS: Primary data saved (49577 records). [2025-10-26T03:03:23.686270] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-26T03:03:23.686577] [INFO ] [MAIN ] Update Progress: 2270/2366 symbols. WBS took 15.9s. Estimated remaining time: 20m 32s [2025-10-26T03:03:23.952433] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:03:23.952745] [DEBUG] [LOCAL ] WBX: No existing data file found in primary storage. [2025-10-26T03:03:23.952837] [WARN ] [MAIN ] WBX: No existing data found, performing full refresh instead. [2025-10-26T03:03:23.952982] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-26T03:03:23.953118] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-26T03:03:23.953216] [DEBUG] [LOCAL ] WBX: No primary data file found to delete. [2025-10-26T03:03:23.953295] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-26T03:03:33.501848] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-26T03:03:33.882242] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-26T03:03:33.882389] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-26T03:03:33.882932] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-26T03:03:33.883012] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-26T03:03:33.883704] [DEBUG] [LOCAL ] WBX: Trimmed 21129 records to 10022 (keeping 200 days of data) [2025-10-26T03:03:33.937201] [DEBUG] [LOCAL ] WBX: Primary data saved (10022 records). [2025-10-26T03:03:33.937364] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-26T03:03:33.937622] [INFO ] [MAIN ] Update Progress: 2271/2366 symbols. WBX took 10.3s. Estimated remaining time: 20m 19s [2025-10-26T03:03:34.103330] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:03:34.103528] [DEBUG] [LOCAL ] WCC: No existing data file found in primary storage. [2025-10-26T03:03:34.103599] [WARN ] [MAIN ] WCC: No existing data found, performing full refresh instead. [2025-10-26T03:03:34.103733] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-26T03:03:34.103811] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-26T03:03:34.103906] [DEBUG] [LOCAL ] WCC: No primary data file found to delete. [2025-10-26T03:03:34.103978] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-26T03:03:48.333271] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-26T03:03:48.770260] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-26T03:03:48.770441] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-26T03:03:48.772443] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-26T03:03:48.772539] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-26T03:03:48.774396] [DEBUG] [LOCAL ] WCC: Trimmed 57005 records to 38902 (keeping 200 days of data) [2025-10-26T03:03:49.041966] [DEBUG] [LOCAL ] WCC: Primary data saved (38902 records). [2025-10-26T03:03:49.042189] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-26T03:03:49.042449] [INFO ] [MAIN ] Update Progress: 2272/2366 symbols. WCC took 15.1s. Estimated remaining time: 20m 6s [2025-10-26T03:03:49.225055] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:03:49.225326] [DEBUG] [LOCAL ] WCN: No existing data file found in primary storage. [2025-10-26T03:03:49.225403] [WARN ] [MAIN ] WCN: No existing data found, performing full refresh instead. [2025-10-26T03:03:49.225532] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-26T03:03:49.225607] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-26T03:03:49.225717] [DEBUG] [LOCAL ] WCN: No primary data file found to delete. [2025-10-26T03:03:49.225793] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-26T03:04:11.142364] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-26T03:04:11.731707] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-26T03:04:11.731909] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-26T03:04:11.733665] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-26T03:04:11.733783] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-26T03:04:11.735411] [DEBUG] [LOCAL ] WCN: Trimmed 69455 records to 48561 (keeping 200 days of data) [2025-10-26T03:04:12.168339] [DEBUG] [LOCAL ] WCN: Primary data saved (48561 records). [2025-10-26T03:04:12.168517] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-26T03:04:12.168731] [INFO ] [MAIN ] Update Progress: 2273/2366 symbols. WCN took 23.1s. Estimated remaining time: 19m 54s [2025-10-26T03:04:12.344712] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:04:12.344927] [DEBUG] [LOCAL ] WD: No existing data file found in primary storage. [2025-10-26T03:04:12.344999] [WARN ] [MAIN ] WD: No existing data found, performing full refresh instead. [2025-10-26T03:04:12.345125] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-26T03:04:12.345202] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-26T03:04:12.345288] [DEBUG] [LOCAL ] WD: No primary data file found to delete. [2025-10-26T03:04:12.345360] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-26T03:04:22.712536] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-26T03:04:23.074779] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-26T03:04:23.074892] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-26T03:04:23.075590] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-26T03:04:23.075686] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-26T03:04:23.076447] [DEBUG] [LOCAL ] WD: Trimmed 32966 records to 22725 (keeping 200 days of data) [2025-10-26T03:04:23.207588] [DEBUG] [LOCAL ] WD: Primary data saved (22725 records). [2025-10-26T03:04:23.207790] [INFO ] [MAIN ] WD: Full history saved. [2025-10-26T03:04:23.207972] [INFO ] [MAIN ] Update Progress: 2274/2366 symbols. WD took 11.0s. Estimated remaining time: 19m 41s [2025-10-26T03:04:23.377197] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:04:23.377396] [DEBUG] [LOCAL ] WDH: No existing data file found in primary storage. [2025-10-26T03:04:23.377466] [WARN ] [MAIN ] WDH: No existing data found, performing full refresh instead. [2025-10-26T03:04:23.377576] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-26T03:04:23.377681] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-26T03:04:23.377767] [DEBUG] [LOCAL ] WDH: No primary data file found to delete. [2025-10-26T03:04:23.377836] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-26T03:04:34.762056] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-26T03:04:35.127986] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-26T03:04:35.128450] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-26T03:04:35.129038] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-26T03:04:35.129117] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-26T03:04:35.129852] [DEBUG] [LOCAL ] WDH: Trimmed 23956 records to 18224 (keeping 200 days of data) [2025-10-26T03:04:35.231383] [DEBUG] [LOCAL ] WDH: Primary data saved (18224 records). [2025-10-26T03:04:35.231552] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-26T03:04:35.231760] [INFO ] [MAIN ] Update Progress: 2275/2366 symbols. WDH took 12.0s. Estimated remaining time: 19m 28s [2025-10-26T03:04:35.401975] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:04:35.402157] [DEBUG] [LOCAL ] WDI: No existing data file found in primary storage. [2025-10-26T03:04:35.402228] [WARN ] [MAIN ] WDI: No existing data found, performing full refresh instead. [2025-10-26T03:04:35.402338] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-26T03:04:35.402415] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-26T03:04:35.402495] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-10-26T03:04:35.402565] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-26T03:04:45.803368] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-26T03:04:46.228139] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-26T03:04:46.228256] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-26T03:04:46.229037] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-26T03:04:46.229122] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-26T03:04:46.230129] [DEBUG] [LOCAL ] WDI: Trimmed 30340 records to 21532 (keeping 200 days of data) [2025-10-26T03:04:46.365944] [DEBUG] [LOCAL ] WDI: Primary data saved (21532 records). [2025-10-26T03:04:46.366116] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-26T03:04:46.366313] [INFO ] [MAIN ] Update Progress: 2276/2366 symbols. WDI took 11.1s. Estimated remaining time: 19m 15s [2025-10-26T03:04:46.554128] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:04:46.554335] [DEBUG] [LOCAL ] WDS: No existing data file found in primary storage. [2025-10-26T03:04:46.554404] [WARN ] [MAIN ] WDS: No existing data found, performing full refresh instead. [2025-10-26T03:04:46.554521] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-26T03:04:46.554593] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-26T03:04:46.554701] [DEBUG] [LOCAL ] WDS: No primary data file found to delete. [2025-10-26T03:04:46.554772] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-26T03:05:02.150101] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-26T03:05:02.533595] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-26T03:05:02.533729] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-26T03:05:02.534835] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-26T03:05:02.534915] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-26T03:05:02.536196] [DEBUG] [LOCAL ] WDS: Trimmed 64081 records to 43633 (keeping 200 days of data) [2025-10-26T03:05:02.790534] [DEBUG] [LOCAL ] WDS: Primary data saved (43633 records). [2025-10-26T03:05:02.790722] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-26T03:05:02.790905] [INFO ] [MAIN ] Update Progress: 2277/2366 symbols. WDS took 16.4s. Estimated remaining time: 19m 3s [2025-10-26T03:05:02.961523] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:05:02.961797] [DEBUG] [LOCAL ] WEA: No existing data file found in primary storage. [2025-10-26T03:05:02.961871] [WARN ] [MAIN ] WEA: No existing data found, performing full refresh instead. [2025-10-26T03:05:02.961994] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-26T03:05:02.962065] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-26T03:05:02.962147] [DEBUG] [LOCAL ] WEA: No primary data file found to delete. [2025-10-26T03:05:02.962223] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-26T03:05:10.272424] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-26T03:05:10.625568] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-26T03:05:10.625716] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-26T03:05:10.625987] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-26T03:05:10.626062] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-26T03:05:10.626537] [DEBUG] [LOCAL ] WEA: Trimmed 10070 records to 7926 (keeping 200 days of data) [2025-10-26T03:05:10.673229] [DEBUG] [LOCAL ] WEA: Primary data saved (7926 records). [2025-10-26T03:05:10.673388] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-26T03:05:10.673592] [INFO ] [MAIN ] Update Progress: 2278/2366 symbols. WEA took 7.9s. Estimated remaining time: 18m 50s [2025-10-26T03:05:10.841608] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:05:10.841850] [DEBUG] [LOCAL ] WEAV: No existing data file found in primary storage. [2025-10-26T03:05:10.841921] [WARN ] [MAIN ] WEAV: No existing data found, performing full refresh instead. [2025-10-26T03:05:10.842036] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-26T03:05:10.842126] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-26T03:05:10.842209] [DEBUG] [LOCAL ] WEAV: No primary data file found to delete. [2025-10-26T03:05:10.842277] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-26T03:05:24.799297] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-26T03:05:25.205961] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-26T03:05:25.206086] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-26T03:05:25.207315] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-26T03:05:25.207420] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-26T03:05:25.208859] [DEBUG] [LOCAL ] WEAV: Trimmed 61724 records to 42950 (keeping 200 days of data) [2025-10-26T03:05:25.451248] [DEBUG] [LOCAL ] WEAV: Primary data saved (42950 records). [2025-10-26T03:05:25.451420] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-26T03:05:25.451606] [INFO ] [MAIN ] Update Progress: 2279/2366 symbols. WEAV took 14.8s. Estimated remaining time: 18m 37s [2025-10-26T03:05:25.651215] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:05:25.651416] [DEBUG] [LOCAL ] WEC: No existing data file found in primary storage. [2025-10-26T03:05:25.651491] [WARN ] [MAIN ] WEC: No existing data found, performing full refresh instead. [2025-10-26T03:05:25.651620] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-26T03:05:25.651718] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-26T03:05:25.651802] [DEBUG] [LOCAL ] WEC: No primary data file found to delete. [2025-10-26T03:05:25.651873] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-26T03:05:42.253528] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-26T03:05:42.648752] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-26T03:05:42.648869] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-26T03:05:42.650087] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-26T03:05:42.650169] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-26T03:05:42.651615] [DEBUG] [LOCAL ] WEC: Trimmed 75873 records to 52886 (keeping 200 days of data) [2025-10-26T03:05:42.973280] [DEBUG] [LOCAL ] WEC: Primary data saved (52886 records). [2025-10-26T03:05:42.973486] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-26T03:05:42.973749] [INFO ] [MAIN ] Update Progress: 2280/2366 symbols. WEC took 17.5s. Estimated remaining time: 18m 24s [2025-10-26T03:05:43.149515] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:05:43.149773] [DEBUG] [LOCAL ] WELL: No existing data file found in primary storage. [2025-10-26T03:05:43.149882] [WARN ] [MAIN ] WELL: No existing data found, performing full refresh instead. [2025-10-26T03:05:43.150031] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-26T03:05:43.150113] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-26T03:05:43.150217] [DEBUG] [LOCAL ] WELL: No primary data file found to delete. [2025-10-26T03:05:43.150299] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-26T03:05:58.580134] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-26T03:05:59.002706] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-26T03:05:59.002888] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-26T03:05:59.005280] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-26T03:05:59.005399] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-26T03:05:59.007729] [DEBUG] [LOCAL ] WELL: Trimmed 76010 records to 53053 (keeping 200 days of data) [2025-10-26T03:05:59.357777] [DEBUG] [LOCAL ] WELL: Primary data saved (53053 records). [2025-10-26T03:05:59.358017] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-26T03:05:59.358295] [INFO ] [MAIN ] Update Progress: 2281/2366 symbols. WELL took 16.4s. Estimated remaining time: 18m 12s [2025-10-26T03:05:59.533249] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:05:59.533573] [DEBUG] [LOCAL ] WES: No existing data file found in primary storage. [2025-10-26T03:05:59.533673] [WARN ] [MAIN ] WES: No existing data found, performing full refresh instead. [2025-10-26T03:05:59.533803] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-26T03:05:59.533876] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-26T03:05:59.533960] [DEBUG] [LOCAL ] WES: No primary data file found to delete. [2025-10-26T03:05:59.534033] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-26T03:06:17.145605] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-26T03:06:17.573237] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-26T03:06:17.573441] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-26T03:06:17.575382] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-26T03:06:17.575485] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-26T03:06:17.577927] [DEBUG] [LOCAL ] WES: Trimmed 70670 records to 49454 (keeping 200 days of data) [2025-10-26T03:06:17.884563] [DEBUG] [LOCAL ] WES: Primary data saved (49454 records). [2025-10-26T03:06:17.884812] [INFO ] [MAIN ] WES: Full history saved. [2025-10-26T03:06:17.885061] [INFO ] [MAIN ] Update Progress: 2282/2366 symbols. WES took 18.5s. Estimated remaining time: 17m 59s [2025-10-26T03:06:18.062511] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:06:18.062840] [DEBUG] [LOCAL ] WEX: No existing data file found in primary storage. [2025-10-26T03:06:18.062915] [WARN ] [MAIN ] WEX: No existing data found, performing full refresh instead. [2025-10-26T03:06:18.063041] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-26T03:06:18.063114] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-26T03:06:18.063198] [DEBUG] [LOCAL ] WEX: No primary data file found to delete. [2025-10-26T03:06:18.063270] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-26T03:06:30.935906] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-26T03:06:31.335674] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-26T03:06:31.335865] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-26T03:06:31.337421] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-26T03:06:31.337514] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-26T03:06:31.339228] [DEBUG] [LOCAL ] WEX: Trimmed 50353 records to 32739 (keeping 200 days of data) [2025-10-26T03:06:31.536736] [DEBUG] [LOCAL ] WEX: Primary data saved (32739 records). [2025-10-26T03:06:31.537007] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-26T03:06:31.537290] [INFO ] [MAIN ] Update Progress: 2283/2366 symbols. WEX took 13.7s. Estimated remaining time: 17m 46s [2025-10-26T03:06:31.722873] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:06:31.723127] [DEBUG] [LOCAL ] WF: No existing data file found in primary storage. [2025-10-26T03:06:31.723207] [WARN ] [MAIN ] WF: No existing data found, performing full refresh instead. [2025-10-26T03:06:31.723331] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-26T03:06:31.723406] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-26T03:06:31.723492] [DEBUG] [LOCAL ] WF: No primary data file found to delete. [2025-10-26T03:06:31.723565] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-26T03:06:40.694605] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-26T03:06:41.093007] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-26T03:06:41.093109] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-26T03:06:41.093503] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-26T03:06:41.093586] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-26T03:06:41.094231] [DEBUG] [LOCAL ] WF: Trimmed 15945 records to 10840 (keeping 200 days of data) [2025-10-26T03:06:41.156260] [DEBUG] [LOCAL ] WF: Primary data saved (10840 records). [2025-10-26T03:06:41.156419] [INFO ] [MAIN ] WF: Full history saved. [2025-10-26T03:06:41.156672] [INFO ] [MAIN ] Update Progress: 2284/2366 symbols. WF took 9.6s. Estimated remaining time: 17m 33s [2025-10-26T03:06:41.327495] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:06:41.327748] [DEBUG] [LOCAL ] WFC: No existing data file found in primary storage. [2025-10-26T03:06:41.327821] [WARN ] [MAIN ] WFC: No existing data found, performing full refresh instead. [2025-10-26T03:06:41.327937] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-26T03:06:41.328010] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-26T03:06:41.328090] [DEBUG] [LOCAL ] WFC: No primary data file found to delete. [2025-10-26T03:06:41.328161] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-26T03:06:59.923857] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-26T03:07:00.319078] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-26T03:07:00.319196] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-26T03:07:00.320395] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-26T03:07:00.320475] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-26T03:07:00.321977] [DEBUG] [LOCAL ] WFC: Trimmed 77927 records to 54528 (keeping 200 days of data) [2025-10-26T03:07:00.639430] [DEBUG] [LOCAL ] WFC: Primary data saved (54528 records). [2025-10-26T03:07:00.639578] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-26T03:07:00.639783] [INFO ] [MAIN ] Update Progress: 2285/2366 symbols. WFC took 19.5s. Estimated remaining time: 17m 20s [2025-10-26T03:07:00.813552] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:07:00.813769] [DEBUG] [LOCAL ] WFG: No existing data file found in primary storage. [2025-10-26T03:07:00.813840] [WARN ] [MAIN ] WFG: No existing data found, performing full refresh instead. [2025-10-26T03:07:00.813960] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-26T03:07:00.814038] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-26T03:07:00.814118] [DEBUG] [LOCAL ] WFG: No primary data file found to delete. [2025-10-26T03:07:00.814188] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-26T03:07:12.930754] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-26T03:07:13.311178] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-26T03:07:13.311372] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-26T03:07:13.312312] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-26T03:07:13.312393] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-26T03:07:13.313373] [DEBUG] [LOCAL ] WFG: Trimmed 36573 records to 24893 (keeping 200 days of data) [2025-10-26T03:07:13.458941] [DEBUG] [LOCAL ] WFG: Primary data saved (24893 records). [2025-10-26T03:07:13.459100] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-26T03:07:13.459286] [INFO ] [MAIN ] Update Progress: 2286/2366 symbols. WFG took 12.8s. Estimated remaining time: 17m 8s [2025-10-26T03:07:13.626509] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:07:13.626731] [DEBUG] [LOCAL ] WGO: No existing data file found in primary storage. [2025-10-26T03:07:13.626859] [WARN ] [MAIN ] WGO: No existing data found, performing full refresh instead. [2025-10-26T03:07:13.626978] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-26T03:07:13.627051] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-26T03:07:13.627114] [DEBUG] [LOCAL ] WGO: No primary data file found to delete. [2025-10-26T03:07:13.627177] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-26T03:07:27.294409] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-26T03:07:27.680588] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-26T03:07:27.680730] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-26T03:07:27.681890] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-26T03:07:27.681973] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-26T03:07:27.683227] [DEBUG] [LOCAL ] WGO: Trimmed 57228 records to 38650 (keeping 200 days of data) [2025-10-26T03:07:27.916227] [DEBUG] [LOCAL ] WGO: Primary data saved (38650 records). [2025-10-26T03:07:27.916419] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-26T03:07:27.916619] [INFO ] [MAIN ] Update Progress: 2287/2366 symbols. WGO took 14.5s. Estimated remaining time: 16m 55s [2025-10-26T03:07:28.086184] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:07:28.086379] [DEBUG] [LOCAL ] WH: No existing data file found in primary storage. [2025-10-26T03:07:28.086451] [WARN ] [MAIN ] WH: No existing data found, performing full refresh instead. [2025-10-26T03:07:28.086597] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-26T03:07:28.086718] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-26T03:07:28.086800] [DEBUG] [LOCAL ] WH: No primary data file found to delete. [2025-10-26T03:07:28.086869] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-26T03:07:41.845172] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-26T03:07:42.267192] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-26T03:07:42.267305] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-26T03:07:42.268393] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-26T03:07:42.268473] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-26T03:07:42.269757] [DEBUG] [LOCAL ] WH: Trimmed 65841 records to 46021 (keeping 200 days of data) [2025-10-26T03:07:42.544251] [DEBUG] [LOCAL ] WH: Primary data saved (46021 records). [2025-10-26T03:07:42.544436] [INFO ] [MAIN ] WH: Full history saved. [2025-10-26T03:07:42.544630] [INFO ] [MAIN ] Update Progress: 2288/2366 symbols. WH took 14.6s. Estimated remaining time: 16m 42s [2025-10-26T03:07:42.719768] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:07:42.720675] [DEBUG] [LOCAL ] WHD: No existing data file found in primary storage. [2025-10-26T03:07:42.720750] [WARN ] [MAIN ] WHD: No existing data found, performing full refresh instead. [2025-10-26T03:07:42.720900] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-26T03:07:42.720972] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-26T03:07:42.721053] [DEBUG] [LOCAL ] WHD: No primary data file found to delete. [2025-10-26T03:07:42.721122] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-26T03:07:56.440835] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-26T03:07:56.841266] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-26T03:07:56.841382] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-26T03:07:56.842411] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-26T03:07:56.842491] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-26T03:07:56.843623] [DEBUG] [LOCAL ] WHD: Trimmed 57965 records to 40534 (keeping 200 days of data) [2025-10-26T03:07:57.074471] [DEBUG] [LOCAL ] WHD: Primary data saved (40534 records). [2025-10-26T03:07:57.074620] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-26T03:07:57.074826] [INFO ] [MAIN ] Update Progress: 2289/2366 symbols. WHD took 14.5s. Estimated remaining time: 16m 29s [2025-10-26T03:07:57.246234] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:07:57.246435] [DEBUG] [LOCAL ] WHG: No existing data file found in primary storage. [2025-10-26T03:07:57.246505] [WARN ] [MAIN ] WHG: No existing data found, performing full refresh instead. [2025-10-26T03:07:57.246593] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-26T03:07:57.246681] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-26T03:07:57.246747] [DEBUG] [LOCAL ] WHG: No primary data file found to delete. [2025-10-26T03:07:57.246817] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-26T03:08:03.359187] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-26T03:08:03.737436] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-26T03:08:03.737556] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-26T03:08:03.738118] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-26T03:08:03.738295] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-26T03:08:03.739117] [DEBUG] [LOCAL ] WHG: Trimmed 4325 records to 3058 (keeping 200 days of data) [2025-10-26T03:08:03.757794] [DEBUG] [LOCAL ] WHG: Primary data saved (3058 records). [2025-10-26T03:08:03.757890] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-26T03:08:03.758080] [INFO ] [MAIN ] Update Progress: 2290/2366 symbols. WHG took 6.7s. Estimated remaining time: 16m 16s [2025-10-26T03:08:03.929347] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:08:03.929573] [DEBUG] [LOCAL ] WHR: No existing data file found in primary storage. [2025-10-26T03:08:03.929668] [WARN ] [MAIN ] WHR: No existing data found, performing full refresh instead. [2025-10-26T03:08:03.929770] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-26T03:08:03.929838] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-26T03:08:03.929920] [DEBUG] [LOCAL ] WHR: No primary data file found to delete. [2025-10-26T03:08:03.929988] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-26T03:08:19.301307] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-26T03:08:19.704785] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-26T03:08:19.704904] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-26T03:08:19.706175] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-26T03:08:19.706269] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-26T03:08:19.710792] [DEBUG] [LOCAL ] WHR: Trimmed 69808 records to 49586 (keeping 200 days of data) [2025-10-26T03:08:20.006065] [DEBUG] [LOCAL ] WHR: Primary data saved (49586 records). [2025-10-26T03:08:20.006233] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-26T03:08:20.006455] [INFO ] [MAIN ] Update Progress: 2291/2366 symbols. WHR took 16.2s. Estimated remaining time: 16m 3s [2025-10-26T03:08:20.179805] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:08:20.180027] [DEBUG] [LOCAL ] WIA: No existing data file found in primary storage. [2025-10-26T03:08:20.180113] [WARN ] [MAIN ] WIA: No existing data found, performing full refresh instead. [2025-10-26T03:08:20.180247] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-26T03:08:20.180336] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-26T03:08:20.180447] [DEBUG] [LOCAL ] WIA: No primary data file found to delete. [2025-10-26T03:08:20.180537] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-26T03:08:26.406532] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-26T03:08:26.759771] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-26T03:08:26.759880] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-26T03:08:26.760129] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-26T03:08:26.760235] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-26T03:08:26.760679] [DEBUG] [LOCAL ] WIA: Trimmed 7321 records to 5133 (keeping 200 days of data) [2025-10-26T03:08:26.790150] [DEBUG] [LOCAL ] WIA: Primary data saved (5133 records). [2025-10-26T03:08:26.790243] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-26T03:08:26.790403] [INFO ] [MAIN ] Update Progress: 2292/2366 symbols. WIA took 6.8s. Estimated remaining time: 15m 50s [2025-10-26T03:08:26.977709] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:08:26.977911] [DEBUG] [LOCAL ] WINN: No existing data file found in primary storage. [2025-10-26T03:08:26.977981] [WARN ] [MAIN ] WINN: No existing data found, performing full refresh instead. [2025-10-26T03:08:26.978082] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-26T03:08:26.978156] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-26T03:08:26.978266] [DEBUG] [LOCAL ] WINN: No primary data file found to delete. [2025-10-26T03:08:26.978337] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-26T03:08:35.059996] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-26T03:08:35.426753] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-26T03:08:35.426880] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-26T03:08:35.427309] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-26T03:08:35.427388] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-26T03:08:35.428077] [DEBUG] [LOCAL ] WINN: Trimmed 17318 records to 11353 (keeping 200 days of data) [2025-10-26T03:08:35.493906] [DEBUG] [LOCAL ] WINN: Primary data saved (11353 records). [2025-10-26T03:08:35.494071] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-26T03:08:35.494260] [INFO ] [MAIN ] Update Progress: 2293/2366 symbols. WINN took 8.7s. Estimated remaining time: 15m 37s [2025-10-26T03:08:35.661554] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:08:35.661766] [DEBUG] [LOCAL ] WIT: No existing data file found in primary storage. [2025-10-26T03:08:35.661837] [WARN ] [MAIN ] WIT: No existing data found, performing full refresh instead. [2025-10-26T03:08:35.661971] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-26T03:08:35.662043] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-26T03:08:35.662123] [DEBUG] [LOCAL ] WIT: No primary data file found to delete. [2025-10-26T03:08:35.662193] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-26T03:08:51.127363] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-26T03:08:51.515500] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-26T03:08:51.515660] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-26T03:08:51.516870] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-26T03:08:51.516952] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-26T03:08:51.518475] [DEBUG] [LOCAL ] WIT: Trimmed 76023 records to 53309 (keeping 200 days of data) [2025-10-26T03:08:51.811244] [DEBUG] [LOCAL ] WIT: Primary data saved (53309 records). [2025-10-26T03:08:51.811422] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-26T03:08:51.811679] [INFO ] [MAIN ] Update Progress: 2294/2366 symbols. WIT took 16.3s. Estimated remaining time: 15m 25s [2025-10-26T03:08:51.985581] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:08:51.985836] [DEBUG] [LOCAL ] WIW: No existing data file found in primary storage. [2025-10-26T03:08:51.985947] [WARN ] [MAIN ] WIW: No existing data found, performing full refresh instead. [2025-10-26T03:08:51.986092] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-26T03:08:51.986182] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-26T03:08:51.986268] [DEBUG] [LOCAL ] WIW: No primary data file found to delete. [2025-10-26T03:08:51.986336] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-26T03:09:02.554104] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-26T03:09:02.924668] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-26T03:09:02.924809] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-26T03:09:02.925493] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-26T03:09:02.925575] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-26T03:09:02.926561] [DEBUG] [LOCAL ] WIW: Trimmed 29268 records to 20503 (keeping 200 days of data) [2025-10-26T03:09:03.046718] [DEBUG] [LOCAL ] WIW: Primary data saved (20503 records). [2025-10-26T03:09:03.046891] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-26T03:09:03.047076] [INFO ] [MAIN ] Update Progress: 2295/2366 symbols. WIW took 11.2s. Estimated remaining time: 15m 12s [2025-10-26T03:09:03.216833] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:09:03.217047] [DEBUG] [LOCAL ] WK: No existing data file found in primary storage. [2025-10-26T03:09:03.217117] [WARN ] [MAIN ] WK: No existing data found, performing full refresh instead. [2025-10-26T03:09:03.217232] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-26T03:09:03.217331] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-26T03:09:03.217418] [DEBUG] [LOCAL ] WK: No primary data file found to delete. [2025-10-26T03:09:03.217485] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-26T03:09:16.291389] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-26T03:09:16.666458] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-26T03:09:16.666576] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-26T03:09:16.667580] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-26T03:09:16.667698] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-26T03:09:16.668817] [DEBUG] [LOCAL ] WK: Trimmed 53444 records to 37475 (keeping 200 days of data) [2025-10-26T03:09:16.879140] [DEBUG] [LOCAL ] WK: Primary data saved (37475 records). [2025-10-26T03:09:16.879394] [INFO ] [MAIN ] WK: Full history saved. [2025-10-26T03:09:16.879623] [INFO ] [MAIN ] Update Progress: 2296/2366 symbols. WK took 13.8s. Estimated remaining time: 14m 59s [2025-10-26T03:09:17.049837] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:09:17.050026] [DEBUG] [LOCAL ] WKC: No existing data file found in primary storage. [2025-10-26T03:09:17.050100] [WARN ] [MAIN ] WKC: No existing data found, performing full refresh instead. [2025-10-26T03:09:17.050213] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-26T03:09:17.050286] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-26T03:09:17.050395] [DEBUG] [LOCAL ] WKC: No primary data file found to delete. [2025-10-26T03:09:17.050472] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-26T03:09:30.260307] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-26T03:09:30.814595] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-26T03:09:30.814758] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-26T03:09:30.815924] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-26T03:09:30.816020] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-26T03:09:30.817282] [DEBUG] [LOCAL ] WKC: Trimmed 50217 records to 35058 (keeping 200 days of data) [2025-10-26T03:09:31.053476] [DEBUG] [LOCAL ] WKC: Primary data saved (35058 records). [2025-10-26T03:09:31.053744] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-26T03:09:31.054079] [INFO ] [MAIN ] Update Progress: 2297/2366 symbols. WKC took 14.2s. Estimated remaining time: 14m 46s [2025-10-26T03:09:31.258821] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:09:31.259089] [DEBUG] [LOCAL ] WLK: No existing data file found in primary storage. [2025-10-26T03:09:31.259165] [WARN ] [MAIN ] WLK: No existing data found, performing full refresh instead. [2025-10-26T03:09:31.259282] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-26T03:09:31.259354] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-26T03:09:31.259439] [DEBUG] [LOCAL ] WLK: No primary data file found to delete. [2025-10-26T03:09:31.259533] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-26T03:09:45.382749] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-26T03:09:45.774278] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-26T03:09:45.774399] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-26T03:09:45.775506] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-26T03:09:45.775588] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-26T03:09:45.776957] [DEBUG] [LOCAL ] WLK: Trimmed 64112 records to 46493 (keeping 200 days of data) [2025-10-26T03:09:46.053579] [DEBUG] [LOCAL ] WLK: Primary data saved (46493 records). [2025-10-26T03:09:46.053790] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-26T03:09:46.053980] [INFO ] [MAIN ] Update Progress: 2298/2366 symbols. WLK took 15.0s. Estimated remaining time: 14m 33s [2025-10-26T03:09:46.256345] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:09:46.256610] [DEBUG] [LOCAL ] WLKP: No existing data file found in primary storage. [2025-10-26T03:09:46.256703] [WARN ] [MAIN ] WLKP: No existing data found, performing full refresh instead. [2025-10-26T03:09:46.256830] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-26T03:09:46.256917] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-26T03:09:46.257004] [DEBUG] [LOCAL ] WLKP: No primary data file found to delete. [2025-10-26T03:09:46.257075] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-26T03:09:53.630665] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-26T03:09:53.983689] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-26T03:09:53.983804] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-26T03:09:53.984082] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-26T03:09:53.984157] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-26T03:09:53.984598] [DEBUG] [LOCAL ] WLKP: Trimmed 10057 records to 7386 (keeping 200 days of data) [2025-10-26T03:09:54.026266] [DEBUG] [LOCAL ] WLKP: Primary data saved (7386 records). [2025-10-26T03:09:54.026366] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-26T03:09:54.026541] [INFO ] [MAIN ] Update Progress: 2299/2366 symbols. WLKP took 8.0s. Estimated remaining time: 14m 20s [2025-10-26T03:09:54.189894] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:09:54.190058] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-26T03:09:54.190130] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-26T03:09:54.190241] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-26T03:09:54.190312] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-26T03:09:54.190393] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-26T03:09:54.190479] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-26T03:09:58.244702] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-26T03:09:58.429992] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T03:09:58.430170] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-26T03:09:58.430239] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-26T03:09:58.430311] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-26T03:09:58.430400] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-26T03:09:58.430472] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-26T03:09:58.430531] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-26T03:09:58.430710] [INFO ] [MAIN ] Update Progress: 2300/2366 symbols. WLTG took 4.4s. Estimated remaining time: 14m 7s [2025-10-26T03:09:58.600013] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:09:58.600233] [DEBUG] [LOCAL ] WLY: No existing data file found in primary storage. [2025-10-26T03:09:58.600305] [WARN ] [MAIN ] WLY: No existing data found, performing full refresh instead. [2025-10-26T03:09:58.600417] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-26T03:09:58.600488] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-26T03:09:58.600568] [DEBUG] [LOCAL ] WLY: No primary data file found to delete. [2025-10-26T03:09:58.600663] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-26T03:10:11.075839] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-26T03:10:11.470480] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-26T03:10:11.470617] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-26T03:10:11.471523] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-26T03:10:11.471602] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-26T03:10:11.472726] [DEBUG] [LOCAL ] WLY: Trimmed 42815 records to 30101 (keeping 200 days of data) [2025-10-26T03:10:11.649905] [DEBUG] [LOCAL ] WLY: Primary data saved (30101 records). [2025-10-26T03:10:11.650068] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-26T03:10:11.650249] [INFO ] [MAIN ] Update Progress: 2301/2366 symbols. WLY took 13.2s. Estimated remaining time: 13m 55s [2025-10-26T03:10:11.822599] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:10:11.822993] [DEBUG] [LOCAL ] WM: No existing data file found in primary storage. [2025-10-26T03:10:11.823070] [WARN ] [MAIN ] WM: No existing data found, performing full refresh instead. [2025-10-26T03:10:11.823190] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-26T03:10:11.823260] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-26T03:10:11.823339] [DEBUG] [LOCAL ] WM: No primary data file found to delete. [2025-10-26T03:10:11.823410] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-26T03:10:28.891675] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-26T03:10:29.315355] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-26T03:10:29.315512] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-26T03:10:29.317297] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-26T03:10:29.317386] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-26T03:10:29.319469] [DEBUG] [LOCAL ] WM: Trimmed 73828 records to 51589 (keeping 200 days of data) [2025-10-26T03:10:29.654590] [DEBUG] [LOCAL ] WM: Primary data saved (51589 records). [2025-10-26T03:10:29.654855] [INFO ] [MAIN ] WM: Full history saved. [2025-10-26T03:10:29.655119] [INFO ] [MAIN ] Update Progress: 2302/2366 symbols. WM took 18.0s. Estimated remaining time: 13m 42s [2025-10-26T03:10:29.828498] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:10:29.828799] [DEBUG] [LOCAL ] WMB: No existing data file found in primary storage. [2025-10-26T03:10:29.828903] [WARN ] [MAIN ] WMB: No existing data found, performing full refresh instead. [2025-10-26T03:10:29.829036] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-26T03:10:29.829111] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-26T03:10:29.829194] [DEBUG] [LOCAL ] WMB: No primary data file found to delete. [2025-10-26T03:10:29.829267] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-26T03:10:46.838361] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-26T03:10:47.249821] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-26T03:10:47.249995] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-26T03:10:47.251824] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-26T03:10:47.251934] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-26T03:10:47.254159] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 54452 (keeping 200 days of data) [2025-10-26T03:10:47.599530] [DEBUG] [LOCAL ] WMB: Primary data saved (54452 records). [2025-10-26T03:10:47.599782] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-26T03:10:47.600075] [INFO ] [MAIN ] Update Progress: 2303/2366 symbols. WMB took 17.9s. Estimated remaining time: 13m 29s [2025-10-26T03:10:47.785526] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:10:47.785794] [DEBUG] [LOCAL ] WMK: No existing data file found in primary storage. [2025-10-26T03:10:47.785871] [WARN ] [MAIN ] WMK: No existing data found, performing full refresh instead. [2025-10-26T03:10:47.786032] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-26T03:10:47.786113] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-26T03:10:47.786201] [DEBUG] [LOCAL ] WMK: No primary data file found to delete. [2025-10-26T03:10:47.786275] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-26T03:10:57.068601] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-26T03:10:57.461829] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-26T03:10:57.462034] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-26T03:10:57.462877] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-26T03:10:57.462969] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-26T03:10:57.464348] [DEBUG] [LOCAL ] WMK: Trimmed 20033 records to 14808 (keeping 200 days of data) [2025-10-26T03:10:57.559553] [DEBUG] [LOCAL ] WMK: Primary data saved (14808 records). [2025-10-26T03:10:57.559837] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-26T03:10:57.560250] [INFO ] [MAIN ] Update Progress: 2304/2366 symbols. WMK took 10.0s. Estimated remaining time: 13m 16s [2025-10-26T03:10:57.740582] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:10:57.740882] [DEBUG] [LOCAL ] WMS: No existing data file found in primary storage. [2025-10-26T03:10:57.740958] [WARN ] [MAIN ] WMS: No existing data found, performing full refresh instead. [2025-10-26T03:10:57.741094] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-26T03:10:57.741201] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-26T03:10:57.741290] [DEBUG] [LOCAL ] WMS: No primary data file found to delete. [2025-10-26T03:10:57.741363] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-26T03:11:11.743411] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-26T03:11:12.121430] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-26T03:11:12.121870] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-26T03:11:12.123182] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-26T03:11:12.123260] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-26T03:11:12.124423] [DEBUG] [LOCAL ] WMS: Trimmed 57043 records to 39959 (keeping 200 days of data) [2025-10-26T03:11:12.362097] [DEBUG] [LOCAL ] WMS: Primary data saved (39959 records). [2025-10-26T03:11:12.362259] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-26T03:11:12.362424] [INFO ] [MAIN ] Update Progress: 2305/2366 symbols. WMS took 14.8s. Estimated remaining time: 13m 3s [2025-10-26T03:11:12.529381] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:11:12.529576] [DEBUG] [LOCAL ] WMT: No existing data file found in primary storage. [2025-10-26T03:11:12.529667] [WARN ] [MAIN ] WMT: No existing data found, performing full refresh instead. [2025-10-26T03:11:12.529780] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-26T03:11:12.529929] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-26T03:11:12.530012] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-10-26T03:11:12.530082] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-26T03:11:35.775493] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-26T03:11:36.187927] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-26T03:11:36.188103] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-26T03:11:36.190682] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-26T03:11:36.190790] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-26T03:11:36.192951] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 54580 (keeping 200 days of data) [2025-10-26T03:11:36.546022] [DEBUG] [LOCAL ] WMT: Primary data saved (54580 records). [2025-10-26T03:11:36.546277] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-26T03:11:36.546565] [INFO ] [MAIN ] Update Progress: 2306/2366 symbols. WMT took 24.2s. Estimated remaining time: 12m 51s [2025-10-26T03:11:36.722918] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:11:36.723227] [DEBUG] [LOCAL ] WNC: No existing data file found in primary storage. [2025-10-26T03:11:36.723304] [WARN ] [MAIN ] WNC: No existing data found, performing full refresh instead. [2025-10-26T03:11:36.723435] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-26T03:11:36.723510] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-26T03:11:36.723597] [DEBUG] [LOCAL ] WNC: No primary data file found to delete. [2025-10-26T03:11:36.723700] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-26T03:11:51.175699] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-26T03:11:51.554719] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-26T03:11:51.554860] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-26T03:11:51.556031] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-26T03:11:51.556113] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-26T03:11:51.557552] [DEBUG] [LOCAL ] WNC: Trimmed 57757 records to 38504 (keeping 200 days of data) [2025-10-26T03:11:51.777491] [DEBUG] [LOCAL ] WNC: Primary data saved (38504 records). [2025-10-26T03:11:51.777699] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-26T03:11:51.777932] [INFO ] [MAIN ] Update Progress: 2307/2366 symbols. WNC took 15.2s. Estimated remaining time: 12m 38s [2025-10-26T03:11:51.943459] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:11:51.943696] [DEBUG] [LOCAL ] WOLF: No existing data file found in primary storage. [2025-10-26T03:11:51.943791] [WARN ] [MAIN ] WOLF: No existing data found, performing full refresh instead. [2025-10-26T03:11:51.943934] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-26T03:11:51.944024] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-26T03:11:51.944103] [DEBUG] [LOCAL ] WOLF: No primary data file found to delete. [2025-10-26T03:11:51.944169] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-26T03:12:14.440691] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-26T03:12:14.828584] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-26T03:12:14.828736] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-26T03:12:14.829979] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-26T03:12:14.830060] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-26T03:12:14.831525] [DEBUG] [LOCAL ] WOLF: Trimmed 77067 records to 53675 (keeping 200 days of data) [2025-10-26T03:12:15.126799] [DEBUG] [LOCAL ] WOLF: Primary data saved (53675 records). [2025-10-26T03:12:15.126961] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-26T03:12:15.127178] [INFO ] [MAIN ] Update Progress: 2308/2366 symbols. WOLF took 23.3s. Estimated remaining time: 12m 26s [2025-10-26T03:12:15.292156] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:12:15.292346] [DEBUG] [LOCAL ] WOR: No existing data file found in primary storage. [2025-10-26T03:12:15.292416] [WARN ] [MAIN ] WOR: No existing data found, performing full refresh instead. [2025-10-26T03:12:15.292527] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-26T03:12:15.292617] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-26T03:12:15.292717] [DEBUG] [LOCAL ] WOR: No primary data file found to delete. [2025-10-26T03:12:15.292799] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-26T03:12:26.629325] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-26T03:12:27.010334] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-26T03:12:27.010470] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-26T03:12:27.011273] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-26T03:12:27.011354] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-26T03:12:27.012323] [DEBUG] [LOCAL ] WOR: Trimmed 36181 records to 23757 (keeping 200 days of data) [2025-10-26T03:12:27.148269] [DEBUG] [LOCAL ] WOR: Primary data saved (23757 records). [2025-10-26T03:12:27.148422] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-26T03:12:27.148606] [INFO ] [MAIN ] Update Progress: 2309/2366 symbols. WOR took 12.0s. Estimated remaining time: 12m 13s [2025-10-26T03:12:27.315685] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:12:27.315852] [DEBUG] [LOCAL ] WOW: No existing data file found in primary storage. [2025-10-26T03:12:27.315944] [WARN ] [MAIN ] WOW: No existing data found, performing full refresh instead. [2025-10-26T03:12:27.316060] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-26T03:12:27.316134] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-26T03:12:27.316222] [DEBUG] [LOCAL ] WOW: No primary data file found to delete. [2025-10-26T03:12:27.316306] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-26T03:12:39.045881] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-26T03:12:39.437112] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-26T03:12:39.437228] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-26T03:12:39.438181] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-26T03:12:39.438264] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-26T03:12:39.439404] [DEBUG] [LOCAL ] WOW: Trimmed 43124 records to 31544 (keeping 200 days of data) [2025-10-26T03:12:39.610028] [DEBUG] [LOCAL ] WOW: Primary data saved (31544 records). [2025-10-26T03:12:39.610211] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-26T03:12:39.610461] [INFO ] [MAIN ] Update Progress: 2310/2366 symbols. WOW took 12.5s. Estimated remaining time: 11m 60s [2025-10-26T03:12:39.800964] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:12:39.801183] [DEBUG] [LOCAL ] WPC: No existing data file found in primary storage. [2025-10-26T03:12:39.801258] [WARN ] [MAIN ] WPC: No existing data found, performing full refresh instead. [2025-10-26T03:12:39.801419] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-26T03:12:39.801497] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-26T03:12:39.801580] [DEBUG] [LOCAL ] WPC: No primary data file found to delete. [2025-10-26T03:12:39.801677] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-26T03:12:54.960047] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-26T03:12:55.366865] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-26T03:12:55.367011] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-26T03:12:55.368388] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-26T03:12:55.368489] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-26T03:12:55.370047] [DEBUG] [LOCAL ] WPC: Trimmed 70379 records to 48759 (keeping 200 days of data) [2025-10-26T03:12:55.661501] [DEBUG] [LOCAL ] WPC: Primary data saved (48759 records). [2025-10-26T03:12:55.661710] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-26T03:12:55.662009] [INFO ] [MAIN ] Update Progress: 2311/2366 symbols. WPC took 16.1s. Estimated remaining time: 11m 47s [2025-10-26T03:12:55.835902] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:12:55.836090] [DEBUG] [LOCAL ] WPM: No existing data file found in primary storage. [2025-10-26T03:12:55.836184] [WARN ] [MAIN ] WPM: No existing data found, performing full refresh instead. [2025-10-26T03:12:55.836355] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-26T03:12:55.836437] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-26T03:12:55.836545] [DEBUG] [LOCAL ] WPM: No primary data file found to delete. [2025-10-26T03:12:55.836630] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-26T03:13:14.687731] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-26T03:13:15.077498] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-26T03:13:15.077685] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-26T03:13:15.078936] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-26T03:13:15.079016] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-26T03:13:15.080827] [DEBUG] [LOCAL ] WPM: Trimmed 76446 records to 53563 (keeping 200 days of data) [2025-10-26T03:13:15.399179] [DEBUG] [LOCAL ] WPM: Primary data saved (53563 records). [2025-10-26T03:13:15.399364] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-26T03:13:15.399555] [INFO ] [MAIN ] Update Progress: 2312/2366 symbols. WPM took 19.7s. Estimated remaining time: 11m 34s [2025-10-26T03:13:15.574572] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:13:15.574789] [DEBUG] [LOCAL ] WPP: No existing data file found in primary storage. [2025-10-26T03:13:15.574860] [WARN ] [MAIN ] WPP: No existing data found, performing full refresh instead. [2025-10-26T03:13:15.574972] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-26T03:13:15.575043] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-26T03:13:15.575124] [DEBUG] [LOCAL ] WPP: No primary data file found to delete. [2025-10-26T03:13:15.575194] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-26T03:13:29.288429] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-26T03:13:29.755117] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-26T03:13:29.755283] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-26T03:13:29.756601] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-26T03:13:29.756721] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-26T03:13:29.758379] [DEBUG] [LOCAL ] WPP: Trimmed 47710 records to 34788 (keeping 200 days of data) [2025-10-26T03:13:29.976635] [DEBUG] [LOCAL ] WPP: Primary data saved (34788 records). [2025-10-26T03:13:29.976899] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-26T03:13:29.977188] [INFO ] [MAIN ] Update Progress: 2313/2366 symbols. WPP took 14.6s. Estimated remaining time: 11m 21s [2025-10-26T03:13:30.148918] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:13:30.149226] [DEBUG] [LOCAL ] WRB: No existing data file found in primary storage. [2025-10-26T03:13:30.149292] [WARN ] [MAIN ] WRB: No existing data found, performing full refresh instead. [2025-10-26T03:13:30.149420] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-26T03:13:30.149502] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-26T03:13:30.149596] [DEBUG] [LOCAL ] WRB: No primary data file found to delete. [2025-10-26T03:13:30.149704] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-26T03:13:46.607931] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-26T03:13:46.985781] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-26T03:13:46.985890] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-26T03:13:46.987052] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-26T03:13:46.987130] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-26T03:13:46.988530] [DEBUG] [LOCAL ] WRB: Trimmed 73875 records to 51561 (keeping 200 days of data) [2025-10-26T03:13:47.292490] [DEBUG] [LOCAL ] WRB: Primary data saved (51561 records). [2025-10-26T03:13:47.292679] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-26T03:13:47.292872] [INFO ] [MAIN ] Update Progress: 2314/2366 symbols. WRB took 17.3s. Estimated remaining time: 11m 9s [2025-10-26T03:13:47.456932] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:13:47.457123] [DEBUG] [LOCAL ] WRBY: No existing data file found in primary storage. [2025-10-26T03:13:47.457192] [WARN ] [MAIN ] WRBY: No existing data found, performing full refresh instead. [2025-10-26T03:13:47.457302] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-26T03:13:47.457371] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-26T03:13:47.457450] [DEBUG] [LOCAL ] WRBY: No primary data file found to delete. [2025-10-26T03:13:47.457518] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-26T03:14:05.339145] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-26T03:14:05.727526] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-26T03:14:05.727689] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-26T03:14:05.728869] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-26T03:14:05.728952] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-26T03:14:05.730409] [DEBUG] [LOCAL ] WRBY: Trimmed 73640 records to 51415 (keeping 200 days of data) [2025-10-26T03:14:06.012567] [DEBUG] [LOCAL ] WRBY: Primary data saved (51415 records). [2025-10-26T03:14:06.012741] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-26T03:14:06.012933] [INFO ] [MAIN ] Update Progress: 2315/2366 symbols. WRBY took 18.7s. Estimated remaining time: 10m 56s [2025-10-26T03:14:06.178900] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:14:06.179045] [DEBUG] [LOCAL ] WS: No existing data file found in primary storage. [2025-10-26T03:14:06.179133] [WARN ] [MAIN ] WS: No existing data found, performing full refresh instead. [2025-10-26T03:14:06.179240] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-26T03:14:06.179309] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-26T03:14:06.179390] [DEBUG] [LOCAL ] WS: No primary data file found to delete. [2025-10-26T03:14:06.179465] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-26T03:14:17.840261] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-26T03:14:18.271767] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-26T03:14:18.271922] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-26T03:14:18.272771] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-26T03:14:18.272855] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-26T03:14:18.273854] [DEBUG] [LOCAL ] WS: Trimmed 35424 records to 23771 (keeping 200 days of data) [2025-10-26T03:14:18.423577] [DEBUG] [LOCAL ] WS: Primary data saved (23771 records). [2025-10-26T03:14:18.423766] [INFO ] [MAIN ] WS: Full history saved. [2025-10-26T03:14:18.423956] [INFO ] [MAIN ] Update Progress: 2316/2366 symbols. WS took 12.4s. Estimated remaining time: 10m 43s [2025-10-26T03:14:18.614611] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:14:18.614875] [DEBUG] [LOCAL ] WSM: No existing data file found in primary storage. [2025-10-26T03:14:18.614950] [WARN ] [MAIN ] WSM: No existing data found, performing full refresh instead. [2025-10-26T03:14:18.615064] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-26T03:14:18.615135] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-26T03:14:18.615216] [DEBUG] [LOCAL ] WSM: No primary data file found to delete. [2025-10-26T03:14:18.615286] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-26T03:14:35.787546] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-26T03:14:36.166186] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-26T03:14:36.166305] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-26T03:14:36.167420] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-26T03:14:36.167505] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-26T03:14:36.168884] [DEBUG] [LOCAL ] WSM: Trimmed 71220 records to 49331 (keeping 200 days of data) [2025-10-26T03:14:36.466961] [DEBUG] [LOCAL ] WSM: Primary data saved (49331 records). [2025-10-26T03:14:36.467125] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-26T03:14:36.467310] [INFO ] [MAIN ] Update Progress: 2317/2366 symbols. WSM took 18.0s. Estimated remaining time: 10m 30s [2025-10-26T03:14:36.634191] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:14:36.634413] [DEBUG] [LOCAL ] WSO: No existing data file found in primary storage. [2025-10-26T03:14:36.634487] [WARN ] [MAIN ] WSO: No existing data found, performing full refresh instead. [2025-10-26T03:14:36.634607] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-26T03:14:36.634710] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-26T03:14:36.634794] [DEBUG] [LOCAL ] WSO: No primary data file found to delete. [2025-10-26T03:14:36.634865] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-26T03:14:48.802584] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-26T03:14:49.193174] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-26T03:14:49.193303] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-26T03:14:49.194172] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-26T03:14:49.194257] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-26T03:14:49.195335] [DEBUG] [LOCAL ] WSO: Trimmed 36033 records to 26305 (keeping 200 days of data) [2025-10-26T03:14:49.364611] [DEBUG] [LOCAL ] WSO: Primary data saved (26305 records). [2025-10-26T03:14:49.364899] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-26T03:14:49.365098] [INFO ] [MAIN ] Update Progress: 2318/2366 symbols. WSO took 12.9s. Estimated remaining time: 10m 18s [2025-10-26T03:14:49.547536] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:14:49.547733] [DEBUG] [LOCAL ] WSR: No existing data file found in primary storage. [2025-10-26T03:14:49.547809] [WARN ] [MAIN ] WSR: No existing data found, performing full refresh instead. [2025-10-26T03:14:49.547925] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-26T03:14:49.548002] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-26T03:14:49.548084] [DEBUG] [LOCAL ] WSR: No primary data file found to delete. [2025-10-26T03:14:49.548153] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-26T03:15:00.460917] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-26T03:15:00.826703] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-26T03:15:00.826816] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-26T03:15:00.827495] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-26T03:15:00.827571] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-26T03:15:00.828463] [DEBUG] [LOCAL ] WSR: Trimmed 32581 records to 22794 (keeping 200 days of data) [2025-10-26T03:15:00.961848] [DEBUG] [LOCAL ] WSR: Primary data saved (22794 records). [2025-10-26T03:15:00.962010] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-26T03:15:00.962192] [INFO ] [MAIN ] Update Progress: 2319/2366 symbols. WSR took 11.6s. Estimated remaining time: 10m 5s [2025-10-26T03:15:01.131834] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:15:01.132018] [DEBUG] [LOCAL ] WST: No existing data file found in primary storage. [2025-10-26T03:15:01.132088] [WARN ] [MAIN ] WST: No existing data found, performing full refresh instead. [2025-10-26T03:15:01.132214] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-26T03:15:01.132296] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-26T03:15:01.132380] [DEBUG] [LOCAL ] WST: No primary data file found to delete. [2025-10-26T03:15:01.132434] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-26T03:15:16.166007] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-26T03:15:16.552417] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-26T03:15:16.552551] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-26T03:15:16.553621] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-26T03:15:16.553723] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-26T03:15:16.554945] [DEBUG] [LOCAL ] WST: Trimmed 54677 records to 37339 (keeping 200 days of data) [2025-10-26T03:15:16.775435] [DEBUG] [LOCAL ] WST: Primary data saved (37339 records). [2025-10-26T03:15:16.775603] [INFO ] [MAIN ] WST: Full history saved. [2025-10-26T03:15:16.775845] [INFO ] [MAIN ] Update Progress: 2320/2366 symbols. WST took 15.8s. Estimated remaining time: 9m 52s [2025-10-26T03:15:16.942224] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:15:16.942435] [DEBUG] [LOCAL ] WT: No existing data file found in primary storage. [2025-10-26T03:15:16.942512] [WARN ] [MAIN ] WT: No existing data found, performing full refresh instead. [2025-10-26T03:15:16.942666] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-26T03:15:16.942741] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-26T03:15:16.942821] [DEBUG] [LOCAL ] WT: No primary data file found to delete. [2025-10-26T03:15:16.942895] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-26T03:15:32.621407] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-26T03:15:33.018546] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-26T03:15:33.018707] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-26T03:15:33.019976] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-26T03:15:33.020074] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-26T03:15:33.021414] [DEBUG] [LOCAL ] WT: Trimmed 69828 records to 48917 (keeping 200 days of data) [2025-10-26T03:15:33.304172] [DEBUG] [LOCAL ] WT: Primary data saved (48917 records). [2025-10-26T03:15:33.304341] [INFO ] [MAIN ] WT: Full history saved. [2025-10-26T03:15:33.304543] [INFO ] [MAIN ] Update Progress: 2321/2366 symbols. WT took 16.5s. Estimated remaining time: 9m 39s [2025-10-26T03:15:33.492187] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:15:33.492466] [DEBUG] [LOCAL ] WTI: No existing data file found in primary storage. [2025-10-26T03:15:33.492542] [WARN ] [MAIN ] WTI: No existing data found, performing full refresh instead. [2025-10-26T03:15:33.492698] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-26T03:15:33.492773] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-26T03:15:33.492856] [DEBUG] [LOCAL ] WTI: No primary data file found to delete. [2025-10-26T03:15:33.492926] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-26T03:15:49.560093] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-26T03:15:49.947430] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-26T03:15:49.947558] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-26T03:15:49.948855] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-26T03:15:49.948952] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-26T03:15:49.950314] [DEBUG] [LOCAL ] WTI: Trimmed 63950 records to 45451 (keeping 200 days of data) [2025-10-26T03:15:50.200052] [DEBUG] [LOCAL ] WTI: Primary data saved (45451 records). [2025-10-26T03:15:50.200218] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-26T03:15:50.200443] [INFO ] [MAIN ] Update Progress: 2322/2366 symbols. WTI took 16.9s. Estimated remaining time: 9m 26s [2025-10-26T03:15:50.366166] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:15:50.366334] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-26T03:15:50.366427] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-26T03:15:50.366572] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-26T03:15:50.366677] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-26T03:15:50.366791] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-26T03:15:50.366872] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-26T03:15:55.820840] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-26T03:15:55.995818] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-26T03:15:55.996009] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-26T03:15:55.996085] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-26T03:15:55.996160] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-26T03:15:55.996252] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-26T03:15:55.996325] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-26T03:15:55.996405] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-26T03:15:55.996602] [INFO ] [MAIN ] Update Progress: 2323/2366 symbols. WTM took 5.8s. Estimated remaining time: 9m 13s [2025-10-26T03:15:56.161151] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:15:56.161384] [DEBUG] [LOCAL ] WTRG: No existing data file found in primary storage. [2025-10-26T03:15:56.161455] [WARN ] [MAIN ] WTRG: No existing data found, performing full refresh instead. [2025-10-26T03:15:56.161564] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-26T03:15:56.161633] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-26T03:15:56.161736] [DEBUG] [LOCAL ] WTRG: No primary data file found to delete. [2025-10-26T03:15:56.161807] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-26T03:16:12.636609] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-26T03:16:13.043783] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-26T03:16:13.043955] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-26T03:16:13.045329] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-26T03:16:13.045431] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-26T03:16:13.046985] [DEBUG] [LOCAL ] WTRG: Trimmed 73897 records to 51645 (keeping 200 days of data) [2025-10-26T03:16:13.344153] [DEBUG] [LOCAL ] WTRG: Primary data saved (51645 records). [2025-10-26T03:16:13.344318] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-26T03:16:13.344519] [INFO ] [MAIN ] Update Progress: 2324/2366 symbols. WTRG took 17.3s. Estimated remaining time: 9m 0s [2025-10-26T03:16:13.513067] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:16:13.513273] [DEBUG] [LOCAL ] WTS: No existing data file found in primary storage. [2025-10-26T03:16:13.513359] [WARN ] [MAIN ] WTS: No existing data found, performing full refresh instead. [2025-10-26T03:16:13.513497] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-26T03:16:13.513587] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-26T03:16:13.513718] [DEBUG] [LOCAL ] WTS: No primary data file found to delete. [2025-10-26T03:16:13.513810] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-26T03:16:23.977691] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-26T03:16:24.397814] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-26T03:16:24.397941] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-26T03:16:24.398503] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-26T03:16:24.398577] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-26T03:16:24.399326] [DEBUG] [LOCAL ] WTS: Trimmed 25678 records to 17427 (keeping 200 days of data) [2025-10-26T03:16:24.513742] [DEBUG] [LOCAL ] WTS: Primary data saved (17427 records). [2025-10-26T03:16:24.513920] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-26T03:16:24.514111] [INFO ] [MAIN ] Update Progress: 2325/2366 symbols. WTS took 11.2s. Estimated remaining time: 8m 48s [2025-10-26T03:16:24.682065] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:16:24.682259] [DEBUG] [LOCAL ] WTTR: No existing data file found in primary storage. [2025-10-26T03:16:24.682330] [WARN ] [MAIN ] WTTR: No existing data found, performing full refresh instead. [2025-10-26T03:16:24.682441] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-26T03:16:24.682513] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-26T03:16:24.682570] [DEBUG] [LOCAL ] WTTR: No primary data file found to delete. [2025-10-26T03:16:24.682612] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-26T03:16:40.545054] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-26T03:16:40.941132] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-26T03:16:40.941250] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-26T03:16:40.942466] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-26T03:16:40.942574] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-26T03:16:40.943924] [DEBUG] [LOCAL ] WTTR: Trimmed 65524 records to 45178 (keeping 200 days of data) [2025-10-26T03:16:41.203817] [DEBUG] [LOCAL ] WTTR: Primary data saved (45178 records). [2025-10-26T03:16:41.203989] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-26T03:16:41.204229] [INFO ] [MAIN ] Update Progress: 2326/2366 symbols. WTTR took 16.7s. Estimated remaining time: 8m 35s [2025-10-26T03:16:41.384211] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:16:41.384380] [DEBUG] [LOCAL ] WU: No existing data file found in primary storage. [2025-10-26T03:16:41.384452] [WARN ] [MAIN ] WU: No existing data found, performing full refresh instead. [2025-10-26T03:16:41.384562] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-26T03:16:41.384666] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-26T03:16:41.384754] [DEBUG] [LOCAL ] WU: No primary data file found to delete. [2025-10-26T03:16:41.384826] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-26T03:16:59.151888] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-26T03:16:59.548163] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-26T03:16:59.548287] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-26T03:16:59.549605] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-26T03:16:59.549732] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-26T03:16:59.551271] [DEBUG] [LOCAL ] WU: Trimmed 77522 records to 54267 (keeping 200 days of data) [2025-10-26T03:16:59.861897] [DEBUG] [LOCAL ] WU: Primary data saved (54267 records). [2025-10-26T03:16:59.862087] [INFO ] [MAIN ] WU: Full history saved. [2025-10-26T03:16:59.862290] [INFO ] [MAIN ] Update Progress: 2327/2366 symbols. WU took 18.7s. Estimated remaining time: 8m 22s [2025-10-26T03:17:00.033186] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:17:00.033379] [DEBUG] [LOCAL ] WWW: No existing data file found in primary storage. [2025-10-26T03:17:00.033469] [WARN ] [MAIN ] WWW: No existing data found, performing full refresh instead. [2025-10-26T03:17:00.033607] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-26T03:17:00.033713] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-26T03:17:00.033821] [DEBUG] [LOCAL ] WWW: No primary data file found to delete. [2025-10-26T03:17:00.033910] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-26T03:17:17.133993] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-26T03:17:17.577672] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-26T03:17:17.577795] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-26T03:17:17.579038] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-26T03:17:17.579120] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-26T03:17:17.580484] [DEBUG] [LOCAL ] WWW: Trimmed 70654 records to 49939 (keeping 200 days of data) [2025-10-26T03:17:17.881018] [DEBUG] [LOCAL ] WWW: Primary data saved (49939 records). [2025-10-26T03:17:17.881178] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-26T03:17:17.881368] [INFO ] [MAIN ] Update Progress: 2328/2366 symbols. WWW took 18.0s. Estimated remaining time: 8m 9s [2025-10-26T03:17:18.086226] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:17:18.086459] [DEBUG] [LOCAL ] WY: No existing data file found in primary storage. [2025-10-26T03:17:18.086534] [WARN ] [MAIN ] WY: No existing data found, performing full refresh instead. [2025-10-26T03:17:18.086668] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-26T03:17:18.086733] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-26T03:17:18.086833] [DEBUG] [LOCAL ] WY: No primary data file found to delete. [2025-10-26T03:17:18.086902] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-26T03:17:35.731567] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-26T03:17:36.120165] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-26T03:17:36.120296] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-26T03:17:36.121502] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-26T03:17:36.121602] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-26T03:17:36.123185] [DEBUG] [LOCAL ] WY: Trimmed 77046 records to 53986 (keeping 200 days of data) [2025-10-26T03:17:36.439955] [DEBUG] [LOCAL ] WY: Primary data saved (53986 records). [2025-10-26T03:17:36.440112] [INFO ] [MAIN ] WY: Full history saved. [2025-10-26T03:17:36.440295] [INFO ] [MAIN ] Update Progress: 2329/2366 symbols. WY took 18.6s. Estimated remaining time: 7m 56s [2025-10-26T03:17:36.606688] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:17:36.606878] [DEBUG] [LOCAL ] XFLT: No existing data file found in primary storage. [2025-10-26T03:17:36.606959] [WARN ] [MAIN ] XFLT: No existing data found, performing full refresh instead. [2025-10-26T03:17:36.607077] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-26T03:17:36.607127] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-26T03:17:36.607175] [DEBUG] [LOCAL ] XFLT: No primary data file found to delete. [2025-10-26T03:17:36.607240] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-26T03:17:50.092923] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-26T03:17:50.457563] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-26T03:17:50.457710] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-26T03:17:50.458715] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-26T03:17:50.458796] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-26T03:17:50.459832] [DEBUG] [LOCAL ] XFLT: Trimmed 43840 records to 30309 (keeping 200 days of data) [2025-10-26T03:17:50.626459] [DEBUG] [LOCAL ] XFLT: Primary data saved (30309 records). [2025-10-26T03:17:50.626621] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-26T03:17:50.626846] [INFO ] [MAIN ] Update Progress: 2330/2366 symbols. XFLT took 14.2s. Estimated remaining time: 7m 44s [2025-10-26T03:17:50.791486] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:17:50.791696] [DEBUG] [LOCAL ] XHR: No existing data file found in primary storage. [2025-10-26T03:17:50.791768] [WARN ] [MAIN ] XHR: No existing data found, performing full refresh instead. [2025-10-26T03:17:50.791860] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-26T03:17:50.791932] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-26T03:17:50.792027] [DEBUG] [LOCAL ] XHR: No primary data file found to delete. [2025-10-26T03:17:50.792101] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-26T03:18:05.587478] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-26T03:18:05.962576] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-26T03:18:05.962706] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-26T03:18:05.963718] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-26T03:18:05.963797] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-26T03:18:05.965088] [DEBUG] [LOCAL ] XHR: Trimmed 61912 records to 43866 (keeping 200 days of data) [2025-10-26T03:18:06.216308] [DEBUG] [LOCAL ] XHR: Primary data saved (43866 records). [2025-10-26T03:18:06.216438] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-26T03:18:06.216599] [INFO ] [MAIN ] Update Progress: 2331/2366 symbols. XHR took 15.6s. Estimated remaining time: 7m 31s [2025-10-26T03:18:06.391662] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:18:06.393017] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-26T03:18:06.393096] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-26T03:18:06.393256] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-26T03:18:06.393331] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-26T03:18:06.393415] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-26T03:18:06.393486] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-26T03:18:06.996813] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-26T03:18:06.996881] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-26T03:18:06.996952] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-26T03:18:06.997043] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-26T03:18:06.997112] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-26T03:18:06.997190] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-26T03:18:06.997362] [INFO ] [MAIN ] Update Progress: 2332/2366 symbols. XIFR took 0.8s. Estimated remaining time: 7m 18s [2025-10-26T03:18:07.174480] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:18:07.174706] [DEBUG] [LOCAL ] XOM: No existing data file found in primary storage. [2025-10-26T03:18:07.174779] [WARN ] [MAIN ] XOM: No existing data found, performing full refresh instead. [2025-10-26T03:18:07.174893] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-26T03:18:07.174970] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-26T03:18:07.175050] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-10-26T03:18:07.175117] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-26T03:18:28.845343] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-26T03:18:29.239610] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-26T03:18:29.239753] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-26T03:18:29.240939] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-26T03:18:29.241035] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-26T03:18:29.242446] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 54573 (keeping 200 days of data) [2025-10-26T03:18:29.591166] [DEBUG] [LOCAL ] XOM: Primary data saved (54573 records). [2025-10-26T03:18:29.591339] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-26T03:18:29.591567] [INFO ] [MAIN ] Update Progress: 2333/2366 symbols. XOM took 22.6s. Estimated remaining time: 7m 5s [2025-10-26T03:18:29.778894] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:18:29.779123] [DEBUG] [LOCAL ] XPER: No existing data file found in primary storage. [2025-10-26T03:18:29.779198] [WARN ] [MAIN ] XPER: No existing data found, performing full refresh instead. [2025-10-26T03:18:29.779315] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-26T03:18:29.779389] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-26T03:18:29.779474] [DEBUG] [LOCAL ] XPER: No primary data file found to delete. [2025-10-26T03:18:29.779547] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-26T03:18:42.959168] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-26T03:18:43.333768] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-26T03:18:43.333891] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-26T03:18:43.334808] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-26T03:18:43.334910] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-26T03:18:43.335919] [DEBUG] [LOCAL ] XPER: Trimmed 43533 records to 31005 (keeping 200 days of data) [2025-10-26T03:18:43.497072] [DEBUG] [LOCAL ] XPER: Primary data saved (31005 records). [2025-10-26T03:18:43.497235] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-26T03:18:43.497427] [INFO ] [MAIN ] Update Progress: 2334/2366 symbols. XPER took 13.9s. Estimated remaining time: 6m 52s [2025-10-26T03:18:43.661695] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:18:43.661891] [DEBUG] [LOCAL ] XPEV: No existing data file found in primary storage. [2025-10-26T03:18:43.661965] [WARN ] [MAIN ] XPEV: No existing data found, performing full refresh instead. [2025-10-26T03:18:43.662082] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-26T03:18:43.662157] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-26T03:18:43.662241] [DEBUG] [LOCAL ] XPEV: No primary data file found to delete. [2025-10-26T03:18:43.662313] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-26T03:19:08.465293] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-26T03:19:08.849775] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-26T03:19:08.849898] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-26T03:19:08.851085] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-26T03:19:08.851168] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-26T03:19:08.852622] [DEBUG] [LOCAL ] XPEV: Trimmed 77770 records to 54394 (keeping 200 days of data) [2025-10-26T03:19:09.162857] [DEBUG] [LOCAL ] XPEV: Primary data saved (54394 records). [2025-10-26T03:19:09.163044] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-26T03:19:09.163237] [INFO ] [MAIN ] Update Progress: 2335/2366 symbols. XPEV took 25.7s. Estimated remaining time: 6m 39s [2025-10-26T03:19:09.338580] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:19:09.338867] [DEBUG] [LOCAL ] XPO: No existing data file found in primary storage. [2025-10-26T03:19:09.338945] [WARN ] [MAIN ] XPO: No existing data found, performing full refresh instead. [2025-10-26T03:19:09.339074] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-26T03:19:09.339152] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-26T03:19:09.339235] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-10-26T03:19:09.339307] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-26T03:19:26.281351] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-26T03:19:26.657956] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-26T03:19:26.658076] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-26T03:19:26.659470] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-26T03:19:26.659565] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-26T03:19:26.661310] [DEBUG] [LOCAL ] XPO: Trimmed 69558 records to 48155 (keeping 200 days of data) [2025-10-26T03:19:26.946878] [DEBUG] [LOCAL ] XPO: Primary data saved (48155 records). [2025-10-26T03:19:26.947071] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-26T03:19:26.947297] [INFO ] [MAIN ] Update Progress: 2336/2366 symbols. XPO took 17.8s. Estimated remaining time: 6m 27s [2025-10-26T03:19:27.112857] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:19:27.113051] [DEBUG] [LOCAL ] XPOF: No existing data file found in primary storage. [2025-10-26T03:19:27.113123] [WARN ] [MAIN ] XPOF: No existing data found, performing full refresh instead. [2025-10-26T03:19:27.113232] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-26T03:19:27.113340] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-26T03:19:27.113429] [DEBUG] [LOCAL ] XPOF: No primary data file found to delete. [2025-10-26T03:19:27.113496] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-26T03:19:41.059432] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-26T03:19:41.434147] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-26T03:19:41.434256] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-26T03:19:41.435225] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-26T03:19:41.435304] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-26T03:19:41.436404] [DEBUG] [LOCAL ] XPOF: Trimmed 52886 records to 37285 (keeping 200 days of data) [2025-10-26T03:19:41.640040] [DEBUG] [LOCAL ] XPOF: Primary data saved (37285 records). [2025-10-26T03:19:41.640220] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-26T03:19:41.640412] [INFO ] [MAIN ] Update Progress: 2337/2366 symbols. XPOF took 14.7s. Estimated remaining time: 6m 14s [2025-10-26T03:19:41.807111] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:19:41.807340] [DEBUG] [LOCAL ] XPRO: No existing data file found in primary storage. [2025-10-26T03:19:41.807427] [WARN ] [MAIN ] XPRO: No existing data found, performing full refresh instead. [2025-10-26T03:19:41.807564] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-26T03:19:41.807690] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-26T03:19:41.807784] [DEBUG] [LOCAL ] XPRO: No primary data file found to delete. [2025-10-26T03:19:41.807875] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-26T03:19:57.709288] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-26T03:19:58.130006] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-26T03:19:58.130162] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-26T03:19:58.132183] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-26T03:19:58.132273] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-26T03:19:58.134096] [DEBUG] [LOCAL ] XPRO: Trimmed 66501 records to 46493 (keeping 200 days of data) [2025-10-26T03:19:58.406957] [DEBUG] [LOCAL ] XPRO: Primary data saved (46493 records). [2025-10-26T03:19:58.407203] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-26T03:19:58.407460] [INFO ] [MAIN ] Update Progress: 2338/2366 symbols. XPRO took 16.8s. Estimated remaining time: 6m 1s [2025-10-26T03:19:58.595083] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:19:58.595367] [DEBUG] [LOCAL ] XYF: No existing data file found in primary storage. [2025-10-26T03:19:58.595445] [WARN ] [MAIN ] XYF: No existing data found, performing full refresh instead. [2025-10-26T03:19:58.595605] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-26T03:19:58.595704] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-26T03:19:58.595794] [DEBUG] [LOCAL ] XYF: No primary data file found to delete. [2025-10-26T03:19:58.595870] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-26T03:20:10.899274] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-26T03:20:11.263821] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-26T03:20:11.263946] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-26T03:20:11.264725] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-26T03:20:11.264833] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-26T03:20:11.265806] [DEBUG] [LOCAL ] XYF: Trimmed 33865 records to 27566 (keeping 200 days of data) [2025-10-26T03:20:11.433548] [DEBUG] [LOCAL ] XYF: Primary data saved (27566 records). [2025-10-26T03:20:11.433850] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-26T03:20:11.434089] [INFO ] [MAIN ] Update Progress: 2339/2366 symbols. XYF took 13.0s. Estimated remaining time: 5m 48s [2025-10-26T03:20:11.610011] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:20:11.610215] [DEBUG] [LOCAL ] XYL: No existing data file found in primary storage. [2025-10-26T03:20:11.610290] [WARN ] [MAIN ] XYL: No existing data found, performing full refresh instead. [2025-10-26T03:20:11.610407] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-26T03:20:11.610480] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-26T03:20:11.610564] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-10-26T03:20:11.610637] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-26T03:20:27.979995] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-26T03:20:28.387424] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-26T03:20:28.387602] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-26T03:20:28.389309] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-26T03:20:28.389397] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-26T03:20:28.391339] [DEBUG] [LOCAL ] XYL: Trimmed 70029 records to 48223 (keeping 200 days of data) [2025-10-26T03:20:28.709462] [DEBUG] [LOCAL ] XYL: Primary data saved (48223 records). [2025-10-26T03:20:28.709750] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-26T03:20:28.710023] [INFO ] [MAIN ] Update Progress: 2340/2366 symbols. XYL took 17.3s. Estimated remaining time: 5m 35s [2025-10-26T03:20:28.889039] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:20:28.889340] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-26T03:20:28.889417] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-26T03:20:28.889548] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-26T03:20:28.889622] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-26T03:20:28.889735] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-26T03:20:28.889833] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-26T03:20:50.462921] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-10-26T03:20:50.662835] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-26T03:20:50.663591] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-26T03:20:50.663702] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-26T03:20:50.663799] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-26T03:20:50.663913] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-26T03:20:50.664004] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-26T03:20:50.664114] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-26T03:20:50.664258] [INFO ] [MAIN ] Update Progress: 2341/2366 symbols. XYZ took 22.0s. Estimated remaining time: 5m 22s [2025-10-26T03:20:50.835806] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:20:50.836016] [DEBUG] [LOCAL ] YALA: No existing data file found in primary storage. [2025-10-26T03:20:50.836096] [WARN ] [MAIN ] YALA: No existing data found, performing full refresh instead. [2025-10-26T03:20:50.836207] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-26T03:20:50.836284] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-26T03:20:50.836368] [DEBUG] [LOCAL ] YALA: No primary data file found to delete. [2025-10-26T03:20:50.836437] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-26T03:21:04.242543] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-26T03:21:04.626180] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-26T03:21:04.626295] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-26T03:21:04.627378] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-26T03:21:04.627462] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-26T03:21:04.628624] [DEBUG] [LOCAL ] YALA: Trimmed 47110 records to 36621 (keeping 200 days of data) [2025-10-26T03:21:04.836537] [DEBUG] [LOCAL ] YALA: Primary data saved (36621 records). [2025-10-26T03:21:04.836725] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-26T03:21:04.836914] [INFO ] [MAIN ] Update Progress: 2342/2366 symbols. YALA took 14.2s. Estimated remaining time: 5m 9s [2025-10-26T03:21:05.004348] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:21:05.004565] [DEBUG] [LOCAL ] YELP: No existing data file found in primary storage. [2025-10-26T03:21:05.004618] [WARN ] [MAIN ] YELP: No existing data found, performing full refresh instead. [2025-10-26T03:21:05.004744] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-26T03:21:05.004815] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-26T03:21:05.004878] [DEBUG] [LOCAL ] YELP: No primary data file found to delete. [2025-10-26T03:21:05.004940] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-26T03:21:19.705741] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-26T03:21:20.086806] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-26T03:21:20.086917] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-26T03:21:20.088076] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-26T03:21:20.088161] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-26T03:21:20.089504] [DEBUG] [LOCAL ] YELP: Trimmed 64726 records to 45756 (keeping 200 days of data) [2025-10-26T03:21:20.339716] [DEBUG] [LOCAL ] YELP: Primary data saved (45756 records). [2025-10-26T03:21:20.339884] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-26T03:21:20.340129] [INFO ] [MAIN ] Update Progress: 2343/2366 symbols. YELP took 15.5s. Estimated remaining time: 4m 57s [2025-10-26T03:21:20.508260] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:21:20.508432] [DEBUG] [LOCAL ] YETI: No existing data file found in primary storage. [2025-10-26T03:21:20.508530] [WARN ] [MAIN ] YETI: No existing data found, performing full refresh instead. [2025-10-26T03:21:20.508704] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-26T03:21:20.508793] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-26T03:21:20.508881] [DEBUG] [LOCAL ] YETI: No primary data file found to delete. [2025-10-26T03:21:20.508960] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-26T03:21:37.164890] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-26T03:21:37.552129] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-26T03:21:37.552256] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-26T03:21:37.553467] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-26T03:21:37.553564] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-26T03:21:37.554955] [DEBUG] [LOCAL ] YETI: Trimmed 75524 records to 53260 (keeping 200 days of data) [2025-10-26T03:21:37.845239] [DEBUG] [LOCAL ] YETI: Primary data saved (53260 records). [2025-10-26T03:21:37.845408] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-26T03:21:37.845592] [INFO ] [MAIN ] Update Progress: 2344/2366 symbols. YETI took 17.5s. Estimated remaining time: 4m 44s [2025-10-26T03:21:38.012342] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:21:38.012516] [DEBUG] [LOCAL ] YEXT: No existing data file found in primary storage. [2025-10-26T03:21:38.012610] [WARN ] [MAIN ] YEXT: No existing data found, performing full refresh instead. [2025-10-26T03:21:38.012734] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-26T03:21:38.012805] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-26T03:21:38.012884] [DEBUG] [LOCAL ] YEXT: No primary data file found to delete. [2025-10-26T03:21:38.012951] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-26T03:21:53.065525] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-26T03:21:53.446136] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-26T03:21:53.446261] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-26T03:21:53.447356] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-26T03:21:53.447436] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-26T03:21:53.448835] [DEBUG] [LOCAL ] YEXT: Trimmed 62974 records to 43601 (keeping 200 days of data) [2025-10-26T03:21:53.687446] [DEBUG] [LOCAL ] YEXT: Primary data saved (43601 records). [2025-10-26T03:21:53.687632] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-26T03:21:53.687847] [INFO ] [MAIN ] Update Progress: 2345/2366 symbols. YEXT took 15.8s. Estimated remaining time: 4m 31s [2025-10-26T03:21:53.853820] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:21:53.854021] [DEBUG] [LOCAL ] YMM: No existing data file found in primary storage. [2025-10-26T03:21:53.854093] [WARN ] [MAIN ] YMM: No existing data found, performing full refresh instead. [2025-10-26T03:21:53.854207] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-26T03:21:53.854279] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-26T03:21:53.854361] [DEBUG] [LOCAL ] YMM: No primary data file found to delete. [2025-10-26T03:21:53.854432] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-26T03:22:12.326743] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-26T03:22:12.715730] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-26T03:22:12.715871] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-26T03:22:12.717207] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-26T03:22:12.717310] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-26T03:22:12.718945] [DEBUG] [LOCAL ] YMM: Trimmed 76469 records to 53355 (keeping 200 days of data) [2025-10-26T03:22:13.034554] [DEBUG] [LOCAL ] YMM: Primary data saved (53355 records). [2025-10-26T03:22:13.034764] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-26T03:22:13.034970] [INFO ] [MAIN ] Update Progress: 2346/2366 symbols. YMM took 19.3s. Estimated remaining time: 4m 18s [2025-10-26T03:22:13.209297] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:22:13.209515] [DEBUG] [LOCAL ] YOU: No existing data file found in primary storage. [2025-10-26T03:22:13.209605] [WARN ] [MAIN ] YOU: No existing data found, performing full refresh instead. [2025-10-26T03:22:13.209754] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-26T03:22:13.209844] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-26T03:22:13.209958] [DEBUG] [LOCAL ] YOU: No primary data file found to delete. [2025-10-26T03:22:13.210046] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-26T03:22:28.694413] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-26T03:22:29.103447] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-26T03:22:29.103581] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-26T03:22:29.104979] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-26T03:22:29.105078] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-26T03:22:29.106566] [DEBUG] [LOCAL ] YOU: Trimmed 72334 records to 50176 (keeping 200 days of data) [2025-10-26T03:22:29.401456] [DEBUG] [LOCAL ] YOU: Primary data saved (50176 records). [2025-10-26T03:22:29.401625] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-26T03:22:29.401856] [INFO ] [MAIN ] Update Progress: 2347/2366 symbols. YOU took 16.4s. Estimated remaining time: 4m 5s [2025-10-26T03:22:29.569775] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:22:29.569971] [DEBUG] [LOCAL ] YPF: No existing data file found in primary storage. [2025-10-26T03:22:29.570040] [WARN ] [MAIN ] YPF: No existing data found, performing full refresh instead. [2025-10-26T03:22:29.570153] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-26T03:22:29.570223] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-26T03:22:29.570303] [DEBUG] [LOCAL ] YPF: No primary data file found to delete. [2025-10-26T03:22:29.570373] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-26T03:22:46.388595] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-26T03:22:46.796377] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-26T03:22:46.796564] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-26T03:22:46.798381] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-26T03:22:46.798467] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-26T03:22:46.800403] [DEBUG] [LOCAL ] YPF: Trimmed 73874 records to 51528 (keeping 200 days of data) [2025-10-26T03:22:47.108762] [DEBUG] [LOCAL ] YPF: Primary data saved (51528 records). [2025-10-26T03:22:47.108994] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-26T03:22:47.109250] [INFO ] [MAIN ] Update Progress: 2348/2366 symbols. YPF took 17.7s. Estimated remaining time: 3m 52s [2025-10-26T03:22:47.278712] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:22:47.279001] [DEBUG] [LOCAL ] YRD: No existing data file found in primary storage. [2025-10-26T03:22:47.279077] [WARN ] [MAIN ] YRD: No existing data found, performing full refresh instead. [2025-10-26T03:22:47.279203] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-26T03:22:47.279278] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-26T03:22:47.279362] [DEBUG] [LOCAL ] YRD: No primary data file found to delete. [2025-10-26T03:22:47.279435] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-26T03:22:56.523080] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-26T03:22:56.923110] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-26T03:22:56.923228] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-26T03:22:56.923746] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-26T03:22:56.923826] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-26T03:22:56.924427] [DEBUG] [LOCAL ] YRD: Trimmed 18720 records to 11228 (keeping 200 days of data) [2025-10-26T03:22:56.992264] [DEBUG] [LOCAL ] YRD: Primary data saved (11228 records). [2025-10-26T03:22:56.992434] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-26T03:22:56.992629] [INFO ] [MAIN ] Update Progress: 2349/2366 symbols. YRD took 9.9s. Estimated remaining time: 3m 39s [2025-10-26T03:22:57.173160] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:22:57.173412] [DEBUG] [LOCAL ] YSG: No existing data file found in primary storage. [2025-10-26T03:22:57.173493] [WARN ] [MAIN ] YSG: No existing data found, performing full refresh instead. [2025-10-26T03:22:57.173607] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-26T03:22:57.173699] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-26T03:22:57.173782] [DEBUG] [LOCAL ] YSG: No primary data file found to delete. [2025-10-26T03:22:57.173875] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-26T03:23:15.912367] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-26T03:23:16.307996] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-26T03:23:16.308115] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-26T03:23:16.308911] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-26T03:23:16.308990] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-26T03:23:16.309801] [DEBUG] [LOCAL ] YSG: Trimmed 32637 records to 25944 (keeping 200 days of data) [2025-10-26T03:23:16.447960] [DEBUG] [LOCAL ] YSG: Primary data saved (25944 records). [2025-10-26T03:23:16.448128] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-26T03:23:16.448313] [INFO ] [MAIN ] Update Progress: 2350/2366 symbols. YSG took 19.5s. Estimated remaining time: 3m 26s [2025-10-26T03:23:16.614703] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:23:16.614918] [DEBUG] [LOCAL ] YUM: No existing data file found in primary storage. [2025-10-26T03:23:16.614990] [WARN ] [MAIN ] YUM: No existing data found, performing full refresh instead. [2025-10-26T03:23:16.615075] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-26T03:23:16.615144] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-26T03:23:16.615225] [DEBUG] [LOCAL ] YUM: No primary data file found to delete. [2025-10-26T03:23:16.615295] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-26T03:23:33.015201] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-26T03:23:33.402317] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-26T03:23:33.402441] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-26T03:23:33.403584] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-26T03:23:33.403690] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-26T03:23:33.405147] [DEBUG] [LOCAL ] YUM: Trimmed 74614 records to 51829 (keeping 200 days of data) [2025-10-26T03:23:33.713740] [DEBUG] [LOCAL ] YUM: Primary data saved (51829 records). [2025-10-26T03:23:33.713902] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-26T03:23:33.714087] [INFO ] [MAIN ] Update Progress: 2351/2366 symbols. YUM took 17.3s. Estimated remaining time: 3m 14s [2025-10-26T03:23:33.880410] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:23:33.880637] [DEBUG] [LOCAL ] YUMC: No existing data file found in primary storage. [2025-10-26T03:23:33.880725] [WARN ] [MAIN ] YUMC: No existing data found, performing full refresh instead. [2025-10-26T03:23:33.880833] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-26T03:23:33.880906] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-26T03:23:33.880967] [DEBUG] [LOCAL ] YUMC: No primary data file found to delete. [2025-10-26T03:23:33.881030] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-26T03:23:51.126163] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-26T03:23:51.519486] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-26T03:23:51.519626] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-26T03:23:51.520996] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-26T03:23:51.521079] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-26T03:23:51.522544] [DEBUG] [LOCAL ] YUMC: Trimmed 76453 records to 53347 (keeping 200 days of data) [2025-10-26T03:23:51.830612] [DEBUG] [LOCAL ] YUMC: Primary data saved (53347 records). [2025-10-26T03:23:51.830798] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-26T03:23:51.830961] [INFO ] [MAIN ] Update Progress: 2352/2366 symbols. YUMC took 18.1s. Estimated remaining time: 3m 1s [2025-10-26T03:23:52.003433] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:23:52.003743] [DEBUG] [LOCAL ] ZBH: No existing data file found in primary storage. [2025-10-26T03:23:52.003844] [WARN ] [MAIN ] ZBH: No existing data found, performing full refresh instead. [2025-10-26T03:23:52.003968] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-26T03:23:52.004038] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-26T03:23:52.004117] [DEBUG] [LOCAL ] ZBH: No primary data file found to delete. [2025-10-26T03:23:52.004186] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-26T03:24:08.812586] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-26T03:24:09.207517] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-26T03:24:09.207671] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-26T03:24:09.208810] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-26T03:24:09.208890] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-26T03:24:09.210234] [DEBUG] [LOCAL ] ZBH: Trimmed 73894 records to 51412 (keeping 200 days of data) [2025-10-26T03:24:09.513614] [DEBUG] [LOCAL ] ZBH: Primary data saved (51412 records). [2025-10-26T03:24:09.513827] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-26T03:24:09.514002] [INFO ] [MAIN ] Update Progress: 2353/2366 symbols. ZBH took 17.7s. Estimated remaining time: 2m 48s [2025-10-26T03:24:09.678236] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:24:09.678416] [DEBUG] [LOCAL ] ZEPP: No existing data file found in primary storage. [2025-10-26T03:24:09.678488] [WARN ] [MAIN ] ZEPP: No existing data found, performing full refresh instead. [2025-10-26T03:24:09.678598] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-26T03:24:09.678690] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-26T03:24:09.678793] [DEBUG] [LOCAL ] ZEPP: No primary data file found to delete. [2025-10-26T03:24:09.678863] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-26T03:24:18.977305] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-26T03:24:19.378482] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-26T03:24:19.378610] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-26T03:24:19.379185] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-26T03:24:19.379267] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-26T03:24:19.379966] [DEBUG] [LOCAL ] ZEPP: Trimmed 21551 records to 20001 (keeping 200 days of data) [2025-10-26T03:24:19.489082] [DEBUG] [LOCAL ] ZEPP: Primary data saved (20001 records). [2025-10-26T03:24:19.489238] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-26T03:24:19.489427] [INFO ] [MAIN ] Update Progress: 2354/2366 symbols. ZEPP took 10.0s. Estimated remaining time: 2m 35s [2025-10-26T03:24:19.656400] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:24:19.656609] [DEBUG] [LOCAL ] ZETA: No existing data file found in primary storage. [2025-10-26T03:24:19.656700] [WARN ] [MAIN ] ZETA: No existing data found, performing full refresh instead. [2025-10-26T03:24:19.656812] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-26T03:24:19.656883] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-26T03:24:19.656963] [DEBUG] [LOCAL ] ZETA: No primary data file found to delete. [2025-10-26T03:24:19.657030] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-26T03:24:42.101202] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-26T03:24:42.494812] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-26T03:24:42.494940] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-26T03:24:42.496169] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-26T03:24:42.496275] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-26T03:24:42.497854] [DEBUG] [LOCAL ] ZETA: Trimmed 77737 records to 54397 (keeping 200 days of data) [2025-10-26T03:24:42.801328] [DEBUG] [LOCAL ] ZETA: Primary data saved (54397 records). [2025-10-26T03:24:42.801502] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-26T03:24:42.801731] [INFO ] [MAIN ] Update Progress: 2355/2366 symbols. ZETA took 23.3s. Estimated remaining time: 2m 22s [2025-10-26T03:24:42.968825] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:24:42.969051] [DEBUG] [LOCAL ] ZGN: No existing data file found in primary storage. [2025-10-26T03:24:42.969124] [WARN ] [MAIN ] ZGN: No existing data found, performing full refresh instead. [2025-10-26T03:24:42.969238] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-26T03:24:42.969310] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-26T03:24:42.969394] [DEBUG] [LOCAL ] ZGN: No primary data file found to delete. [2025-10-26T03:24:42.969466] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-26T03:24:57.987275] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-26T03:24:58.383991] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-26T03:24:58.384118] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-26T03:24:58.385416] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-26T03:24:58.385501] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-26T03:24:58.386913] [DEBUG] [LOCAL ] ZGN: Trimmed 58898 records to 41489 (keeping 200 days of data) [2025-10-26T03:24:58.621923] [DEBUG] [LOCAL ] ZGN: Primary data saved (41489 records). [2025-10-26T03:24:58.622086] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-26T03:24:58.622280] [INFO ] [MAIN ] Update Progress: 2356/2366 symbols. ZGN took 15.8s. Estimated remaining time: 2m 9s [2025-10-26T03:24:58.797394] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:24:58.797678] [DEBUG] [LOCAL ] ZH: No existing data file found in primary storage. [2025-10-26T03:24:58.797753] [WARN ] [MAIN ] ZH: No existing data found, performing full refresh instead. [2025-10-26T03:24:58.797872] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-26T03:24:58.797998] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-26T03:24:58.798117] [DEBUG] [LOCAL ] ZH: No primary data file found to delete. [2025-10-26T03:24:58.798226] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-26T03:25:11.505553] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-26T03:25:11.888591] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-26T03:25:11.888750] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-26T03:25:11.889666] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-26T03:25:11.889748] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-26T03:25:11.890720] [DEBUG] [LOCAL ] ZH: Trimmed 39716 records to 24876 (keeping 200 days of data) [2025-10-26T03:25:12.022123] [DEBUG] [LOCAL ] ZH: Primary data saved (24876 records). [2025-10-26T03:25:12.022278] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-26T03:25:12.022469] [INFO ] [MAIN ] Update Progress: 2357/2366 symbols. ZH took 13.4s. Estimated remaining time: 1m 56s [2025-10-26T03:25:12.191426] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:25:12.191587] [DEBUG] [LOCAL ] ZIM: No existing data file found in primary storage. [2025-10-26T03:25:12.191682] [WARN ] [MAIN ] ZIM: No existing data found, performing full refresh instead. [2025-10-26T03:25:12.191795] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-26T03:25:12.191867] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-26T03:25:12.191964] [DEBUG] [LOCAL ] ZIM: No primary data file found to delete. [2025-10-26T03:25:12.192034] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-26T03:25:33.298111] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-26T03:25:33.692634] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-26T03:25:33.693115] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-26T03:25:33.694315] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-26T03:25:33.694397] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-26T03:25:33.695871] [DEBUG] [LOCAL ] ZIM: Trimmed 77557 records to 54216 (keeping 200 days of data) [2025-10-26T03:25:34.017340] [DEBUG] [LOCAL ] ZIM: Primary data saved (54216 records). [2025-10-26T03:25:34.017510] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-26T03:25:34.017746] [INFO ] [MAIN ] Update Progress: 2358/2366 symbols. ZIM took 22.0s. Estimated remaining time: 1m 43s [2025-10-26T03:25:34.186556] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:25:34.186803] [DEBUG] [LOCAL ] ZIP: No existing data file found in primary storage. [2025-10-26T03:25:34.186874] [WARN ] [MAIN ] ZIP: No existing data found, performing full refresh instead. [2025-10-26T03:25:34.186984] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-26T03:25:34.187053] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-26T03:25:34.187132] [DEBUG] [LOCAL ] ZIP: No primary data file found to delete. [2025-10-26T03:25:34.187201] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-26T03:25:48.482574] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-26T03:25:48.861353] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-26T03:25:48.861461] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-26T03:25:48.862502] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-26T03:25:48.862583] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-26T03:25:48.863826] [DEBUG] [LOCAL ] ZIP: Trimmed 60847 records to 44045 (keeping 200 days of data) [2025-10-26T03:25:49.093902] [DEBUG] [LOCAL ] ZIP: Primary data saved (44045 records). [2025-10-26T03:25:49.094053] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-26T03:25:49.094238] [INFO ] [MAIN ] Update Progress: 2359/2366 symbols. ZIP took 15.1s. Estimated remaining time: 1m 30s [2025-10-26T03:25:49.259163] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:25:49.259326] [DEBUG] [LOCAL ] ZK: No existing data file found in primary storage. [2025-10-26T03:25:49.259397] [WARN ] [MAIN ] ZK: No existing data found, performing full refresh instead. [2025-10-26T03:25:49.259506] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-26T03:25:49.259576] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-26T03:25:49.259682] [DEBUG] [LOCAL ] ZK: No primary data file found to delete. [2025-10-26T03:25:49.259752] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-26T03:26:03.587620] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-26T03:26:03.988815] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-26T03:26:03.988987] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-26T03:26:03.991288] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-26T03:26:03.991389] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-26T03:26:03.992970] [DEBUG] [LOCAL ] ZK: Trimmed 57117 records to 39505 (keeping 200 days of data) [2025-10-26T03:26:04.227178] [DEBUG] [LOCAL ] ZK: Primary data saved (39505 records). [2025-10-26T03:26:04.227447] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-26T03:26:04.227798] [INFO ] [MAIN ] Update Progress: 2360/2366 symbols. ZK took 15.1s. Estimated remaining time: 1m 18s [2025-10-26T03:26:04.402944] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:26:04.403248] [DEBUG] [LOCAL ] ZKH: No existing data file found in primary storage. [2025-10-26T03:26:04.403339] [WARN ] [MAIN ] ZKH: No existing data found, performing full refresh instead. [2025-10-26T03:26:04.403467] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-26T03:26:04.403540] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-26T03:26:04.403625] [DEBUG] [LOCAL ] ZKH: No primary data file found to delete. [2025-10-26T03:26:04.403721] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-26T03:26:11.829942] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-26T03:26:12.196733] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-26T03:26:12.196861] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-26T03:26:12.197211] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-26T03:26:12.197301] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-26T03:26:12.197889] [DEBUG] [LOCAL ] ZKH: Trimmed 11746 records to 7395 (keeping 200 days of data) [2025-10-26T03:26:12.236051] [DEBUG] [LOCAL ] ZKH: Primary data saved (7395 records). [2025-10-26T03:26:12.236208] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-26T03:26:12.236486] [INFO ] [MAIN ] Update Progress: 2361/2366 symbols. ZKH took 8.0s. Estimated remaining time: 1m 5s [2025-10-26T03:26:12.403164] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:26:12.403391] [DEBUG] [LOCAL ] ZTO: No existing data file found in primary storage. [2025-10-26T03:26:12.403491] [WARN ] [MAIN ] ZTO: No existing data found, performing full refresh instead. [2025-10-26T03:26:12.403667] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-26T03:26:12.403753] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-26T03:26:12.403863] [DEBUG] [LOCAL ] ZTO: No primary data file found to delete. [2025-10-26T03:26:12.403947] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-26T03:26:28.904054] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-26T03:26:29.289117] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-26T03:26:29.289242] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-26T03:26:29.290407] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-26T03:26:29.290487] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-26T03:26:29.291956] [DEBUG] [LOCAL ] ZTO: Trimmed 72602 records to 49886 (keeping 200 days of data) [2025-10-26T03:26:29.581191] [DEBUG] [LOCAL ] ZTO: Primary data saved (49886 records). [2025-10-26T03:26:29.581347] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-26T03:26:29.581537] [INFO ] [MAIN ] Update Progress: 2362/2366 symbols. ZTO took 17.3s. Estimated remaining time: 51.7s [2025-10-26T03:26:29.747945] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:26:29.748124] [DEBUG] [LOCAL ] ZTR: No existing data file found in primary storage. [2025-10-26T03:26:29.748194] [WARN ] [MAIN ] ZTR: No existing data found, performing full refresh instead. [2025-10-26T03:26:29.748309] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-26T03:26:29.748380] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-26T03:26:29.748443] [DEBUG] [LOCAL ] ZTR: No primary data file found to delete. [2025-10-26T03:26:29.748504] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-26T03:26:39.727382] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-26T03:26:40.087857] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-26T03:26:40.087972] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-26T03:26:40.088638] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-26T03:26:40.088733] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-26T03:26:40.089402] [DEBUG] [LOCAL ] ZTR: Trimmed 26927 records to 16790 (keeping 200 days of data) [2025-10-26T03:26:40.182199] [DEBUG] [LOCAL ] ZTR: Primary data saved (16790 records). [2025-10-26T03:26:40.182358] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-26T03:26:40.182537] [INFO ] [MAIN ] Update Progress: 2363/2366 symbols. ZTR took 10.6s. Estimated remaining time: 38.8s [2025-10-26T03:26:40.349245] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:26:40.349422] [DEBUG] [LOCAL ] ZTS: No existing data file found in primary storage. [2025-10-26T03:26:40.349496] [WARN ] [MAIN ] ZTS: No existing data found, performing full refresh instead. [2025-10-26T03:26:40.349602] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-26T03:26:40.349700] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-26T03:26:40.349786] [DEBUG] [LOCAL ] ZTS: No primary data file found to delete. [2025-10-26T03:26:40.349855] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-26T03:26:57.818615] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-26T03:26:58.224099] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-26T03:26:58.224246] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-26T03:26:58.226059] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-26T03:26:58.226146] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-26T03:26:58.228177] [DEBUG] [LOCAL ] ZTS: Trimmed 76856 records to 53866 (keeping 200 days of data) [2025-10-26T03:26:58.574993] [DEBUG] [LOCAL ] ZTS: Primary data saved (53866 records). [2025-10-26T03:26:58.575245] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-26T03:26:58.575512] [INFO ] [MAIN ] Update Progress: 2364/2366 symbols. ZTS took 18.4s. Estimated remaining time: 25.8s [2025-10-26T03:26:58.755156] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:26:58.755483] [DEBUG] [LOCAL ] ZVIA: No existing data file found in primary storage. [2025-10-26T03:26:58.755563] [WARN ] [MAIN ] ZVIA: No existing data found, performing full refresh instead. [2025-10-26T03:26:58.755700] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-26T03:26:58.755783] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-26T03:26:58.755872] [DEBUG] [LOCAL ] ZVIA: No primary data file found to delete. [2025-10-26T03:26:58.755949] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-26T03:27:13.437350] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-26T03:27:13.841420] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-26T03:27:13.841545] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-26T03:27:13.842693] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-26T03:27:13.842785] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-26T03:27:13.844000] [DEBUG] [LOCAL ] ZVIA: Trimmed 52518 records to 36374 (keeping 200 days of data) [2025-10-26T03:27:14.040331] [DEBUG] [LOCAL ] ZVIA: Primary data saved (36374 records). [2025-10-26T03:27:14.040516] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-26T03:27:14.040870] [INFO ] [MAIN ] Update Progress: 2365/2366 symbols. ZVIA took 15.5s. Estimated remaining time: 12.9s [2025-10-26T03:27:14.217447] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-16 to 2025-10-24. [2025-10-26T03:27:14.217677] [DEBUG] [LOCAL ] ZWS: No existing data file found in primary storage. [2025-10-26T03:27:14.217754] [WARN ] [MAIN ] ZWS: No existing data found, performing full refresh instead. [2025-10-26T03:27:14.217877] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-26T03:27:14.217981] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-26T03:27:14.218068] [DEBUG] [LOCAL ] ZWS: No primary data file found to delete. [2025-10-26T03:27:14.218135] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-26T03:27:28.453292] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-26T03:27:28.848968] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-26T03:27:28.849107] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-26T03:27:28.851051] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-26T03:27:28.851136] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-26T03:27:28.852868] [DEBUG] [LOCAL ] ZWS: Trimmed 61961 records to 42708 (keeping 200 days of data) [2025-10-26T03:27:29.117199] [DEBUG] [LOCAL ] ZWS: Primary data saved (42708 records). [2025-10-26T03:27:29.117435] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-26T03:27:29.117751] [INFO ] [MAIN ] Update Progress: 2366/2366 symbols. ZWS took 15.1s. Estimated remaining time: 0.0s [2025-10-26T03:27:29.117849] [WARN ] [MAIN ] Failed symbols (159): AAM, AAUC, AD, AEXA, AHL, AII, AKA, ALH, AMBQ, AMRZ, ANGX, AOMD, ARX, AVBC, B, BALY, BBT, BEDU, BHV, BLSH, BRCE, BRIE, BRSL, BTX, CBO, CBX, CCIA, CCZ, CFND, CICB, CIMO, CIMP, CMDB, CNR, CPAC, CRCL, CSW, CTEV, CUBB, DIVY, DTF, DTK, ECCC, ECCW, ECCX, EEA, EICA, EICB, ELPC, EMA, EQS, FCRX, FENG, FGSN, FIG, FIXT, FLOC, GBLI, HCXY, HF, HFND, HNGE, HTB, HTFC, HYAC, HYBX, INR, JBS, JMM, KEY, KKRT, KLAR, KO, KRMN, LAR, LUXE, MCD, MFSB, MH, MHLA, MIAX, MITN, MMID, MMKT, MNTN, MO, MRP, MSC, MSIF, MTR, MUSE, MXE, NIQ, NKE, NL, NMAX, NOM, NP, NPB, NTEST, NUE, NXDR, NYC, O, OPY, ORCL, ORI, OSK, OTF, OXY, PAII, PDCC, PEW, PG, PMTU, PMTV, PMTW, PRVS, PXED, RCB, RHLD, RWTN, RWTO, RWTP, SAJ, SAT, SAY, SAZ, SBDS, SBXD, SGI, SI, SLAI, SLNZ, SMA, SOJF, SPME, SRL, STG, STUB, STXM, TBLU, TCAI, TCPA, TE, TGE, TIC, TNGY, TTAM, TWOD, UZF, VG, VIA, VOYG, WBI, WLTG, WTM, XIFR, XYZ [2025-10-26T03:27:29.117935] [INFO ] [MAIN ] Update success rate: 93.3% (2207/2366 symbols) [2025-10-26T03:27:30.727314] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Data Update Completed (2207/2366 @ 93.28%)' [2025-10-26T03:27:33.474533] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Update Failed' [2025-10-26T03:27:33.475225] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-10-26T03:27:33.475417] [INFO ] [STATE ] Last completion updated: 2025-10-26T03:27:33.475307